Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workflow for GPU Runner #694

Merged
merged 8 commits into from
Mar 20, 2024

Conversation

riedgar-ms
Copy link
Collaborator

@riedgar-ms riedgar-ms commented Mar 15, 2024

Starting to onboard to the new GPU runner. Just have GPT2 and Phi-2 enabled for now.

@riedgar-ms riedgar-ms requested a review from Harsha-Nori March 15, 2024 14:39
tests/library/test_gen.py Outdated Show resolved Hide resolved
on:
push:
branches: [main]
pull_request:
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We might not want the PR trigger here

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@riedgar-ms Does branches: [main] mean it'll only run when merged to main? brainstorming out loud, is there a way to manually trigger on PR instead of automatically? Another option is to have it run on a "staging" branch or something of the sort which we can merge to before merging with main. That way we can have a maintainer vet that the code isn't malicious, but still verify that it passes GPU tests before we put on main. Thoughts?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

push ...main is (AIUI) the trigger which will run on the actual merge. The workflow_dispatch trigger is supposed to add a 'Run Workflow' button on the Actions page. Having said that, for the plain 'Unit Test' build, the list of available branches I'm seeing are only those for this repo, not forks.

We could have an extra 'staging' branch, but that would be an extra thing to manage. And if the workflow were being automatically run there, there would still be the potential problem of people sneaking in Bitcoin miners.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whenever there's a new contributor, I believe that the builds won't be run until someone listed on the guidance repo clicks on a button, so there is that, @Harsha-Nori

@riedgar-ms riedgar-ms changed the title [WIP] Workflow for GPU Runner Workflow for GPU Runner Mar 15, 2024
@riedgar-ms
Copy link
Collaborator Author

@Harsha-Nori what do you think?

@Harsha-Nori
Copy link
Collaborator

Looks fine to me, outside one workflow question

@Harsha-Nori Harsha-Nori merged commit 45503d8 into guidance-ai:main Mar 20, 2024
45 checks passed
@riedgar-ms riedgar-ms deleted the riedgar-ms/gpu-runner-01 branch March 27, 2024 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants