Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create mechanism to run pipelines locally #2775

Closed
kurtwheeler opened this issue Jun 17, 2021 · 1 comment
Closed

Create mechanism to run pipelines locally #2775

kurtwheeler opened this issue Jun 17, 2021 · 1 comment

Comments

@kurtwheeler
Copy link
Contributor

Context

#2584

We can't run Batch locally like we could with Nomad. This means that there's not currently a way to run a sample all the way through locally without using the tester.sh script which hasn't gotten a lot of use in the last couple years.

Problem or idea

I think we need a script that will monitor the database and will start containers for any jobs that are waiting to be run. This is necessary because no one docker image has all the dependencies for all jobs.

Solution or next step

Create that script or a similar mechanism to be able to run all jobs locally, along with running downstream jobs.

@kurtwheeler
Copy link
Contributor Author

Closed by #2799

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant