Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Example for High Throughput Computing #6

Open
atuldeshpande opened this issue Jan 22, 2019 · 3 comments
Open

Example for High Throughput Computing #6

atuldeshpande opened this issue Jan 22, 2019 · 3 comments

Comments

@atuldeshpande
Copy link
Collaborator

Provide example with high throughput computing.
Could include specific example with broad guidelines to facilitate the adaptation on other high-throughput systems.

@agitter
Copy link
Member

agitter commented Nov 8, 2019

The generalized SINGE.sh from #43 can now support a high-throughput computing workflow. The script tests/high_throughput_test.sh gives one example of how to run the GLG and aggregate steps separately through Docker. We could also add a HTCondor example or other real example of how to run in a high-throughput setting without Docker before closing this.

@agitter
Copy link
Member

agitter commented Jan 26, 2020

The Docker command that HTCondor uses is relevant for this issue #18 (comment)

@agitter
Copy link
Member

agitter commented Feb 11, 2020

I'd like to consider Snakemake for our high-throughput computing SINGE example. It can support HTCondor as well as other clustering queueing systems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants