Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit threads #36

Open
StevenBai97 opened this issue Mar 17, 2021 · 3 comments
Open

Limit threads #36

StevenBai97 opened this issue Mar 17, 2021 · 3 comments
Labels
documentation Improvements or additions to documentation

Comments

@StevenBai97
Copy link

StevenBai97 commented Mar 17, 2021

Hi,
How to limit threads when running merqury (merqury.sh)? I used default parameter and it seemed to take up too many cores.
I'll really appreciate your suggestions.
Thanks.

@faguil
Copy link

faguil commented Mar 17, 2021

Hi,

I am facing the same issue here. At the moment, I have no access to a computer with high cores and memory RAM.

I think the issue arises in the spectra-cn plots because this script uses meryl to select the kmers greater than the selected kmer. I thought to edit the script and include the options threads and memory in order to fit my computer.

Is that OK?

Another question, is it possible to re-run an analysis? merqury is able to restart a previous run?

Regards,

@brianwalenz
Copy link
Member

Environment variable OMP_NUM_THREADS= will limit CPU usage to cores.

There is no equivalent setting for memory usage, but you can (ab)use variables used by grid schedulers to achieve the same effect. SLURM_MEM_PER_NODE= will limit meryl to MEGABYTES of memory.

@arangrhie
Copy link
Contributor

@faguil you could, depending on which stage you want to re start.
There are some files that you may have to manually remove before restarting though in case the restart is due to a failure in a particular step.

In case that was in the very early process of the spectra-cn step, I'd recommend to do a fresh restart in a new dir.

@arangrhie arangrhie added the documentation Improvements or additions to documentation label Apr 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

4 participants