Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rcorrector speed optimization #18

Open
sagnikbanerjee15 opened this issue Nov 20, 2019 · 3 comments
Open

Rcorrector speed optimization #18

sagnikbanerjee15 opened this issue Nov 20, 2019 · 3 comments

Comments

@sagnikbanerjee15
Copy link

Hello,

I have been running Rcorrector and it has given me very good results. But unfortunately, it takes a very long time. Is there any settings which can help increase the speed.

Thank you.

@mourisl
Copy link
Owner

mourisl commented Nov 20, 2019

That depends on the quality of the data. If there are more errors, it could take more time on searching the correct bases. You can try lower threshold for -maxcorK, so Rcorrector will not fix the reads with too many errors.

Another trick could be you can decompress the fastq file and gives more threads to Rcorrector. In my experience, when given more threads, the bottleneck becomes decompress/compress the fastq file.

@sagnikbanerjee15
Copy link
Author

Great thanks!

@IdoBar
Copy link

IdoBar commented Jun 10, 2020

Hi,
Coming back to this issue, is it possible to overcome the bottleneck by instructing Jellyfish to open multiple files at once as detailed in the documentation?
How to read multiple files at once
I can put a PR for this when I'll have a bit of time to play with it.

Cheers, Ido

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants