Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MultiQC may fail with big sample groups #53

Open
nsharp2 opened this issue Sep 7, 2023 · 1 comment
Open

MultiQC may fail with big sample groups #53

nsharp2 opened this issue Sep 7, 2023 · 1 comment

Comments

@nsharp2
Copy link
Collaborator

nsharp2 commented Sep 7, 2023

While generating the reference healthy gut dataset (844 samples at once) for this microbiomics pipeline, the MultiQC step failed due to lack of memory. The retry failed as well.

Error executing process > 'NFCORE_TAXPROFILER:TAXPROFILER:MULTIQC (1)'

Caused by:
  Essential container in task exited - OutOfMemoryError: Container killed due to memory usage

Command executed:

  cd multiqc_custom_plugins                                                                                                                                    python setup.py develop
  cd ..

  multiqc \
      --force \
       \
      --config multiqc_config.yml \
       \
      -m composition_barplots \
      -m fastqc \
      -m fastp \
      -m bowtie2 \
      -m bbduk \
      -m plot_heatmap \
      -m custom_content \
      .

  cat <<-END_VERSIONS > versions.yml
  "NFCORE_TAXPROFILER:TAXPROFILER:MULTIQC":
      multiqc: $( multiqc --version | sed -e "s/multiqc, version //g" )
  END_VERSIONS

Command exit status:
  137
@zxl124
Copy link
Collaborator

zxl124 commented Sep 19, 2023

#61 should alleviate this problem. Not sure if it's completely fixed though

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants