Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✏️ added sort chr blocks to concatenateVCFs.sh #442

Closed
wants to merge 10 commits into from
20 changes: 10 additions & 10 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ jobs:
environment:
GENOME: GRCh37
SNPEFF_CACHE_VERSION: "75"
SAREK_TAG: dev
SAREK_TAG: 2.7.1
steps:
- checkout
- setup_remote_docker
Expand All @@ -20,28 +20,28 @@ jobs:
environment:
GENOME: GRCh38
SNPEFF_CACHE_VERSION: "86"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

snpeffgrcm38:
<< : *buildsnpeff
environment:
GENOME: GRCm38
SNPEFF_CACHE_VERSION: "86"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

snpeffcanfam3_1:
<< : *buildsnpeff
environment:
GENOME: CanFam3.1
SNPEFF_CACHE_VERSION: "86"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

snpeffwbcel235:
<< : *buildsnpeff
environment:
GENOME: WBcel235
SNPEFF_CACHE_VERSION: "86"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

vepgrch37: &buildvep
docker:
Expand All @@ -50,7 +50,7 @@ jobs:
GENOME: GRCh37
SPECIES: homo_sapiens
VEP_VERSION: "99"
SAREK_TAG: dev
SAREK_TAG: 2.7.1
steps:
- checkout
- setup_remote_docker
Expand All @@ -67,31 +67,31 @@ jobs:
GENOME: GRCh38
SPECIES: homo_sapiens
VEP_VERSION: "99"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

vepgrcm38:
<< : *buildvep
environment:
GENOME: GRCm38
SPECIES: mus_musculus
VEP_VERSION: "99"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

vepcanfam3_1:
<< : *buildvep
environment:
GENOME: CanFam3.1
SPECIES: canis_familiaris
VEP_VERSION: "99"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

vepwbcel235:
<< : *buildvep
environment:
GENOME: WBcel235
SPECIES: caenorhabditis_elegans
VEP_VERSION: "99"
SAREK_TAG: dev
SAREK_TAG: 2.7.1

workflows:
version: 2
Expand Down
20 changes: 10 additions & 10 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,13 +36,13 @@ jobs:
environment.yml
- name: Build new docker image
if: env.MATCHED_FILES
run: docker build --no-cache . -t nfcore/sarek:dev
run: docker build --no-cache . -t nfcore/sarek:2.7.1

- name: Pull docker image
if: ${{ !env.MATCHED_FILES }}
run: |
docker pull nfcore/sarek:dev
docker tag nfcore/sarek:dev nfcore/sarek:dev
docker tag nfcore/sarek:dev nfcore/sarek:2.7.1

- name: Install Nextflow
env:
Expand Down Expand Up @@ -74,8 +74,8 @@ jobs:
NXF_VER: '20.04.0'
- name: Pull docker image
run: |
docker pull nfcore/sarek:dev
docker pull nfcore/sarek${{ matrix.tools }}:dev.${{ matrix.species }}
docker pull nfcore/sarek:2.7.1
docker pull nfcore/sarek${{ matrix.tools }}:2.7.1.${{ matrix.species }}
- name: Run annotation test
run: nextflow run ${GITHUB_WORKSPACE} -profile test_annotation,docker --tools ${{ matrix.tools }}

Expand All @@ -96,7 +96,7 @@ jobs:
# Only check Nextflow pipeline minimum version
NXF_VER: '20.04.0'
- name: Pull docker image
run: docker pull nfcore/sarek:dev
run: docker pull nfcore/sarek:2.7.1
- name: Get test data
run: git clone --single-branch --branch sarek https://github.com/nf-core/test-datasets.git data
- name: Run germline test
Expand Down Expand Up @@ -124,7 +124,7 @@ jobs:
# Only check Nextflow pipeline minimum version
NXF_VER: '20.04.0'
- name: Pull docker image
run: docker pull nfcore/sarek:dev
run: docker pull nfcore/sarek:2.7.1
- name: Run test for minimal genomes
run: nextflow run ${GITHUB_WORKSPACE} -profile test,docker --skip_qc all --genome ${{ matrix.genome }} ${{ matrix.intervals }} --tools Manta,mpileup,Strelka,FreeBayes

Expand All @@ -145,7 +145,7 @@ jobs:
# Only check Nextflow pipeline minimum version
NXF_VER: '20.04.0'
- name: Pull docker image
run: docker pull nfcore/sarek:dev
run: docker pull nfcore/sarek:2.7.1
- name: Run ${{ matrix.profile }} test
run: nextflow run ${GITHUB_WORKSPACE} -profile ${{ matrix.profile }},docker

Expand All @@ -166,7 +166,7 @@ jobs:
# Only check Nextflow pipeline minimum version
NXF_VER: '20.04.0'
- name: Pull docker image
run: docker pull nfcore/sarek:dev
run: docker pull nfcore/sarek:2.7.1
- name: Run ${{ matrix.profile }} test
run: nextflow run ${GITHUB_WORKSPACE} -profile test,docker --aligner ${{ matrix.aligner }}

Expand Down Expand Up @@ -197,6 +197,6 @@ jobs:
# Only check Nextflow pipeline minimum version
NXF_VER: '20.04.0'
- name: Pull docker image
run: docker pull nfcore/sarek:dev
run: docker pull nfcore/sarek:2.7.1
- name: Run ${{ matrix.tool }} test
run: nextflow run ${GITHUB_WORKSPACE} -profile test_tool,docker --tools ${{ matrix.tool }} ${{ matrix.intervals }}
run: nextflow run ${GITHUB_WORKSPACE} -profile test_tool,docker --tools ${{ matrix.tool }} ${{ matrix.intervals }}
4 changes: 3 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,9 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/)
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [dev](https://github.com/nf-core/sarek/tree/dev)
## [2.7.1](https://github.com/nf-core/sarek/releases/tag/2.7.1) - Pårtejekna

Pårtejekna is one of glaciers of the Pårte Massif.

### Added

Expand Down
4 changes: 2 additions & 2 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ COPY environment.yml /
RUN conda env create --quiet -f /environment.yml && conda clean -a

# Add conda installation dir to PATH (instead of doing 'conda activate')
ENV PATH /opt/conda/envs/nf-core-sarek-3.0dev/bin:$PATH
ENV PATH /opt/conda/envs/nf-core-sarek-2.7.1/bin:$PATH

# Dump the details of the installed packages to a file for posterity
RUN conda env export --name nf-core-sarek-3.0dev > nf-core-sarek-3.0dev.yml
RUN conda env export --name nf-core-sarek-2.7.1 > nf-core-sarek-2.7.1.yml
10 changes: 8 additions & 2 deletions bin/concatenateVCFs.sh
Original file line number Diff line number Diff line change
Expand Up @@ -85,13 +85,19 @@ then
tail -n +$((L+1)) ${vcf}
done
done
) | bgzip -@${cpus} > rawcalls.vcf.gz
) | bgzip -@${cpus} > rawcalls_tmp.vcf.gz
bgzip -d rawcalls_tmp.vcf.gz
bcftools sort rawcalls_tmp.vcf -o rawcalls.vcf
bgzip -@${cpus} rawcalls.vcf
tabix rawcalls.vcf.gz
rm rawcalls_tmp.vcf*
else
VCF=$(ls no_intervals*.vcf)
cp $VCF rawcalls.vcf
cp $VCF rawcalls_tmp.vcf
bcftools sort rawcalls_tmp.vcf -o rawcalls.vcf
bgzip -@${cpus} rawcalls.vcf
tabix rawcalls.vcf.gz
rm rawcalls_tmp.vcf*
fi

set +u
Expand Down
4 changes: 2 additions & 2 deletions conf/base.config
Original file line number Diff line number Diff line change
Expand Up @@ -90,11 +90,11 @@ process {
errorStrategy = {task.exitStatus == 143 ? 'retry' : 'ignore'}
}
withName:Snpeff {
container = {(params.annotation_cache && params.snpeff_cache) ? 'nfcore/sarek:dev' : "nfcore/sareksnpeff:dev.${params.genome}"}
container = {(params.annotation_cache && params.snpeff_cache) ? 'nfcore/sarek:2.7.1' : "nfcore/sareksnpeff:2.7.1.${params.genome}"}
errorStrategy = {task.exitStatus == 143 ? 'retry' : 'ignore'}
}
withLabel:VEP {
container = {(params.annotation_cache && params.vep_cache) ? 'nfcore/sarek:dev' : "nfcore/sarekvep:dev.${params.genome}"}
container = {(params.annotation_cache && params.vep_cache) ? 'nfcore/sarek:2.7.1' : "nfcore/sarekvep:2.7.1.${params.genome}"}
errorStrategy = {task.exitStatus == 143 ? 'retry' : 'ignore'}
}
withLabel:msisensor {
Expand Down
4 changes: 2 additions & 2 deletions conf/test.config
Original file line number Diff line number Diff line change
Expand Up @@ -33,11 +33,11 @@ params {

process {
withName:Snpeff {
container = 'nfcore/sareksnpeff:dev.WBcel235'
container = 'nfcore/sareksnpeff:2.7.1.WBcel235'
maxForks = 1
}
withLabel:VEP {
container = 'nfcore/sarekvep:dev.WBcel235'
container = 'nfcore/sarekvep:2.7.1.WBcel235'
maxForks = 1
}
}
4 changes: 2 additions & 2 deletions containers/snpeff/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ COPY environment.yml /
RUN conda env create -f /environment.yml && conda clean -a

# Add conda installation dir to PATH (instead of doing 'conda activate')
ENV PATH /opt/conda/envs/nf-core-sarek-snpeff-dev/bin:$PATH
ENV PATH /opt/conda/envs/nf-core-sarek-snpeff-2.7.1/bin:$PATH

# Setup default ARG variables
ARG GENOME=GRCh38
Expand All @@ -19,4 +19,4 @@ ARG SNPEFF_CACHE_VERSION=86
RUN snpEff download -v ${GENOME}.${SNPEFF_CACHE_VERSION}

# Dump the details of the installed packages to a file for posterity
RUN conda env export --name nf-core-sarek-snpeff-dev > nf-core-sarek-snpeff-dev.yml
RUN conda env export --name nf-core-sarek-snpeff-2.7.1 > nf-core-sarek-snpeff-2.7.1.yml
2 changes: 1 addition & 1 deletion containers/snpeff/environment.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# You can use this file to create a conda environment for this pipeline:
# conda env create -f environment.yml
name: nf-core-sarek-snpeff-dev
name: nf-core-sarek-snpeff-2.7.1
channels:
- conda-forge
- bioconda
Expand Down
4 changes: 2 additions & 2 deletions containers/vep/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ COPY environment.yml /
RUN conda env create -f /environment.yml && conda clean -a

# Add conda installation dir to PATH (instead of doing 'conda activate')
ENV PATH /opt/conda/envs/nf-core-sarek-vep-dev/bin:$PATH
ENV PATH /opt/conda/envs/nf-core-sarek-vep-2.7.1/bin:$PATH

# Setup default ARG variables
ARG GENOME=GRCh38
Expand All @@ -27,4 +27,4 @@ RUN vep_install \
--NO_BIOPERL --NO_HTSLIB --NO_TEST --NO_UPDATE

# Dump the details of the installed packages to a file for posterity
RUN conda env export --name nf-core-sarek-vep-dev > nf-core-sarek-vep-dev.yml
RUN conda env export --name nf-core-sarek-vep-2.7.1 > nf-core-sarek-vep-2.7.1.yml
2 changes: 1 addition & 1 deletion containers/vep/environment.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# You can use this file to create a conda environment for this pipeline:
# conda env create -f environment.yml
name: nf-core-sarek-vep-dev
name: nf-core-sarek-vep-2.7.1
channels:
- conda-forge
- bioconda
Expand Down
Binary file modified docs/images/sarek_workflow.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
13 changes: 10 additions & 3 deletions docs/images/sarek_workflow.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions environment.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# You can use this file to create a conda environment for this pipeline:
# conda env create -f environment.yml
name: nf-core-sarek-3.0dev
name: nf-core-sarek-2.7.1
channels:
- conda-forge
- bioconda
Expand Down Expand Up @@ -38,4 +38,4 @@ dependencies:
- bioconda::vcfanno=0.3.2=0
- bioconda::vcftools=0.1.16=he513fc3_4
- conda-forge::pigz=2.3.4=hed695b0_1
- conda-forge::r-ggplot2=3.3.0=r40h6115d3f_1
- conda-forge::r-ggplot2=3.3.0=r40h6115d3f_1
6 changes: 3 additions & 3 deletions nextflow.config
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@ params {
// Container slug
// Stable releases should specify release tag (ie: `2.5.2`)
// Developmental code should specify dev
process.container = 'nfcore/sarek:dev'
process.container = 'nfcore/sarek:2.7.1'

// Load base.config by default for all pipelines
includeConfig 'conf/base.config'
Expand Down Expand Up @@ -246,7 +246,7 @@ manifest {
description = 'An open-source analysis pipeline to detect germline or somatic variants from whole genome or targeted sequencing'
mainScript = 'main.nf'
nextflowVersion = '>=20.04.0'
version = '3.0dev'
version = '2.7.1'
}

// Return the minimum between requirements and a maximum limit to ensure that resource requirements don't go over
Expand All @@ -263,4 +263,4 @@ def check_resource(obj) {
} catch (all) {
println " ### ERROR ### Max params max_memory:'${params.max_memory}', max_time:'${params.max_time}' or max_cpus:'${params.max_cpus}' is not valid! Using default value: $obj"
}
}
}