Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release 2.5.11 #95

Closed
3 tasks done
slsevilla opened this issue Jan 16, 2024 · 5 comments
Closed
3 tasks done

release 2.5.11 #95

slsevilla opened this issue Jan 16, 2024 · 5 comments
Assignees
Labels
RENEE RepoName
Milestone

Comments

@slsevilla
Copy link
Contributor

slsevilla commented Jan 16, 2024

Steps

  • Run test data through main branch on biowulf
  • Run test data through main branch on FRCE
  • Most recent commit passes Tests / Dryrun_Lint github actions workflow.

Test: Biowulf

Deployment:

RENEE_DIR=/data/sevillas2/RENEE
WORK_DIR=/data/sevillas2/renee_2.5.11_biowulf
if [[ -d $WORK_DIR ]]; then rm -rf $WORK_DIR; fi
$RENEE_DIR/bin/renee run \
    --input $RENEE_DIR/.tests/*.gz \
    --output $WORK_DIR \
    --genome hg38_30 \
    --mode slurm \
    --sif-cache /data/CCBR_Pipeliner/SIFS

Status:

  • 1/16 In progress (Successfully submitted master job: 17190892)
  • 1/17 completed successfully

Test: FRCE

Deployment:

RENEE_DIR=/mnt/projects/CCBR-Pipelines/pipelines/RENEE/v2.5.10
WORK_DIR=/scratch/cluster_scratch/$USER/renee_2.5.11_frce
if [[ -d $WORK_DIR ]]; then rm -r $WORK_DIR; fi
module load singularity
$RENEE_DIR/bin/renee run \
    --input $RENEE_DIR/.tests/*.gz \
    --output $WORK_DIR \
    --genome hg38_30 \
    --mode slurm \
    --sif-cache /mnt/projects/CCBR-Pipelines/SIFs

Status:

  • In progress (Successfully submitted master job:30434596)
@slsevilla
Copy link
Contributor Author

FRCE run failed for me, with multiple rules failing due to this error:

FATAL:   container creation failed: mount /lscratch->/lscratch error: while mounting /lscratch: mount source /lscratch doesn't exist

Unsure why the pipeline is not detecting FRCE and appears to think it's still on Biowulf. @kelly-sovacool is running a test on FRCE to determine if it's a user issue or if it's something more systemic.

@kelly-sovacool
Copy link
Member

FRCE run failed for me, with multiple rules failing due to this error:

FATAL:   container creation failed: mount /lscratch->/lscratch error: while mounting /lscratch: mount source /lscratch doesn't exist

Unsure why the pipeline is not detecting FRCE and appears to think it's still on Biowulf. @kelly-sovacool is running a test on FRCE to determine if it's a user issue or if it's something more systemic.

My test on FRCE worked 🤔

RENEE	Fri Jan 19 11:26:54 EST 2024
Running pipeline with the following parameters:
	b	/mnt/projects/CCBR-Pipelines,/mnt/projects/CCBR-Pipelines/Pipelines/RENEE/renee-dev-sovacool/.tests,/scratch/cluster_scratch/sovacoolkl/renee_test_v2.5.11,/scratch/cluster_scratch/sovacoolkl
	c	/scratch/cluster_scratch/sovacoolkl/renee_test_v2.5.11/.singularity
	e	slurm
	h	frce
	j	pl:renee
	o	/scratch/cluster_scratch/sovacoolkl/renee_test_v2.5.11
	t	/scratch/cluster_scratch/sovacoolkl/renee_test_v2.5.11
	w	--nowait
[Fri Jan 19 11:26:55 EST 2024] Pipeline submitted to cluster.
Master Job ID: 30547456
JobID         Partition  Timelimit    Elapsed        NodeList              Submit               Start                 End      State ExitCode
------------ ---------- ---------- ---------- --------------- ------------------- ------------------- ------------------- ---------- --------
30547456           norm 4-00:00:00   00:49:17           cn062 2024-01-19T11:26:55 2024-01-19T11:27:00 2024-01-19T12:16:17     FAILED      1:0

@kelly-sovacool
Copy link
Member

Oh, it's because I set --tmp-dir. I'll work on #79 for this release

@slsevilla
Copy link
Contributor Author

issue with permissions #101 fixed. FRCE run completed successfully!

@kelly-sovacool
Copy link
Member

closed by #102

@kopardev kopardev modified the milestones: Jan 2024, Jan 2025 Jan 24, 2024
@slsevilla slsevilla added this to the 2024-01 milestone Feb 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
RENEE RepoName
Projects
None yet
Development

No branches or pull requests

3 participants