Skip to content

Conversation

@antgonza
Copy link
Member

No description provided.

@antgonza antgonza changed the title adding "PacBio processing" to scripts [WIP]: adding "PacBio processing" to scripts Oct 23, 2025
@antgonza antgonza changed the title [WIP]: adding "PacBio processing" to scripts adding "PacBio processing" to scripts Oct 24, 2025
@antgonza antgonza requested a review from jianshu93 October 24, 2025 19:03
@lucaspatel lucaspatel self-requested a review October 28, 2025 18:13
@lucaspatel lucaspatel self-assigned this Oct 28, 2025
Copy link
Collaborator

@lucaspatel lucaspatel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

#SBATCH -n 1
#SBATCH --time {{wall_time_limit}}
#SBATCH --mem {{mem_in_gb}}G
#SBATCH -o {{output}}/log-finish.out
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Different log directory for this final job, is that intentional?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was, I think I'm gonna put it back where all the rest go in the next PR.

main_fp, merge_fp = generate_minimap2_processing(
qclient, job_id, output_dir, parameters)
all_jids = []
for step_id in range(1, total_steps + 1, 1):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clever. Do we have a mechanism to handle resubmission if there's a failure in 1+ samples halfway through the steps?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not yet.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this will be very useful but not easy to integrate now. Only resubmit for that sample for the failed steps and all steps after it.

@lucaspatel lucaspatel merged commit d9ad02a into main Oct 28, 2025
2 checks passed
@lucaspatel lucaspatel deleted the finish-PacBio_processing branch October 28, 2025 18:40
Copy link
Collaborator

@jianshu93 jianshu93 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All slurm script look good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants