Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change task array submission commad in Google Batch #5780

Conversation

jorgee
Copy link
Contributor

@jorgee jorgee commented Feb 11, 2025

Close #5777

This PR modifies the execution command for task arrays to directly run the task command avoiding race conditions when using gcfuse.

pditommaso and others added 2 commits February 10, 2025 23:05
Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
…atch

Signed-off-by: jorgee <jorge.ejarque@seqera.io>
@jorgee jorgee linked an issue Feb 11, 2025 that may be closed by this pull request
Copy link

netlify bot commented Feb 11, 2025

Deploy Preview for nextflow-docs-staging canceled.

Name Link
🔨 Latest commit e1ee4f7
🔍 Latest deploy log https://app.netlify.com/sites/nextflow-docs-staging/deploys/67abc2c283a21b00084540f3

jorgee and others added 3 commits February 11, 2025 20:02
Signed-off-by: jorgee <jorge.ejarque@seqera.io>
Signed-off-by: Paolo Di Tommaso <paolo.ditommaso@gmail.com>
@pditommaso
Copy link
Member

Bit unfortunate, because in principle the double-command (plain vs array) should be implemented also for the other executors. Anyhow, let's go ahead, and we'll look a more structural solution later on.

Made a minor change to not modify the GoogleBatchScriptLauncher signature because I think it's extended in the xpack plugin

@pditommaso pditommaso merged commit 7ad7a23 into master Feb 11, 2025
20 checks passed
@pditommaso pditommaso deleted the 5777-not-detected-failing-condition-with-google-batch-and-task-array branch February 11, 2025 22:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Not detected failing condition with Google Batch and task array
3 participants