Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How would the Raptor instance cancel Tasks? #3002

Open
eirrgang opened this issue Aug 2, 2023 · 1 comment
Open

How would the Raptor instance cancel Tasks? #3002

eirrgang opened this issue Aug 2, 2023 · 1 comment

Comments

@eirrgang
Copy link
Contributor

eirrgang commented Aug 2, 2023

There is not a complementary method to Raptor.submit_workers() . How would the Raptor instance cancel workers (or other Tasks)?

I would like to confirm the appropriate way for the Master to cancel a Task (worker or otherwise). If this is not supported (or not normative), I need to document that somewhere.

Note that my current expectation is that the ScalemsMaster needs to outlive the Worker(s) in order to clean up (handle final task disposition and workflow state). If this just seems unfeasible, then we need to rethink how we might clean up the filesystem artifacts and metadata (bookkeeping) from the client side after receiving confirmation that the Master and Worker(s) are shut down.

@eirrgang
Copy link
Contributor Author

eirrgang commented Aug 4, 2023

Update from the dev call: This is probably not a high priority issue. @andre-merzky will look into adding some API accessible to the Master. However, for the purposes of the scalems project, we can probably just shut down the Master (and, transitively, its workers) and do post hoc inspection of filesystem artifacts to determine any necessary cleanup or reconciliation of workflow state.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant