Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core feature] Support for Pausing launchplans/Pipelines (Similar to Pausing DAGs in Airflow) #5835

Open
2 tasks done
avasani opened this issue Oct 10, 2024 · 1 comment
Open
2 tasks done
Assignees
Labels
enhancement New feature or request

Comments

@avasani
Copy link

avasani commented Oct 10, 2024

Motivation: Why do you think this is important?

Flyte currently lacks the ability to pause launchplan or pipelines, which is a common feature in other workflow orchestration tools like Airflow. Users need a way to temporarily halt all new executions of a workflow without deregistering or deleting it, especially during incidents or while deploying critical fixes.

All the pending execution request should go in wait queue if user triggers the remote-launchplan. If request could be executed if trigged as remote-workflow

Goal: What should the final outcome look like, ideally?

  • A production workflow starts failing due to a bad deployment or unforeseen data issues.
  • The user wants to prevent any new executions from starting while investigating and fixing the problem.
  • In Airflow, this is achieved by pausing the DAG.

Describe alternatives you've considered

Missing feature in Flyte.

Propose: Link/Inline OR Additional context

No response

Are you sure this issue hasn't been raised already?

  • Yes

Have you read the Code of Conduct?

  • Yes
@avasani avasani added enhancement New feature or request untriaged This issues has not yet been looked at by the Maintainers labels Oct 10, 2024
@eapolinario eapolinario self-assigned this Oct 17, 2024
@eapolinario eapolinario removed the untriaged This issues has not yet been looked at by the Maintainers label Oct 17, 2024
@kumare3
Copy link
Contributor

kumare3 commented Dec 3, 2024

@avasani Flyte supports recover mode. Even if things fail you can simply recover right? Why not do it this way instead of manual pausing.

One simple way of pausing is - just go and kill the flytepropeller pod and all progress will stop and when you restart it, it will just simply resume

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants