-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Mark Multiple Executor Configuration as stable in Airflow 3 #46742
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mark Multiple Executor Configuration as stable in Airflow 3 #46742
Conversation
Multiple Executor Configuration (aka hybrid executors) has been released for over half a year and will be almost a year when Airflow 3.0 is released. I think with the release of Airflow 3 we can call it stable, but keep in as experimental in 2.10.X and 2.11.X in case any issues are discovered during those releases.
|
Optionally we could mark it as stable in 2.11 if we wanted to give people more time to migrate. Thoughts? |
|
I think we better have lazy consensus vote on this one. Personally I would prefer to wait with marking it stable. There were reports on this feature not working with helm chart and so far the fix was not released (waiting for chart 1.16) |
I agree, I was just typing up a discussion thread for this actually! I will send that out. I think a course of action that's in the middle is mark this as stable in 2.11 and very publicly mark the old hard coded executors as deprecated in 2.11 and then. Remove them in 3.0 I don't personally think issues with the helm chart stop multi exec config from being stable. That is not related to bugs in the fundamental interface of that feature. |
As explained in the devlist message. While it's not a blocker, a call to make it works should be included in a call to make the feature stable. |
|
Now that #46944 is merged, and Jed is planning to release a new Helm Chart soon, we should be able to merge this one as well. This small PR simply maintains consistency with the above mentioned change in 2.10.X |
amoghrajesh
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Late approval but looks good!
Multiple Executor Configuration (aka hybrid executors) has been released for over half a year and will be almost a year when Airflow 3.0 is released. With the release of Airflow 3 we can call it stable.
Multiple Executor Configuration (aka hybrid executors) has been released for over half a year and will be almost a year when Airflow 3.0 is released. With the release of Airflow 3 we can call it stable.
Multiple Executor Configuration (aka hybrid executors, AIP-61) has been released for over half a year and it will be almost a year when Airflow 3.0 is released. I think with the release of Airflow 3 we can call it stable, but keep in as experimental in 2.10.X and 2.11.X in case any issues are discovered during those releases.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.