Skip to content

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented May 4, 2025

The task SDK we have currently is not yet fully decoupled from the Airflow version we are going to have. It is simply not "future compatible" yet.

The "true" decoupling will come when we have Airflow 3.1, for now the task-sdk we have is really tied with 3.1.* version of Airflow - and for now we should have the limits set properly for core:

  • Lower >= 3.0.0 -> the main version of task-sdk will only work with airflow 3.0.* (including pre-releases)
  • Upper < 3.1.0 -> the task-sdk from main (1.1.0) will not work with Airflow 3.0.* and it's not going to be installable for Airflow 3.0 as well.

Related to #50163


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

The task SDK we have currently is not yet fully decoupled from the
Airflow version we are going to have. It is simply not "future
compatible" yet.

The "true" decoupling will come when we have Airflow 3.1, for now the
task-sdk we have is really tied with 3.1.* version of Airflow - and for
now we should have the limits set properly for core:

* Lower >= 3.0.0 -> the main version of task-sdk will only work with
  airflow 3.0.* (including pre-releases)
* Upper < 3.1.0 -> the task-sdk from main (1.1.0) will not work with
  Airflow 3.0.* and it's not going to be installable for Airflow 3.0
  as well.

Related to apache#50163
@potiuk potiuk requested review from amoghrajesh, ashb and kaxil as code owners May 4, 2025 07:59
@potiuk potiuk requested review from eladkal and gopidesupavan May 4, 2025 08:04
@potiuk potiuk merged commit 5bf074e into apache:v3-0-test May 4, 2025
51 checks passed
@potiuk potiuk deleted the apply-proper-limits-for-3-0-test-task-sdk branch May 4, 2025 08:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant