Skip to content

Conversation

@Dev-iL
Copy link
Collaborator

@Dev-iL Dev-iL commented Dec 8, 2025

related: #28723, #58049

Fixing assorted issues preventing us from removing the SQLA1.4 limitation. Note that many fixes done as part of this effort were split into standalone PRs as can be seen in this PR's history below.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@Dev-iL Dev-iL changed the title Dev i l/sqla2 deadlock Attempting to fix the MySQL timeout with SQLA2 Dec 8, 2025
@vincbeck vincbeck force-pushed the vincbeck/fab_remove_sqla_limit branch from 17dec44 to f3cc8f8 Compare December 8, 2025 20:30
@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch from 5ce5e2e to 084d78f Compare December 8, 2025 21:14
@Dev-iL Dev-iL changed the base branch from vincbeck/fab_remove_sqla_limit to main December 8, 2025 21:15
@Dev-iL Dev-iL marked this pull request as draft December 8, 2025 21:15
@Dev-iL Dev-iL marked this pull request as ready for review December 8, 2025 21:15
@Dev-iL Dev-iL closed this Dec 8, 2025
@Dev-iL Dev-iL reopened this Dec 8, 2025
@Dev-iL Dev-iL changed the base branch from main to vincbeck/fab_remove_sqla_limit December 8, 2025 21:17
@vincbeck vincbeck added full tests needed We need to run full set of tests for this PR to merge all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs labels Dec 8, 2025
@vincbeck vincbeck closed this Dec 8, 2025
@vincbeck vincbeck reopened this Dec 8, 2025
@Dev-iL Dev-iL changed the base branch from vincbeck/fab_remove_sqla_limit to main December 8, 2025 21:23
@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch 7 times, most recently from 0a11b78 to a410faf Compare December 13, 2025 20:51
@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch from 7112da5 to 20def2f Compare December 29, 2025 05:04
Copy link
Contributor

@Nataneljpwd Nataneljpwd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch from 20def2f to 438246b Compare December 29, 2025 20:08
Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - but I think at least @vincbeck review will be needed as well - possibly few other people who are more into SQLA.

Also - the DISCUSS thread is overwhelmingly "let's drop SQLA1" as expected, I propose @Dev-iL you start a LAZY CONSENSUS thread and link to this PR - this will drag attention of more maintainers.

Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Jan 2, 2026
Related: apache#59218, apache#59402

Passes mypy & pre-commit checks

airflow-core/src/airflow/api_fastapi
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_dag_runs.py.
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_variables.py
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_xcoms.py
@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch from 438246b to 0c069eb Compare January 3, 2026 19:06
@Dev-iL
Copy link
Collaborator Author

Dev-iL commented Jan 3, 2026

Lazy consensus passed. I guess we're waiting for @vincbeck's blessing now...

@Dev-iL
Copy link
Collaborator Author

Dev-iL commented Jan 4, 2026

Interestingly, after the latest rebase, several deps get downgraded:

< cadwyn==6.0.0
> cadwyn==5.4.6
< fastapi==0.128.0
> fastapi==0.117.1
< starlette==0.50.0
> starlette==0.48.0

@Nataneljpwd
Copy link
Contributor

Interestingly, after the latest rebase, several deps get downgraded:

< cadwyn==6.0.0
> cadwyn==5.4.6
< fastapi==0.128.0
> fastapi==0.117.1
< starlette==0.50.0
> starlette==0.48.0

I think @jscheffl wrote something about it in the cicd channel on slack, where the pipeline got dependency conflicts on Arm, maybe it can help him.

Here is the slack message:

https://apache-airflow.slack.com/archives/C015SLQF059/p1767483103162959?thread_ts=1767480352.315619&cid=C015SLQF059

@Dev-iL Dev-iL force-pushed the Dev-iL/sqla2_deadlock branch 2 times, most recently from 6549cb9 to 1c84f22 Compare January 4, 2026 22:39
Copy link
Contributor

@jscheffl jscheffl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No objection from @vincbeck then LGTM!

@jscheffl jscheffl force-pushed the Dev-iL/sqla2_deadlock branch from 1c84f22 to 887dad6 Compare January 5, 2026 14:13
@jscheffl
Copy link
Contributor

jscheffl commented Jan 5, 2026

For safety made a final rebase, let's have CI green and then merge ASAP!

Copy link
Contributor

@vincbeck vincbeck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome!

@vincbeck vincbeck merged commit e626a7f into apache:main Jan 5, 2026
220 checks passed
@Dev-iL Dev-iL deleted the Dev-iL/sqla2_deadlock branch January 5, 2026 16:34
@jscheffl
Copy link
Contributor

jscheffl commented Jan 5, 2026

#protm

chirodip98 pushed a commit to chirodip98/airflow-contrib that referenced this pull request Jan 9, 2026
* Remove SQLA 1 limit in Fab provider

* Simplify the SQLA debug logging

* Modify session start/end and release metadata locks

* Address Nataneljpwd's comments

* Address copilot's comments

---------

Co-authored-by: vincbeck <vincbeck@amazon.com>
stegololz pushed a commit to stegololz/airflow that referenced this pull request Jan 9, 2026
Related: apache#59218, apache#59402

Passes mypy & pre-commit checks

airflow-core/src/airflow/api_fastapi
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_dag_runs.py.
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_variables.py
airflow-core/tests/unit/api_fastapi/execution_api/versions/head/test_xcoms.py
stegololz pushed a commit to stegololz/airflow that referenced this pull request Jan 9, 2026
* Remove SQLA 1 limit in Fab provider

* Simplify the SQLA debug logging

* Modify session start/end and release metadata locks

* Address Nataneljpwd's comments

* Address copilot's comments

---------

Co-authored-by: vincbeck <vincbeck@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants