Constraints in 3.0.3 have incompatible combination of pandas & sqlalchemy #53392
Replies: 4 comments 7 replies
-
|
I am not sur where this error comes from ? How do you think it comes from those version and not your wrong usage? the cohnstraints in airflow are generated when there is no error in unit tests of airflow showing that those versions work. As far as I know the issue you have is because some code you are using needs sqlalchemy 2: Which waits for FAB 5 to be merged: Without knowing what exactly caused your issue, we are unable to spend our time on trying to guess what is causing your problem, but if you can spend some time on providing more details, complete stack traces and more context, we might. |
Beta Was this translation helpful? Give feedback.
-
|
converting to a discussion as more discussion and input from reporter is needed. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I have the same issue. All tasks that have the df.to_sql() method failed with the same error in airflow v3.0.3. I had to downgrade to 3.0.2 and everything started working again. |
Beta Was this translation helpful? Give feedback.
-
|
@potiuk the airflow constraints file is wrong however: https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.11.txt it has: pandas==2.2.3 These are not compatible as pandas >=2.2.0 only supports sqlalchemy>=2.0.0 |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Apache Airflow version
3.0.3
If "Other Airflow 2 version" selected, which one?
No response
What happened?
constraints for 3.0.3 have pandas 2.2.3 and SQLAlchemy 1.4.54 causing this issue now:
pandas-dev/pandas#57049
What you think should happen instead?
No response
How to reproduce
Upgrade to 3.0.3 using constraints for 3.0.3 python3.12
Operating System
Ubuntu 24.04
Versions of Apache Airflow Providers
No response
Deployment
Virtualenv installation
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions