Bump upper binding on pandas in all providers#52060
Merged
potiuk merged 1 commit intoapache:mainfrom Jun 23, 2025
Merged
Conversation
boring-cyborg
bot
added
area:providers
provider:apache-hdfs
provider:common-sql
provider:databricks
provider:exasol
provider:papermill
provider:salesforce
provider:snowflake
potiuk
requested review from
amoghrajesh,
hussein-awala,
mobuchowski and
vatsrahul1001
We are limiting pandas to < 2.2, however Pandas is now at 2.4 and if we limit it to <2.2 it's not possible to have providers that support python 3.13 We should open up to higher pandas versions, there is no reason to believe that newer pandas versions might be breaking heavily - we are using very small subset of pandas APIs that should be stable. We also should add provisional lower bounds for Python 3.13, because older versions of Pandas do not compile for Python 3.13 and sometiems uv or other installers might attempt to build those older versions if they are not limited.
potiuk
force-pushed
the
update-pandas-requirements
branch
from
086be3b to
05e9cf4
Compare
potiuk
added a commit
to potiuk/airflow
that referenced
this pull request
Jun 23, 2025
After apache#52060 some tests started to fail - this PR fixes it: * test_pandas.py is removed, it makes no sense as we seem to be testing if pandas has specific API (which we neither use nor guarantee) * numpy serializers are now compatible with numpy 2
potiuk
added a commit
that referenced
this pull request
Jun 23, 2025
After #52060 some tests started to fail - this PR fixes it: * test_pandas.py is removed, it makes no sense as we seem to be testing if pandas has specific API (which we neither use nor guarantee) * numpy serializers are now compatible with numpy 2
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
We are limiting pandas to < 2.2, however Pandas is now at 2.4 and if we limit it to <2.2 it's not possible to have providers that support python 3.13
We should open up to higher pandas versions, there is no reason to believe that newer pandas versions might be breaking heavily - we are using very small subset of pandas APIs that should be stable. We also should add provisional lower bounds for
Python 3.13, because older versions of Pandas do not compile for Python 3.13 and sometiems uv or other installers might attempt to build those older versions if they are not limited.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.