Skip to content

Conversation

@kaxil
Copy link
Member

@kaxil kaxil commented Oct 22, 2025

Replace version-specific conditional imports with common.compat layer. This standardizes compatibility handling across Airflow 2.x and 3.x.

Special handling for hive (context helpers) and spark (decorators) where version_compat re-exports base classes from common.compat.

Migrated providers:

  • beam, cassandra, drill, flink, hdfs, hive, iceberg, impala
  • kafka, livy, pig, pinot, spark, tinkerpop
  • elasticsearch

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@eladkal
Copy link
Contributor

eladkal commented Oct 22, 2025

Tests are failing

Replace version-specific conditional imports with common.compat layer.
This standardizes compatibility handling across Airflow 2.x and 3.x.

Special handling for hive (context helpers) and spark (decorators)
where version_compat re-exports base classes from common.compat.

Migrated providers:
- beam, cassandra, drill, flink, hdfs, hive, iceberg, impala
- kafka, livy, pig, pinot, spark, tinkerpop

Total: 54 files modified across 14 providers
@kaxil kaxil force-pushed the migrate-elasticsearch-to-common-compat branch from 9cc74b8 to 20f55f2 Compare October 22, 2025 11:36
@kaxil
Copy link
Member Author

kaxil commented Oct 22, 2025

@eladkal this should be good to go now. The only static check failure is about go sdk that is fixed on main.

@kaxil kaxil merged commit 9d51b42 into apache:main Oct 22, 2025
24 checks passed
@kaxil kaxil deleted the migrate-elasticsearch-to-common-compat branch October 22, 2025 12:58
@kaxil
Copy link
Member Author

kaxil commented Oct 22, 2025

Merging to get it in the release. The only failure was ruff & go. Go is fixed on main and ruff is fixed in 8fb7c2e

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants