Skip to content

Conversation

@guan404ming
Copy link
Member

@guan404ming guan404ming commented May 1, 2025

Related Issue

Why

get_pandas_df deprecated in #48875, which would be replaced by get_df. Thus, we need to migrate them in providers.

How

  • This PR is focus on migration of Hive provider.
  • Migrate unit test to test pandas and polars
  • since pandas and polars is only used by get_df, thus move them to extra
  • update missing extra in Drill

cc: @eladkal @potiuk


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@guan404ming guan404ming force-pushed the migrate-hive branch 2 times, most recently from 3148cb7 to c81bd15 Compare May 1, 2025 12:31
@guan404ming guan404ming marked this pull request as ready for review May 1, 2025 14:13
@guan404ming guan404ming changed the title Migrate Hive provider to use get_df Migrate Hive provider to use get_df May 1, 2025
@eladkal eladkal merged commit 164b465 into apache:main May 2, 2025
68 checks passed
@guan404ming
Copy link
Member Author

Thanks for the review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants