Skip to content

Conversation

@guan404ming
Copy link
Member

Related Issue

Why

get_pandas_df deprecated in #48875, which would be replaced by get_df. Thus, we need to migrate them in providers.

How

  • This PR is focus on migration of Presto and Trino provider since they have similar structure
  • Migrate unit test to test pandas and polars
  • since pandas and polars is only used by get_df, thus move them to extra

cc: @eladkal @potiuk


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@guan404ming guan404ming force-pushed the migrate-presto-trino branch from c678567 to e14ef8e Compare May 2, 2025 14:26
@guan404ming guan404ming changed the title Migrate Presto and Trino to use get_df Migrate PrestoHook and TrinoHook to use get_df May 2, 2025
@guan404ming guan404ming marked this pull request as ready for review May 2, 2025 14:49
@eladkal eladkal merged commit 223d25a into apache:main May 2, 2025
121 of 127 checks passed
@guan404ming
Copy link
Member Author

Thanks for the review!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants