Skip to content

Conversation

@guan404ming
Copy link
Member

Related Issue

Why

get_pandas_df deprecated in #48875, which would be replaced by get_df. Thus, we need to migrate them in providers.

How

  • This PR is focus on migration of BigQueryHook
  • Migrate unit test

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:providers provider:google Google (including GCP) related issues labels May 8, 2025
@guan404ming guan404ming marked this pull request as ready for review May 8, 2025 15:12
@guan404ming guan404ming force-pushed the migrate-bgq branch 3 times, most recently from 74156ba to 50c7cf9 Compare May 9, 2025 14:59
@guan404ming guan404ming marked this pull request as draft May 9, 2025 18:53
guan404ming and others added 4 commits May 10, 2025 03:07
Co-authored-by: maks.yermakou@gmail.com

Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com>
@guan404ming guan404ming marked this pull request as ready for review May 9, 2025 19:10
Copy link
Member

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. @MaksYermak ?

Copy link
Contributor

@eladkal eladkal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@eladkal eladkal merged commit fc688af into apache:main May 12, 2025
68 checks passed
@guan404ming
Copy link
Member Author

Thanks for all reviews and suggestions!

@guan404ming guan404ming deleted the migrate-bgq branch May 12, 2025 08:01
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
* Migrate `BigQueryHook` to use `get_df`

* Update test and deprecated

Co-authored-by: maks.yermakou@gmail.com

Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com>

* Remove unused mock

* Update synchronous func and test

* Update type overload

---------

Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:providers provider:google Google (including GCP) related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants