Status of testing Providers that were prepared on September 05, 2025

[eladkal]

Body

I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comments, whether the issue is addressed.

These are providers that require testing as there were some substantial changes introduced:

Provider amazon: 9.13.0rc1

• feature: Add OpenLineage support for transfer operators between GCS and S3 (#54269): @pawelgrochowicz
• Update HiveToDynamoDBOperator to support Polars (#54221): @guan404ming
• Update SqlToS3Operator to support Polars and deprecate read_pd_kwargs (#54195): @guan404ming
  Linked issues:
  • Linked Issue #53399: @CincyBC
• Fix SqlToS3Operator _partition_dataframe for proper polars support (#54588): @guan404ming
• fixing file extension issue on SqlToS3Operator (#54187): @arvindp25
  Linked issues:
  • Linked Issue #53976: @RamesChan
• Fix connection management for EKS token generation (#55195): @o-nikolas
  Linked issues:
  • Linked Issue #53578: @valereColleville
  • Linked Issue #54582: @viiccwen
• Retry on more edge cases for bedrock (#55201): @o-nikolas
• Refactor Common Queue Interface (#54651): @jason810496
  Linked issues:
  • Linked Issue #52712: @jason810496
• Introduce LIST action in AWS auth manager (#54987): @vincbeck
  Linked issues:
  • Linked Issue #54926: @vincbeck
• Move secrets_masker over to airflow_shared distribution (#54449): @amoghrajesh
• Handle task-sdk connection retrieval import error in BaseHook (#54692): @seanghaeli
• Remove end_from_trigger attribute in MwaaDagRunSensor trigger (#54567): @seanghaeli
  Linked issues:
  • Linked Issue #54531: @seanghaeli
• Remove redundant exception handling in AWS hook (#54485): @ramitkataria
  Linked issues:
  • Linked Issue #54299: @amoghrajesh
• Remove end_from_trigger attribute in MwaaTaskSensor trigger (#54531): @seanghaeli
• Unify error handling when connection is not found in aws hook (#54299): @amoghrajesh

Provider apache.beam: 6.1.4rc1

• fix apache beam provider with missing google provider (#54982): @olegkachur-e

Provider apache.kafka: 1.10.3rc1

• Refactor Common Queue Interface (#54651): @jason810496
  Linked issues:
  • Linked Issue #52712: @jason810496

Provider celery: 3.12.3rc1

• Fix setproctitle usage (#53122): @jason810496
  Linked issues:
  • Linked Issue #52860: @jason810496
• Fix celery visibility timeout (set to 23.5h instead of the intended 24h) (#54480): @seanmuth
  Linked issues:
  • Linked Issue #40879: @ephraimbuddy
• Remove MappedOperator inheritance (#53696): @uranusjr
  Linked issues:
  • Linked Issue #52141: @kaxil
• Update usage of timeout contextmanager from SDK where possible (#54183): @amoghrajesh

Provider cncf.kubernetes: 10.8.0rc1

• Add customizable log prefix and formatter to KubernetesPodOperator (#53598): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #53054: @NilsJPWerner
• Enhanced Pod Failure Logging in KubernetesExecutor (#54115): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #37548: @hterik
• Fix: Handle Kubernetes API responses with non-JSON bodies (#55107): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #49244: @whynick1
• Retry on 409 conflict (#54777): @romsharon98
• [KubernetesPodOperator] logs pod and container state after error occurred (#54828): @AutomationDev85
• [providers-cncf-kubernetes] Throttle HTTPError during consume pod logs (#54761): @AutomationDev85
• Refactor Kubernetes Executor Types to NamedTuples (#54858): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #54115: @HsiuChuanHsu

Provider common.messaging: 2.0.0rc1

• Refactor Common Queue Interface (#54651): @jason810496
  Linked issues:
  • Linked Issue #52712: @jason810496
• fix(messaging): improve MessageQueueTrigger logging and add tests (#54492): @dejii

Provider common.sql: 1.28.0rc1

• Add SQLInsertRowsOperator in common.sql provider (#55031): @dabla
• Added paginated_sql_statement_clause parameter to GenericTransfer (#48866): @dabla
• Add support for the psycopg3 postgres driver (#52976): @Dev-iL
  Linked issues:
  • Linked Issue #52233: @Dev-iL
• Fixed resolving of dialect name when host of JdbcHook is an JDBC URL (#54446): @dabla

Provider databricks: 7.7.2rc1

• Fix Databricks sqlalchemy URL construction (#54478): @BrianLii
  Linked issues:
  • Linked Issue #53217: @BrianLii
• Ensures DatabricksWorkflowOperator updates ACL (if available) when resetting a job. (#47827): @hardeybisey
  Linked issues:
  • Linked Issue #45738: @adamgorkaextbi
• chore: remove explicit openlineage dependency from databricks provider (#54748): @kacpermuda

Provider dbt.cloud: 4.4.3rc1

• added DBT job run id to XCom in DbtCloudRunJobOperator (#55184): @AardJan

Provider edge3: 1.2.0rc1

• Provide React UI for Edge (#53563): @jscheffl
  Linked issues:
  • Linked Issue #49536: @dheerajturaga
• Feature/add auto refresh to edge react UI (#54994): @jscheffl
• Feature/add state badge to edge react UI (#54993): @jscheffl
• Fix setproctitle usage (#53122): @jason810496
  Linked issues:
  • Linked Issue #52860: @jason810496

Provider fab: 2.4.2rc1

• Remove query obj from providers fab (#53953): @Prab-27
• fix: Add cookies options into FAB provider.yaml (#54995): @LipuFei
• To fix Fab auth manager returns get_id of integer type where str is expected (#54384): @Abhishek1559
  Linked issues:
  • Linked Issue #54298: @tirkarthi
• Potential fix for code scanning alert no. 519: Clear-text logging of sensitive information (#54742): @potiuk
• Create FAB's user/role tables on migration, not only on initdb (#54227): @ashb
• Update is_authorized_dag method in FabAuthManager (#54926): @vincbeck
  Linked issues:
  • Linked Issue #53936: @devgonvarun
  • Linked Issue #54197: @vincbeck

Provider git: 0.0.7rc1

• Catch Exception in git hook instantiation (#55079): @dstandish
• Fix process leaks in GitDagBundle repository management (#54997): @jedcunningham

Provider google: 17.2.0rc1

• Add handler for cli command exit code in CloudComposerRunAirflowCLICommandOperator (#54497): @Crowiant
• Add create_intermediate_dirs option to GCSToSFTPOperator (#54916): @jroachgolf84
• feature: Add OpenLineage support for PubSubPullOperator (#54821): @pawelgrochowicz
• feature: Add OpenLineage support for pubsub create subscription operator - include inputs into OL (#54785): @pawelgrochowicz
• feature: Add OpenLineage support for PubSubPublishMessageOperator (#54764): @pawelgrochowicz
• feature: Add OpenLineage support for pubsub create subscription operator (#54707): @pawelgrochowicz
• feature: Add OpenLineage support for OracleToGCSOperator (#54953): @pawelgrochowicz
• feature: Add OpenLineage support for BigQueryToMsSqlOperator (#55168): @pawelgrochowicz
• [AIRFLOW-53596] Add GSheetsHook API endpoint support (Part 1) (#54560): @dataengineervishal
• Add cluster_tier flag support to Dataproc ClusterGenerator (#54105): @swainmoc
• Fix BigQueryInsertJobOperator failure with asset-triggered DAGs (#55092): @kaxil
  Linked issues:
  • Linked Issue #55073: @txu-7777
• Fix serialization in triggers in Google provider (#55014): @VladaZakharova
• Fix CloudComposerDAGRunSensor functionality (#54351): @MaksYermak
• Skip provider_session usage in AF3 for BigQuery and Dataproc triggers (#54405): @MaksYermak
• Update logic of BQ operators to be able to use WRITE_TRUNCATE_DATA in case if schemaUpdateOptions specified (#54417): @VladaZakharova
• Remove MappedOperator inheritance (#53696): @uranusjr
  Linked issues:
  • Linked Issue #52141: @kaxil
• Validate Dataproc batch labels max 63 characters (#55196): @cnauroth
• Add support for the psycopg3 postgres driver (#52976): @Dev-iL
  Linked issues:
  • Linked Issue #52233: @Dev-iL
• Add get_secret function to the common/utils in google provider (#54213): @Crowiant
• Update usage of timeout contextmanager from SDK where possible (#54183): @amoghrajesh
• Add ability to return number of affected rows to SpannerQueryDatabaseInstanceOperator (#55127): @VladaZakharova
• Add composer_dag_run_id as optional parameter to CloudComposerDAGRunSensor (#54977): @MaksYermak

Provider http: 5.3.4rc1

• fix(http): Fix HttpHook.url_from_endpoint() lazy initialization (#54202): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #54112: @fritz-astronomer

Provider jdbc: 5.2.3rc1

• Fixed resolving of dialect name when host of JdbcHook is an JDBC URL (#54446): @dabla

Provider keycloak: 0.1.0rc1

• Add LIST scope in Keycloak auth manager (#54998): @vincbeck
  Linked issues:
  • Linked Issue #54987: @vincbeck
  • Linked Issue #54926: @vincbeck
• docs(keycloak): Update documentation for Keycloak auth manager CLI usage and permission management (#54928): @bugraoz93

Provider microsoft.azure: 12.7.0rc1

• Add setter for blob_service_client in WasbHook to support async injection (#54219): @fweilun
• Add CI support for SQLAlchemy 2.0 (#52233): @Dev-iL
  Linked issues:
  • Linked Issue #50960: @potiuk
  • Linked Issue #48953: @potiuk
  • Linked Issue #28723: @potiuk
  • Linked Issue #52663: @Dev-iL
• Made get_conn method async for KiotaRequestAdapterHook to fix AsyncToSync error (#54598): @dabla
• fix unreachable mypy warnings for microsoft/azure (#53647): @fweilun
• Remove portalocker dependency (#54751): @eladkal

Provider mysql: 6.3.4rc1

• Add CI support for SQLAlchemy 2.0 (#52233): @Dev-iL
  Linked issues:
  • Linked Issue #50960: @potiuk
  • Linked Issue #48953: @potiuk
  • Linked Issue #28723: @potiuk
  • Linked Issue #52663: @Dev-iL
• Add optional SQLA logging/diagnostics (#54315): @Dev-iL
  Linked issues:
  • Linked Issue #52233: @Dev-iL

Provider neo4j: 3.10.1rc1

• Improve code of neo4j hook (#54909): @yangyulely

Provider openlineage: 2.7.0rc1

• add tasksDuration to state run facet (#53644): @mobuchowski
• Fix setproctitle usage (#53122): @jason810496
  Linked issues:
  • Linked Issue #52860: @jason810496
• Decouple Serialization and Deserialization Code for tasks (#54569): @kaxil
• Move secrets_masker over to airflow_shared distribution (#54449): @amoghrajesh
• Remove MappedOperator inheritance (#53696): @uranusjr
  Linked issues:
  • Linked Issue #52141: @kaxil
• Update usage of timeout contextmanager from SDK where possible (#54183): @amoghrajesh
• docs: fix broken link on OpenLineage developer section (#54356): @ksoullpwk

Provider oracle: 4.2.0rc1

• feature: Add OpenLineage support for OracleToGCSOperator (#54953): @pawelgrochowicz

Provider postgres: 6.3.0rc1

• Added specialized insert_rows in PostgresHook which uses faster psycopg execute_batch method (#54988): @dabla
• Add support for the psycopg3 postgres driver (#52976): @Dev-iL
  Linked issues:
  • Linked Issue #52233: @Dev-iL
• Implemented native get_column_names in PostgresDialect to become SQLAlchemy independent (#54437): @dabla
• PostgresDialect should use index instead of name in get_column_names and get_primary_keys (#54832): @dabla
• Add CI support for SQLAlchemy 2.0 (#52233): @Dev-iL
  Linked issues:
  • Linked Issue #50960: @potiuk
  • Linked Issue #48953: @potiuk
  • Linked Issue #28723: @potiuk
  • Linked Issue #52663: @Dev-iL

Provider redis: 4.3.0rc2

• AIP-82: Add RedisPubSubMessageQueueProvider (#53556): @Jasperora
  Linked issues:
  • Linked Issue #52712: @jason810496
  • Linked Issue #52917: @Jasperora
• Refactor Common Queue Interface (#54651): @jason810496
  Linked issues:
  • Linked Issue #52712: @jason810496
• make bundle_name not nullable (#47592): @gyli
• Prepare release for Aug 2025 1st wave of providers (#54193): @eladkal

Provider salesforce: 5.11.3rc1

• Fix mypy error for salesforce to_json (#55060): @potiuk
• Use 'orient' kwarg in SalesforceHook (#55056): @uranusjr

Provider samba: 4.11.0rc1

• Added support for Windows paths in SambaHook (#54459): @dabla
• Fix windows path joining in sambahook (#54573): @gopidesupavan

Provider sftp: 5.4.0rc1

• Feature: add optional managed connection (#52700): @Nataneljpwd
• SFTPSensor - add file_pattern to template fields (#54562): @JstFlip
• Fix SFTPAsyncHook to set the default value of no_host_key_check according to documentation (#54763): @VladaZakharova

Provider slack: 9.2.0rc1

• AIP-86 - Add async support for Notifiers (#53831): @ramitkataria

Provider smtp: 2.2.1rc1

• Fix SMTP email template when mark_success_url is undefined for RuntimeTaskInstance objects (#54680): @Kiretori

Provider snowflake: 6.5.3rc1

• fix(snowflake): Improve 422 SQL error message formatting in SnowflakeSqlApiHook (#54063): @Programmer-RD-AI
  Linked issues:
  • Linked Issue #53638: @rawwar

Provider standard: 1.7.0rc1

• Add options_mapping support to HITLBranchOperator (#55093): @cmarteepants
• feat(hitl): update url generating utility (#55022): @Lee-W
• feat(hitl): add utility functions for generating the url to required actions page (#54827): @Lee-W
• Display a more friendly error when invalid branches are provided to b… (#54273): @jroachgolf84
• Add owners/actors/respondents to HITLOperators (#54308): @sjyangkevin
  Linked issues:
  • Linked Issue #54016: @Lee-W
• Fix BranchPythonOperator execution failure when callable returns None (#54991): @kaxil
  Linked issues:
  • Linked Issue #54340: @yershovkiril
• Fix external_python task failure when expect_airflow=False (#54809): @kaxil
• Fix typos in HITL-related code and comments (#54670): @guan404ming
• refactor(hitl): rename HITLDetail.user_id as HITLDetail.responded_user_id and add HITLDetail.responded_user_name (#55019): @Lee-W
• Revert "Fix rendering of template fields with start from trigger" (#55037): @kaxil
  Linked issues:
  • Linked Issue #53071: @dabla
• Change StartTriggerArgs imports (#54856): @uranusjr
• Do not use HITLDetailResponse from core in sdk (#54358): @amoghrajesh
• Remove MappedOperator inheritance (#53696): @uranusjr
  Linked issues:
  • Linked Issue #52141: @kaxil

All users involved in the PRs:
@gyli @dejii @cmarteepants @guan404ming @ksoullpwk @dataengineervishal @Lee-W @uranusjr @MaksYermak @Jasperora @ramitkataria @VladaZakharova @Programmer-RD-AI @jason810496 @Crowiant @amoghrajesh @HsiuChuanHsu @vincbeck @yangyulely @Dev-iL

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[dabla]

I've tested following PR's in Airflow 3.0.6 which work:

• Added specialized insert_rows in PostgresHook which uses faster psycopg execute_batch method #54988
• PostgresDialect should use index instead of name in get_column_names and get_primary_keys #54832
• Fixed resolving of dialect name when host of JdbcHook is an JDBC URL #54446
• Implemented native get_column_names in PostgresDialect to become SQLAlchemy independent #54437

I've tested following PR in Airflow 3.0.6 which I knew wouldn't work due to an issue in the Connection.extra_dejson, I created a new PR to workaround that issue:

• Made get_conn method async for KiotaRequestAdapterHook to fix AsyncToSync error #54598

Following PR works partially in Airflow 3.0.6, only the row_processor is broken, for which I created new PR:

• Add SQLInsertRowsOperator in common.sql provider #55031

[kacpermuda]

#53644, #54748 and #54356 are okay.

[ramitkataria]

#54485 was a refactor with no change in user experience

[jscheffl]

Tested the changes in Edge UI and looks good - a lot of features missing but might need an ad-hoc then again together with 3.1 release or so.

[arvindp25]

tested #53976. work as expected

[hardeybisey]

I am unable to test #47827 due to not having an activate Databricks subscription.

[Dev-iL]

I will be able to check only once 3.1.0 images with python 3.13 are available.

[potiuk]

Checked all my issues. As @Dev-iL mentioned - we will be be able to do some more verification on SQLAlchemy 2 when we have 3.1 out :).

[guan404ming]

Checked all my PR, look good to me.

• Fix SqlToS3Operator _partition_dataframe for proper polars support #54588
• Update HiveToDynamoDBOperator to support Polars #54221
• Update SqlToS3Operator to support Polars and deprecate read_pd_kwargs #54195

[eladkal]

Thank you everyone. Providers are released.

I invite everyone to help improve providers for the next release, a list of open issues can be found here.