Status of testing Providers that were prepared on October 22, 2025

[eladkal]

Body

I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comments, whether the issue is addressed.

These are providers that require testing as there were some substantial changes introduced:

Provider amazon: 9.16.0rc1

• Firehose and kinesis hook in independent file (#56276): @xchwan
  Linked issues:
  • Linked Issue #52712: @jason810496
  • Linked Issue #55955: @xchwan
• Fixed incorrect path in EMR notebook waiter (#56584): @ellisms
• Add poke_mode_only to version_compat to fix the incorrect deprecation warning (#56435): @zachliu
• Refactor: deprecate wait_policy in EmrCreateJobFlowOperator in favor of wait_for_completion (#56158): @laksh-krishna-sharma
  Linked issues:
  • Linked Issue #56153: @vincbeck
• Update UI authentication to handle JWT token in backend (#56633): @vincbeck

Provider apache.beam: 6.1.6rc1

• Fix Dataflow Java system test and link inside the operator (#56286): @VladaZakharova

Provider apache.hive: 9.1.3rc1

• FIX: incorrect access of logical_date in google bigquery operator and google workflow operator (#55110): @obarisk
  Linked issues:
  • Linked Issue #55073: @txu-7777
  • Linked Issue #53634: @obarisk
  • Linked Issue #55092: @kaxil
• Replace sasl with pyhive.get_installed_sasl for pure-sasl compatibility (#55772): @kesem0811

Provider apache.kafka: 1.10.5rc1

• Make AwaitMessageTrigger inherit BaseEventTrigger (#56741): @vincbeck

Provider apache.spark: 5.3.3rc1

• Use ValueError instead of RuntimeError when resolving SparkSubmitHook connection (#56631): @ephraimbuddy

Provider atlassian.jira: 3.2.0rc1

• feat: add async jira notifier (#56326): @dondaum
  Linked issues:
  • Linked Issue #55237: @ferruzzi

Provider celery: 3.13.0rc1

• Add CLI command to remove all queues from Celery worker (#56195): @dheerajturaga

Provider cncf.kubernetes: 10.9.0rc1

• Move container-related functions from PodManager to a separate file (#56700): @AutomationDev85
• KubernetesPodOperator deferred callbacks (#47108): @johnhoran
• Fix KubernetesPodOperator termination_grace_period parameter not being applied to pod spec (#56402): @HsiuChuanHsu
  Linked issues:
  • Linked Issue #56349: @atzannes
• Preserve existing metadata labels (and other fields) in SparkApplication manifest (#56063): @mohamed-mis

Provider common.compat: 1.8.0rc1

• Add SQLA's mapped_column to common-compat (#56880): @Dev-iL
  Linked issues:
  • Linked Issue #56738: @vincbeck
• Add compatibility lazy imports for Airflow 2 to 3 upgrade (#56790): @kaxil

Provider common.io: 1.6.4rc1

• Fix XCom object storage backend path validation (#56244): @amoghrajesh

Provider dbt.cloud: 4.4.4rc1

• Add retry mechanism and error handling to DBT Hook (#56651): @AardJan
  Linked issues:
  • Linked Issue #51801: @rawwar

Provider docker: 4.4.4rc1

• DockerSwarmOperator: Use inspect_service() instead of inspect_container() (#56043): @sealmove
  Linked issues:
  • Linked Issue #56029: @sealmove

Provider edge3: 1.4.0rc1

• Introduce generic Callbacks to support running callbacks on executors (#54796): @ramitkataria
• Add revoke_task implementation to EdgeExecutor for task queued timeout support (#56240): @dheerajturaga
• Bugfix/remove airflow utils deprecations in edge (#56568): @jscheffl
• Fix Edge3 provider navigation with webserver base_url configuration (#56189): @dheerajturaga

Provider fab: 3.0.1rc1

• Update UI authentication to handle JWT token in backend (#56633): @vincbeck
• Werkzeug Version Check (#56398): @utieyin
• SQLA2/FAB: fix some type hints (#56928): @Dev-iL

Provider git: 0.0.9rc1

• Fix corrupted bare Git repository recovery in DAG bundles (#56206): @dheerajturaga

Provider google: 18.1.0rc1

• Deprecate old VertexAI generative model operators and introduce new Generative AI on Vertex AI operators (#56950): @VladaZakharova
• Add support of deferable mode for CloudDataTransferServiceRunJobOperator (#56711): @Crowiant
• Add fail_on_file_not_exist to SFTPToGCSOperator (#56528): @nguy4130
• Add GCS Dag bundle (unversioned) (#55919): @shahar1
  Linked issues:
  • Linked Issue #55909: @shahar1
• Add use_rest_api parameter for CloudComposerDAGRunSensor for pulling dag_runs using the Airflow REST API (#56138): @MaksYermak
• feature: Add Open Lineage support for CloudDataFusionStartPipelineOperator (#56365): @pawelgrochowicz
• feature: Add OpenLineage support for SpannerQueryDatabaseInstanceOperator (#56348): @pawelgrochowicz
• feature: Add OpenLineage support for CloudDataTransferServiceS3ToGCSOperator (#55946): @pawelgrochowicz
• let PubsubPullTrigger exceptions propagate to triggerer framework (#56400): @dejii
• Fix AsyncToSync call in Google provider (#56363): @VladaZakharova
• FIX: incorrect access of logical_date in google bigquery operator and google workflow operator (#55110): @obarisk
  Linked issues:
  • Linked Issue #55073: @txu-7777
  • Linked Issue #53634: @obarisk
  • Linked Issue #55092: @kaxil
• Prefer BigQueryInsertJobOperator's project_id over hook's project_id for openlineage (#55948): @BasPH
• Fix ValueError in operators in Google provider (#55821): @VladaZakharova
• Deprecate CreateAutoMLVideoTrainingJobOperator in google provider (#56282): @Crowiant
• Refactor CloudSQLDatabaseHook.create_connection (#56323): @Crowiant
• Support google ads v21 in google provider (#56012): @Crowiant

Provider http: 5.4.0rc1

• Create HttpEventTrigger for AssetWatcher library (#51253): @karenbraganz

Provider jenkins: 4.1.4rc1

• Handle get_queue_info todo in JenkinsJobTriggerOperator (#54207): @sjyangkevin

Provider keycloak: 0.2.0rc1

• Integrate KeycloakAuthManager with airflowctl (#55969): @bugraoz93
• Update refresh token flow (#55506): @vincbeck
• Update UI authentication to handle JWT token in backend (#56633): @vincbeck

Provider microsoft.azure: 12.8.0rc1

• Add msgraphfs to the Microsoft Azure provider (#55454): @bolkedebruin
• Reapply "update AzureBaseHook to return credentials that supports get_token method" (#56228): @karunpoudel
  Linked issues:
  • Linked Issue #52182: @karunpoudel
• Improve exception handling in AzureDataFactoryTrigger (#56350): @m1racoli

Provider openlineage: 2.7.3rc1

• Fix openlineage dag state event emit on timed out dag (#56542): @antonlin1
• Only import OL plugin listeners/hooks if OL is enabled (#56266): @jedcunningham
• nit: Bump required OL client to 1.38 for Openlineage provider (#56302): @kacpermuda
• chore: safeguard external call in OL sqlparser (#55692): @kacpermuda

Provider pagerduty: 5.1.0rc1

• feat: add async pagerduty notifier (#56540): @dondaum
  Linked issues:
  • Linked Issue #55237: @ferruzzi

Provider postgres: 6.4.0rc1

• Azure IAM/Entra ID support for PostgresHook (#55729): @karunpoudel
  Linked issues:
  • Linked Issue #52182: @karunpoudel

Provider slack: 9.4.0rc1

• feat: async slack notifier (#56685): @dondaum

Provider snowflake: 6.6.0rc1

• Azure IAM/Entra ID support for SnowflakeHook (#55874): @karunpoudel
  Linked issues:
  • Linked Issue #52182: @karunpoudel
• Complete snowflake-snowpark-python pip resolver hint (#56606): @notatallshaw
• added the path for the how-to-guide docs for copy into Snowflake (#56527): @Srivats7

Provider standard: 1.9.1rc1

• Throw NotImplementedError error when fail_when_dag_is_paused is used in TriggerDagRunOperator with Airflow 3.x (#56965): @gopidesupavan

Provider teradata: 3.2.2rc1

• Fix mypy type errors in Teradata provider for SQLAlchemy 2 upgrade (#56861): @RoyLee1224
  Linked issues:
  • Linked Issue #56738: @vincbeck
• Improve error messages in Teradata provider (#56367): @sc250072
• Build correct SQLAlchemy URI in Teradata Hook (#56305): @sc250072

Provider vertica: 4.1.3rc1

• Fix: Handle SQLAlchemy_URI for Vertica Provider (#55928): @Pyasma
  Linked issues:
  • Linked Issue #38195: @Taragolis

All users involved in the PRs:
@AutomationDev85 @dejii @johnhoran @kacpermuda @RoyLee1224 @ephraimbuddy @BasPH @dheerajturaga @m1racoli @sjyangkevin @sc250072 @nguy4130 @dondaum @sealmove @Pyasma @antonlin1 @laksh-krishna-sharma

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[bugraoz93]

My changes look good. Thanks Elad!

[karenbraganz]

@eladkal I tested my PR for the HTTP provider on Breeze. Confirming that it's working.

[jscheffl]

Tested current Edge in the release and needed to realize that the fixes break the UI Plugin in Airflow 3.1.1rc1. Looks like this:

Reason seems to be the change DOM routing which was a fix to enable internal links. I attempted multiple ways to make a fix that is also backwards compatible. Also discussed with @pierrejeambrun seems to be a breaking fix between 3.1.0 and 3.1.1(rc1).

So the 1.4.0rc1 (Plugin UI) is "broken" with Airflow 3.1.1(++) and is only working with Airflow <= 3.1.0 :-(
(Note: Only UI Plugin: Edge in general is working but you can not manage).

I am attempting to fix this in #55642 - but the UI plugin therefore also needs a breaking change and the fixed provider will not work with Airflow 3.1.0 (but all other versions).

So potentially we need to cut another version of edge alongside 3.1.1 release :-( FYI @kaxil

[dondaum]

I have successfully tested all my changes with Airflow==3.1.0:
#56326
#56540
#56685

I installed the pre-release provider packages and ran some DAGs. They successfully sent asynchronous notifications for Slack and Jira.

For Pagerduty, I can confirm that the source code looks good.

Everything looks good from my side ✅

[ramitkataria]

#54796 had a minor change of order in API but no change in user experience ✅

[karunpoudel]

Tested following successfully on Airflow 2.11.0
#56228 Reapply "update AzureBaseHook to return credentials that supports get_token method" #52182
#55729 Azure IAM/Entra ID support for PostgresHook
#55874 Azure IAM/Entra ID support for SnowflakeHook

[m1racoli]

Successfully tested #56350 ✅

[dejii]

Successfully tested #56400 ✅

[RoyLee1224]

Successfully tested #56861 ✅

[sjyangkevin]

Successfully tested #54207 ✅

1. Set up: running Jenkins in Docker locally and use the same network as airflow (i.e., breeze_default)
2. Jenkins URL set to http://localhost:8080/
3. Create a freestyle project called generate-merlin-config and let it accept two parameters following the ones in example DAG
4. Update the example DAG to use the Jenkins connection, and run DAG

[kacpermuda]

My changes look good, thanks !

[zachliu]

Successfully tested #56435 ✅

---

Found another 🐛 while testing the providers-amazon 9.16.0rc1, here is the fix #57159