-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Description
Body
I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
Verify providers by contributors
Let us know in the comments, whether the issue is addressed.
These are providers that require testing as there were some substantial changes introduced:
Provider alibaba: 3.2.3rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
Provider amazon: 9.14.0rc1
- Implement
batch_is_authorized_methods in AWS auth manager (#55307): @vincbeck
Linked issues: - Add configurable confirm parameter to S3ToSFTPOperator (#55569): @harsh481
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
- Catch a couple other 404/401 issues for Bedrock Operators (#55445): @o-nikolas
- EcsRunTaskOperator fails when no containers are provided in the response (#51692): @dominikhei
Linked issues: - Fix(4561) - AWS BatchOperator does not fetch log entries for deferred jobs (#55703): @yash1thsa
Linked issues: - List only connections, pools and variables the user has access to (#55298): @vincbeck
- AIP-67 - Multi-team: Per team executor config (env var only) (#55003): @o-nikolas
- Allow SSM operators and sensors to run in deferrable mode (#55649): @seanghaeli
Provider apache.beam: 6.1.5rc1
- Disable links for beam provider operators using non-dataflow runner (#55248): @olegkachur-e
- remove the 'provide_authorized_glcoud' from BeamPipeline operators (#55453): @olegkachur-e
Provider apache.hdfs: 4.10.3rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
Provider apache.kafka: 1.10.4rc1
Provider apache.livy: 4.4.3rc1
Provider cncf.kubernetes: 10.8.1rc1
- Fix: Add task context labels to driver and executor pods for SparkKubernetesOperator reattach_on_restart functionality (#41211) (#50803): @asb108
Linked issues: - Add more error handling in pod_manager consume_logs (#55479): @o-nikolas
- [KubernetesPodOperator] Add more robust reading of the container statuses (#55371): @AutomationDev85
- Fix circular import error when Kubernetes executors are dynamically loaded with Sentry (#55809): @kaxil
- Move the KubernetesPodOperator 'convert_config_file_to_dict' call (#55064): @olegkachur-e
- Fix kpo log_events_on_failure logs warnings at warning level (#54967): @ketozhang
Linked issues:
Provider common.compat: 1.7.4rc1
Provider common.io: 1.6.3rc1
- Fix circular import when using
XComObjectStorageBackend(#55805): @kaxil
Linked issues: - Make term Dag consistent in providers docs (#55101): @jscheffl
Provider common.sql: 1.28.1rc1
Provider databricks: 7.7.3rc1
Provider docker: 4.4.3rc1
- Fix version_compat for Airflow 3.0.X (#55447): @morgan-dgk
Linked issues: - Make term Dag consistent in providers docs (#55101): @jscheffl
Provider edge3: 1.3.0rc1
- Add Color Scheme to all Operations Buttons in Edge React UI (#55637): @jscheffl
Linked issues: - Add shutdown-all-workers command to Edge CLI (#55626): @dheerajturaga
- Add queue management UI buttons for Edge workers (#55625): @dheerajturaga
- Add Worker Maintenance Comment Change to React UI (#55547): @jscheffl
- feat: Add delete button for offline edge workers (#55529): @dheerajturaga
- feat: Add shutdown button for edge workers with confirmation dialog (#55513): @dheerajturaga
- Add confirmation dialog for exit maintenance action in Edge Worker Page (#55400): @dheerajturaga
- Add Links to Edge React UI (#55356): @jscheffl
- Feature/edge maintenance plugin beautification (#55348): @jscheffl
- Add worker maintenance mode functionality to Edge3 provider UI (#55301): @dheerajturaga
- Fix EdgeWorker multiprocessing pickle error on Windows (#55284): @dheerajturaga
- Pick/vite vitest full (#55623): @KatalKavya96
Linked issues: - Adjust Edge color scheme after merge of PR #53981 (#55485): @jscheffl
Linked issues:
Provider elasticsearch: 6.3.3rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
- Make term Dag consistent in providers docs (#55101): @jscheffl
Provider exasol: 4.8.3rc1
- Fix SqlAlchemy URI Construction in ExasolHook (#53798): @BrianLii
Linked issues:
Provider fab: 2.4.3rc1
- Fix: Clean up FAB permissions when deleting DAGs (#54528): @HsiuChuanHsu
Linked issues: - Remove SDK dependency from SerializedDAG (#55538): @uranusjr
Linked issues:
Provider git: 0.0.8rc1
- Fix https access token repo url (#54643): @adrian-edbert
Linked issues:
Provider google: 18.0.0rc1
- Feat ol bigquery to postgres operatorfeature: Add OpenLineage support for BigQueryToPostgresOperator (#55392): @pawelgrochowicz
- feature: Add OpenLineage support for BigQueryToMySqlOperator (#55219): @pawelgrochowicz
- Add range partitioning option to bigquery operators (#55247): @kianelbo
Linked issues: - Add CloudComposerTriggerDAGRunOperator for Cloud Composer service (#55256): @MaksYermak
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
- Add conversion to timedelta type for self.timeout value for CloudComposerDAGRunSensor (#55570): @MaksYermak
- Fix Cloud Run async hooks (inc. unit tests) (#55321): @shahar1
Linked issues: - Change CloudComposerAsyncHook to inherit from GoogleBaseAsyncHook instead of GoogleBaseHook. (#54976): @Crowiant
- 🩹 fix: Use GoogleBaseAsyncHook (#55316): @morgan-dgk
Linked issues:
Provider jenkins: 4.1.3rc1
- Fix: Make Jenkins connection schema visible (#55444): @RoyLee1224
Linked issues: - Make term Dag consistent in providers docs (#55101): @jscheffl
Provider microsoft.azure: 12.7.1rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
- Avoid using extra_dejson method on connection in KiotaRequestAdapterHook to avoid AsyncToSync RuntimeError (#55179): @dabla
Provider microsoft.psrp: 3.1.3rc1
Provider openlineage: 2.7.1rc1
- fix: prevent user facets from overriding OL facets (#55765): @kacpermuda
- Remove SDK dependency from SerializedDAG (#55538): @uranusjr
Linked issues: - Decouple secrets_masker project from airflow configuration (#55259): @amoghrajesh
Linked issues:
Provider opensearch: 1.7.3rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
Provider papermill: 3.11.3rc1
- Bump mypy to 1.18.1 (#55596): @gopidesupavan
- Make term Dag consistent in providers docs (#55101): @jscheffl
Provider redis: 4.3.1rc1
- [OSSTaskHandler, CloudwatchTaskHandler, S3TaskHandler, HdfsTaskHandler, ElasticsearchTaskHandler, GCSTaskHandler, OpensearchTaskHandler, RedisTaskHandler, WasbTaskHandler] supports log file size handling (#55455): @AutomationDev85
Provider slack: 9.3.0rc1
Provider smtp: 2.3.0rc1
Provider standard: 1.8.0rc1
- feat(hitl): get rid off "Fallback to defaults" in HITL (#55536): @Lee-W
- feat(hitl): add fail_on_reject to ApprovalOperator (#55255): @Lee-W
- fix(hitl): make the user model in HITLDetail consistent with airflow user model (#55463): @Lee-W
- HITL: Resolve Conflict 409 in API server when user actions at nearly timeout (#55243): @sjyangkevin
Linked issues: - fix(HITL): timeout error handling (#55760): @Lee-W
- refactor(hitl): rename response_at to responded_at (#55535): @Lee-W
- refactor(hitl): remove AirflowException from HITLTriggerEventError inheritance (#55763): @Lee-W
All users involved in the PRs:
@Crowiant @Lee-W @sjyangkevin @MaksYermak @kacpermuda @adrian-edbert @shahar1 @olegkachur-e @AutomationDev85 @RoyLee1224 @kianelbo @kaxil @xchwan @javierherrer @amoghrajesh @gopidesupavan @dheerajturaga @o-nikolas @HsiuChuanHsu @pawelgrochowicz @morgan-dgk @harsh481 @jscheffl @vincbeck @yash1thsa @seanghaeli @ferruzzi @uranusjr @KatalKavya96 @asb108 @dabla @
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.