Fix deferrable mode in CloudRunExecuteJobOperator#61546
Merged
shahar1 merged 1 commit intoapache:mainfrom Feb 10, 2026
Merged
Conversation
10b9ab7 to
acd39c4
Compare
MaksYermak
reviewed
Feb 9, 2026
Contributor
MaksYermak
left a comment
There was a problem hiding this comment.
In general this PR looks good to me, only small note about tag in System Test for documentation.
@VladaZakharova @olegkachur-e what do you think?
providers/google/tests/system/google/cloud/cloud_run/example_cloud_run.py
Outdated
Show resolved
Hide resolved
olegkachur-e
reviewed
Feb 9, 2026
providers/google/tests/unit/google/cloud/hooks/test_cloud_run.py
Outdated
Show resolved
Hide resolved
dabla
reviewed
Feb 9, 2026
providers/google/tests/unit/google/cloud/hooks/test_cloud_run.py
Outdated
Show resolved
Hide resolved
dabla
reviewed
Feb 9, 2026
providers/google/tests/unit/google/cloud/hooks/test_cloud_run.py
Outdated
Show resolved
Hide resolved
dabla
reviewed
Feb 9, 2026
providers/google/tests/unit/google/cloud/hooks/test_cloud_run.py
Outdated
Show resolved
Hide resolved
dabla
reviewed
Feb 9, 2026
providers/google/tests/unit/google/cloud/hooks/test_cloud_run.py
Outdated
Show resolved
Hide resolved
dabla
approved these changes
Feb 9, 2026
potiuk
approved these changes
Feb 9, 2026
7f0186b to
aa3b59d
Compare
aa3b59d to
d6d33d5
Compare
81 tasks
Ratasa143
pushed a commit
to Ratasa143/airflow
that referenced
this pull request
Feb 15, 2026
choo121600
pushed a commit
to choo121600/airflow
that referenced
this pull request
Feb 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
related: #60394
Bug description
PR #60394 introduced the
transportparameter forCloudRunExecuteJobOperator, but unfortunately it broke its deferrable mode.There were two underlying issues:
transporttype of the async hook connection isgrpc_asyncio(notgrpc), which is more optimized to work with async logic (in fact, the only way - see below).transportother thangrpc_asyncio- the returnedOperationobject is not awaitable.The combination of those issues caused the
TypeError: Operation can't be used in 'await' expressionwhen we ran the opeartor in deferrable mode.Proposed solutions
grpc, we now usegrpc_asyncioin the underlying async client.rest, we now call the sync client on a backround thread when polling the operation. This is a workaround, as the returnedOperationmust be awaitable.Extra details
resttransport (sync + async).grpcwhen possible and including the caveat of rest transport in deferrable mode.Discussion points
restin its current state? While we could revert to an implementation where I actually prohibited it, I thought that would be useful as a "last resort" for those who can't run withgrpc(which is probably the only reason people actually needresttransport at all).@VladaZakharova @MaksYermak - As we had already released the
transportfeature, I wanted to avoid making sudden breaking changes by reverting the original PR, so I preferred just to fix the issue instead. I intend to include it in the upcoming release on Tuesday, so I'll appreciate if you could review it by Monday.Was generative AI tooling used to co-author this PR?
Generated-by: Claude Sonnet 4.5 following the guidelines
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.