Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add timeout when watching pod events in k8s executor #39551

Merged
merged 4 commits into from
May 15, 2024

Conversation

dstandish
Copy link
Contributor

If we don't set a timeout, it may hang indefinitely if there's a network issue.

Copy link
Member

@hussein-awala hussein-awala left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@dirrao dirrao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

dstandish and others added 3 commits May 13, 2024 22:17
If we don't set a timeout, it may hang indefinitely if there's a network issue.
…r_utils.py

Co-authored-by: Ryan Hatter <25823361+RNHTTR@users.noreply.github.com>
@dstandish dstandish force-pushed the add-timeout-when-reading-pod-events branch from 654739b to 54a3fe0 Compare May 14, 2024 06:13
@collinmcnulty
Copy link
Contributor

Should this be marked as closes #36998 ?

@dstandish
Copy link
Contributor Author

Should this be marked as closes #36998 ?

it's not obvious to me how this would be connected to that issue

@dstandish dstandish merged commit 610747d into apache:main May 15, 2024
49 checks passed
@dstandish dstandish deleted the add-timeout-when-reading-pod-events branch May 15, 2024 16:23
@RNHTTR RNHTTR mentioned this pull request May 17, 2024
2 tasks
Comment on lines +156 to +157
kwargs["_request_timeout"] = client_timeout
kwargs["timeout_seconds"] = server_conn_timeout
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These settings were configurable using the AIRFLOW__KUBERNETES_EXECUTOR__KUBE_CLIENT_REQUEST_ARGS env variable, but now they are overridden if I'm not mistaken. Is this expected?

@dstandish dstandish added this to the Airflow 2.10.0 milestone Jul 18, 2024
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
If we don't set a timeout, it may hang indefinitely if there's a network issue.

---------

Co-authored-by: Ryan Hatter <25823361+RNHTTR@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:providers provider:cncf-kubernetes Kubernetes provider related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants