Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add proxy startup and liveness probe config. #3450

Merged
merged 1 commit into from
Jan 11, 2024

Conversation

hashi-derek
Copy link
Member

@hashi-derek hashi-derek commented Jan 8, 2024

This PR adds in two new consul.hashicorp.com/sidecar-proxy-startup-failure-seconds and consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds annotations that are disabled by default.

When set to a value greater than zero, these configurations will enable their corresponding startup / liveness probes for the Envoy proxy. This helps to prevent scenarios where the Envoy proxy would hang and never recover.

Due to the difficult nature of testing this particular scenario, manual testing was performed on modified consul-server code to ensure that the probes would trigger a restart of the consul-dataplane container when unhealthy.

@hashi-derek hashi-derek force-pushed the derekm/NET-6858/failure-probe-config branch from a2a3912 to 1c9d2c7 Compare January 9, 2024 20:32
@hashi-derek hashi-derek requested review from a team, david-yu and wilkermichael and removed request for a team January 9, 2024 21:10
Copy link
Contributor

@david-yu david-yu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, would need an associated PR for docs

This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.
@hashi-derek hashi-derek force-pushed the derekm/NET-6858/failure-probe-config branch from 1c9d2c7 to f80723a Compare January 10, 2024 20:28
@hashi-derek hashi-derek added backport/1.1.x Backport to release/1.1.x branch backport/1.2.x This release branch is no longer active. backport/1.3.x labels Jan 11, 2024
@hashi-derek hashi-derek marked this pull request as ready for review January 11, 2024 18:21
@hashi-derek hashi-derek merged commit 202ba1f into main Jan 11, 2024
56 of 57 checks passed
@hashi-derek hashi-derek deleted the derekm/NET-6858/failure-probe-config branch January 11, 2024 18:21
hashi-derek added a commit that referenced this pull request Jan 11, 2024
This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.
hashi-derek added a commit that referenced this pull request Jan 11, 2024
This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.
hashi-derek added a commit that referenced this pull request Jan 12, 2024
This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.
hashi-derek added a commit that referenced this pull request Jan 12, 2024
This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.
hashi-derek added a commit that referenced this pull request Jan 12, 2024
…/1.2.x (#3468)

Add proxy startup and liveness probe config. (#3450)

This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.

Co-authored-by: Derek Menteer <105233703+hashi-derek@users.noreply.github.com>
hashi-derek added a commit that referenced this pull request Jan 12, 2024
…/1.1.x (#3467)

* Add proxy startup and liveness probe config. (#3450)

This PR adds in two new
`consul.hashicorp.com/sidecar-proxy-startup-failure-seconds` and
`consul.hashicorp.com/sidecar-proxy-liveness-failure-seconds` annotations that
are disabled by default.

When set to a value greater than zero, these configurations will enable their
corresponding startup / liveness probes for the Envoy proxy. This helps to
prevent scenarios where the Envoy proxy would hang and never recover.

* Fix potential test deadlock.

---------

Co-authored-by: Derek Menteer <105233703+hashi-derek@users.noreply.github.com>
Co-authored-by: Derek Menteer <derek.menteer@hashicorp.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport/1.1.x Backport to release/1.1.x branch backport/1.2.x This release branch is no longer active. backport/1.3.x
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Set startupProbe on consul-dataplane container (injected as part of the Service Mesh implementation)
4 participants