Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Probe wget calls are missing a timeout #377

Closed
burmanm opened this issue Jul 15, 2022 · 0 comments · Fixed by #373
Closed

Probe wget calls are missing a timeout #377

burmanm opened this issue Jul 15, 2022 · 0 comments · Fixed by #373
Labels
backport Feature requires backporting to older release branches bug Something isn't working

Comments

@burmanm
Copy link
Contributor

burmanm commented Jul 15, 2022

What happened?
When management-api is configured to use mutual TLS authentication, we are unable to use Kubernetes' httpGet for liveness and readiness probes, since Kubernetes does not allow us to use mutual auth TLS. Thus, in this case we replace the calls by executing wget on the pod that then has access to both of these certificates (since they're mounted to the pods).

If the calls never reach the target for some reason, this wget call was never exiting itself. This caused multiple wget processes to live in the pod, as they would live longer than the interval for those calls.

Did you expect to see something different?
Each wget call should have a timeout that's shorter than (or equal to) the probing interval.

How to reproduce it (as minimally and precisely as possible):

Environment

  • Cass Operator version:

    Insert image tag or Git SHA here

    * Kubernetes version information:

    kubectl version

    * Kubernetes cluster kind:
insert how you created your cluster: kops, bootkube, etc.
  • Manifests:
insert manifests relevant to the issue
  • Cass Operator Logs:
insert Cass Operator logs relevant to the issue here

Anything else we need to know?:

┆Issue is synchronized with this Jira Task by Unito
┆friendlyId: K8SSAND-1667
┆priority: Medium

@burmanm burmanm added the bug Something isn't working label Jul 15, 2022
@sync-by-unito sync-by-unito bot changed the title wget calls are missing a timeout K8SSAND-1667 ⁃ wget calls are missing a timeout Jul 15, 2022
@burmanm burmanm changed the title K8SSAND-1667 ⁃ wget calls are missing a timeout Probe wget calls are missing a timeout Jul 15, 2022
@burmanm burmanm added the backport Feature requires backporting to older release branches label Jul 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport Feature requires backporting to older release branches bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant