Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a solution to InternalError webhook context timedout #1558

Merged
merged 4 commits into from
Jun 29, 2022

Conversation

justmike1
Copy link
Contributor

Context

#1527

@toast-gear
Copy link
Collaborator

Add the entry to the pages index

Comment on lines 42 to 43
kubectl delete mutatingwebhookconfiguration actions-runner-controller-mutating-webhook-configuration
kubectl delete validatingwebhookconfiguration actions-runner-controller-validating-webhook-configuration
Copy link
Collaborator

@mumoshu mumoshu Jun 24, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey! Thanks for your contribution.
To be clear, this isn't always correct.
context deadline exceeded on mutation and validation can happen for two reasons:

  • Your K8s control-plane is somehow unable to access the K8s service's clusterIP associated with the admission webhook server (of ARC)
    • Possible causes: (1)You're running apiserver as a binary and you didn't make service cluster IPs available to the host network or (2)You're running the apiserver in the pod but your pod network (i.e. CNI plugin installation and config) is not good so your pods(like kube-apiserver) in the K8s control-plane nodes can't access ARC's admission webhook server pod(s) in probably data-plane nodes
  • Your cluster has dangling "admissionwebhookconfiguration" and "validatingwebhookconfiguration" from probably previous installation of ARC
    • In that case, isolate the dangling resources by running kubectl get {mutating,validating}webhookconfiguration and only after that, delete only outdated ones like this solution

That said, I'm unsure how I can reorganize my full explanation to a more approachable guide. So... I'd greatly appreciate it if you could somehow enhance this guide to reflect the above 🙏 Thanks!

Copy link

@mikejoseph-ef mikejoseph-ef Jun 25, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Np!

Edit: done.
It is hard to sort it out but I did it in a way that would be considered fine if I was going through it for the first time or such... hopefully that suits what you wanted...

@justmike1 justmike1 requested a review from mumoshu June 25, 2022 15:25
Copy link
Collaborator

@mumoshu mumoshu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks a lot for your contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants