Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kpoof daemon just stop working sometimes #19

Open
gerbil opened this issue Apr 17, 2020 · 4 comments
Open

kpoof daemon just stop working sometimes #19

gerbil opened this issue Apr 17, 2020 · 4 comments

Comments

@gerbil
Copy link

gerbil commented Apr 17, 2020

I can see random connection issues with kpood daemon on my local kuber cluster, without any reasons.. it just stops working so i need to restart it.
any ideas how can i troubleshoot this?

@lypht
Copy link
Member

lypht commented Apr 17, 2020

Are other long-running processes also timing out? Is the local cluster running on a laptop with any power-saving mode (clam-shell close, for example)? The daemon doesn't withstand power cycles or similar OS-governed processes.

@gerbil
Copy link
Author

gerbil commented Apr 22, 2020

Nope, it's centos based cluster on vms in my dc; All kubeletes running with connection timeout=0

@gerbil
Copy link
Author

gerbil commented May 5, 2020

Weird stuff, sometime in the middle of the night:
E0503 02:16:58.605281 5471 portforward.go:233] lost connection to pod

How can i detect those failures and fix them automagically?

@lypht
Copy link
Member

lypht commented May 24, 2020

By any chance are you doing large pipes to the pod, such as from a mongodump or similar? If the throughput is greater than the pod can handle, it will close the connection.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants