Troubles Getting v1.21.1 Working

[spjmurray]

What happened:

I added the new tag to my Jenkins matrix build and Kind failed to come up

What you expected to happen:

A big beautiful pass!

How to reproduce it (as minimally and precisely as possible):

I'm using ubuntu 20.04 locally. Just a basic kind create cluster --image kindest/node:v1.21.1 goes awry.

Anything else we need to know?:

I did a bit of poking about and got...

root@test-control-plane:/# journalctl -u kubelet
-- Logs begin at Tue 2021-05-18 09:59:58 UTC, end at Tue 2021-05-18 10:27:18 UTC. --
May 18 09:59:58 test-control-plane systemd[1]: Condition check resulted in kubelet: The Kubernetes Node A
gent being skipped.
May 18 10:00:00 test-control-plane systemd[1]: Starting kubelet: The Kubernetes Node Agent...
May 18 10:00:00 test-control-plane systemd[1]: Started kubelet: The Kubernetes Node Agent.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --fail-swap-on has been deprecated, This parameter 
should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/doc
s/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --provider-id has been deprecated, This parameter s
hould be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs
/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --fail-swap-on has been deprecated, This parameter 
should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/doc
s/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --cgroup-root has been deprecated, This parameter s
hould be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs
/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: I0518 10:00:01.003712     252 server.go:197] "Warning: F
or remote container runtime, --pod-infra-container-image is ignored in kubelet, which should be set in th
at remote runtime instead"
May 18 10:00:01 test-control-plane kubelet[252]: Flag --fail-swap-on has been deprecated, This parameter 
should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/doc
s/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --provider-id has been deprecated, This parameter s
hould be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs
/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --fail-swap-on has been deprecated, This parameter 
should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/doc
s/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: Flag --cgroup-root has been deprecated, This parameter s
hould be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs
/tasks/administer-cluster/kubelet-config-file/ for more information.
May 18 10:00:01 test-control-plane kubelet[252]: I0518 10:00:01.232789     252 server.go:440] "Kubelet ve
rsion" kubeletVersion="v1.21.1"
May 18 10:00:01 test-control-plane kubelet[252]: I0518 10:00:01.233079     252 server.go:851] "Client rot
ation is on, will bootstrap in background"
May 18 10:00:01 test-control-plane kubelet[252]: I0518 10:00:01.235753     252 dynamic_cafile_content.go:
167] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
May 18 10:00:01 test-control-plane kubelet[252]: E0518 10:00:01.244308     252 certificate_manager.go:437
] Failed while requesting a signed certificate from the master: cannot create certificate signing request
: Post "https://test-control-plane:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp
 172.18.0.3:6443: connect: connection refused
May 18 10:00:03 test-control-plane kubelet[252]: E0518 10:00:03.352602     252 certificate_manager.go:437
] Failed while requesting a signed certificate from the master: cannot create certificate signing request
: Post "https://test-control-plane:6443/apis/certificates.k8s.io/v1/certificatesigningrequests": dial tcp
 172.18.0.3:6443: connect: connection refused
May 18 10:00:06 test-control-plane kubelet[252]: E0518 10:00:06.276821     252 server.go:292] "Failed to 
run kubelet" err="failed to run Kubelet: invalid configuration: cgroup-root [\"kubelet\"] doesn't exist"
May 18 10:00:06 test-control-plane systemd[1]: kubelet.service: Main process exit
ed, code=exited, status=1/FAILURE
May 18 10:00:06 test-control-plane systemd[1]: kubelet.service: Faile
d with result 'exit-code'.

Environment:

• kind version: 0.9.0 and 0.10.0
• Kubernetes version: 1.21.0
• Docker version: 20.10.2
• OS : ubunut (deliberate typo, cos it sounds fun!) focal (20.04 LTS)

[atoato88]

I'm facing same issue.

[BenTheElder]

#2236

it won't work on these older versions due to a breaking change in kubernetes upstream
you'll need kind v0.11, being released today.

[BenTheElder]

https://github.com/kubernetes-sigs/kind/releases/tag/v0.11.0#contributors out now

[atoato88]

@BenTheElder
I confirmed that kind v0.11.0 works with kubernetes v1.21.1!!
Thank you to fix!!

[BenTheElder]

great! sorry this took so long to get in a tagged release 😅