[Release-1.27] - Stopping service on ControlPlane node causes other nodes to go NotReady

[brandond]

Backport fix for Stopping service on ControlPlane node causes other nodes to go NotReady

• Stopping service on ControlPlane node causes other nodes to go NotReady #9910

[fmoral2]

Validated on Version:

-$ k3s version v1.27.12+k3s-2d48b196 (2d48b196)

Environment Details

Infrastructure
Cloud EC2 instance

Node(s) CPU architecture, OS, and Version:
SUSE Linux Enterprise Server 15 SP4

Cluster Configuration:
Split roles:

• 2 cp only
• 2 etcd
• 1 worker

Steps to validate the fix

1. create split roles cluster
2. Stop server on one of the cp only
3. check other nodes
4. validate no other node is not ready or inactive
5. validate pods

Reproduction Issue:

Validation Results:

       
       
- `Tried from 2 diff control plane nodes. It only stops the requested one.`

CP -2 
$ kubectl get nodes
NAME                                          STATUS     ROLES                       AGE   VERSION
ip-172-31-0-80.us-east-2.compute.internal     Ready      etcd                        14m   v1.27.12+k3s-2d48b196
ip-172-31-1-21.us-east-2.compute.internal     Ready      control-plane,master        14m   v1.27.12+k3s-2d48b196
ip-172-31-12-104.us-east-2.compute.internal   Ready      <none>                      12m   v1.27.12+k3s-2d48b196
ip-172-31-14-103.us-east-2.compute.internal   Ready      <none>                      12m   v1.27.12+k3s-2d48b196
ip-172-31-15-103.us-east-2.compute.internal   NotReady   control-plane,master        14m   v1.27.12+k3s-2d48b196
ip-172-31-4-156.us-east-2.compute.internal    Ready      <none>                      11m   v1.27.12+k3s-2d48b196
ip-172-31-5-224.us-east-2.compute.internal    Ready      etcd                        14m   v1.27.12+k3s-2d48b196
ip-172-31-7-127.us-east-2.compute.internal    Ready      control-plane,etcd,master   17m   v1.27.12+k3s-2d48b196


CP -1 
$ kubectl get nodes
NAME                                          STATUS     ROLES                       AGE   VERSION
ip-172-31-0-80.us-east-2.compute.internal     Ready      etcd                        15m   v1.27.12+k3s-2d48b196
ip-172-31-1-21.us-east-2.compute.internal     NotReady   control-plane,master        15m   v1.27.12+k3s-2d48b196
ip-172-31-12-104.us-east-2.compute.internal   Ready      <none>                      13m   v1.27.12+k3s-2d48b196
ip-172-31-14-103.us-east-2.compute.internal   Ready      <none>                      13m   v1.27.12+k3s-2d48b196
ip-172-31-15-103.us-east-2.compute.internal   Ready      control-plane,master        15m   v1.27.12+k3s-2d48b196
ip-172-31-4-156.us-east-2.compute.internal    Ready      <none>                      12m   v1.27.12+k3s-2d48b196
ip-172-31-5-224.us-east-2.compute.internal    Ready      etcd                        15m   v1.27.12+k3s-2d48b196
ip-172-31-7-127.us-east-2.compute.internal    Ready      control-plane,etcd,master   18m   v1.27.12+k3s-2d48b196