Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubernetes investigate: running the control plane 1-2 versions ahead of the worker nodes - skew policy #84

Open
obriensystems opened this issue Dec 20, 2024 · 1 comment
Assignees

Comments

@obriensystems
Copy link
Member

obriensystems commented Dec 20, 2024

Some kubernetes providers push towards the latest (currently 1.32) version. Staying on an older version can cause extended support finops issues.

https://aws.amazon.com/blogs/containers/amazon-eks-extended-support-for-kubernetes-versions-pricing/
see AWS cluster insights
https://docs.aws.amazon.com/eks/latest/userguide/cluster-insights.html

we are used to kubectl skew, test out skew on the cluster with ideally workloads using services near or at deprecation
https://kubernetes.io/releases/version-skew-policy/

@obriensystems obriensystems self-assigned this Dec 20, 2024
@obriensystems
Copy link
Member Author

obriensystems commented Dec 20, 2024

EKS testing 1.30 to 1.31 upgrade

michaelobrien@mbp8 src % kubectl get nodes         
NAME                            STATUS                        ROLES    AGE     VERSION
ip-172-31-23-127.ec2.internal   Ready                         <none>   9m13s   v1.31.3-eks-59bf375
ip-172-31-27-5.ec2.internal     Ready                         <none>   15m     v1.31.3-eks-59bf375
ip-172-31-32-235.ec2.internal   Ready                         <none>   10m     v1.31.3-eks-59bf375
ip-172-31-57-166.ec2.internal   Ready                         <none>   13m     v1.31.3-eks-59bf375
ip-172-31-62-13.ec2.internal    Ready                         <none>   11m     v1.31.3-eks-59bf375
ip-172-31-72-105.ec2.internal   Ready                         <none>   15m     v1.31.3-eks-59bf375
ip-172-31-74-176.ec2.internal   Ready                         <none>   12m     v1.31.3-eks-59bf375
ip-172-31-80-165.ec2.internal   NotReady,SchedulingDisabled   <none>   56d     v1.30.4-eks-a737599
ip-172-31-87-114.ec2.internal   Ready                         <none>   8m14s   v1.31.3-eks-59bf375
michaelobrien@mbp8 src % kubectl get nodes -o wide
NAME                            STATUS                        ROLES    AGE     VERSION               INTERNAL-IP     EXTERNAL-IP      OS-IMAGE         KERNEL-VERSION                  CONTAINER-RUNTIME
ip-172-31-23-127.ec2.internal   Ready                         <none>   9m18s   v1.31.3-eks-59bf375   172.31.23.127   54.83.189.38     Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-27-5.ec2.internal     Ready                         <none>   15m     v1.31.3-eks-59bf375   172.31.27.5     54.1..    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-32-235.ec2.internal   Ready                         <none>   10m     v1.31.3-eks-59bf375   172.31.32.235   3.89.209.5       Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-57-166.ec2.internal   Ready                         <none>   13m     v1.31.3-eks-59bf375   172.31.57.166   44.211.151.211   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-62-13.ec2.internal    Ready                         <none>   11m     v1.31.3-eks-59bf375   172.31.62.13    44...   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-72-105.ec2.internal   Ready                         <none>   15m     v1.31.3-eks-59bf375   172.31.72.105   44.200.200.131   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-74-176.ec2.internal   Ready                         <none>   12m     v1.31.3-eks-59bf375   172.31.74.176   3.220.174.98     Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-80-165.ec2.internal   NotReady,SchedulingDisabled   <none>   56d     v1.30.4-eks-a737599   172.31.80.165   35.168.110.61    Amazon Linux 2   5.10.226-214.880.amzn2.x86_64   containerd://1.7.22
ip-172-31-87-114.ec2.internal   Ready                         <none>   8m19s   v1.31.3-eks-59bf375   172.31.87.114   34.236.37.254    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
michaelobrien@mbp8 src % kubectl get nodes -o wide
NAME                            STATUS                     ROLES    AGE   VERSION               INTERNAL-IP     EXTERNAL-IP      OS-IMAGE         KERNEL-VERSION                  CONTAINER-RUNTIME
ip-172-31-27-5.ec2.internal     Ready                      <none>   19m   v1.31.3-eks-59bf375   172.31.27.5     54..    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-32-235.ec2.internal   Ready                      <none>   14m   v1.31.3-eks-59bf375   172.31.32.235   3.89.209.5       Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-57-166.ec2.internal   Ready                      <none>   17m   v1.31.3-eks-59bf375   172.31.57.166   44.211.151.211   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-62-13.ec2.internal    Ready,SchedulingDisabled   <none>   15m   v1.31.3-eks-59bf375   172.31.62.13    44.202.253.217   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-72-105.ec2.internal   Ready                      <none>   19m   v1.31.3-eks-59bf375   172.31.72.105   44....   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-74-176.ec2.internal   Ready                      <none>   16m   v1.31.3-eks-59bf375   172.31.74.176   3.220.174.98     Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-87-114.ec2.internal   Ready                      <none>   12m   v1.31.3-eks-59bf375   172.31.87.114   34.236.37.254    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
michaelobrien@mbp8 src % kubectl get nodes -o wide
NAME                            STATUS                     ROLES    AGE   VERSION               INTERNAL-IP     EXTERNAL-IP      OS-IMAGE         KERNEL-VERSION                  CONTAINER-RUNTIME
ip-172-31-27-5.ec2.internal     Ready                      <none>   22m   v1.31.3-eks-59bf375   172.31.27.5     54...    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-32-235.ec2.internal   Ready                      <none>   17m   v1.31.3-eks-59bf375   172.31.32.235   3.89.209.5       Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-57-166.ec2.internal   Ready                      <none>   20m   v1.31.3-eks-59bf375   172.31.57.166   44.211.151.211   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-72-105.ec2.internal   Ready                      <none>   22m   v1.31.3-eks-59bf375   172.31.72.105   44....   Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-74-176.ec2.internal   Ready,SchedulingDisabled   <none>   19m   v1.31.3-eks-59bf375   172.31.74.176   3.220.174.98     Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-87-114.ec2.internal   Ready                      <none>   15m   v1.31.3-eks-59bf375   172.31.87.114   34.236.37.254    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
michaelobrien@mbp8 src % kubectl get nodes -o wide
NAME                            STATUS   ROLES    AGE     VERSION               INTERNAL-IP     EXTERNAL-IP      OS-IMAGE         KERNEL-VERSION                  CONTAINER-RUNTIME
ip-172-31-27-5.ec2.internal     Ready    <none>   5h31m   v1.31.3-eks-59bf375   172.31.27.5     54....    Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23
ip-172-31-72-105.ec2.internal   Ready    <none>   5h31m   v1.31.3-eks-59bf375   172.31.72.105   44...  Amazon Linux 2   5.10.228-219.884.amzn2.x86_64   containerd://1.7.23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant