Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

k3s-killall.sh does not work if data-dir doesn't end with /k3s #10708

Closed
brandond opened this issue Aug 13, 2024 · 3 comments
Closed

k3s-killall.sh does not work if data-dir doesn't end with /k3s #10708

brandond opened this issue Aug 13, 2024 · 3 comments
Assignees
@brandond @endawkins
Milestone
2024-08 Release C...

Comments

@brandond
Copy link
Member

Same problem with the grep expression as rancher/rke2#6522 - it expects the k3s data-dir to end with /k3s. If it does not, the pods are not killed.
@brandond brandond mentioned this issue Aug 13, 2024
Merged
@brandond brandond moved this from New to Peer Review in K3s Development Aug 13, 2024
@brandond brandond self-assigned this Aug 13, 2024
@brandond brandond added this to the August 2024 Release Cycle milestone Aug 13, 2024
@brandond brandond moved this from Peer Review to To Test in K3s Development Aug 13, 2024
@endawkins endawkins self-assigned this Aug 13, 2024
@endawkins
Copy link

Testing

Steps:

  1. Create a custom data-dir
  2. Use older install script (capture from the github)
  3. Install k3s using older install script ***(reproduction)
  4. Install k3s like normal ***(validation)
  5. Capture the processes running ps auxfww | grep coredns; ps auxfww | grep helm; ps auxfww | grep metrics; ps auxfww | grep traefik before the killall
  6. Capture processes running after the killall
  7. Validate that the pods aren’t running anymore

Observations:

Reproduction:

config.yaml

cluster-init: true
write-kubeconfig-mode: 644
node-external-ip: <EXTERNAL_NODE_IP>
data-dir: /opt/custom_data_dir

Node OS:

Linux ip-172-31-14-74 6.8.0-1012-aws #13-Ubuntu SMP Mon Jul 15 13:40:27 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 24.04 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

Version:

k3s -v
k3s version v1.30.3+k3s1 (f6466040)
go version go1.22.5
  • Checking the processes
ps auxfww | grep coredns; ps auxfww | grep helm; ps auxfww | grep metrics; ps auxfww | grep traefik
ubuntu      6931  0.0  0.0   7076  2176 pts/0    S+   08:59   0:00  |           \_ grep --color=auto coredns
root        2474  0.1  1.2 764656 49400 ?        Ssl  08:50   0:00  \_ /coredns -conf /etc/coredns/Corefile
ubuntu      6933  0.0  0.0   7076  2176 pts/0    S+   08:59   0:00  |           \_ grep --color=auto helm
ubuntu      6935  0.0  0.0   7076  2176 pts/0    S+   08:59   0:00  |           \_ grep --color=auto metrics
ubuntu      2595  0.8  1.4 1283868 57824 ?       Ssl  08:50   0:04  \_ /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305
65532       3630  0.2  2.5 1369668 99588 ?       Ssl  08:50   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu      6937  0.0  0.0   7076  2176 pts/0    S+   08:59   0:00  |           \_ grep --color=auto traefik
65532       3630  0.2  2.5 1369668 99588 ?       Ssl  08:50   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true

ps aux -u ubuntu | grep metrics
ubuntu      2595  0.2  1.4 1283868 55032 ?       Ssl  08:50   0:08 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305
65532       3630  0.0  2.5 1369668 99956 ?       Ssl  08:50   0:01 traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu     24956  0.0  0.0   7076  2176 pts/2    S+   09:49   0:00 grep --color=auto metrics

Validation:

Version:

k3s -v
k3s version v1.30.4-rc1+k3s1 (98262b5d)
go version go1.22.5

Pod Info:

kubectl get pods -A -o wide
NAMESPACE     NAME                                      READY   STATUS      RESTARTS   AGE   IP          NODE              NOMINATED NODE   READINESS GATES
kube-system   coredns-576bfc4dc7-lt6tv                  1/1     Running     0          26s   10.42.0.6   ip-172-31-14-74   <none>           <none>
kube-system   helm-install-traefik-crd-fmz42            0/1     Completed   0          27s   10.42.0.2   ip-172-31-14-74   <none>           <none>
kube-system   helm-install-traefik-f5hbb                0/1     Completed   1          27s   10.42.0.4   ip-172-31-14-74   <none>           <none>
kube-system   local-path-provisioner-6795b5f9d8-nf8l7   1/1     Running     0          26s   10.42.0.5   ip-172-31-14-74   <none>           <none>
kube-system   metrics-server-557ff575fb-bvq5f           1/1     Running     0          26s   10.42.0.3   ip-172-31-14-74   <none>           <none>
kube-system   svclb-traefik-89876c8b-9pkfr              2/2     Running     0          12s   10.42.0.7   ip-172-31-14-74   <none>           <none>
kube-system   traefik-5fb479b77-wqf6v                   1/1     Running     0          12s   10.42.0.8   ip-172-31-14-74   <none>           <none>

Processes:

*** before killall.sh
ps auxfww | grep coredns; ps auxfww | grep helm; ps auxfww | grep metrics; ps auxfww | grep traefik
ubuntu      7048  0.0  0.0   7076  2176 pts/3    S+   09:30   0:00              \_ grep --color=auto coredns
root        5793  0.2  1.2 764656 48512 ?        Ssl  09:28   0:00  \_ /coredns -conf /etc/coredns/Corefile
ubuntu      7050  0.0  0.0   7076  2176 pts/3    S+   09:30   0:00              \_ grep --color=auto helm
ubuntu      7052  0.0  0.0   7076  2176 pts/3    S+   09:30   0:00              \_ grep --color=auto metrics
65532       5783  0.9  2.6 1369668 102912 ?      Ssl  09:28   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu      5736  1.5  1.4 1283868 57216 ?       Ssl  09:28   0:02  \_ /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_{REDACTED]
ubuntu      7054  0.0  0.0   7076  2176 pts/3    S+   09:30   0:00              \_ grep --color=auto traefik
65532       5783  0.9  2.6 1369668 102912 ?      Ssl  09:28   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true

ps aux -u ubuntu | grep metrics
ubuntu      5736  9.0  1.3 1283612 52352 ?       Ssl  09:28   0:01 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_{REDACTED]
65532       5783  7.6  2.5 1369668 102144 ?      Ssl  09:28   0:01 traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu      6083  0.0  0.0   7076  2048 pts/3    S+   09:28   0:00 grep --color=auto metrics

*** after killall.sh

ps auxfww | grep coredns; ps auxfww | grep helm; ps auxfww | grep metrics; ps auxfww | grep traefik
ubuntu      7667  0.0  0.0   7076  2176 pts/3    S+   09:31   0:00              \_ grep --color=auto coredns
root        5793  0.1  1.2 764656 49536 ?        Ssl  09:28   0:00  \_ /coredns -conf /etc/coredns/Corefile
ubuntu      7669  0.0  0.0   7076  2176 pts/3    S+   09:31   0:00              \_ grep --color=auto helm
ubuntu      7671  0.0  0.0   7076  2176 pts/3    S+   09:31   0:00              \_ grep --color=auto metrics
65532       5783  0.6  2.6 1369668 103424 ?      Ssl  09:28   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu      5736  1.1  1.4 1283868 57344 ?       Ssl  09:28   0:02  \_ /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_[REDACTED]
ubuntu      7673  0.0  0.0   7076  2176 pts/3    S+   09:31   0:00              \_ grep --color=auto traefik
65532       5783  0.6  2.6 1369668 103424 ?      Ssl  09:28   0:01  \_ traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true

ps aux -u ubuntu | grep metrics
ubuntu      5736  1.2  1.4 1283868 57344 ?       Ssl  09:28   0:02 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_[REDACTED]
65532       5783  0.7  2.6 1369668 103424 ?      Ssl  09:28   0:01 traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu      7530  0.0  0.0   7076  2176 pts/3    S+   09:31   0:00 grep --color=auto metrics

ps aux -u ubuntu | grep metrics
ubuntu      5736  0.4  1.3 1283868 54480 ?       Ssl  09:28   0:02 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305
65532       5783  0.2  2.4 1369668 97988 ?       Ssl  09:28   0:01 traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu     10092  0.0  0.0   7076  2176 pts/3    S+   09:38   0:00 grep --color=auto metrics

ps aux -u ubuntu | grep metrics
ubuntu      5736  0.4  1.3 1283868 54480 ?       Ssl  09:28   0:02 /metrics-server --cert-dir=/tmp --secure-port=10250 --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --kubelet-use-node-status-port --metric-resolution=15s --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305
65532       5783  0.2  2.6 1369668 103236 ?      Ssl  09:28   0:01 traefik traefik --global.checknewversion --global.sendanonymoususage --entrypoints.metrics.address=:9100/tcp --entrypoints.traefik.address=:9000/tcp --entrypoints.web.address=:8000/tcp --entrypoints.websecure.address=:8443/tcp --api.dashboard=true --ping=true --metrics.prometheus=true --metrics.prometheus.entrypoint=metrics --providers.kubernetescrd --providers.kubernetesingress --providers.kubernetesingress.ingressendpoint.publishedservice=kube-system/traefik --entrypoints.websecure.http.tls=true
ubuntu     10492  0.0  0.0   7076  2176 pts/3    S+   09:39   0:00 grep --color=auto metrics

Conclusion
If the STAT is supposed to read as T for a stopped process for containerd, metrics, etc then Ssl and S+ will not suffice to validate issue. @brandond in need of your input.

@brandond
Copy link
Member Author

brandond commented Aug 21, 2024 •
edited
Loading

It doesn't look like you passed in the custom data-dir when running the killall script? You need to set the K3S_DATA_DIR env var when running the killall script if you're using a custom data dir. This PR did not change that requirement.

See the validation here: #10471 (comment)

$ sudo K3S_DATA_DIR=/opt/mydir k3s-killall.sh

@endawkins
Copy link

Testing Steps

Reproduction:

$ sudo mkdir -p /etc/rancher/k3s 

$ sudo bash -c 'cat <<EOF>/etc/rancher/k3s/config.yaml 
write-kubeconfig-mode: 644 
data-dir: /var/elwood 
EOF' 

$ sudo curl https://get.k3s.io/ | sudo INSTALL_K3S_VERSION=v1.29.7+k3s1 sh -s - server 

$ kubectl get nodes 
NAME             STATUS  ROLES                 AGE  VERSION 
ip-172-31-0-148  Ready   control-plane,master  6s   v1.29.7+k3s1 

$ sudo su 

$ export K3S_DATA_DIR=/var/elwood && /usr/local/bin/k3s-uninstall.sh 

$ ls -l /var/elwood 
ls: cannot access '/var/elwood': No such file or directory 

$ sudo mkdir -p /etc/rancher/k3s 

$ sudo bash -c 'cat <<EOF>/etc/rancher/k3s/config.yaml 
write-kubeconfig-mode: 644 
data-dir: /var/elwood 
EOF' 

$ sudo curl https://get.k3s.io/ | sudo INSTALL_K3S_VERSION=v1.29.7+k3s1 sh -s - server 

$ kubectl get nodes
NAME             STATUS  ROLES                AGE  VERSION 
ip-172-31-0-148  Ready   control-plane,master 3s   v1.29.7+k3s1 

$ sudo su 

$ export K3S_DATA_DIR=/var/elwood && /usr/local/bin/k3s-killall.sh 

$ ls -l /var/elwood 
total 12 
drwx------ 5 root root 4096 Aug 21 20:11 agent 
drwxr-xr-x 3 root root 4096 Aug 21 20:11 data 
drwx------ 8 root root 4096 Aug 21 20:11 server

$ kubectl get nodes 
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

$ export KUBECONFIG=/etc/rancher/k3s/k3s.yaml 
$ PATH=$PATH:/var/elwood/bin 
$ sudo chmod 644 /etc/rancher/k3s/k3s.yaml

$ kubectl get nodes
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

From Logs:

Aug 21 20:12:21 ip-172-31-0-148 k3s[33204]: E0821 20:12:21.398099   33204 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"3c43c1c3597ac9fc25d0729a09e017159ab471c8be9f96dae6016b7b46178b73\": not found" containerID="3c43c1c3597ac9fc25d0729a09e017159ab471c8be9f96dae6016b7b46178b73"

Aug 21 20:19:50 ip-172-31-0-148 k3s[33204]: W0821 20:19:50.438781   33204 reflector.go:462] k8s.io/client-go@v1.29.7-k3s1/tools/cache/reflector.go:229: watch of *v1.Endpoints ended with: an error on the server ("unable to decode an event from the watch stream: context canceled") has prevented the request from succeeding

Validation:

$ sudo mkdir -p /etc/rancher/k3s 

$ sudo bash -c 'cat <<EOF>/etc/rancher/k3s/config.yaml 
write-kubeconfig-mode: 644 
data-dir: /var/elwood 
EOF' 

$ sudo curl https://get.k3s.io | sudo INSTALL_K3S_VERSION=v1.30.4-rc1+k3s1 sh -s - server 

$ kubectl get nodes
NAME              STATUS   ROLES                  AGE   VERSION
ip-172-31-0-148   Ready    control-plane,master   39s   v1.30.4-rc1+k3s1 

$ sudo su 

$ export K3S_DATA_DIR=/var/elwood && /usr/local/bin/k3s-uninstall.sh 

$ ls -l /var/elwood 
ls: cannot access '/var/elwood': No such file or directory 

$ sudo mkdir -p /etc/rancher/k3s 

$ sudo bash -c 'cat <<EOF>/etc/rancher/k3s/config.yaml 
write-kubeconfig-mode: 644 
data-dir: /var/elwood 
EOF' 

$ sudo curl https://get.k3s.io | sudo INSTALL_K3S_VERSION=v1.30.4-rc1+k3s1 sh -s - server 

$ kubectl get nodes
NAME              STATUS   ROLES                  AGE   VERSION
ip-172-31-0-148   Ready    control-plane,master   3s    v1.30.4-rc1+k3s1 

$ sudo su 

$ export K3S_DATA_DIR=/var/elwood && /usr/local/bin/k3s-killall.sh 

$ ls -l /var/elwood
total 12
drwx------ 5 root root 4096 Aug 21 21:00 agent
drwxr-xr-x 3 root root 4096 Aug 21 21:00 data
drwx------ 8 root root 4096 Aug 21 21:00 server 

$ kubectl get nodes 
The connection to the server 127.0.0.1:6443 was refused - did you specify the right host or port?

$ export KUBECONFIG=/etc/rancher/k3s/k3s.yaml 
$ PATH=$PATH:/var/elwood/bin 
$ sudo chmod 644 /etc/rancher/k3s/k3s.yaml

Install Again:
$ kubectl get nodes
NAME              STATUS   ROLES                  AGE     VERSION
ip-172-31-0-148   Ready    control-plane,master   2m27s   v1.30.4-rc1+k3s1

@github-project-automation github-project-automation bot moved this from To Test to Done Issue in K3s Development Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@brandond brandond

@endawkins endawkins

Labels
None yet
Projects
K3s Development
Status: Done Issue
Milestone
2024-08 Release Cycle
Development

No branches or pull requests
2 participants
@brandond @endawkins