add kubernetes v1.25.x image to dockerhub #1581

willzhang · 2022-11-07T14:19:06Z

Your current KubeKey version

2.3.0

Describe this feature

kk artifact export

22:12:42 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:k8s-dns-node-cache:1.21.1-amd64
Getting image source signatures
Copying blob sha256:af833073aa9559031531fca731390d329e083cccc0b824c236e7efc5742ae666
Copying blob sha256:20b09fbd30377e1315a8bc9e15b5f8393a1090a7ec3f714ba5fce0c9b82a42f2
Copying config sha256:87fe60ddfca990f76d112aa3834ea22624fbcceef0116f19dc78b553c49355f8
Writing manifest to image destination
Storing signatures
22:12:55 CST Source: docker://docker.io/kubesphere/kube-apiserver:v1.25.3
22:12:55 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:kube-apiserver:v1.25.3-amd64
22:12:58 CST message: [LocalHost]
initializing source docker://kubesphere/kube-apiserver:v1.25.3: reading manifest v1.25.3 in docker.io/kubesphere/kube-apiserver: manifest unknown: manifest unknown
22:12:58 CST failed: [LocalHost]
error: Pipeline[ArtifactExportPipeline] execute failed: Module[CopyImagesToLocalModule] exec failed: 
failed: [LocalHost] [SaveImages] exec failed after 1 retires: initializing source docker://kubesphere/kube-apiserver:v1.25.3: reading manifest v1.25.3 in docker.io/kubesphere/kube-apiserver: manifest unknown: manifest unknown

Describe the solution you'd like

add v1.25 images to dockerhub, or sync everyday with github action.

Additional information

No response

The text was updated successfully, but these errors were encountered:

willzhang · 2022-11-07T14:38:25Z

i can not use this images in manifests.yaml

  - registry.k8s.io/dns/k8s-dns-node-cache:1.22.13

run kk artifact export


toring signatures
22:32:40 CST Source: docker://registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
22:32:40 CST Destination: oci:/data/kubekey/kubekey/artifact/images:dns:k8s-dns-node-cache:1.22.13-amd64
Getting image source signatures
Copying blob sha256:6694ef4704cc2d48d77d400e108676f3bd706e9496c7c2b0b9ad86d2c4961422
Copying blob sha256:33905e809db95cdd940d3db7fc8f1486243bf738f5cd712b8f62b105be60dad6
Copying config sha256:1fe3f5a38246787fa48f5212b5c559a3be012f8cbb578130ace9c7251d672e41
Writing manifest to image destination
Storing signatures
panic: runtime error: index out of range [2] with length 2

goroutine 105 [running]:
github.com/kubesphere/kubekey/pkg/images.(*SaveImages).Execute(0xc0003fb050, {0x2711428, 0xc000666a50})
        /home/runner/work/kubekey/kubekey/pkg/images/tasks.go:172 +0x8ee
github.com/kubesphere/kubekey/pkg/core/task.(*LocalTask).ExecuteWithRetry(0xc0006669a0, {0x2711428, 0xc000666a50}, {0x27136c0, 0xc00016b140})
        /home/runner/work/kubekey/kubekey/pkg/core/task/local_task.go:205 +0x126
github.com/kubesphere/kubekey/pkg/core/task.(*LocalTask).Run(0xc0006669a0, {0x2711428, 0xc000666a50}, {0x27136c0?, 0xc00016b140}, 0xc000112ea0?)
        /home/runner/work/kubekey/kubekey/pkg/core/task/local_task.go:159 +0x225
created by github.com/kubesphere/kubekey/pkg/core/task.(*LocalTask).RunWithTimeout
        /home/runner/work/kubekey/kubekey/pkg/core/task/local_task.go:121 +0x172
root@ubuntu:/data/kubekey# ^C

24sama · 2022-11-08T07:33:11Z

Thanks for the feedback, we are still syncing the k8s images...

24sama · 2022-11-08T07:40:46Z

i can not use this images in manifests.yaml

registry.k8s.io/dns/k8s-dns-node-cache:1.22.13

As for this error, it looks like one of the images behind this registry.k8s.io/dns/k8s-dns-node-cache:1.22.13 has a formatting problem. registry.k8s.io/dns/k8s-dns-node-cache:1.22.13 has been stored in the OCI path.

willzhang · 2022-11-08T12:04:09Z

but i can pull success.

root@ubuntu:~# docker pull registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
1.22.13: Pulling from dns/k8s-dns-node-cache
33905e809db9: Pull complete 
6694ef4704cc: Pull complete 
Digest: sha256:4746f27a85263d058d397deccbd4a07d5c98acf138bc35f98729c5c6b813a6b6
Status: Downloaded newer image for registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
root@ubuntu:~#

24sama · 2022-11-08T13:14:14Z

but i can pull success.

root@ubuntu:~# docker pull registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
1.22.13: Pulling from dns/k8s-dns-node-cache
33905e809db9: Pull complete 
6694ef4704cc: Pull complete 
Digest: sha256:4746f27a85263d058d397deccbd4a07d5c98acf138bc35f98729c5c6b813a6b6
Status: Downloaded newer image for registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
root@ubuntu:~#

I mean there is something wrong with the format of the other image names. Could you please paste your manifest file here?

willzhang · 2022-11-09T05:37:24Z

command

root@ubuntu:/data/kubekey# kk artifact export -m manifests-v1.25.3.yaml -o kubernetes-v1.25.3.tar.gz |tee gen.log

manifests-v1.25.3.yaml

kind: Manifest
metadata:
  name: sample
spec:
  arches: 
  - amd64
  operatingSystems: 
  - arch: amd64
    type: linux
    id: ubuntu
    version: "22.04"
    osImage: Ubuntu 22.04 LTS
    repository: 
      iso:
        localPath: 
        url: https://github.com/kubesphere/kubekey/releases/download/v2.3.0/ubuntu-22.04-debs-amd64.iso
  kubernetesDistributions: 
  - type: kubernetes
    version: v1.25.3
  components: 
    helm:
      version: v3.6.3
    cni:
      version: v1.1.2
    etcd:
      version: v3.5.4
    containerRuntimes:
    - type: containerd
      version: 1.6.9
    crictl:
      version: v1.25.0
  images:
  - docker.io/calico/cni:v3.24.4
  - docker.io/calico/kube-controllers:v3.24.4
  - docker.io/calico/node:v3.24.4
  - docker.io/calico/pod2daemon-flexvol:v3.24.4
  - registry.k8s.io/coredns/coredns:v1.9.3
  - registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
  - registry.k8s.io/kube-apiserver:v1.25.3
  - registry.k8s.io/kube-controller-manager:v1.25.3
  - registry.k8s.io/kube-proxy:v1.25.3
  - registry.k8s.io/kube-scheduler:v1.25.3
  - registry.k8s.io/pause:3.8

24sama · 2022-11-09T05:48:40Z

Thanks @willzhang
Then following images are missing the namespace. Image name must be formated as registry/namespace/name:tag.

  - registry.k8s.io/kube-apiserver:v1.25.3
  - registry.k8s.io/kube-controller-manager:v1.25.3
  - registry.k8s.io/kube-proxy:v1.25.3
  - registry.k8s.io/kube-scheduler:v1.25.3
  - registry.k8s.io/pause:3.8

willzhang · 2022-11-09T06:13:54Z

some images lost

apiVersion: kubekey.kubesphere.io/v1alpha2
kind: Manifest
metadata:
  name: sample
spec:
  arches:
  - amd64
  operatingSystems:
  - arch: amd64
    type: linux
    id: ubuntu
    version: "22.04"
    osImage: Ubuntu 22.04 LTS
    repository:
      iso:
        localPath:
        url: https://github.com/kubesphere/kubekey/releases/download/v2.3.0/ubuntu-22.04-debs-amd64.iso
  kubernetesDistributions:
  - type: kubernetes
    version: v1.25.3
  components:
    helm:
      version: v3.6.3
    cni:
      version: v1.1.2
    etcd:
      version: v3.5.4
    containerRuntimes:
    - type: containerd
      version: 1.6.9
    crictl:
      version: v1.25.0
  images:
  - docker.io/calico/cni:v3.24.4
  - docker.io/calico/kube-controllers:v3.24.4
  - docker.io/calico/node:v3.24.4
  - docker.io/calico/pod2daemon-flexvol:v3.24.4
  - registry.k8s.io/coredns/coredns:v1.9.3
  - registry.k8s.io/dns/k8s-dns-node-cache:1.22.13
  - docker.io/kubesphere/kube-apiserver:v1.25.3
  - docker.io/kubesphere/kube-controller-manager:v1.25.3
  - docker.io/kubesphere/kube-proxy:v1.25.3
  - docker.io/kubesphere/kube-scheduler:v1.25.3
  - docker.io/kubesphere/pause:3.8

need pause and k8s-dns-node-cache

13:53:56 CST Source: docker://docker.io/kubesphere/kube-scheduler:v1.25.3
13:53:56 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:kube-scheduler:v1.25.3-amd64
Getting image source signatures
Copying blob sha256:79e0d8860fadaab56c716928c84875d99ff5e13787ca3fcced10b70af29bf320
Copying blob sha256:640696bfc7d7d234958dba52a2ea4694dc28a0f553c84ffd4aab41abaae2c690
Copying blob sha256:78ef12c4eeb634aec1f4d65185c8a5b2e56af3467f1ca90e2b00053853ada41f
Copying config sha256:890912e6edc6cdebc14e720a2189fbb1b64064c876abd6f15e49ceb4577b5a2c
Writing manifest to image destination
Storing signatures
13:54:04 CST Source: docker://docker.io/kubesphere/pause:3.8
13:54:04 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:pause:3.8-amd64
13:54:07 CST message: [LocalHost]
initializing source docker://kubesphere/pause:3.8: reading manifest 3.8 in docker.io/kubesphere/pause: manifest unknown: manifest unknown
13:54:07 CST failed: [LocalHost]
error: Pipeline[ArtifactExportPipeline] execute failed: Module[CopyImagesToLocalModule] exec failed: 
failed: [LocalHost] [SaveImages] exec failed after 1 retires: initializing source docker://kubesphere/pause:3.8: reading manifest 3.8 in docker.io/kubesphere/pause: manifest unknown: manifest unknown

suggest

root@ubuntu:/data/kubekey# kubeadm config images list
registry.k8s.io/kube-apiserver:v1.25.3
registry.k8s.io/kube-controller-manager:v1.25.3
registry.k8s.io/kube-scheduler:v1.25.3
registry.k8s.io/kube-proxy:v1.25.3
registry.k8s.io/pause:3.8
registry.k8s.io/etcd:3.5.4-0
registry.k8s.io/coredns/coredns:v1.9.3

part1: kube images

wget kubeadm --version 1.25.3
kubeadm config images list | xargs -I {} skopeo sync --src docker --dest docker {} kubesphere/${image##}

part2: k8s-dns-node-cache

skopeo sync registry.k8s.io/dns/k8s-dns-node-cache kubesphere/k8s-dns-node-cache

part3: calico images just use docker.io

suggest use github action workflow sync all version tags

sync.yaml

registry.k8s.io:
    images-by-tag-regex:
        dns/k8s-dns-node-cache: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        kube-apiserver: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        kube-controller-manager: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        kube-scheduler: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        kube-proxy: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        pause: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        etcd: ^v([0-9]+\.){0,2}(\*|[0-9]+)$
        coredns/coredns: ^v([0-9]+\.){0,2}(\*|[0-9]+)$

workflow.yaml

name: image-sync
on:
  push:
    branches: [ main ]
  pull_request:
    branches: [ main ]
  schedule:
    - cron: '0 14 * * 1'

env:
  USERNAME: ${{ secrets.DOCKER_USERNAME }}
  PASSWORD: ${{ secretsDOCKER_PASSWORD }}

jobs:
  image-sync:
    runs-on: ubuntu-22.04

    steps:
    - name: Checkout
      uses: actions/checkout@v2

    - name: check podman
      run: |
        sudo podman version
    - name: sync images
      run: |
        sudo podman run -it --rm -v ${PWD}:/workspace -w /workspace quay.io/skopeo/stable:latest \
        sync --src yaml --dest docker sync.yaml registry.cn-shenzhen.aliyuncs.com/cnmirror \
        --dest-username $USERNAME --dest-password $PASSWORD \
        --keep-going --retry-times 2

willzhang · 2022-11-09T06:30:38Z

some more error with kubeadm. v1.25.3 is not supported

14:28:24 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:kube-proxy:v1.25.3-amd64
Getting image source signatures
Copying blob sha256:8bd04c8f2ed1b474f8a4c802b458df58cc47446c44bd774e355ac52c90afa961
Copying blob sha256:01b10be092f3407152f1867eb4f101f359839421e77b9b0e931612e4181b2eb2
Copying config sha256:b37e7578f1e8edf3ffe46f7dcff539008d6782be4818517f3e0834dcc08ddd32
Writing manifest to image destination
Storing signatures
14:28:29 CST Source: docker://docker.io/kubesphere/kube-scheduler:v1.25.3
14:28:29 CST Destination: oci:/data/kubekey/kubekey/artifact/images:kubesphere:kube-scheduler:v1.25.3-amd64
Getting image source signatures
Copying blob sha256:640696bfc7d7d234958dba52a2ea4694dc28a0f553c84ffd4aab41abaae2c690
Copying blob sha256:79e0d8860fadaab56c716928c84875d99ff5e13787ca3fcced10b70af29bf320
Copying blob sha256:78ef12c4eeb634aec1f4d65185c8a5b2e56af3467f1ca90e2b00053853ada41f
Copying config sha256:890912e6edc6cdebc14e720a2189fbb1b64064c876abd6f15e49ceb4577b5a2c
Writing manifest to image destination
Storing signatures
14:28:35 CST Source: docker://docker.io/willdockerhub/pause:3.8
14:28:35 CST Destination: oci:/data/kubekey/kubekey/artifact/images:willdockerhub:pause:3.8-amd64
Getting image source signatures
Copying blob sha256:9457426d68990df190301d2e20b8450c4f67d7559bdb7ded6c40d41ced6731f7
Copying config sha256:23de5be0bae74ecda33ddf75a481f2446df195cc80d92bee1b6d294d24b3c49b
Writing manifest to image destination
Storing signatures
14:28:39 CST success: [LocalHost]
14:28:39 CST [ArtifactBinariesModule] Download manifest expect binaries
14:28:39 CST message: [localhost]
downloading amd64 kubeadm v1.25.3 ...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 41.7M  100 41.7M    0     0  7552k      0  0:00:05  0:00:05 --:--:-- 9268k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 41.7M  100 41.7M    0     0  7670k      0  0:00:05  0:00:05 --:--:-- 9664k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 41.7M  100 41.7M    0     0  7705k      0  0:00:05  0:00:05 --:--:--  9.8M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 41.7M  100 41.7M    0     0  7703k      0  0:00:05  0:00:05 --:--:-- 8769k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 41.7M  100 41.7M    0     0  7631k      0  0:00:05  0:00:05 --:--:-- 8824k
14:29:08 CST message: [LocalHost]
Failed to download kubeadm binary: curl -L -o /data/kubekey/kubekey/artifact/kube/v1.25.3/amd64/kubeadm https://storage.googleapis.com/kubernetes-release/release/v1.25.3/bin/linux/amd64/kubeadm error: No SHA256 found for kubeadm. v1.25.3 is not supported. 
14:29:08 CST failed: [LocalHost]
error: Pipeline[ArtifactExportPipeline] execute failed: Module[ArtifactBinariesModule] exec failed: 
failed: [LocalHost] [DownloadBinaries] exec failed after 1 retires: Failed to download kubeadm binary: curl -L -o /data/kubekey/kubekey/artifact/kube/v1.25.3/amd64/kubeadm https://storage.googleapis.com/kubernetes-release/release/v1.25.3/bin/linux/amd64/kubeadm error: No SHA256 found for kubeadm. v1.25.3 is not supported. 
root@ubuntu:/data/kubekey#

24sama · 2022-11-09T07:25:12Z

need pause and k8s-dns-node-cache

The images pause and k8s-dns-node-cache have synced to docker.io/kubesphere.

some more error with kubeadm. v1.25.3 is not supported

#1577 is included in the KubeKey v3.0.0. And you can use ./kk version --show-supported-k8s to check the support k8s version.

suggest use github action workflow sync all version tags

Thanks for the suggestion!

For some historical reasons, the ks community uses an internal AWX project to sync the images. And we also recently wanted to migrate this feature to GitHub action. The workflow.yaml is very useful and we will try it later.

willzhang · 2022-11-09T12:01:24Z

aliyun images should sync too.

what's command

export KKZONE=cn
kk create cluster -y --with-kubernetes v1.25.3 --container-manager containerd

error logs

downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.7
19:58:42 CST message: [ubuntu]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3
19:58:43 CST message: [ubuntu]
pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3" 
E1109 19:58:43.402315    2676 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found: Process exited with status 1
19:58:43 CST retry: [ubuntu]
19:58:48 CST message: [ubuntu]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.7
19:58:49 CST message: [ubuntu]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3
19:58:49 CST message: [ubuntu]
pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3" 
E1109 19:58:49.565941    2688 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found: Process exited with status 1
19:58:49 CST retry: [ubuntu]
19:58:54 CST message: [ubuntu]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.7
19:58:55 CST message: [ubuntu]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3
19:58:55 CST message: [ubuntu]
pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3" 
E1109 19:58:55.825604    2701 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found: Process exited with status 1
19:58:55 CST failed: [ubuntu]
error: Pipeline[CreateClusterPipeline] execute failed: Module[PullModule] exec failed: 
failed: [ubuntu] [PullImages] exec failed after 3 retires: pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3" 
E1109 19:58:55.825604    2701 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3": registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3: not found: Process exited with status 1

willzhang · 2022-11-18T16:52:26Z

apiVersion: kubekey.kubesphere.io/v1alpha2
kind: Cluster
metadata:
  name: sample
spec:
  hosts:
  - {name: node01, address: 192.168.72.60, internalAddress: 192.168.72.60, user: root, password: "123456"}
  - {name: node02, address: 192.168.72.61, internalAddress: 192.168.72.61, user: root, password: "123456"}
  - {name: node03, address: 192.168.72.62, internalAddress: 192.168.72.62, user: root, password: "123456"}
  - {name: node04, address: 192.168.72.63, internalAddress: 192.168.72.63, user: root, password: "123456"}
  roleGroups:
    etcd:
    - node01
    - node02
    - node03
    control-plane:
    - node01
    - node02
    - node03
    worker:
    - node04
  controlPlaneEndpoint:
    internalLoadbalancer: kube-vip
    domain: lb.kubesphere.local
    address: "192.168.72.200"
    port: 6443
  kubernetes:
    version: v1.25.3
    clusterName: cluster.local
    autoRenewCerts: true
    containerManager: containerd
  etcd:
    type: kubekey
  network:
    plugin: calico
    kubePodsCIDR: 10.233.64.0/18
    kubeServiceCIDR: 10.233.0.0/18
    multusCNI:
      enabled: false
  addons: []

error logs

00:48:54 CST retry: [node03]
00:48:59 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.8
00:49:00 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.25.3
00:49:01 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager:v1.25.3
00:49:01 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler:v1.25.3
00:49:03 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy:v1.25.3
00:49:04 CST message: [node03]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3
00:49:04 CST message: [node03]
pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3" 
E1119 00:49:04.635488    3424 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found: Process exited with status 1
00:49:04 CST failed: [node04]
00:49:04 CST failed: [node01]
00:49:04 CST failed: [node02]
00:49:04 CST failed: [node03]
error: Pipeline[CreateClusterPipeline] execute failed: Module[PullModule] exec failed: 
failed: [node04] [PullImages] exec failed after 3 retires: pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3" 
E1119 00:48:03.373167    3469 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found: Process exited with status 1
failed: [node01] [PullImages] exec failed after 3 retires: pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3" 
E1119 00:48:43.378398    3508 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found: Process exited with status 1
failed: [node02] [PullImages] exec failed after 3 retires: pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3" 
E1119 00:48:53.210106    3510 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found: Process exited with status 1
failed: [node03] [PullImages] exec failed after 3 retires: pull image failed: Failed to exec command: sudo -E /bin/bash -c "env PATH=$PATH crictl pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3" 
E1119 00:49:04.635488    3424 remote_image.go:238] "PullImage from image service failed" err="rpc error: code = NotFound desc = failed to pull and unpack image \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": failed to resolve reference \"registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3\": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found" image="registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3"
FATA[0000] pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": failed to resolve reference "registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3": registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3: not found: Process exited with status 1

root@ubuntu:~# docker pull registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3
Error response from daemon: manifest for registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3 not found: manifest unknown: manifest unknown

24sama · 2022-11-22T08:21:54Z

done

24sama · 2022-11-22T08:21:59Z

/close

ks-ci-bot · 2022-11-22T08:22:04Z

@24sama: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

This was referenced Nov 10, 2022

fix the image name parsing panic #1595

Merged

kubekey安装1.25.3失败 #1600

Open

ks-ci-bot closed this as completed Nov 22, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add kubernetes v1.25.x image to dockerhub #1581

add kubernetes v1.25.x image to dockerhub #1581

willzhang commented Nov 7, 2022 •

edited

Loading

willzhang commented Nov 7, 2022

24sama commented Nov 8, 2022

24sama commented Nov 8, 2022

willzhang commented Nov 8, 2022

24sama commented Nov 8, 2022

willzhang commented Nov 9, 2022 •

edited

Loading

24sama commented Nov 9, 2022

willzhang commented Nov 9, 2022 •

edited

Loading

willzhang commented Nov 9, 2022

24sama commented Nov 9, 2022

willzhang commented Nov 9, 2022

willzhang commented Nov 18, 2022

24sama commented Nov 22, 2022

24sama commented Nov 22, 2022

ks-ci-bot commented Nov 22, 2022

add kubernetes v1.25.x image to dockerhub #1581

add kubernetes v1.25.x image to dockerhub #1581

Comments

willzhang commented Nov 7, 2022 • edited Loading

Your current KubeKey version

Describe this feature

Describe the solution you'd like

Additional information

willzhang commented Nov 7, 2022

24sama commented Nov 8, 2022

24sama commented Nov 8, 2022

willzhang commented Nov 8, 2022

24sama commented Nov 8, 2022

willzhang commented Nov 9, 2022 • edited Loading

24sama commented Nov 9, 2022

willzhang commented Nov 9, 2022 • edited Loading

some images lost

suggest

part1: kube images

part2: k8s-dns-node-cache

part3: calico images just use docker.io

suggest use github action workflow sync all version tags

willzhang commented Nov 9, 2022

24sama commented Nov 9, 2022

willzhang commented Nov 9, 2022

what's command

error logs

willzhang commented Nov 18, 2022

24sama commented Nov 22, 2022

24sama commented Nov 22, 2022

ks-ci-bot commented Nov 22, 2022

willzhang commented Nov 7, 2022 •

edited

Loading

willzhang commented Nov 9, 2022 •

edited

Loading

willzhang commented Nov 9, 2022 •

edited

Loading