Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The Service "kube-dns" is invalid: spec.clusterIP: Invalid value: "10.96.0.10": provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/24 #2240

Closed
DennisBayer opened this issue Nov 30, 2017 · 9 comments

Comments

@DennisBayer
Copy link

DennisBayer commented Nov 30, 2017

Minikube version (use minikube version): minikube version: v0.24.0

  • OS (e.g. from /etc/os-release): Windows 10 Enterprise (1709)
  • VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): hyperv
  • ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO or minikube ssh cat /etc/VERSION): minikube-v0.23.5.iso

What happened:
Updated to 0.24 from 0.23 and kube-dns is logging errors. Hostname resolving fails (see below for further information)

What you expected to happen: No errors are logged and the hostname resolving within pods works as in 0.23.

How to reproduce it (as minimally and precisely as possible):
Simply install minikube by calling minikube start --vm-driver="hyperv" --hyperv-virtual-switch="vSwitchExt" --v=3 --alsologtostderr. Deploy the two pods like in 0.23. Call first one.

Output of minikube logs (if applicable):
by request

Anything else do we need to know:

Hi there,

I had to reinstall my minikube-instance, so I scrubbed any ".minikube" and ".kube" directories in addtion to the vm.

My test case did run in the previous version and now fails due to UnknownHostExceptions. Digging in the logs I found an error output (see below) and googled for kube-dns is invalid... which lead me to the issue #1908 .

Did something go wrong while installing the "new" instance or might this be broken in the new release? Since I'm a beginner with Kubernetes/Minikube, let me know if you need additional information (and how to get them ;))

NFO: == Reconciling with addon-manager label ==
The Service "kube-dns" is invalid: spec.clusterIP: Invalid value: "10.96.0.10": provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/24
INFO: == Kubernetes addon reconcile completed at 2017-11-30T14:22:49+0000 ==
INFO: == Kubernetes addon ensure completed at 2017-11-30T14:23:48+0000 ==
INFO: == Reconciling with deprecated label ==
error: no objects passed to apply
INFO: == Reconciling with addon-manager label ==
The Service "kube-dns" is invalid: spec.clusterIP: Invalid value: "10.96.0.10": provided IP is not in the valid range. The range of valid IPs is 10.0.0.0/24
INFO: == Kubernetes addon reconcile completed at 2017-11-30T14:23:49+0000 ==
==== END logs for container kube-addon-manager of pod kube-system/kube-addon-manager-minikube ====
==== START logs for container kubedns of pod kube-system/kube-dns-6fc954457d-fj7kl ====
I1130 14:13:45.497261       1 dns.go:48] version: 1.14.4-2-g5584e04
I1130 14:13:45.499391       1 server.go:66] Using configuration read from ConfigMap: kube-system:kube-dns
I1130 14:13:45.499413       1 server.go:113] FLAG: --alsologtostderr="false"
I1130 14:13:45.499434       1 server.go:113] FLAG: --config-dir=""
I1130 14:13:45.499441       1 server.go:113] FLAG: --config-map="kube-dns"
I1130 14:13:45.499443       1 server.go:113] FLAG: --config-map-namespace="kube-system"
I1130 14:13:45.499444       1 server.go:113] FLAG: --config-period="10s"
I1130 14:13:45.499451       1 server.go:113] FLAG: --dns-bind-address="0.0.0.0"
I1130 14:13:45.499452       1 server.go:113] FLAG: --dns-port="10053"
I1130 14:13:45.499455       1 server.go:113] FLAG: --domain="cluster.local."
I1130 14:13:45.499461       1 server.go:113] FLAG: --federations=""
I1130 14:13:45.499464       1 server.go:113] FLAG: --healthz-port="8081"
I1130 14:13:45.499465       1 server.go:113] FLAG: --initial-sync-timeout="1m0s"
I1130 14:13:45.499471       1 server.go:113] FLAG: --kube-master-url=""
I1130 14:13:45.499473       1 server.go:113] FLAG: --kubecfg-file=""
I1130 14:13:45.499474       1 server.go:113] FLAG: --log-backtrace-at=":0"
I1130 14:13:45.499486       1 server.go:113] FLAG: --log-dir=""
I1130 14:13:45.499488       1 server.go:113] FLAG: --log-flush-frequency="5s"
I1130 14:13:45.499490       1 server.go:113] FLAG: --logtostderr="true"
I1130 14:13:45.499491       1 server.go:113] FLAG: --nameservers=""
I1130 14:13:45.499493       1 server.go:113] FLAG: --stderrthreshold="2"
I1130 14:13:45.499494       1 server.go:113] FLAG: --v="2"
I1130 14:13:45.499506       1 server.go:113] FLAG: --version="false"
I1130 14:13:45.499514       1 server.go:113] FLAG: --vmodule=""
I1130 14:13:45.499538       1 server.go:176] Starting SkyDNS server (0.0.0.0:10053)
I1130 14:13:45.499728       1 server.go:198] Skydns metrics enabled (/metrics:10055)
I1130 14:13:45.499737       1 dns.go:147] Starting endpointsController
I1130 14:13:45.499739       1 dns.go:150] Starting serviceController
I1130 14:13:45.499911       1 logs.go:41] skydns: ready for queries on cluster.local. for tcp://0.0.0.0:10053 [rcache 0]
I1130 14:13:45.499925       1 logs.go:41] skydns: ready for queries on cluster.local. for udp://0.0.0.0:10053 [rcache 0]
I1130 14:13:45.633081       1 sync_configmap.go:107] ConfigMap kube-system:kube-dns was created
I1130 14:13:46.116626       1 dns.go:171] Initialized services and endpoints from apiserver
I1130 14:13:46.116664       1 server.go:129] Setting up Healthz Handler (/readiness)
I1130 14:13:46.116669       1 server.go:134] Setting up cache handler (/cache)
I1130 14:13:46.116673       1 server.go:120] Status HTTP port 8081
==== END logs for container kubedns of pod kube-system/kube-dns-6fc954457d-fj7kl ====
{
    "ConfigVersion": 3,
    "Driver": {
        "IPAddress": "10.100.0.56",
        "MachineName": "minikube",
        "SSHUser": "docker",
        "SSHPort": 22,
        "SSHKeyPath": "c:\\.minikube\\machines\\minikube\\id_rsa",
        "StorePath": "c:\\.minikube",
        "SwarmMaster": false,
        "SwarmHost": "",
        "SwarmDiscovery": "",
        "Boot2DockerURL": "file://c:/.minikube/cache/iso/minikube-v0.23.5.iso",
        "VSwitch": "vSwitchExt",
        "DiskSize": 20000,
        "MemSize": 2048,
        "CPU": 2,
        "MacAddr": "",
        "VLanID": 0
    },
    "DriverName": "hyperv",
    "HostOptions": {
        "Driver": "",
        "Memory": 0,
        "Disk": 0,
        "EngineOptions": {
            "ArbitraryFlags": null,
            "Dns": null,
            "GraphDir": "",
            "Env": [
                "HTTP_PROXY=xxx:8080",
                "HTTPS_PROXY=xxx:8080"
            ],
            "Ipv6": false,
            "InsecureRegistry": [
                "10.96.0.0/12"
            ],
            "Labels": null,
            "LogLevel": "",
            "StorageDriver": "",
            "SelinuxEnabled": false,
            "TlsVerify": false,
            "RegistryMirror": null,
            "InstallURL": ""
        },
        "SwarmOptions": {
            "IsSwarm": false,
            "Address": "",
            "Discovery": "",
            "Agent": false,
            "Master": false,
            "Host": "",
            "Image": "",
            "Strategy": "",
            "Heartbeat": 0,
            "Overcommit": 0,
            "ArbitraryFlags": null,
            "ArbitraryJoinFlags": null,
            "Env": null,
            "IsExperimental": false
        },
        "AuthOptions": {
            "CertDir": "c:\\.minikube",
            "CaCertPath": "c:\\.minikube\\certs\\ca.pem",
            "CaPrivateKeyPath": "c:\\.minikube\\certs\\ca-key.pem",
            "CaCertRemotePath": "",
            "ServerCertPath": "c:\\.minikube\\machines\\server.pem",
            "ServerKeyPath": "c:\\.minikube\\machines\\server-key.pem",
            "ClientKeyPath": "c:\\.minikube\\certs\\key.pem",
            "ServerCertRemotePath": "",
            "ServerKeyRemotePath": "",
            "ClientCertPath": "c:\\.minikube\\certs\\cert.pem",
            "ServerCertSANs": null,
            "StorePath": "c:\\.minikube"
        }
    },
    "Name": "minikube"
}
PS C:\> minikube start --vm-driver="hyperv" --hyperv-virtual-switch="vSwitchExt" --v=1 --alsologtostderr
W1130 15:44:17.171956    3932 root.go:148] Error reading config file at c:\.minikube\config\config.json: open c:\.minikube\config\config.json: Das System kann die angegebene Datei nicht finden.
I1130 15:44:17.172958    3932 notify.go:109] Checking for updates...
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/k8s-minikube/storage-provisioner:v1.8.0 at c_\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.0
Starting local Kubernetes v1.8.0 cluster...
Starting VM...
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google_containers/k8s-dns-dnsmasq-nanny-amd64:1.14.5 at c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-dnsmasq-nanny-amd64_1.14.5
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google_containers/kubernetes-dashboard-amd64:v1.6.3 at c_\.minikube\cache\images\gcr.io\google_containers\kubernetes-dashboard-amd64_v1.6.3
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google_containers/k8s-dns-kube-dns-amd64:1.14.5 at c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-kube-dns-amd64_1.14.5
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google-containers/kube-addon-manager:v6.4-beta.2 at c_\.minikube\cache\images\gcr.io\google-containers\kube-addon-manager_v6.4-beta.2
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google_containers/pause-amd64:3.0 at c_\.minikube\cache\images\gcr.io\google_containers\pause-amd64_3.0
I1130 15:44:17.313592    3932 cache_images.go:290] Attempting to cache image: gcr.io/google_containers/k8s-dns-sidecar-amd64:1.14.5 at c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-sidecar-amd64_1.14.5
I1130 15:44:17.314620    3932 cluster.go:74] Skipping create...Using existing machine configuration
I1130 15:44:17.315592    3932 cache_images.go:78] Successfully cached all images.
I1130 15:44:17.697720    3932 cluster.go:83] Machine state:  Stopped
I1130 15:44:45.003612    3932 ssh_runner.go:57] Run: sudo rm -f /etc/docker/server.pem
I1130 15:44:45.048960    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
I1130 15:44:45.054955    3932 ssh_runner.go:57] Run: sudo rm -f /etc/docker/server-key.pem
I1130 15:44:45.057955    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
I1130 15:44:45.068204    3932 ssh_runner.go:57] Run: sudo rm -f /etc/docker/ca.pem
I1130 15:44:45.072204    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/docker
Getting VM IP address...
Moving files into cluster...
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.0
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-dnsmasq-nanny-amd64_1.14.5
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google_containers\kubernetes-dashboard-amd64_v1.6.3
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-kube-dns-amd64_1.14.5
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google-containers\kube-addon-manager_v6.4-beta.2
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google_containers\pause-amd64_3.0
I1130 15:44:54.127824    3932 cache_images.go:193] Loading image from cache at  c_\.minikube\cache\images\gcr.io\google_containers\k8s-dns-sidecar-amd64_1.14.5
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-kube-dns-amd64_1.14.5
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/kube-addon-manager_v6.4-beta.2
I1130 15:44:54.129824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/pause-amd64_3.0
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /usr/local/bin/localkube
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/storage-provisioner_v1.8.0
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-dnsmasq-nanny-amd64_1.14.5
I1130 15:44:54.128824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/kubernetes-dashboard-amd64_v1.6.3
I1130 15:44:54.129824    3932 ssh_runner.go:57] Run: sudo rm -f /tmp/k8s-dns-sidecar-amd64_1.14.5
I1130 15:44:54.132825    3932 ssh_runner.go:57] Run: sudo mkdir -p /usr/local/bin
I1130 15:44:54.136829    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.139839    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.139839    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.140836    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.140836    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.141837    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.141837    3932 ssh_runner.go:57] Run: sudo mkdir -p /tmp
I1130 15:44:54.180835    3932 ssh_runner.go:57] Run: docker load -i \tmp\pause-amd64_3.0
I1130 15:44:54.600826    3932 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-sidecar-amd64_1.14.5
I1130 15:44:54.616825    3932 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-dnsmasq-nanny-amd64_1.14.5
I1130 15:44:54.644826    3932 ssh_runner.go:57] Run: docker load -i \tmp\k8s-dns-kube-dns-amd64_1.14.5
I1130 15:44:54.778823    3932 ssh_runner.go:57] Run: docker load -i \tmp\kube-addon-manager_v6.4-beta.2
I1130 15:44:54.835819    3932 ssh_runner.go:57] Run: docker load -i \tmp\storage-provisioner_v1.8.0
I1130 15:44:55.004817    3932 ssh_runner.go:57] Run: docker load -i \tmp\kubernetes-dashboard-amd64_v1.6.3
I1130 15:44:55.570807    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/manifests/addon-manager.yaml
I1130 15:44:55.573842    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/manifests/
I1130 15:44:55.581808    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/dashboard-rc.yaml
I1130 15:44:55.585835    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.596809    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/dashboard-svc.yaml
I1130 15:44:55.600838    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.607805    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/storageclass.yaml
I1130 15:44:55.612850    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.624808    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/storage-provisioner.yaml
I1130 15:44:55.631807    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.643806    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-controller.yaml
I1130 15:44:55.651806    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.665806    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-cm.yaml
I1130 15:44:55.669805    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
I1130 15:44:55.678833    3932 ssh_runner.go:57] Run: sudo rm -f /etc/kubernetes/addons/kube-dns-svc.yaml
I1130 15:44:55.683833    3932 ssh_runner.go:57] Run: sudo mkdir -p /etc/kubernetes/addons
Setting up certs...
I1130 15:44:55.695809    3932 certs.go:46] Setting up certificates for IP: 10.100.0.56
I1130 15:44:55.732843    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/ca.crt
I1130 15:44:55.736816    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.741814    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/ca.key
I1130 15:44:55.746685    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.752695    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/apiserver.crt
I1130 15:44:55.755694    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.761696    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/apiserver.key
I1130 15:44:55.766757    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.774821    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client-ca.crt
I1130 15:44:55.779828    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.787827    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client-ca.key
I1130 15:44:55.790829    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.799854    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client.crt
I1130 15:44:55.802885    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.811885    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/certs/proxy-client.key
I1130 15:44:55.815862    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube/certs/
I1130 15:44:55.825928    3932 ssh_runner.go:57] Run: sudo rm -f /var/lib/localkube/kubeconfig
I1130 15:44:55.830502    3932 ssh_runner.go:57] Run: sudo mkdir -p /var/lib/localkube
Connecting to cluster...
Setting up kubeconfig...
I1130 15:44:56.705042    3932 config.go:101] Using kubeconfig:  c:\Users\dba/.kube/config
Starting cluster components...
I1130 15:44:56.717260    3932 ssh_runner.go:57] Run: if [[ `systemctl` =~ -\.mount ]] &>/dev/null;then
  printf %s "[Unit]
Description=Localkube
Documentation=https://github.com/kubernetes/minikube/tree/master/pkg/localkube

[Service]
Type=notify
Restart=always
RestartSec=3

Environment=GODEBUG=netdns=go

ExecStart=/usr/local/bin/localkube   --v 1 --dns-domain=cluster.local --node-ip=10.100.0.56 --generate-certs=false --logtostderr=true --enable-dns=false

ExecReload=/bin/kill -s HUP $MAINPID

[Install]
WantedBy=multi-user.target
" | sudo tee /etc/systemd/system/localkube.service
  sudo systemctl daemon-reload
  sudo systemctl enable localkube.service
  sudo systemctl restart localkube.service || true
else
  sudo killall localkube || true

# Run with nohup so it stays up. Redirect logs to useful places.
sudo sh -c 'PATH=/usr/local/sbin:$PATH GODEBUG=netdns=go nohup /usr/local/bin/localkube   --v 1 --dns-domain=cluster.local --node-ip=10.100.0.56 --generate-certs=false --logtostderr=true --enable-dns=false > /var/lib/localkube/localkube.out 2> /var/lib/localkube/localkube.err < /dev/null & echo $! > /var/run/localkube.pid &'

fi

Kubectl is now configured to use the cluster.
Loading cached images from config file.
PS C:\> kubectl get po -n kube-system
NAME                          READY     STATUS    RESTARTS   AGE
kube-addon-manager-minikube   1/1       Running   2          1h
kube-dns-6fc954457d-fj7kl     3/3       Running   6          1h
kubernetes-dashboard-bd5lq    1/1       Running   2          1h
storage-provisioner           1/1       Running   2          1h
PS C:\> minikube addons list
- storage-provisioner: enabled
- registry: disabled
- registry-creds: disabled
- default-storageclass: enabled
- dashboard: enabled
- coredns: disabled
- kube-dns: enabled
- heapster: disabled
- efk: disabled
- ingress: disabled
- addon-manager: enabled
@weirdgiraffe
Copy link

👍

@dlorenc
Copy link
Contributor

dlorenc commented Nov 30, 2017

cc @r2d4

@DennisBayer
Copy link
Author

DennisBayer commented Nov 30, 2017

  1. clean-install-minikube.iso0.23.6-minikube.exe0.24.0.log
  2. clean-install-minikube.iso0.24.0-minikube.exe0.24.0.log
  3. clean-install-minikube.iso0.23.6-minikube.exe0.23.0.log

I did some tests involving different iso files (see attachements). Approach 1 & 2 failed. So I replaced the new minikube.exe with the old one (approach 3). My tests started to work again. :)

I compared the log of the installation and noticed that different flags are passed:

  • exe-0.23/iso-0.23.6:
    I1130 17:19:34.833072 1396 cluster.go:65] Provisioning machine with config: {MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v0.23.6.iso Memory:2048 CPUs:2 DiskSize:20000 VMDriver:hyperv XhyveDiskDriver:ahci-hd DockerEnv:[] InsecureRegistry:[10.0.0.0/24] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch:vSwitchExt KvmNetwork:default Downloader:{} DockerOpt:[] DisableDriverMounts:false}
  • exe-0.24/iso-0.23.6:
    I1130 17:00:53.850789 4812 cluster.go:71] Provisioning machine with config: {MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v0.23.6.iso Memory:2048 CPUs:2 DiskSize:20000 VMDriver:hyperv XhyveDiskDriver:ahci-hd DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch:vSwitchExt KvmNetwork:default Downloader:{} DockerOpt:[] DisableDriverMounts:false}

InsecureRegistry:[10.0.0.0/24] differs. Of course, this could be coincidence, but perhaps it's helpful. Let me know if you need further logs.

@r2d4
Copy link
Contributor

r2d4 commented Nov 30, 2017

This will be fixed by #2245. We will be getting a patched release out today. In the meantime, there are a few different workarounds:

  • Run minikube config set bootstrapper kubeadm. Delete and recreate the minikube instance. This will be the default starting once we support v1.9.0

  • Or, Download localkube from https://storage.googleapis.com/minikube/releases/latest/localkube and then run minikube config set kubernetes-version file:///path/to/file/above/localkube

  • Or, You may be able to use --insecure-registry 10.0.0.0/24 as an argument to minikube start

Of course, once we release a patch version, you won't need to use any of these.

@r2d4
Copy link
Contributor

r2d4 commented Dec 1, 2017

@mildebrandt
Copy link

@r2d4 I had to use one of the workarounds (I chose the first one) to get v0.24.1 working on Mac. I'm assuming that's not expected?

@mildebrandt
Copy link

Now there's something weird with my Mongo service using the kubeadm bootstrapper, not setting itself to master. Could be a communication issue with the sidecar container in the same pod.....don't know yet. When I revert back to v0.23.0, everything is fine. I'll try to come up with a recreatable test.....but this doesn't seem to be working for Mac.

Here's what I've tried so far:

  1. v0.24.1 -- no DNS
  2. v0.24.1 + kubeadm -- DNS works, Mongo can't set itself the master
  3. v0.24.1 + latest localkube -- no DNS
  4. v0.23.0 -- everything works fine.

@mildebrandt
Copy link

After some testing, here's a little more information about the above. All those example were done using kubernetes 1.7.5. When I move to kubernetes 1.8.0, everything I mentioned above works. So it's some incompatibility with minikube 0.24.1 and kubernetes 1.7.5.

We're a little stuck on 1.7.5 until this issue gets fixed:
kubernetes-client/python#415

@mildebrandt
Copy link

Sorry, seems this was brought up in this open issue already:
#2280

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants