Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DNS Test Fail: nslookup kubernetes.default: NXDOMAIN #4475

Closed
medyagh opened this issue Jun 12, 2019 · 1 comment · Fixed by #4480
Closed

DNS Test Fail: nslookup kubernetes.default: NXDOMAIN #4475

medyagh opened this issue Jun 12, 2019 · 1 comment · Fixed by #4480
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.

Comments

@medyagh
Copy link
Member

medyagh commented Jun 12, 2019 •
edited
Loading

Place holder to collect evidence for for Failing test for DNS
The error message is :

11:13:16             ** server can't find kubernetes.default: NXDOMAIN

to replicate:

  • start minikube build from head

  • spin up busybox in default namespace
    kubectl apply -f https://k8s.io/examples/admin/dns/busybox.yaml

  • this will fail : kubectl exec -ti busybox -- nslookup kubernetes.default

tried on both osx and linux, both kvm and virtualbox

note this error does not happen on latest release minikube version: v1.1.1 and only on current master/head

Logs from integration tests:

Linux_Integration_Tests_Virtualbox :

11:13:16     --- FAIL: TestFunctional/DNS (786.92s)
11:13:16         util.go:297: Temporary Error: error running command [exec busybox-xwnm4 nslookup kubernetes.default]: exit status 1. Stdout: 
11:13:16              Server:		10.96.0.10
11:13:16             Address:	10.96.0.10:53
11:13:16             
11:13:16             ** server can't find kubernetes.default: NXDOMAIN
11:13:16             
11:13:16             ** server can't find kubernetes.default: NXDOMAIN
11:13:16             
11:13:16             command terminated with exit code 1
11:13:16             
..
..

11:13:16         cluster_dns_test.go:55: Temporary Error: error running command [exec busybox-xwnm4 nslookup kubernetes.default]: exit status 1. Stdout: 
11:13:16              Server:		10.96.0.10
11:13:16             Address:	10.96.0.10:53
11:13:16             
11:13:16             ** server can't find kubernetes.default: NXDOMAIN
11:13:16             
11:13:16             ** server can't find kubernetes.default: NXDOMAIN
11:13:16             
11:13:16             command terminated with exit code 1

Linux KVM (same error )

  --- FAIL: TestFunctional/DNS (631.04s)
        util.go:297: Temporary Error: error running command [exec busybox-c2ssf nslookup kubernetes.default]: exit status 1. Stdout: 
             Server:        10.96.0.10
            Address:    10.96.0.10:53
             
            ** server can't find kubernetes.default: NXDOMAIN
             
            ** server can't find kubernetes.default: NXDOMAIN
             
            command terminated with exit code 1

OSX VirtualBox (same error )

        cluster_dns_test.go:55: Temporary Error: error running command [exec busybox-4djrh nslookup kubernetes.default]: exit status 1. Stdout: 
             Server:        10.96.0.10
            Address:    10.96.0.10:53
             
            ** server can't find kubernetes.default: NOTIMP
             
            ** server can't find kubernetes.default: NXDOMAIN
             
            command terminated with exit code 1
             
            Temporary Error: error running command [exec busybox-4djrh nslookup kubernetes.default]: exit status 1. Stdout: 
             Server:        10.96.0.10
            Address:    10.96.0.10:53
             
            ** server can't find kubernetes.default: NOTIMP
             
            ** server can't find kubernetes.default: NXDOMAIN
             
            command terminated with exit code 1
             
            Temporary Error: error running command [exec busybox-4djrh nslookup kubernetes.default]: exit status 1. Stdout: 
             Server:        10.96.0.10
            Address:    10.96.0.10:53
             
            ** server can't find kubernetes.default: NOTIMP
             
            ** server can't find kubernetes.default: NXDOMAIN
             
            command terminated with exit code 1
@medyagh medyagh added help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Jun 12, 2019
@medyagh
Copy link
Member Author

medyagh commented Jun 12, 2019

I was able to replicate this error on my own linux kvm box on master:

here the logs for coredns and other pods:

logs for coredns 1

$ kc logs -f coredns-fb8b8dccf-w9crm -n kube-system

.:53
2019-06-12T20:12:58.800Z [INFO] CoreDNS-1.3.1
2019-06-12T20:12:58.800Z [INFO] linux/amd64, go1.11.4, 6b56a9c
CoreDNS-1.3.1
linux/amd64, go1.11.4, 6b56a9c
2019-06-12T20:12:58.800Z [INFO] plugin/reload: Running configuration MD5 = 599b9eb76b8c147408aed6a0bbe0f669

logs for coredns second container

$ kc logs -f coredns-fb8b8dccf-2mjz5 -n kube-system

.:53
2019-06-12T20:12:58.732Z [INFO] CoreDNS-1.3.1
2019-06-12T20:12:58.732Z [INFO] linux/amd64, go1.11.4, 6b56a9c
CoreDNS-1.3.1
linux/amd64, go1.11.4, 6b56a9c
2019-06-12T20:12:58.732Z [INFO] plugin/reload: Running configuration MD5 = 599b9eb76b8c147408aed6a0bbe0f669

logs from kube-api-server-minikube

$ kc logs -f kube-apiserver-minikube -n kube-system
Flag --insecure-port has been deprecated, This flag will be removed in a future version.
I0612 20:12:41.848922       1 server.go:559] external host was not specified, using 192.168.39.246
I0612 20:12:41.849005       1 server.go:146] Version: v1.14.3
I0612 20:12:42.366726       1 plugins.go:158] Loaded 9 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,MutatingAdmissionWebhook.
I0612 20:12:42.366795       1 plugins.go:161] Loaded 6 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,ResourceQuota.
E0612 20:12:42.367267       1 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:42.367313       1 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:42.367383       1 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:42.367446       1 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:42.367484       1 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:42.367526       1 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted
I0612 20:12:42.367552       1 plugins.go:158] Loaded 9 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,MutatingAdmissionWebhook.
I0612 20:12:42.367567       1 plugins.go:161] Loaded 6 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,ResourceQuota.
I0612 20:12:42.368761       1 client.go:352] parsed scheme: ""
I0612 20:12:42.368817       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:42.368862       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:42.368936       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.174158       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.174424       1 client.go:352] parsed scheme: ""
I0612 20:12:43.174453       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.174504       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.174586       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.181023       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.197143       1 master.go:233] Using reconciler: lease
I0612 20:12:43.197657       1 client.go:352] parsed scheme: ""
I0612 20:12:43.197726       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.198413       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.198509       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.205795       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.206995       1 client.go:352] parsed scheme: ""
I0612 20:12:43.207025       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.207095       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.207152       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.212994       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.213365       1 client.go:352] parsed scheme: ""
I0612 20:12:43.213374       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.213423       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.213492       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.219895       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.220162       1 client.go:352] parsed scheme: ""
I0612 20:12:43.220170       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.220289       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.220329       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.226680       1 client.go:352] parsed scheme: ""
I0612 20:12:43.226747       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.226797       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.226901       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.227016       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.232868       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.233169       1 client.go:352] parsed scheme: ""
I0612 20:12:43.233229       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.233279       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.233453       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.240555       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.240902       1 client.go:352] parsed scheme: ""
I0612 20:12:43.240932       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.240978       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.241050       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.248535       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.248934       1 client.go:352] parsed scheme: ""
I0612 20:12:43.248944       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.249025       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.249095       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.255642       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.256045       1 client.go:352] parsed scheme: ""
I0612 20:12:43.256054       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.256137       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.256173       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.263442       1 client.go:352] parsed scheme: ""
I0612 20:12:43.263510       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.263558       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.263634       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.263761       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.269673       1 client.go:352] parsed scheme: ""
I0612 20:12:43.269709       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.269739       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.269784       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.269919       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.277204       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.277437       1 client.go:352] parsed scheme: ""
I0612 20:12:43.277447       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.277519       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.277647       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.285091       1 client.go:352] parsed scheme: ""
I0612 20:12:43.285129       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.285163       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.285224       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.285336       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.294123       1 client.go:352] parsed scheme: ""
I0612 20:12:43.294167       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.294561       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.294624       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.298760       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.305103       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.305428       1 client.go:352] parsed scheme: ""
I0612 20:12:43.305455       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.305489       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.305528       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.311184       1 client.go:352] parsed scheme: ""
I0612 20:12:43.311219       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.311248       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.311292       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.311422       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.317687       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.317949       1 client.go:352] parsed scheme: ""
I0612 20:12:43.317976       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.318005       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.318084       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.324540       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.324901       1 client.go:352] parsed scheme: ""
I0612 20:12:43.324980       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.325056       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.325146       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.331211       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.366616       1 client.go:352] parsed scheme: ""
I0612 20:12:43.366772       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.366982       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.367240       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.382132       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.391291       1 client.go:352] parsed scheme: ""
I0612 20:12:43.391300       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.391323       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.391491       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.398095       1 client.go:352] parsed scheme: ""
I0612 20:12:43.398129       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.398157       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.398244       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.398458       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.405961       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.406180       1 client.go:352] parsed scheme: ""
I0612 20:12:43.406192       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.406212       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.406368       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.420229       1 client.go:352] parsed scheme: ""
I0612 20:12:43.420286       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.420371       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.420482       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.420626       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.427807       1 client.go:352] parsed scheme: ""
I0612 20:12:43.427863       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.427956       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.428051       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.428210       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.435927       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.436563       1 client.go:352] parsed scheme: ""
I0612 20:12:43.436595       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.436805       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.436898       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.444405       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.445089       1 client.go:352] parsed scheme: ""
I0612 20:12:43.445255       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.445339       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.445462       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.452446       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.452975       1 client.go:352] parsed scheme: ""
I0612 20:12:43.453051       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.453120       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.453207       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.459350       1 client.go:352] parsed scheme: ""
I0612 20:12:43.459429       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.459495       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.459586       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.459763       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.466327       1 client.go:352] parsed scheme: ""
I0612 20:12:43.466392       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.466473       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.466546       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.466723       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.472780       1 client.go:352] parsed scheme: ""
I0612 20:12:43.472835       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.472921       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.473000       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.473188       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.480205       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.480670       1 client.go:352] parsed scheme: ""
I0612 20:12:43.480679       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.480708       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.481071       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.492237       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.492859       1 client.go:352] parsed scheme: ""
I0612 20:12:43.492919       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.493030       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.493111       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.499966       1 client.go:352] parsed scheme: ""
I0612 20:12:43.500022       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.500100       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.500168       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.500349       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.506575       1 client.go:352] parsed scheme: ""
I0612 20:12:43.506630       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.506708       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.506777       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.506974       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.512909       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.513300       1 client.go:352] parsed scheme: ""
I0612 20:12:43.513330       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.513367       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.513464       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.525664       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.526180       1 client.go:352] parsed scheme: ""
I0612 20:12:43.526274       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.526350       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.526447       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.536590       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.537170       1 client.go:352] parsed scheme: ""
I0612 20:12:43.537350       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.537869       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.538006       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.560263       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.560551       1 client.go:352] parsed scheme: ""
I0612 20:12:43.560620       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.560686       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.560827       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.567545       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.567852       1 client.go:352] parsed scheme: ""
I0612 20:12:43.567860       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.567939       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.567990       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.573545       1 client.go:352] parsed scheme: ""
I0612 20:12:43.573617       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.573711       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.573921       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.574020       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.579366       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.579835       1 client.go:352] parsed scheme: ""
I0612 20:12:43.579845       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.579947       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.580018       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.591623       1 client.go:352] parsed scheme: ""
I0612 20:12:43.591729       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.591832       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.591913       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.592095       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.598755       1 client.go:352] parsed scheme: ""
I0612 20:12:43.598767       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.598802       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.598841       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.598978       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.606346       1 client.go:352] parsed scheme: ""
I0612 20:12:43.606361       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.606407       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.606523       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.606670       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.613739       1 client.go:352] parsed scheme: ""
I0612 20:12:43.613751       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.613800       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.613922       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.614094       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.621637       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.621902       1 client.go:352] parsed scheme: ""
I0612 20:12:43.621930       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.622014       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.622098       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.628474       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.628794       1 client.go:352] parsed scheme: ""
I0612 20:12:43.628866       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.628945       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.629077       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.642909       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.644293       1 client.go:352] parsed scheme: ""
I0612 20:12:43.644325       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.644387       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.644477       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.651710       1 client.go:352] parsed scheme: ""
I0612 20:12:43.651721       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.651754       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.651824       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.651967       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.658529       1 client.go:352] parsed scheme: ""
I0612 20:12:43.658539       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.658616       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.658855       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.658907       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.665579       1 client.go:352] parsed scheme: ""
I0612 20:12:43.665590       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.665662       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.665720       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.665861       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.672020       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.672472       1 client.go:352] parsed scheme: ""
I0612 20:12:43.672482       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.672533       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.672619       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.679254       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.679539       1 client.go:352] parsed scheme: ""
I0612 20:12:43.679614       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.679665       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.679761       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.686915       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.687359       1 client.go:352] parsed scheme: ""
I0612 20:12:43.687367       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.687468       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.687508       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.693673       1 client.go:352] parsed scheme: ""
I0612 20:12:43.693684       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.693737       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.693818       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.693943       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.700969       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.701904       1 client.go:352] parsed scheme: ""
I0612 20:12:43.702043       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.702612       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.702763       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.710294       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.710569       1 client.go:352] parsed scheme: ""
I0612 20:12:43.710598       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.710641       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.710794       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.730965       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.731741       1 client.go:352] parsed scheme: ""
I0612 20:12:43.731765       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.731951       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.732047       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.749140       1 client.go:352] parsed scheme: ""
I0612 20:12:43.749248       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.749326       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.749446       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.749638       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.756231       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.756610       1 client.go:352] parsed scheme: ""
I0612 20:12:43.756619       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.756658       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.756681       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.762592       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.762969       1 client.go:352] parsed scheme: ""
I0612 20:12:43.762983       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.763009       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.763051       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.770176       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.770486       1 client.go:352] parsed scheme: ""
I0612 20:12:43.770513       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.770555       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.770604       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.776732       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.777252       1 client.go:352] parsed scheme: ""
I0612 20:12:43.777309       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.777345       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.777405       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.784251       1 client.go:352] parsed scheme: ""
I0612 20:12:43.784302       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.784341       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.784473       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.784552       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.791312       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.791725       1 client.go:352] parsed scheme: ""
I0612 20:12:43.791734       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.791809       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.791911       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.798546       1 client.go:352] parsed scheme: ""
I0612 20:12:43.798605       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.798641       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.798705       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.798793       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.805218       1 client.go:352] parsed scheme: ""
I0612 20:12:43.805231       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.805248       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.805276       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.805468       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.811643       1 client.go:352] parsed scheme: ""
I0612 20:12:43.811656       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.811685       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.811799       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.811996       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.827637       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.827961       1 client.go:352] parsed scheme: ""
I0612 20:12:43.827990       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.828044       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.828099       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.834680       1 client.go:352] parsed scheme: ""
I0612 20:12:43.834729       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.834777       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.834844       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.835014       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.841160       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.841498       1 client.go:352] parsed scheme: ""
I0612 20:12:43.841544       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:43.841587       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:43.841642       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:43.858210       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
W0612 20:12:43.964978       1 genericapiserver.go:344] Skipping API batch/v2alpha1 because it has no resources.
W0612 20:12:43.969720       1 genericapiserver.go:344] Skipping API node.k8s.io/v1alpha1 because it has no resources.
W0612 20:12:43.972192       1 genericapiserver.go:344] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
W0612 20:12:43.972703       1 genericapiserver.go:344] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
W0612 20:12:43.974105       1 genericapiserver.go:344] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
E0612 20:12:44.540248       1 prometheus.go:138] failed to register depth metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:44.540516       1 prometheus.go:150] failed to register adds metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:44.540635       1 prometheus.go:162] failed to register latency metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:44.540699       1 prometheus.go:174] failed to register work_duration metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:44.540725       1 prometheus.go:189] failed to register unfinished_work_seconds metric admission_quota_controller: duplicate metrics collector registration attempted
E0612 20:12:44.540752       1 prometheus.go:202] failed to register longest_running_processor_microseconds metric admission_quota_controller: duplicate metrics collector registration attempted
I0612 20:12:44.540780       1 plugins.go:158] Loaded 9 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,MutatingAdmissionWebhook.
I0612 20:12:44.540793       1 plugins.go:161] Loaded 6 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,ValidatingAdmissionWebhook,ResourceQuota.
I0612 20:12:44.542454       1 client.go:352] parsed scheme: ""
I0612 20:12:44.542525       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:44.542611       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:44.542702       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:44.549591       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:44.550141       1 client.go:352] parsed scheme: ""
I0612 20:12:44.550243       1 client.go:352] scheme "" not registered, fallback to default scheme
I0612 20:12:44.550366       1 asm_amd64.s:1337] ccResolverWrapper: sending new addresses to cc: [{127.0.0.1:2379 0  <nil>}]
I0612 20:12:44.550620       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:44.558422       1 asm_amd64.s:1337] balancerWrapper: got update addr from Notify: [{127.0.0.1:2379 <nil>}]
I0612 20:12:45.761523       1 secure_serving.go:116] Serving securely on [::]:8443
I0612 20:12:45.761731       1 available_controller.go:320] Starting AvailableConditionController
I0612 20:12:45.761787       1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
I0612 20:12:45.763127       1 autoregister_controller.go:139] Starting autoregister controller
I0612 20:12:45.763137       1 cache.go:32] Waiting for caches to sync for autoregister controller
I0612 20:12:45.764089       1 crd_finalizer.go:242] Starting CRDFinalizer
I0612 20:12:45.764424       1 apiservice_controller.go:94] Starting APIServiceRegistrationController
I0612 20:12:45.764438       1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
I0612 20:12:45.764750       1 controller.go:81] Starting OpenAPI AggregationController
I0612 20:12:45.769155       1 crdregistration_controller.go:112] Starting crd-autoregister controller
I0612 20:12:45.769166       1 controller_utils.go:1027] Waiting for caches to sync for crd-autoregister controller
I0612 20:12:45.779817       1 customresource_discovery_controller.go:208] Starting DiscoveryController
I0612 20:12:45.784211       1 naming_controller.go:284] Starting NamingConditionController
I0612 20:12:45.788151       1 establishing_controller.go:73] Starting EstablishingController
E0612 20:12:45.869841       1 controller.go:148] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.39.246, ResourceVersion: 0, AdditionalErrorMsg: 
I0612 20:12:45.961922       1 cache.go:39] Caches are synced for AvailableConditionController controller
I0612 20:12:45.963297       1 cache.go:39] Caches are synced for autoregister controller
I0612 20:12:45.964753       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
I0612 20:12:45.969925       1 controller_utils.go:1034] Caches are synced for crd-autoregister controller
I0612 20:12:46.083087       1 controller.go:606] quota admission added evaluator for: namespaces
I0612 20:12:46.752581       1 controller.go:107] OpenAPI AggregationController: Processing item 
I0612 20:12:46.752732       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
I0612 20:12:46.752871       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
I0612 20:12:46.777898       1 storage_scheduling.go:113] created PriorityClass system-node-critical with value 2000001000
I0612 20:12:46.818651       1 storage_scheduling.go:113] created PriorityClass system-cluster-critical with value 2000000000
I0612 20:12:46.818812       1 storage_scheduling.go:122] all system priority classes are created successfully or already exist.
I0612 20:12:46.826979       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/cluster-admin
I0612 20:12:46.831040       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:discovery
I0612 20:12:46.838262       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:basic-user
I0612 20:12:46.847544       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:public-info-viewer
I0612 20:12:46.851958       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/admin
I0612 20:12:46.855208       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/edit
I0612 20:12:46.858828       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/view
I0612 20:12:46.862126       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:aggregate-to-admin
I0612 20:12:46.864803       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:aggregate-to-edit
I0612 20:12:46.882844       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:aggregate-to-view
I0612 20:12:46.889716       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:heapster
I0612 20:12:46.898235       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:node
I0612 20:12:46.906790       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:node-problem-detector
I0612 20:12:46.910338       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:node-proxier
I0612 20:12:46.914354       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:kubelet-api-admin
I0612 20:12:46.942616       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:node-bootstrapper
I0612 20:12:46.946444       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:auth-delegator
I0612 20:12:46.951610       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:kube-aggregator
I0612 20:12:46.954774       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:kube-controller-manager
I0612 20:12:46.961781       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:kube-scheduler
I0612 20:12:46.964346       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:kube-dns
I0612 20:12:46.967838       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:persistent-volume-provisioner
I0612 20:12:46.971801       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:csi-external-attacher
I0612 20:12:46.974994       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:aws-cloud-provider
I0612 20:12:46.977652       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:nodeclient
I0612 20:12:46.985260       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient
I0612 20:12:46.988018       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:volume-scheduler
I0612 20:12:46.990929       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:csi-external-provisioner
I0612 20:12:46.993999       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:attachdetach-controller
I0612 20:12:47.001616       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller
I0612 20:12:47.009989       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:cronjob-controller
I0612 20:12:47.025981       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:daemon-set-controller
I0612 20:12:47.029722       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:deployment-controller
I0612 20:12:47.032929       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:disruption-controller
I0612 20:12:47.036671       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:endpoint-controller
I0612 20:12:47.039531       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:expand-controller
I0612 20:12:47.059768       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:generic-garbage-collector
I0612 20:12:47.064345       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler
I0612 20:12:47.068017       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:job-controller
I0612 20:12:47.071113       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:namespace-controller
I0612 20:12:47.073800       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:node-controller
I0612 20:12:47.080664       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:persistent-volume-binder
I0612 20:12:47.087503       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:pod-garbage-collector
I0612 20:12:47.090610       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:replicaset-controller
I0612 20:12:47.094346       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:replication-controller
I0612 20:12:47.097342       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:resourcequota-controller
I0612 20:12:47.100151       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:route-controller
I0612 20:12:47.103334       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:service-account-controller
I0612 20:12:47.112109       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:service-controller
I0612 20:12:47.116576       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:statefulset-controller
I0612 20:12:47.120410       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:ttl-controller
I0612 20:12:47.124809       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:certificate-controller
I0612 20:12:47.128054       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:pvc-protection-controller
I0612 20:12:47.131093       1 storage_rbac.go:195] created clusterrole.rbac.authorization.k8s.io/system:controller:pv-protection-controller
I0612 20:12:47.145605       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/cluster-admin
I0612 20:12:47.188391       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:discovery
I0612 20:12:47.226345       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:basic-user
I0612 20:12:47.276800       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:public-info-viewer
I0612 20:12:47.307533       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:node-proxier
I0612 20:12:47.347136       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:kube-controller-manager
I0612 20:12:47.386868       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:kube-dns
I0612 20:12:47.426960       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:kube-scheduler
I0612 20:12:47.467661       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:aws-cloud-provider
I0612 20:12:47.507474       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:volume-scheduler
I0612 20:12:47.546897       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:node
I0612 20:12:47.588424       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller
I0612 20:12:47.627551       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller
I0612 20:12:47.669783       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller
I0612 20:12:47.731808       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller
I0612 20:12:47.748689       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller
I0612 20:12:47.785605       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller
I0612 20:12:47.832550       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller
I0612 20:12:47.868086       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller
I0612 20:12:47.906922       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector
I0612 20:12:47.946777       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler
I0612 20:12:47.987761       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller
I0612 20:12:48.028316       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller
I0612 20:12:48.067456       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller
I0612 20:12:48.107278       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder
I0612 20:12:48.149213       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:pod-garbage-collector
I0612 20:12:48.188145       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:replicaset-controller
I0612 20:12:48.228500       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:replication-controller
I0612 20:12:48.267241       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:resourcequota-controller
I0612 20:12:48.308583       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:route-controller
I0612 20:12:48.348196       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-account-controller
I0612 20:12:48.390496       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-controller
I0612 20:12:48.428260       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:statefulset-controller
I0612 20:12:48.472776       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:ttl-controller
I0612 20:12:48.509229       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller
I0612 20:12:48.548145       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:pvc-protection-controller
I0612 20:12:48.588660       1 storage_rbac.go:223] created clusterrolebinding.rbac.authorization.k8s.io/system:controller:pv-protection-controller
I0612 20:12:48.624741       1 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io
I0612 20:12:48.629393       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system:controller:bootstrap-signer in kube-public
I0612 20:12:48.668525       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/extension-apiserver-authentication-reader in kube-system
I0612 20:12:48.708305       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system:controller:bootstrap-signer in kube-system
I0612 20:12:48.748170       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system:controller:cloud-provider in kube-system
I0612 20:12:48.801766       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system:controller:token-cleaner in kube-system
I0612 20:12:48.827427       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system::leader-locking-kube-controller-manager in kube-system
I0612 20:12:48.839260       1 controller.go:606] quota admission added evaluator for: endpoints
I0612 20:12:48.865709       1 storage_rbac.go:254] created role.rbac.authorization.k8s.io/system::leader-locking-kube-scheduler in kube-system
I0612 20:12:48.904356       1 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
I0612 20:12:48.912625       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system:controller:bootstrap-signer in kube-public
I0612 20:12:48.947022       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system::extension-apiserver-authentication-reader in kube-system
I0612 20:12:48.988441       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system::leader-locking-kube-controller-manager in kube-system
I0612 20:12:49.035589       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system::leader-locking-kube-scheduler in kube-system
I0612 20:12:49.068107       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system:controller:bootstrap-signer in kube-system
I0612 20:12:49.108295       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system:controller:cloud-provider in kube-system
I0612 20:12:49.146045       1 storage_rbac.go:284] created rolebinding.rbac.authorization.k8s.io/system:controller:token-cleaner in kube-system
I0612 20:12:49.249616       1 controller.go:606] quota admission added evaluator for: leases.coordination.k8s.io
W0612 20:12:49.268556       1 lease.go:222] Resetting endpoints for master service "kubernetes" to [192.168.39.246]
I0612 20:12:50.329068       1 controller.go:606] quota admission added evaluator for: serviceaccounts
I0612 20:12:50.769466       1 controller.go:606] quota admission added evaluator for: deployments.apps
I0612 20:12:51.207941       1 controller.go:606] quota admission added evaluator for: daemonsets.apps
I0612 20:12:56.976737       1 controller.go:606] quota admission added evaluator for: controllerrevisions.apps
I0612 20:12:57.226790       1 controller.go:606] quota admission added evaluator for: replicasets.apps
**E0612 20:17:10.826143       1 upgradeaware.go:370] Error proxying data from client to backend: tls: use** of closed connection
E0612 20:18:27.298046       1 upgradeaware.go:370] Error proxying data from client to backend: tls: use of closed connection
E0612 20:19:19.205798       1 upgradeaware.go:370] Error proxying data from client to backend: write tcp 192.168.122.246:46014->192.168.122.246:10250: write: connection reset by peer
E0612 20:19:19.205899       1 upgradeaware.go:384] Error proxying data from backend to client: tls: use of closed connection

@medyagh medyagh changed the title Integration DNS test failing : server can't find kubernetes.default: NXDOMAIN DNS Failed to nslook up kubernetes.default: NXDOMAIN Jun 12, 2019
@medyagh medyagh changed the title DNS Failed to nslook up kubernetes.default: NXDOMAIN DNS Fail: nslookup kubernetes.default: NXDOMAIN Jun 12, 2019
@medyagh medyagh changed the title DNS Fail: nslookup kubernetes.default: NXDOMAIN DNS Test Fail: nslookup kubernetes.default: NXDOMAIN Jun 12, 2019
@medyagh medyagh mentioned this issue Jun 12, 2019
Merged
u5surf added a commit to u5surf/minikube that referenced this issue Jun 13, 2019
@u5surf
use busybox 1.28.4 to be worked nslookup in tests kubernetes#4475
1d5d1b6
@u5surf u5surf mentioned this issue Jun 13, 2019
Merged
u5surf added a commit to u5surf/minikube that referenced this issue Jun 13, 2019
@u5surf
Use busybox 1.28.4 to be worked nslookup in tests kubernetes#4475
5fa1494
medyagh pushed a commit that referenced this issue Jun 14, 2019
@u5surf @medyagh
Fix busybox version in integration tests
8c88558 
Fixes #4475 related to this docker-library/busybox#48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/failing-test Categorizes issue or PR as related to a consistently or frequently failing test. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix busybox version in integration tests u5surf/minikube
1 participant
@medyagh