openshift-apiserver drops out temporarily after install. #813

RobertKrawitz · 2018-12-06T20:26:12Z

Version

ostree 47.194
Installer b4f5ceb6bfde8d3dc0e29f708e0494488ea37ee0
Terraform v0.11.8

Platform (aws|libvirt|openstack):

AWS and libvirt

What happened?

After the installer completed (immediately on AWS, about 7 minutes later on libvirt), I was able to oc login. A few minutes later, I was no longer able to; I got 400 messages on the command line. Shortly thereafter (within a few minutes), I was then able to interact, and it stayed up.

On AWS, I was able to narrow the time down to within maybe 20 seconds prior to 20:09:01 UTC.

What you expected to happen?

Once I'm able to log in, I expect to be able to interact with either the CLI or the console without interruption.

How to reproduce it (as minimally and precisely as possible)?

After the installer completes, run oc login -u kubeadmin -p <password> until the login succeeds.
Run oc get routes --all-namespaces (or any similar command) repeatedly.
After several minutes, observe

No resources found.
error: You must be logged in to the server (Unauthorized)

If you try to run oc login, observe

Error from server (InternalError): Internal error occurred: unexpected response: 400

Wait a few more minutes (no need to log in again), and you'll be able to run oc commands as normal, and it stays up.

The text was updated successfully, but these errors were encountered:

RobertKrawitz · 2018-12-06T20:27:46Z

On AWS, there are three openshift-apiservers; one is about a minute or two older than the others. The newer ones started right around the time this problem occurred.

RobertKrawitz · 2018-12-06T20:28:24Z

Log from "older" openshift-apiserver:

I1206 20:07:53.304383       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: openshift.io/BuildConfigSecretInjector.
I1206 20:07:53.304450       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/BuildConfigSecretInjector.
I1206 20:07:53.305957       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: BuildByStrategy.
I1206 20:07:53.306204       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: openshift.io/ImageLimitRange.
I1206 20:07:53.306262       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/ImageLimitRange.
I1206 20:07:53.306444       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: OwnerReferencesPermissionEnforcement.
I1206 20:07:53.316994       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: MutatingAdmissionWebhook.
I1206 20:07:53.324348       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: ValidatingAdmissionWebhook.
I1206 20:07:53.331939       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: ResourceQuota.
I1206 20:07:53.332297       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/ClusterResourceQuota.
I1206 20:07:53.371626       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421b663c0
I1206 20:07:53.371722       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:53.371793       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:53.371940       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:53.374847       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:53.374934       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:53.380212       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b46ce0, CONNECTING
I1206 20:07:53.380284       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421b663c0
I1206 20:07:53.431958       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b46ce0, READY
I1206 20:07:53.432185       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421b663c0
I1206 20:07:53.432254       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:53.432316       1 store.go:1397] Monitoring deploymentconfigs.apps.openshift.io count at <storage-prefix>//deploymentconfigs
W1206 20:07:54.193247       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:54 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:54 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:07:54.525478       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421986300
I1206 20:07:54.525505       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:54.525515       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:54.525570       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:54.525606       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:54.525623       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:54.525868       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4210ce2b0, CONNECTING
I1206 20:07:54.525881       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421986300
I1206 20:07:54.606138       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4210ce2b0, READY
I1206 20:07:54.606266       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421986300
I1206 20:07:54.606346       1 store.go:1397] Monitoring rolebindingrestrictions.authorization.openshift.io count at <storage-prefix>//rolebindingrestrictions
I1206 20:07:54.606430       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:07:55.579878       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:55 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:55 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:07:55.979600       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422e54900
I1206 20:07:55.979626       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:55.979635       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:55.979691       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:55.979727       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:55.979745       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:55.979899       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420a3cc50, CONNECTING
I1206 20:07:55.979913       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422e54900
I1206 20:07:56.016169       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420a3cc50, READY
I1206 20:07:56.016455       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422e54900
I1206 20:07:56.016617       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:56.016802       1 store.go:1397] Monitoring builds.build.openshift.io count at <storage-prefix>//builds
I1206 20:07:56.018586       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422e55aa0
I1206 20:07:56.018725       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:56.018829       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:56.018896       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:56.018952       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:56.019035       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:56.019198       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4209fc5b0, CONNECTING
I1206 20:07:56.019249       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422e55aa0
I1206 20:07:56.137721       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4209fc5b0, READY
I1206 20:07:56.137801       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422e55aa0
I1206 20:07:56.137895       1 store.go:1397] Monitoring buildconfigs.build.openshift.io count at <storage-prefix>//buildconfigs
I1206 20:07:56.138005       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:07:56.548151       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:56 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:56 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:07:56.946890       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422f775c0
I1206 20:07:56.946919       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:56.946930       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:56.947024       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:56.947047       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:56.947072       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:56.947551       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421a360a0, CONNECTING
I1206 20:07:56.947566       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422f775c0
I1206 20:07:57.010972       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421a360a0, READY
I1206 20:07:57.011108       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422f775c0
I1206 20:07:57.011179       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:57.011218       1 store.go:1397] Monitoring images.image.openshift.io count at <storage-prefix>//images
I1206 20:07:57.015006       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421f50000
I1206 20:07:57.015076       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:57.015177       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:57.015236       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:57.015315       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:57.015372       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:57.015495       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4221d3390, CONNECTING
I1206 20:07:57.015542       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421f50000
I1206 20:07:57.063466       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4221d3390, READY
I1206 20:07:57.063581       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421f50000
I1206 20:07:57.063640       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:57.063675       1 store.go:1397] Monitoring imagestreams.image.openshift.io count at <storage-prefix>//imagestreams
W1206 20:07:57.806599       1 genericapiserver.go:342] Skipping API image.openshift.io/1.0 because it has no resources.
W1206 20:07:57.806691       1 genericapiserver.go:342] Skipping API image.openshift.io/pre012 because it has no resources.
W1206 20:07:57.833426       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:57 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:57 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:07:58.306972       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42254d9e0
I1206 20:07:58.307144       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:58.307203       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:58.307306       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:58.307383       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.307443       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:58.307845       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42197e910, CONNECTING
I1206 20:07:58.307912       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42254d9e0
I1206 20:07:58.369679       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42197e910, READY
I1206 20:07:58.369785       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42254d9e0
I1206 20:07:58.369881       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.369925       1 store.go:1397] Monitoring oauthclients.oauth.openshift.io count at <storage-prefix>//oauth/clients
I1206 20:07:58.371855       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc423890f00
I1206 20:07:58.371927       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:58.372064       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:58.372163       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:58.372223       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.372288       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:58.372537       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b47df0, CONNECTING
I1206 20:07:58.372592       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc423890f00
I1206 20:07:58.409985       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b47df0, READY
I1206 20:07:58.410016       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc423890f00
I1206 20:07:58.410057       1 store.go:1397] Monitoring oauthauthorizetokens.oauth.openshift.io count at <storage-prefix>//oauth/authorizetokens
I1206 20:07:58.410959       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.411317       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422432fc0
I1206 20:07:58.411334       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:58.411343       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:58.411549       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:58.411564       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.411581       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:58.411916       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420fb6590, CONNECTING
I1206 20:07:58.411929       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422432fc0
I1206 20:07:58.453032       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420fb6590, READY
I1206 20:07:58.453062       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422432fc0
I1206 20:07:58.453102       1 store.go:1397] Monitoring oauthaccesstokens.oauth.openshift.io count at <storage-prefix>//oauth/accesstokens
I1206 20:07:58.454169       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc423814060
I1206 20:07:58.454191       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:58.454201       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:58.454327       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.454519       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:58.454535       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:58.454551       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:58.457902       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4203cdb90, CONNECTING
I1206 20:07:58.457920       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc423814060
I1206 20:07:58.500984       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4203cdb90, READY
I1206 20:07:58.501009       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc423814060
I1206 20:07:58.501048       1 store.go:1397] Monitoring oauthclientauthorizations.oauth.openshift.io count at <storage-prefix>//oauth/clientauthorizations
I1206 20:07:58.508911       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:07:58.769696       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:58 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:58 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
W1206 20:07:59.280676       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:59 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:59 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:07:59.460325       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422655ec0
I1206 20:07:59.460344       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:07:59.460353       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:07:59.460403       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:07:59.460416       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:07:59.460430       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:07:59.460751       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4200afe20, CONNECTING
I1206 20:07:59.460782       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422655ec0
I1206 20:07:59.501464       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4200afe20, READY
I1206 20:07:59.501489       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422655ec0
I1206 20:07:59.501523       1 store.go:1397] Monitoring clusterresourcequotas.quota.openshift.io count at <storage-prefix>//clusterresourcequotas
I1206 20:07:59.508012       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:07:59.750388       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:07:59 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:07:59 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:00.066011       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4236073e0
I1206 20:08:00.066035       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:00.066046       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:00.066101       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:00.066114       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:00.066160       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:00.066366       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421389f70, CONNECTING
I1206 20:08:00.066380       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4236073e0
I1206 20:08:00.090325       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421389f70, READY
I1206 20:08:00.090346       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4236073e0
I1206 20:08:00.090381       1 store.go:1397] Monitoring routes.route.openshift.io count at <storage-prefix>//routes
I1206 20:08:00.095951       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:08:00.170944       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:08:00 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:08:00 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:00.466918       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4214ecd80
I1206 20:08:00.467110       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:00.467161       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:00.467228       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:00.467307       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:00.467361       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:00.467500       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420fc8910, CONNECTING
I1206 20:08:00.467551       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4214ecd80
I1206 20:08:00.496017       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420fc8910, READY
I1206 20:08:00.496046       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4214ecd80
I1206 20:08:00.496090       1 store.go:1397] Monitoring securitycontextconstraints.security.openshift.io count at <storage-prefix>//securitycontextconstraints
I1206 20:08:00.497164       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4223bcba0
I1206 20:08:00.497182       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:00.497192       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:00.497368       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:00.497562       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:00.497578       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:00.497596       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:00.497940       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421176cb0, CONNECTING
I1206 20:08:00.497955       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4223bcba0
I1206 20:08:00.541052       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421176cb0, READY
I1206 20:08:00.541082       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4223bcba0
I1206 20:08:00.541124       1 store.go:1397] Monitoring rangeallocations.security.openshift.io count at <storage-prefix>//rangeallocations
I1206 20:08:00.542920       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:08:01.281699       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:08:01 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:08:01 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:01.544631       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc424d5ed80
I1206 20:08:01.544851       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:01.544917       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:01.545021       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:01.545095       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:01.545170       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:01.545436       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4251cdcb0, CONNECTING
I1206 20:08:01.545496       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc424d5ed80
I1206 20:08:01.614080       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4251cdcb0, READY
I1206 20:08:01.614406       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:01.614486       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc424d5ed80
I1206 20:08:01.614591       1 store.go:1397] Monitoring templates.template.openshift.io count at <storage-prefix>//templates
I1206 20:08:01.615731       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42505eb40
I1206 20:08:01.616166       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:01.616253       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:01.616424       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:01.616501       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:01.616556       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:01.617168       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4250d13a0, CONNECTING
I1206 20:08:01.617301       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42505eb40
I1206 20:08:01.647611       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4250d13a0, READY
I1206 20:08:01.647646       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42505eb40
I1206 20:08:01.647692       1 store.go:1397] Monitoring templateinstances.template.openshift.io count at <storage-prefix>//templateinstances
I1206 20:08:01.648173       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:01.650299       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42183e060
I1206 20:08:01.650322       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:01.650332       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:01.650419       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:01.650434       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:01.650451       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:01.650911       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42516edd0, CONNECTING
I1206 20:08:01.650926       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42183e060
I1206 20:08:01.706808       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42516edd0, READY
I1206 20:08:01.706839       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42183e060
I1206 20:08:01.706882       1 store.go:1397] Monitoring brokertemplateinstances.template.openshift.io count at <storage-prefix>//brokertemplateinstances
I1206 20:08:01.708162       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:08:02.066855       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:08:02 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:08:02 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:02.383502       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4235575c0
I1206 20:08:02.383526       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:02.383537       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:02.383596       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:02.383642       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:02.383661       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:02.383849       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4242ba400, CONNECTING
I1206 20:08:02.383867       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4235575c0
I1206 20:08:02.416979       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4242ba400, READY
I1206 20:08:02.417003       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4235575c0
I1206 20:08:02.417038       1 store.go:1397] Monitoring users.user.openshift.io count at <storage-prefix>//users
I1206 20:08:02.418228       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:02.424156       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4243487e0
I1206 20:08:02.424175       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:02.424186       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:02.424260       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:02.424275       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:02.424290       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:02.424625       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc424350dc0, CONNECTING
I1206 20:08:02.424641       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4243487e0
I1206 20:08:02.475712       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc424350dc0, READY
I1206 20:08:02.475736       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4243487e0
I1206 20:08:02.476070       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:02.476101       1 store.go:1397] Monitoring identities.user.openshift.io count at <storage-prefix>//useridentities
I1206 20:08:02.477710       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42595ca80
I1206 20:08:02.477726       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:08:02.477735       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:08:02.488013       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:08:02.488033       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:08:02.488049       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:08:02.488364       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc424351260, CONNECTING
I1206 20:08:02.488377       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42595ca80
I1206 20:08:02.527167       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc424351260, READY
I1206 20:08:02.527523       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42595ca80
I1206 20:08:02.527614       1 store.go:1397] Monitoring groups.user.openshift.io count at <storage-prefix>//groups
I1206 20:08:02.528555       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:08:02.799971       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:08:02 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:08:02 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:05.634093       1 openshift_apiserver.go:560] Started Origin API at /oapi/v1
[restful] 2018/12/06 20:08:05 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:08:05 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:08:07.286264       1 server.go:45] Starting master on 0.0.0.0:8443 (v1.11.0+99b66db)
I1206 20:08:07.286371       1 serve.go:116] Serving securely on 0.0.0.0:8443
I1206 20:08:07.286479       1 clusterquotamapping.go:130] Starting ClusterQuotaMappingController controller
I1206 20:08:07.289495       1 openshift_apiserver.go:676] Using default project node label selector: 
I1206 20:08:07.304941       1 logs.go:49] http: TLS handshake error from 10.129.0.1:40604: EOF
I1206 20:08:08.587097       1 storage_rbac.go:185] updated clusterrole.rbac.authorization.k8s.io/system:registry with additional permissions: [{[list] [] [imagestreams] [] []} {[delete] [] [images] [] []} {[get] [] [images] [] []} {[delete] [] [imagestreamtags] [] []} {[get] [] [imagestreamtags] [] []} {[delete] [image.openshift.io] [images] [] []} {[get] [image.openshift.io] [imagestreamtags] [] []} {[get] [] [imagestreamimages] [] []} {[get] [] [imagestreams/secrets] [] []} {[get] [] [images] [] []} {[update] [] [images] [] []} {[get] [] [imagestreams] [] []} {[update] [] [imagestreams] [] []} {[create] [] [imagestreammappings] [] []}]
E1206 20:08:18.285182       1 memcache.go:147] couldn't get resource list for template.openshift.io/v1: the server is currently unable to handle the request
E1206 20:08:28.867651       1 memcache.go:147] couldn't get resource list for template.openshift.io/v1: the server is currently unable to handle the request
E1206 20:08:39.480863       1 memcache.go:147] couldn't get resource list for template.openshift.io/v1: the server is currently unable to handle the request
E1206 20:09:06.941015       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.941437       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.941693       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.941975       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.942270       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.942491       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.942741       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.954780       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.955118       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.955380       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.955819       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.956074       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
E1206 20:09:06.956335       1 streamwatcher.go:109] Unable to decode an event from the watch stream: http2: server sent GOAWAY and closed the connection; LastStreamID=1319, ErrCode=NO_ERROR, debug=""
W1206 20:09:07.169152       1 reflector.go:272] k8s.io/client-go/informers/factory.go:130: watch of *v1.Namespace ended with: too old resource version: 8352 (9495)
W1206 20:09:07.169263       1 reflector.go:272] k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:129: watch of *core.Namespace ended with: too old resource version: 8352 (9495)
W1206 20:09:07.222061       1 reflector.go:272] k8s.io/client-go/informers/factory.go:130: watch of *v1beta1.MutatingWebhookConfiguration ended with: too old resource version: 6069 (9553)
W1206 20:09:07.222166       1 reflector.go:272] k8s.io/client-go/informers/factory.go:130: watch of *v1beta1.ValidatingWebhookConfiguration ended with: too old resource version: 6069 (9552)
W1206 20:09:07.506869       1 reflector.go:272] k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:129: watch of *core.LimitRange ended with: too old resource version: 6050 (9494)
W1206 20:09:07.740480       1 reflector.go:272] k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:129: watch of *core.ResourceQuota ended with: too old resource version: 6051 (9494)
E1206 20:09:31.079623       1 memcache.go:147] couldn't get resource list for packages.apps.redhat.com/v1alpha1: the server is currently unable to handle the request
E1206 20:09:59.460373       1 watch.go:212] unable to encode watch object: expected pointer, but got invalid kind
E1206 20:10:06.370664       1 status.go:64] apiserver received an error that is not an metav1.Status: &field.Error{Type:"FieldValueInvalid", Field:"metadata.name", BadValue:"kube:admin", Detail:"may not contain \":\""}
E1206 20:10:58.452310       1 status.go:64] apiserver received an error that is not an metav1.Status: &field.Error{Type:"FieldValueInvalid", Field:"metadata.name", BadValue:"kube:admin", Detail:"may not contain \":\""}

RobertKrawitz · 2018-12-06T20:28:52Z

Log from one of the "newer" openshift-apiservers:

I1206 20:09:02.389057       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: openshift.io/BuildConfigSecretInjector.
I1206 20:09:02.389121       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/BuildConfigSecretInjector.
I1206 20:09:02.391476       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: BuildByStrategy.
I1206 20:09:02.391728       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: openshift.io/ImageLimitRange.
I1206 20:09:02.391785       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/ImageLimitRange.
I1206 20:09:02.391957       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: OwnerReferencesPermissionEnforcement.
I1206 20:09:02.392272       1 plugins.go:158] Loaded 1 mutating admission controller(s) successfully in the following order: MutatingAdmissionWebhook.
I1206 20:09:02.392580       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: ValidatingAdmissionWebhook.
I1206 20:09:02.393014       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: ResourceQuota.
I1206 20:09:02.393300       1 plugins.go:161] Loaded 1 validating admission controller(s) successfully in the following order: openshift.io/ClusterResourceQuota.
I1206 20:09:02.447080       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421b4eba0
I1206 20:09:02.457579       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:02.457655       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:02.457854       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:02.457925       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:02.458024       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:02.458224       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b2dc70, CONNECTING
I1206 20:09:02.458312       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421b4eba0
I1206 20:09:02.526793       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421b2dc70, READY
I1206 20:09:02.526827       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421b4eba0
I1206 20:09:02.526887       1 store.go:1397] Monitoring deploymentconfigs.apps.openshift.io count at <storage-prefix>//deploymentconfigs
I1206 20:09:02.528943       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:09:03.169971       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:03 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:03 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:03.750865       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4209fe180
I1206 20:09:03.750895       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:03.750906       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:03.750988       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:03.751007       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:03.751031       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:03.754496       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4212aa280, CONNECTING
I1206 20:09:03.754512       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4209fe180
I1206 20:09:03.797917       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4212aa280, READY
I1206 20:09:03.797994       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4209fe180
I1206 20:09:03.798020       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:03.798068       1 store.go:1397] Monitoring rolebindingrestrictions.authorization.openshift.io count at <storage-prefix>//rolebindingrestrictions
W1206 20:09:04.458170       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:04 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:04 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:04.930893       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421ebaa20
I1206 20:09:04.930923       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:04.930934       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:04.931016       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:04.931050       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:04.931068       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:04.931228       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42115d770, CONNECTING
I1206 20:09:04.931241       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421ebaa20
I1206 20:09:04.973645       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42115d770, READY
I1206 20:09:04.973770       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421ebaa20
I1206 20:09:04.973873       1 store.go:1397] Monitoring builds.build.openshift.io count at <storage-prefix>//builds
I1206 20:09:04.976249       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421ebb800
I1206 20:09:04.976342       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:04.976437       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:04.976650       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:04.976959       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:04.977047       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:04.977106       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:04.979639       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c65a0, CONNECTING
I1206 20:09:04.979727       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421ebb800
I1206 20:09:05.030790       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c65a0, READY
I1206 20:09:05.030820       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421ebb800
I1206 20:09:05.030873       1 store.go:1397] Monitoring buildconfigs.build.openshift.io count at <storage-prefix>//buildconfigs
I1206 20:09:05.045781       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:09:05.598308       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:05 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:05 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:05.962464       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422d303c0
I1206 20:09:05.962647       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:05.962722       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:05.962819       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:05.962888       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:05.962943       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:05.963061       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42001a860, CONNECTING
I1206 20:09:05.963114       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422d303c0
I1206 20:09:06.028511       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42001a860, READY
I1206 20:09:06.028729       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422d303c0
I1206 20:09:06.028817       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:06.028855       1 store.go:1397] Monitoring images.image.openshift.io count at <storage-prefix>//images
I1206 20:09:06.030365       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422146a80
I1206 20:09:06.030433       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:06.030511       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:06.030577       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:06.030622       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:06.030701       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:06.030871       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42007a1b0, CONNECTING
I1206 20:09:06.030922       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422146a80
I1206 20:09:06.088014       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc42007a1b0, READY
I1206 20:09:06.088238       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422146a80
I1206 20:09:06.088326       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:06.088367       1 store.go:1397] Monitoring imagestreams.image.openshift.io count at <storage-prefix>//imagestreams
W1206 20:09:06.806852       1 genericapiserver.go:342] Skipping API image.openshift.io/1.0 because it has no resources.
W1206 20:09:06.806977       1 genericapiserver.go:342] Skipping API image.openshift.io/pre012 because it has no resources.
W1206 20:09:06.835349       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:06 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:06 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:07.444989       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc423133680
I1206 20:09:07.445092       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:07.445247       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:07.445317       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:07.445424       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.445482       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:07.445598       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421481170, CONNECTING
I1206 20:09:07.445654       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc423133680
I1206 20:09:07.492693       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421481170, READY
I1206 20:09:07.492959       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc423133680
I1206 20:09:07.493051       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.493090       1 store.go:1397] Monitoring oauthclients.oauth.openshift.io count at <storage-prefix>//oauth/clients
I1206 20:09:07.494776       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422ad4fc0
I1206 20:09:07.494844       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:07.494932       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:07.495004       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:07.495078       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.495132       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:07.495262       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4208603f0, CONNECTING
I1206 20:09:07.495318       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422ad4fc0
I1206 20:09:07.533708       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4208603f0, READY
I1206 20:09:07.534035       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.534111       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422ad4fc0
I1206 20:09:07.534224       1 store.go:1397] Monitoring oauthauthorizetokens.oauth.openshift.io count at <storage-prefix>//oauth/authorizetokens
I1206 20:09:07.535626       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc422ad5d40
I1206 20:09:07.535693       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:07.535794       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:07.535858       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:07.535932       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.535984       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:07.536107       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420861de0, CONNECTING
I1206 20:09:07.536167       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc422ad5d40
I1206 20:09:07.572727       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420861de0, READY
I1206 20:09:07.572809       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc422ad5d40
I1206 20:09:07.572908       1 store.go:1397] Monitoring oauthaccesstokens.oauth.openshift.io count at <storage-prefix>//oauth/accesstokens
I1206 20:09:07.573983       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421dba9c0
I1206 20:09:07.574074       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:07.574120       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:07.574285       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.574584       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:07.574659       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.574708       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:07.574969       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421481850, CONNECTING
I1206 20:09:07.575024       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421dba9c0
I1206 20:09:07.617576       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc421481850, READY
I1206 20:09:07.617845       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421dba9c0
I1206 20:09:07.617940       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:07.617979       1 store.go:1397] Monitoring oauthclientauthorizations.oauth.openshift.io count at <storage-prefix>//oauth/clientauthorizations
W1206 20:09:07.969800       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:07 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:07 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
W1206 20:09:08.664075       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:08 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:08 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:08.864452       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc423dacb40
I1206 20:09:08.864697       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:08.864764       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:08.864872       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:08.864947       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:08.865010       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:08.865462       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4209168d0, CONNECTING
I1206 20:09:08.865525       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc423dacb40
I1206 20:09:08.963706       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4209168d0, READY
I1206 20:09:08.963990       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:08.964060       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc423dacb40
I1206 20:09:08.964177       1 store.go:1397] Monitoring clusterresourcequotas.quota.openshift.io count at <storage-prefix>//clusterresourcequotas
W1206 20:09:09.215939       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:09 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:09 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:09.668866       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc421d5b500
I1206 20:09:09.669048       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:09.669104       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:09.669202       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:09.669275       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:09.669337       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:09.669458       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c84de0, CONNECTING
I1206 20:09:09.669514       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc421d5b500
I1206 20:09:09.758629       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c84de0, READY
I1206 20:09:09.758870       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc421d5b500
I1206 20:09:09.758957       1 store.go:1397] Monitoring routes.route.openshift.io count at <storage-prefix>//routes
I1206 20:09:09.759071       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:09:09.918302       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:09 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:09 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:10.394778       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4210ce720
I1206 20:09:10.394968       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:10.395026       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:10.395128       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:10.395203       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:10.395265       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:10.395381       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420734280, CONNECTING
I1206 20:09:10.395446       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4210ce720
I1206 20:09:10.465657       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420734280, READY
I1206 20:09:10.466014       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:10.465981       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4210ce720
I1206 20:09:10.466235       1 store.go:1397] Monitoring securitycontextconstraints.security.openshift.io count at <storage-prefix>//securitycontextconstraints
I1206 20:09:10.468085       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4210cf380
I1206 20:09:10.468240       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:10.468299       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:10.468428       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:10.468490       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:10.468636       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:10.468798       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420d84390, CONNECTING
I1206 20:09:10.468857       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4210cf380
I1206 20:09:10.558714       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420d84390, READY
I1206 20:09:10.558749       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4210cf380
I1206 20:09:10.558791       1 store.go:1397] Monitoring rangeallocations.security.openshift.io count at <storage-prefix>//rangeallocations
I1206 20:09:10.559009       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
W1206 20:09:11.069440       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:11 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:11 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:11.622673       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42275e180
I1206 20:09:11.622821       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:11.622877       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:11.622957       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:11.623071       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.623149       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:11.623442       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c6d00, CONNECTING
I1206 20:09:11.623510       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42275e180
I1206 20:09:11.671209       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c6d00, READY
I1206 20:09:11.671516       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42275e180
I1206 20:09:11.671595       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.671658       1 store.go:1397] Monitoring templates.template.openshift.io count at <storage-prefix>//templates
I1206 20:09:11.673141       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42134aae0
I1206 20:09:11.673492       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:11.673562       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:11.673717       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:11.673775       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.673830       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:11.674096       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420cc4ca0, CONNECTING
I1206 20:09:11.674157       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42134aae0
I1206 20:09:11.718226       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420cc4ca0, READY
I1206 20:09:11.718353       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42134aae0
I1206 20:09:11.718460       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.718504       1 store.go:1397] Monitoring templateinstances.template.openshift.io count at <storage-prefix>//templateinstances
I1206 20:09:11.720196       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc42134b980
I1206 20:09:11.720268       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:11.720381       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:11.720492       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:11.720573       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.720666       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:11.720848       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c5a070, CONNECTING
I1206 20:09:11.720906       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc42134b980
I1206 20:09:11.797248       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c5a070, READY
I1206 20:09:11.797549       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:11.797625       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc42134b980
I1206 20:09:11.797762       1 store.go:1397] Monitoring brokertemplateinstances.template.openshift.io count at <storage-prefix>//brokertemplateinstances
W1206 20:09:12.209391       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:12 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:12 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:12.710341       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4232dd1a0
I1206 20:09:12.710438       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:12.710450       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:12.710487       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:12.710503       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.710521       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:12.710609       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c74f0, CONNECTING
I1206 20:09:12.710622       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4232dd1a0
I1206 20:09:12.767765       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc4211c74f0, READY
I1206 20:09:12.767795       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4232dd1a0
I1206 20:09:12.767840       1 store.go:1397] Monitoring users.user.openshift.io count at <storage-prefix>//users
I1206 20:09:12.769454       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.770040       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4232ddf80
I1206 20:09:12.770058       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:12.770068       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:12.770280       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:12.770296       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.770314       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:12.771674       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420cb4090, CONNECTING
I1206 20:09:12.771692       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4232ddf80
I1206 20:09:12.837128       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420cb4090, READY
I1206 20:09:12.837305       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4232ddf80
I1206 20:09:12.837417       1 store.go:1397] Monitoring identities.user.openshift.io count at <storage-prefix>//useridentities
I1206 20:09:12.837643       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.838735       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: IDLE, 0xc4243c6d80
I1206 20:09:12.838825       1 resolver_conn_wrapper.go:64] dialing to target with scheme: ""
I1206 20:09:12.838871       1 resolver_conn_wrapper.go:70] could not get resolver for scheme: ""
I1206 20:09:12.839169       1 balancer_v1_wrapper.go:91] balancerWrapper: is pickfirst: false
I1206 20:09:12.839227       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.839277       1 balancer_conn_wrappers.go:168] ccBalancerWrapper: new subconn: [{etcd.kube-system.svc:2379 0  <nil>}]
I1206 20:09:12.839724       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c5bfa0, CONNECTING
I1206 20:09:12.839785       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: CONNECTING, 0xc4243c6d80
I1206 20:09:12.893704       1 balancer_v1_wrapper.go:224] balancerWrapper: handle subconn state change: 0xc420c5bfa0, READY
I1206 20:09:12.893972       1 balancer_conn_wrappers.go:190] ccBalancerWrapper: updating state and picker called by balancer: READY, 0xc4243c6d80
I1206 20:09:12.894065       1 balancer_v1_wrapper.go:116] balancerWrapper: got update addr from Notify: [{etcd.kube-system.svc:2379 <nil>}]
I1206 20:09:12.894109       1 store.go:1397] Monitoring groups.user.openshift.io count at <storage-prefix>//groups
W1206 20:09:13.245394       1 config.go:270] No API exists for predefined swagger description /oapi/v1
[restful] 2018/12/06 20:09:13 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:13 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:17.315408       1 openshift_apiserver.go:560] Started Origin API at /oapi/v1
[restful] 2018/12/06 20:09:17 log.go:33: [restful/swagger] listing is available at https://apiserver.openshift-apiserver.svc:8443/swaggerapi
[restful] 2018/12/06 20:09:17 log.go:33: [restful/swagger] https://apiserver.openshift-apiserver.svc:8443/swaggerui/ is mapped to folder /swagger-ui/
I1206 20:09:18.571637       1 server.go:45] Starting master on 0.0.0.0:8443 (v1.11.0+99b66db)
I1206 20:09:18.571809       1 serve.go:116] Serving securely on 0.0.0.0:8443
I1206 20:09:18.578672       1 clusterquotamapping.go:130] Starting ClusterQuotaMappingController controller
I1206 20:09:18.578806       1 openshift_apiserver.go:676] Using default project node label selector: 
I1206 20:09:18.585424       1 logs.go:49] http: TLS handshake error from 10.130.0.1:41922: EOF
E1206 20:09:19.036984       1 memcache.go:147] couldn't get resource list for apps.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.045457       1 memcache.go:147] couldn't get resource list for build.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.049885       1 memcache.go:147] couldn't get resource list for image.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.051999       1 memcache.go:147] couldn't get resource list for oauth.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.054537       1 memcache.go:147] couldn't get resource list for project.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.067515       1 memcache.go:147] couldn't get resource list for security.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.079521       1 memcache.go:147] couldn't get resource list for template.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.087639       1 memcache.go:147] couldn't get resource list for user.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.179406       1 memcache.go:147] couldn't get resource list for apps.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.184167       1 memcache.go:147] couldn't get resource list for build.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.184924       1 memcache.go:147] couldn't get resource list for image.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.187067       1 memcache.go:147] couldn't get resource list for oauth.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.195126       1 memcache.go:147] couldn't get resource list for project.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.203633       1 memcache.go:147] couldn't get resource list for security.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.204326       1 memcache.go:147] couldn't get resource list for template.openshift.io/v1: the server could not find the requested resource
E1206 20:09:19.206107       1 memcache.go:147] couldn't get resource list for user.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.310755       1 memcache.go:147] couldn't get resource list for build.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.311600       1 memcache.go:147] couldn't get resource list for image.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.312741       1 memcache.go:147] couldn't get resource list for oauth.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.313893       1 memcache.go:147] couldn't get resource list for project.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.327398       1 memcache.go:147] couldn't get resource list for security.openshift.io/v1: the server could not find the requested resource
E1206 20:09:29.335285       1 memcache.go:147] couldn't get resource list for user.openshift.io/v1: the server could not find the requested resource
E1206 20:09:39.491022       1 memcache.go:147] couldn't get resource list for build.openshift.io/v1: the server could not find the requested resource
E1206 20:09:39.491850       1 memcache.go:147] couldn't get resource list for image.openshift.io/v1: the server could not find the requested resource
E1206 20:09:39.493096       1 memcache.go:147] couldn't get resource list for oauth.openshift.io/v1: the server could not find the requested resource
E1206 20:09:39.500933       1 memcache.go:147] couldn't get resource list for security.openshift.io/v1: the server could not find the requested resource
E1206 20:09:39.509884       1 memcache.go:147] couldn't get resource list for packages.apps.redhat.com/v1alpha1: the server is currently unable to handle the request
E1206 20:09:49.589315       1 memcache.go:147] couldn't get resource list for build.openshift.io/v1: the server could not find the requested resource
E1206 20:09:49.602435       1 memcache.go:147] couldn't get resource list for security.openshift.io/v1: the server could not find the requested resource
E1206 20:09:49.613755       1 memcache.go:147] couldn't get resource list for packages.apps.redhat.com/v1alpha1: the server is currently unable to handle the request

wking · 2018-12-07T07:00:00Z

Cross-linking openshift/origin#21612.

deads2k · 2018-12-07T13:18:46Z

On libvirt an api server drop is expected.

On aws, I wouldn't. Based on the message and the user, this worth checking with @enj for the new authenticator.

RobertKrawitz · 2018-12-07T21:50:49Z

This is very definitely happening on AWS also.

wking · 2018-12-14T06:17:46Z

I think this might have been resolved by openshift/machine-config-operator#225. Can anyone still reproduce? If not, can we close this?

RobertKrawitz · 2018-12-14T14:39:16Z

I didn't observe it on either aws or libvirt; go ahead and close it.

wking · 2018-12-14T15:34:27Z

/close

openshift-ci-robot · 2018-12-14T15:34:29Z

@wking: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

deads2k mentioned this issue Dec 7, 2018

new authenticator not handled by all consumers openshift/origin#21632

Closed

openshift-ci-robot closed this as completed Dec 14, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

openshift-apiserver drops out temporarily after install. #813

openshift-apiserver drops out temporarily after install. #813

RobertKrawitz commented Dec 6, 2018

RobertKrawitz commented Dec 6, 2018

RobertKrawitz commented Dec 6, 2018 •

edited by crawford

Loading

RobertKrawitz commented Dec 6, 2018 •

edited by crawford

Loading

wking commented Dec 7, 2018

deads2k commented Dec 7, 2018

RobertKrawitz commented Dec 7, 2018

wking commented Dec 14, 2018

RobertKrawitz commented Dec 14, 2018

wking commented Dec 14, 2018

openshift-ci-robot commented Dec 14, 2018

openshift-apiserver drops out temporarily after install. #813

openshift-apiserver drops out temporarily after install. #813

Comments

RobertKrawitz commented Dec 6, 2018

Version

Platform (aws|libvirt|openstack):

What happened?

What you expected to happen?

How to reproduce it (as minimally and precisely as possible)?

RobertKrawitz commented Dec 6, 2018

RobertKrawitz commented Dec 6, 2018 • edited by crawford Loading

RobertKrawitz commented Dec 6, 2018 • edited by crawford Loading

wking commented Dec 7, 2018

deads2k commented Dec 7, 2018

RobertKrawitz commented Dec 7, 2018

wking commented Dec 14, 2018

RobertKrawitz commented Dec 14, 2018

wking commented Dec 14, 2018

openshift-ci-robot commented Dec 14, 2018

RobertKrawitz commented Dec 6, 2018 •

edited by crawford

Loading

RobertKrawitz commented Dec 6, 2018 •

edited by crawford

Loading