Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Panic from kustomize / kyaml: fatal error: concurrent map writes #310

Closed
benagricola opened this issue Mar 31, 2021 · 2 comments · Fixed by #343
Closed

Panic from kustomize / kyaml: fatal error: concurrent map writes #310

benagricola opened this issue Mar 31, 2021 · 2 comments · Fixed by #343

Comments

@benagricola
Copy link

A previously working installation of kustomize-controller v0.9.3 has started to panic shortly after startup, with the following backtrace:

Backtrace 
{"level":"info","ts":"2021-03-31T18:19:21.635Z","logger":"controller-runtime.metrics","msg":"metrics server is starting to listen","addr":":8080"}
{"level":"info","ts":"2021-03-31T18:19:21.636Z","logger":"setup","msg":"starting manager"}
I0331 18:19:21.636806       7 leaderelection.go:243] attempting to acquire leader lease flux-system/7593cc5d.fluxcd.io...
{"level":"info","ts":"2021-03-31T18:19:21.636Z","msg":"starting metrics server","path":"/metrics"}
I0331 18:19:37.188167       7 leaderelection.go:253] successfully acquired lease flux-system/7593cc5d.fluxcd.io
{"level":"info","ts":"2021-03-31T18:19:37.188Z","logger":"controller.kustomization","msg":"Starting EventSource","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization","source":"kind source: /, Kind="}
{"level":"info","ts":"2021-03-31T18:19:37.188Z","logger":"controller.kustomization","msg":"Starting EventSource","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization","source":"kind source: /, Kind="}
{"level":"debug","ts":"2021-03-31T18:19:37.188Z","logger":"events","msg":"Normal","object":{"kind":"ConfigMap","namespace":"flux-system","name":"7593cc5d.fluxcd.io","uid":"ae9e08d0-5500-48b0-b3b3-b5ac794e1d15","apiVersion":"v1","resourceVersion":"11452803"},"reason":"LeaderElection","message":"kustomize-controller-6799f796db-wd4v7_fbd558c6-84d4-4269-8de9-c570b36d51e1 became leader"}
{"level":"debug","ts":"2021-03-31T18:19:37.188Z","logger":"events","msg":"Normal","object":{"kind":"Lease","namespace":"flux-system","name":"7593cc5d.fluxcd.io","uid":"67555884-8dbe-4132-800d-f2f4a9787005","apiVersion":"coordination.k8s.io/v1","resourceVersion":"11452804"},"reason":"LeaderElection","message":"kustomize-controller-6799f796db-wd4v7_fbd558c6-84d4-4269-8de9-c570b36d51e1 became leader"}
{"level":"info","ts":"2021-03-31T18:19:37.288Z","logger":"controller.kustomization","msg":"Starting EventSource","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization","source":"kind source: /, Kind="}
{"level":"info","ts":"2021-03-31T18:19:37.389Z","logger":"controller.kustomization","msg":"Starting Controller","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization"}
{"level":"info","ts":"2021-03-31T18:19:37.389Z","logger":"controller.kustomization","msg":"Starting workers","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization","worker count":4}
{"level":"error","ts":"2021-03-31T18:19:37.402Z","logger":"controller.kustomization","msg":"Dependencies do not meet ready condition, retrying in 30s","reconciler group":"kustomize.toolkit.fluxcd.io","reconciler kind":"Kustomization","name":"crossplane-providers","namespace":"flux-system","error":"dependency 'flux-system/crossplane' is not ready","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:298\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:253\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:216\nk8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext.func1\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185\nk8s.io/apimachinery/pkg/util/wait.UntilWithContext\n\t/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:99"}
{"level":"debug","ts":"2021-03-31T18:19:37.403Z","logger":"events","msg":"Normal","object":{"kind":"Kustomization","namespace":"flux-system","name":"crossplane-providers","uid":"ba9bd37b-90d0-4f00-8b00-6bae787b22b7","apiVersion":"kustomize.toolkit.fluxcd.io/v1beta1","resourceVersion":"11443812"},"reason":"info","message":"Dependencies do not meet ready condition, retrying in 30s"}
fatal error: concurrent map writes

goroutine 323 [running]:
runtime.throw(0x20c2c4c, 0x15)
	/usr/local/go/src/runtime/panic.go:1116 +0x72 fp=0xc0009b9af8 sp=0xc0009b9ac8 pc=0x437c72
runtime.mapassign(0x1e38e20, 0xc00b76c630, 0xc0009b9c00, 0xc0015fbd40)
	/usr/local/go/src/runtime/map.go:676 +0x5a7 fp=0xc0009b9b78 sp=0xc0009b9af8 pc=0x4101a7
sigs.k8s.io/kustomize/kyaml/openapi.AddDefinitions(0xc0009cc0c0)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:200 +0x1b9 fp=0xc0009b9ca0 sp=0xc0009b9b78 pc=0x1aec159
sigs.k8s.io/kustomize/kyaml/openapi.parse(0xc00160c000, 0x46d829, 0x7ffe00, 0x46d829, 0x7ffe00)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:505 +0x105 fp=0xc0009b9dd8 sp=0xc0009b9ca0 pc=0x1aed7c5
sigs.k8s.io/kustomize/kyaml/openapi.parseSchema(0x20a8d98, 0x5)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:487 +0x130 fp=0xc0009b9e50 sp=0xc0009b9dd8 pc=0x1aed610
sigs.k8s.io/kustomize/kyaml/openapi.initSchema()
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:469 +0x73 fp=0xc0009b9e90 sp=0xc0009b9e50 pc=0x1aed453
sigs.k8s.io/kustomize/kyaml/openapi.IsNamespaceScoped(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:269
sigs.k8s.io/kustomize/api/resid.Gvk.IsNamespaceableKind(0xc000a1f940, 0x18, 0xc000a1f959, 0x7, 0xc000a28bf0, 0xe, 0xc000a2d2a8)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/gvk.go:219 +0xa5 fp=0xc0009b9f30 sp=0xc0009b9e90 pc=0x1aeef65
sigs.k8s.io/kustomize/api/resid.ResId.EffectiveNamespace(0xc000a1f940, 0x18, 0xc000a1f959, 0x7, 0xc000a28bf0, 0xe, 0xc000a28c14, 0x7, 0xc000a28c30, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:120 +0x5a fp=0xc0009b9fc8 sp=0xc0009b9f30 pc=0x1aef8fa
sigs.k8s.io/kustomize/api/resid.ResId.IsNsEquals(0xc000a1f940, 0x18, 0xc000a1f959, 0x7, 0xc000a28bf0, 0xe, 0xc000a28c14, 0x7, 0xc000a28c30, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:102 +0x45 fp=0xc0009ba048 sp=0xc0009b9fc8 pc=0x1aef705
sigs.k8s.io/kustomize/api/resid.ResId.Equals(0xc000a1f940, 0x18, 0xc000a1f959, 0x7, 0xc000a28bf0, 0xe, 0xc000a28c14, 0x7, 0xc000a28c30, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:96 +0x78 fp=0xc0009ba200 sp=0xc0009ba048 pc=0x1aef498
sigs.k8s.io/kustomize/api/resid.ResId.Equals-fm(0xc000a1f660, 0x14, 0xc000a1f675, 0x2, 0xc000a28a10, 0xe, 0xc000a1f6c0, 0x1f, 0xc000a28a50, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:95 +0x98 fp=0xc0009ba308 sp=0xc0009ba200 pc=0x1b2e278
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).filteredById(0xc000b158c0, 0xc0009ba500, 0x2197960, 0xc000a1f959, 0x7, 0xc000a28bf0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:185 +0x102 fp=0xc0009ba3f8 sp=0xc0009ba308 pc=0x1b2a142
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).GetMatchingResourcesByCurrentId(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:163
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).Append(0xc000b158c0, 0xc0003b6c30, 0x1, 0x1)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:65 +0x11d fp=0xc0009ba568 sp=0xc0009ba3f8 pc=0x1b28c7d
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).AppendAll(0xc000b158c0, 0x241e420, 0xc000b15e20, 0xc000a287e0, 0xf)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:443 +0x8e fp=0xc0009ba5b0 sp=0xc0009ba568 pc=0x1b2c8ce
sigs.k8s.io/kustomize/api/internal/accumulator.(*ResAccumulator).AppendAll(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/accumulator/resaccumulator.go:45
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateFile(0xc0009aca40, 0xc000b158a0, 0xc000a287e0, 0xf, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:427 +0xad fp=0xc0009ba638 sp=0xc0009ba5b0 pc=0x1bd246d
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateResources(0xc0009aca40, 0xc000b158a0, 0xc0009ace40, 0x4, 0x4, 0xc00006e400, 0xc0007e7500, 0xc0009ba780)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:337 +0xb8 fp=0xc0009ba718 sp=0xc0009ba638 pc=0x1bd11b8
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateTarget(0xc0009aca40, 0xc000b158a0, 0x470367, 0x1aed39b, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:163 +0x74 fp=0xc0009ba7b0 sp=0xc0009ba718 pc=0x1bcf554
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).AccumulateTarget(0xc0009aca40, 0x0, 0xffffffffffffffff, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:156 +0xce fp=0xc0009ba7f0 sp=0xc0009ba7b0 pc=0x1bcf46e
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).makeCustomizedResMap(0xc0009aca40, 0xc000a28801, 0x0, 0x0, 0x1f)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:111 +0x2f fp=0xc0009ba828 sp=0xc0009ba7f0 pc=0x1bcf10f
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).MakeCustomizedResMap(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:107
sigs.k8s.io/kustomize/api/krusty.(*Kustomizer).Run(0xc0009bae30, 0xc000b32900, 0x2e, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/krusty/kustomizer.go:82 +0x31b fp=0xc0009bade8 sp=0xc0009ba828 pc=0x1c1827b
github.com/fluxcd/kustomize-controller/controllers.buildKustomization(0x240f540, 0x3275788, 0xc000b32900, 0x2e, 0x0, 0x706f454b49354c46, 0x363258753045586c, 0xa627568704a4538)
	/workspace/controllers/kustomization_generator.go:355 +0x112 fp=0xc0009bae60 sp=0xc0009bade8 pc=0x1c30f12
github.com/fluxcd/kustomize-controller/controllers.(*KustomizeGenerator).checksum(0xc0009bbd00, 0x23ee0c0, 0xc0009c41b0, 0xc000b32900, 0x2e, 0x6ea, 0x0, 0x0, 0x1000)
	/workspace/controllers/kustomization_generator.go:248 +0x134 fp=0xc0009bb498 sp=0xc0009bae60 pc=0x1c305b4
github.com/fluxcd/kustomize-controller/controllers.(*KustomizeGenerator).WriteFile(0xc0009bbd00, 0x23ee0c0, 0xc0009c41b0, 0xc000b32900, 0x2e, 0x50dfe5, 0xc0007de04a, 0xc0009bbae0, 0x40dc88)
	/workspace/controllers/kustomization_generator.go:62 +0x16d fp=0xc0009bba08 sp=0xc0009bb498 pc=0x1c2ec0d
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).generate(0xc0009941e0, 0x23ee0c0, 0xc0009c41b0, 0x240bec0, 0xc0009940a0, 0x1c8ac57, 0xd, 0xc000052f60, 0x23, 0xc000b44b14, ...)
	/workspace/controllers/kustomization_controller.go:503 +0xf8 fp=0xc0009bbfd0 sp=0xc0009bba08 pc=0x1c25818
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009c41b0, 0x1c8ac57, 0xd, 0xc000052f60, 0x23, 0xc000b44b14, 0x7, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:330 +0xa1c fp=0xc0009bce98 sp=0xc0009bbfd0 pc=0x1c234fc
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).Reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009c41b0, 0xc000b44b30, 0xb, 0xc000b44b14, 0x7, 0xc0009c4100, 0x0, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:233 +0xd3e fp=0xc0009c1bf0 sp=0xc0009bce98 pc=0x1c210fe
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x1e9cfc0, 0xc000b711e0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:298 +0x317 fp=0xc0009c1d18 sp=0xc0009c1bf0 pc=0x143d157
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0xc0004b7e00)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:253 +0x205 fp=0xc0009c1da8 sp=0xc0009c1d18 pc=0x143c945
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1.2(0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:216 +0x4a fp=0xc0009c1de0 sp=0xc0009c1da8 pc=0x143df6a
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0x37 fp=0xc0009c1e00 sp=0xc0009c1de0 pc=0x10dd277
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004b7f50)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f fp=0xc0009c1e50 sp=0xc0009c1e00 pc=0x10dd1df
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0009c1f50, 0x2397620, 0xc0009c4150, 0xc0006d7001, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad fp=0xc0009c1ef0 sp=0xc0009c1e50 pc=0x10dc0ad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004b7f50, 0x3b9aca00, 0x0, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98 fp=0xc0009c1f28 sp=0xc0009c1ef0 pc=0x10dbfd8
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x23ee000, 0xc0006d7040, 0xc000735370, 0x3b9aca00, 0x0, 0x1)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0xa6 fp=0xc0009c1f80 sp=0xc0009c1f28 pc=0x10dc2a6
k8s.io/apimachinery/pkg/util/wait.UntilWithContext(0x23ee000, 0xc0006d7040, 0xc000735370, 0x3b9aca00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:99 +0x57 fp=0xc0009c1fc0 sp=0xc0009c1f80 pc=0x10dbf17
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1374 +0x1 fp=0xc0009c1fc8 sp=0xc0009c1fc0 pc=0x470241
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:213 +0x45e

goroutine 1 [select]:
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).Start(0xc0002fcc40, 0x23ee000, 0xc000a47780, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:496 +0x348
main.main()
	/workspace/main.go:145 +0xb76

goroutine 18 [chan receive]:
k8s.io/klog/v2.(*loggingT).flushDaemon(0x3243b20)
	/go/pkg/mod/k8s.io/klog/v2@v2.4.0/klog.go:1169 +0x8b
created by k8s.io/klog/v2.init.0
	/go/pkg/mod/k8s.io/klog/v2@v2.4.0/klog.go:417 +0xdf

goroutine 50 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0003b68c0)
	/go/pkg/mod/go.opencensus.io@v0.22.3/stats/view/worker.go:154 +0x105
created by go.opencensus.io/stats/view.init.0
	/go/pkg/mod/go.opencensus.io@v0.22.3/stats/view/worker.go:32 +0x57

goroutine 46 [runnable]:
internal/poll.runtime_pollWait(0x7f87bf080718, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc00009e598, 0x72, 0x239ad00, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00009e580, 0xc000a64000, 0x6b7b, 0x6b7b, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
net.(*netFD).Read(0xc00009e580, 0xc000a64000, 0x6b7b, 0x6b7b, 0x203000, 0x6fb81b, 0xc0006e6160)
	/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc00000e190, 0xc000a64000, 0x6b7b, 0x6b7b, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:182 +0x8e
crypto/tls.(*atLeastReader).Read(0xc002b85ca0, 0xc000a64000, 0x6b7b, 0x6b7b, 0x37d, 0x6b1e, 0xc00017d708)
	/usr/local/go/src/crypto/tls/conn.go:779 +0x62
bytes.(*Buffer).ReadFrom(0xc0006e6280, 0x23943c0, 0xc002b85ca0, 0x40b7a5, 0x1e3d020, 0x2025180)
	/usr/local/go/src/bytes/buffer.go:204 +0xb1
crypto/tls.(*Conn).readFromUntil(0xc0006e6000, 0x2397b80, 0xc00000e190, 0x5, 0xc00000e190, 0x36c)
	/usr/local/go/src/crypto/tls/conn.go:801 +0xf3
crypto/tls.(*Conn).readRecordOrCCS(0xc0006e6000, 0x0, 0x0, 0xc003c40ae0)
	/usr/local/go/src/crypto/tls/conn.go:608 +0x115
crypto/tls.(*Conn).readRecord(...)
	/usr/local/go/src/crypto/tls/conn.go:576
crypto/tls.(*Conn).Read(0xc0006e6000, 0xc00037f000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/crypto/tls/conn.go:1252 +0x15f
bufio.(*Reader).Read(0xc0003993e0, 0xc0007741f8, 0x9, 0x9, 0xc00987c0c0, 0xc00017dd18, 0x2197a00)
	/usr/local/go/src/bufio/bufio.go:227 +0x222
io.ReadAtLeast(0x2394180, 0xc0003993e0, 0xc0007741f8, 0x9, 0x9, 0x9, 0xc006caad50, 0xc000102030, 0x0)
	/usr/local/go/src/io/io.go:314 +0x87
io.ReadFull(...)
	/usr/local/go/src/io/io.go:333
golang.org/x/net/http2.readFrameHeader(0xc0007741f8, 0x9, 0x9, 0x2394180, 0xc0003993e0, 0x0, 0x0, 0xc0005f98f0, 0xc00017ddd0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/frame.go:237 +0x89
golang.org/x/net/http2.(*Framer).ReadFrame(0xc0007741c0, 0xc0085f98f0, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/frame.go:492 +0xa5
golang.org/x/net/http2.(*clientConnReadLoop).run(0xc00017dfa8, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:1819 +0xd8
golang.org/x/net/http2.(*ClientConn).readLoop(0xc00028a480)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:1741 +0x6f
created by golang.org/x/net/http2.(*Transport).newClientConn
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:705 +0x6c5

goroutine 343 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf080290, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc00083d718, 0x72, 0x239ad00, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00083d700, 0xc000918000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
net.(*netFD).Read(0xc00083d700, 0xc000918000, 0x1000, 0x1000, 0x43a91c, 0xc0000d1b58, 0x467d80)
	/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc000119720, 0xc000918000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:182 +0x8e
net/http.(*persistConn).Read(0xc00072ec60, 0xc000918000, 0x1000, 0x1000, 0xc00090e1e0, 0xc0000d1c58, 0x4058f5)
	/usr/local/go/src/net/http/transport.go:1890 +0x77
bufio.(*Reader).fill(0xc000237920)
	/usr/local/go/src/bufio/bufio.go:101 +0x105
bufio.(*Reader).Peek(0xc000237920, 0x1, 0x0, 0x1, 0x1, 0x0, 0xc00090e120)
	/usr/local/go/src/bufio/bufio.go:139 +0x4f
net/http.(*persistConn).readLoop(0xc00072ec60)
	/usr/local/go/src/net/http/transport.go:2043 +0x1a8
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1711 +0xcb7

goroutine 267 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:228 +0x153
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable.func1(0xc0002fcc40, 0x7f87bef53198, 0xc000a174a0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:681 +0x7e
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:679 +0x73

goroutine 335 [select]:
net/http.(*persistConn).writeLoop(0xc00072f0e0)
	/usr/local/go/src/net/http/transport.go:2342 +0x11c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1712 +0xcdc

goroutine 353 [select]:
net/http.(*persistConn).writeLoop(0xc00083e900)
	/usr/local/go/src/net/http/transport.go:2342 +0x11c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1712 +0xcdc

goroutine 346 [select]:
net/http.(*persistConn).writeLoop(0xc00072e7e0)
	/usr/local/go/src/net/http/transport.go:2342 +0x11c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1712 +0xcdc

goroutine 325 [runnable]:
encoding/json.interfaceEncoder(0xc000839e80, 0x1dcdd00, 0xc006c71dc0, 0x94, 0xc006c70100)
	/usr/local/go/src/encoding/json/encode.go:709 +0x185
encoding/json.mapEncoder.encode(0x2192e80, 0xc000839e80, 0x1dffce0, 0xc0085984e0, 0x15, 0x1df0100)
	/usr/local/go/src/encoding/json/encode.go:801 +0x35c
encoding/json.(*encodeState).reflectValue(0xc000839e80, 0x1dffce0, 0xc0085984e0, 0x15, 0xc008590100)
	/usr/local/go/src/encoding/json/encode.go:358 +0x82
encoding/json.interfaceEncoder(0xc000839e80, 0x1dcdd00, 0xc003cae520, 0x194, 0x1dc0100)
	/usr/local/go/src/encoding/json/encode.go:714 +0xac
encoding/json.arrayEncoder.encode(0x2192e80, 0xc000839e80, 0x1d27980, 0xc002afb880, 0x97, 0x5a0100)
	/usr/local/go/src/encoding/json/encode.go:886 +0xd6
encoding/json.sliceEncoder.encode(0xc000354e20, 0xc000839e80, 0x1d27980, 0xc002afb880, 0x97, 0x1d20100)
	/usr/local/go/src/encoding/json/encode.go:860 +0x8f
encoding/json.(*encodeState).reflectValue(0xc000839e80, 0x1d27980, 0xc002afb880, 0x97, 0xc002af0100)
	/usr/local/go/src/encoding/json/encode.go:358 +0x82
encoding/json.interfaceEncoder(0xc000839e80, 0x1dcdd00, 0xc006c71440, 0x94, 0xc006c70100)
	/usr/local/go/src/encoding/json/encode.go:714 +0xac
encoding/json.mapEncoder.encode(0x2192e80, 0xc000839e80, 0x1dffce0, 0xc00852fd10, 0x15, 0x1df0100)
	/usr/local/go/src/encoding/json/encode.go:801 +0x35c
encoding/json.(*encodeState).reflectValue(0xc000839e80, 0x1dffce0, 0xc00852fd10, 0x15, 0xc008520100)
	/usr/local/go/src/encoding/json/encode.go:358 +0x82
encoding/json.interfaceEncoder(0xc000839e80, 0x1dcdd00, 0xc001088310, 0x194, 0x1dc0100)
	/usr/local/go/src/encoding/json/encode.go:714 +0xac
encoding/json.arrayEncoder.encode(0x2192e80, 0xc000839e80, 0x1d27980, 0xc002c48420, 0x97, 0x5a0100)
	/usr/local/go/src/encoding/json/encode.go:886 +0xd6
encoding/json.sliceEncoder.encode(0xc000354e20, 0xc000839e80, 0x1d27980, 0xc002c48420, 0x97, 0x1d20100)
	/usr/local/go/src/encoding/json/encode.go:860 +0x8f
encoding/json.(*encodeState).reflectValue(0xc000839e80, 0x1d27980, 0xc002c48420, 0x97, 0xc002c40100)
	/usr/local/go/src/encoding/json/encode.go:358 +0x82
encoding/json.interfaceEncoder(0xc000839e80, 0x1dcdd00, 0xc006c71200, 0x94, 0xc006bd0100)
	/usr/local/go/src/encoding/json/encode.go:714 +0xac
encoding/json.mapEncoder.encode(0x2192e80, 0xc000839e80, 0x1dffce0, 0xc00852ebd0, 0x15, 0x1df0100)
	/usr/local/go/src/encoding/json/encode.go:801 +0x35c
encoding/json.(*encodeState).reflectValue(0xc000839e80, 0x1dffce0, 0xc00852ebd0, 0x15, 0xc000780100)
	/usr/local/go/src/encoding/json/encode.go:358 +0x82
encoding/json.(*encodeState).marshal(0xc000839e80, 0x1dffce0, 0xc00852ebd0, 0x1df0100, 0x0, 0x0)
	/usr/local/go/src/encoding/json/encode.go:330 +0xf4
encoding/json.Marshal(0x1dffce0, 0xc00852ebd0, 0xc00078ae88, 0x1dffce0, 0xc00852ebd0, 0x0, 0x0)
	/usr/local/go/src/encoding/json/encode.go:161 +0x52
sigs.k8s.io/yaml.yamlToJSON(0xc003dcc000, 0x5a2e, 0x5a2e, 0xc00078b030, 0x2195cf8, 0x7f87e5eae108, 0xc00b30d0a0, 0x20200a656d614e73, 0xc00006e400, 0x0)
	/go/pkg/mod/sigs.k8s.io/yaml@v1.2.0/yaml.go:139 +0x105
sigs.k8s.io/yaml.yamlUnmarshal(0xc003dcc000, 0x5a2e, 0x5a2e, 0x1f1e380, 0xc00b30d0a0, 0x3300, 0x0, 0x0, 0x0, 0xc0007856dd, ...)
	/go/pkg/mod/sigs.k8s.io/yaml@v1.2.0/yaml.go:53 +0x125
sigs.k8s.io/yaml.Unmarshal(...)
	/go/pkg/mod/sigs.k8s.io/yaml@v1.2.0/yaml.go:36
sigs.k8s.io/kustomize/api/internal/plugins/builtinconfig.makeTransformerConfigFromBytes(0xc003dcc000, 0x5a2e, 0x5a2e, 0x203001, 0x0, 0x203002)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/plugins/builtinconfig/loaddefaultconfig.go:36 +0x88
sigs.k8s.io/kustomize/api/internal/plugins/builtinconfig.MakeDefaultConfig(0xc007e18cf0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/plugins/builtinconfig/transformerconfig.go:35 +0x2b
sigs.k8s.io/kustomize/api/internal/plugins/builtinconfig.MakeTransformerConfig(0x23ef200, 0xc00035c4e0, 0x0, 0x0, 0x0, 0xc0027e12c0, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/plugins/builtinconfig/transformerconfig.go:47 +0x26
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateTarget(0xc0071e44c0, 0xc0027e12c0, 0xc00078b278, 0x1aed2c7, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:171 +0x133
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).AccumulateTarget(0xc0071e44c0, 0x0, 0xffffffffffffffff, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:156 +0xce
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).makeCustomizedResMap(0xc0071e44c0, 0xc00786b601, 0x0, 0x0, 0x1f)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:111 +0x2f
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).MakeCustomizedResMap(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:107
sigs.k8s.io/kustomize/api/krusty.(*Kustomizer).Run(0xc00078b890, 0xc000b2e5c0, 0x40, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/krusty/kustomizer.go:82 +0x31b
github.com/fluxcd/kustomize-controller/controllers.buildKustomization(0x240f540, 0x3275788, 0xc000b2e5c0, 0x40, 0x0, 0x23, 0xc000b44dc0, 0x10)
	/workspace/controllers/kustomization_generator.go:355 +0x112
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).build(0xc0009941e0, 0x23ee080, 0xc000399f20, 0x1c8ac57, 0xd, 0xc00025d5f0, 0x23, 0xc000b44dc0, 0x10, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:523 +0x231
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).reconcile(0xc0009941e0, 0x23ee0c0, 0xc000a61590, 0x1c8ac57, 0xd, 0xc00025d5f0, 0x23, 0xc000b44dc0, 0x10, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:341 +0xad4
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).Reconcile(0xc0009941e0, 0x23ee0c0, 0xc000a61590, 0xc000b44dd0, 0xb, 0xc000b44dc0, 0x10, 0xc000a61500, 0x0, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:233 +0xd3e
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x1e9cfc0, 0xc000b71240)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:298 +0x317
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:253 +0x205
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1.2(0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:216 +0x4a
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0x37
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000573750)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000791f50, 0x2397620, 0xc000a61500, 0xc0006d7001, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000573750, 0x3b9aca00, 0x0, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x23ee000, 0xc0006d7040, 0xc0007353e0, 0x3b9aca00, 0x0, 0x1)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0xa6
k8s.io/apimachinery/pkg/util/wait.UntilWithContext(0x23ee000, 0xc0006d7040, 0xc0007353e0, 0x3b9aca00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:99 +0x57
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:213 +0x45e

goroutine 291 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:772 +0x5d
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00038e760)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000250f60, 0x2397620, 0xc0009938f0, 0x1dcf101, 0xc00090dc80)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00038e760, 0x3b9aca00, 0x0, 0xc000703001, 0xc00090dc80)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000aaf000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:771 +0x95
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007d6760, 0xc000a95b50)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 201 [syscall]:
os/signal.signal_recv(0xc0006f0f60)
	/usr/local/go/src/runtime/sigqueue.go:147 +0x9d
os/signal.loop()
	/usr/local/go/src/os/signal/signal_unix.go:23 +0x25
created by os/signal.Notify.func1.1
	/usr/local/go/src/os/signal/signal.go:150 +0x45

goroutine 406 [select]:
os/exec.(*Cmd).Start.func2(0xc000455080)
	/usr/local/go/src/os/exec/exec.go:449 +0xd5
created by os/exec.(*Cmd).Start
	/usr/local/go/src/os/exec/exec.go:448 +0x6c5

goroutine 336 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf0801a8, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc000b25f98, 0x72, 0x239ad00, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc000b25f80, 0xc0008ef000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
net.(*netFD).Read(0xc000b25f80, 0xc0008ef000, 0x1000, 0x1000, 0x43a91c, 0xc00024eb58, 0x467d80)
	/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc0004a9178, 0xc0008ef000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:182 +0x8e
net/http.(*persistConn).Read(0xc00083e900, 0xc0008ef000, 0x1000, 0x1000, 0xc0007ac900, 0xc00024ec58, 0x4058f5)
	/usr/local/go/src/net/http/transport.go:1890 +0x77
bufio.(*Reader).fill(0xc00011baa0)
	/usr/local/go/src/bufio/bufio.go:101 +0x105
bufio.(*Reader).Peek(0xc00011baa0, 0x1, 0x0, 0x1, 0x1, 0x0, 0xc0007ac5a0)
	/usr/local/go/src/bufio/bufio.go:139 +0x4f
net/http.(*persistConn).readLoop(0xc00083e900)
	/usr/local/go/src/net/http/transport.go:2043 +0x1a8
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1711 +0xcb7

goroutine 281 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0002340e0, 0xc00090c4e0, 0xc00090d6e0, 0xc000a2f920)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:373 +0x16f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:367 +0x2c5

goroutine 278 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0002340e0, 0xc0114d2e4b6a8cd0, 0x3b765cd4e, 0x3243800, 0x23aaa40, 0xc00011f100, 0xc000729bc8, 0xc000a2f920, 0xc00090c4e0, 0x0, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:463 +0x1a5
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0002340e0, 0xc00090c4e0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:427 +0x6ac
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:221 +0x38
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004b8ef0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000729ef0, 0x2397600, 0xc0009952c0, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc0002340e0, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:220 +0x1c5
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000b44900, 0xc000b71400)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 321 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:772 +0x5d
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000390760)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000390760, 0x2397620, 0xc0009c4840, 0x1dcf101, 0xc00090dce0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000390760, 0x3b9aca00, 0x0, 0x1, 0xc00090dce0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000b6fe00)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:771 +0x95
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0003934f0, 0xc0007352f0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 222 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start(0xc0001b0dd0, 0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:144 +0x6a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/deleg_map.go:66 +0x94

goroutine 293 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc00035f748, 0x0)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc00035f738)
	/usr/local/go/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc00035f720, 0xc000a95c50, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/delta_fifo.go:493 +0x98
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000599e60)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:183 +0x42
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0000cde68)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0000cde68, 0x2397620, 0xc0008cef00, 0xc0005d3001, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000cde68, 0x3b9aca00, 0x0, 0xc00000a901, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*controller).Run(0xc000599e60, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:154 +0x2e5
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc00035f680, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:410 +0x42a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:229 +0x5a5

goroutine 234 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000774540, 0xc00090c4e0, 0xc00090c900, 0xc000a2f200)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:373 +0x16f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:367 +0x2c5

goroutine 334 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf080378, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc000b25d98, 0x72, 0x239ad00, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc000b25d80, 0xc0008d1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
net.(*netFD).Read(0xc000b25d80, 0xc0008d1000, 0x1000, 0x1000, 0x43a91c, 0xc0000d2b58, 0x467d80)
	/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc0004a9170, 0xc0008d1000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:182 +0x8e
net/http.(*persistConn).Read(0xc00072f0e0, 0xc0008d1000, 0x1000, 0x1000, 0xc0007ac7e0, 0xc0000d2c58, 0x4058f5)
	/usr/local/go/src/net/http/transport.go:1890 +0x77
bufio.(*Reader).fill(0xc00011b9e0)
	/usr/local/go/src/bufio/bufio.go:101 +0x105
bufio.(*Reader).Peek(0xc00011b9e0, 0x1, 0x0, 0x1, 0x1, 0x0, 0xc0007ac720)
	/usr/local/go/src/bufio/bufio.go:139 +0x4f
net/http.(*persistConn).readLoop(0xc00072f0e0)
	/usr/local/go/src/net/http/transport.go:2043 +0x1a8
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1711 +0xcb7

goroutine 269 [select]:
k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000a2ea80)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/util/workqueue/delaying_queue.go:231 +0x405
created by k8s.io/client-go/util/workqueue.newDelayingQueue
	/go/pkg/mod/k8s.io/client-go@v0.20.2/util/workqueue/delaying_queue.go:68 +0x185

goroutine 204 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveHealthProbes(0xc0002fcc40)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:431 +0xea
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).Start
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:478 +0x44a

goroutine 276 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc0007d6700, 0xc00090d3e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:628 +0x53
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc000b448d0, 0xc000b713a0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 261 [chan receive]:
k8s.io/apimachinery/pkg/watch.(*Broadcaster).loop(0xc000b1af40)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/mux.go:219 +0x66
created by k8s.io/apimachinery/pkg/watch.NewBroadcaster
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/mux.go:73 +0xf7

goroutine 220 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start(0xc0009014a0, 0x23ee000, 0xc0006d7040, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/deleg_map.go:68 +0xf9
sigs.k8s.io/controller-runtime/pkg/cluster.(*cluster).Start(0xc0008dfd80, 0x23ee000, 0xc0006d7040, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cluster/internal.go:127 +0x8a
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable.func1(0xc0002fcc40, 0x7f87beef0a18, 0xc0008dfd80)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:681 +0x7e
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:679 +0x73

goroutine 324 [runnable]:
sigs.k8s.io/kustomize/kyaml/openapi.AddDefinitions(0xc000e36180)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:197 +0xea
sigs.k8s.io/kustomize/kyaml/openapi.parse(0xc001f8c000, 0x46d829, 0x7ffe00, 0x46d829, 0x7ffe00)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:505 +0x105
sigs.k8s.io/kustomize/kyaml/openapi.parseSchema(0x20a8d98, 0x5)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:487 +0x130
sigs.k8s.io/kustomize/kyaml/openapi.initSchema()
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:469 +0x73
sigs.k8s.io/kustomize/kyaml/openapi.IsNamespaceScoped(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/kyaml@v0.10.9/openapi/openapi.go:269
sigs.k8s.io/kustomize/api/resid.Gvk.IsNamespaceableKind(0xc0009d31a0, 0x1b, 0xc0009d31bc, 0x7, 0xc0007088c0, 0xd, 0xc00018e638)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/gvk.go:219 +0xa5
sigs.k8s.io/kustomize/api/resid.ResId.EffectiveNamespace(0xc0009d31a0, 0x1b, 0xc0009d31bc, 0x7, 0xc0007088c0, 0xd, 0xc0004115c0, 0x14, 0xc0007088f0, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:120 +0x5a
sigs.k8s.io/kustomize/api/resid.ResId.IsNsEquals(0xc0009d31a0, 0x1b, 0xc0009d31bc, 0x7, 0xc0007088c0, 0xd, 0xc0004115c0, 0x14, 0xc0007088f0, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:102 +0x45
sigs.k8s.io/kustomize/api/resid.ResId.Equals(0xc0009d31a0, 0x1b, 0xc0009d31bc, 0x7, 0xc0007088c0, 0xd, 0xc0004115c0, 0x14, 0xc0007088f0, 0xb, ...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resid/resid.go:96 +0x78
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).filteredById(0xc000b142a0, 0xc0009f0500, 0x2197960, 0xc0009d31bc, 0x7, 0xc0007088c0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:185 +0x102
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).GetMatchingResourcesByCurrentId(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:163
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).Append(0xc000b142a0, 0xc000138fa0, 0x1, 0x1)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:65 +0x11d
sigs.k8s.io/kustomize/api/resmap.(*resWrangler).AppendAll(0xc000b142a0, 0x241e420, 0xc000b14ac0, 0xc0004101a0, 0x1b)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/resmap/reswrangler.go:443 +0x8e
sigs.k8s.io/kustomize/api/internal/accumulator.(*ResAccumulator).AppendAll(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/accumulator/resaccumulator.go:45
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateFile(0xc000907a80, 0xc000b14280, 0xc0004101a0, 0x1b, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:427 +0xad
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateResources(0xc000907a80, 0xc000b14280, 0xc000904ea0, 0x8, 0x9, 0xc00070a000, 0xc000269800, 0xc0009f0780)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:337 +0xb8
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).accumulateTarget(0xc000907a80, 0xc000b14280, 0x470367, 0x1aed39b, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:163 +0x74
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).AccumulateTarget(0xc000907a80, 0x0, 0xffffffffffffffff, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:156 +0xce
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).makeCustomizedResMap(0xc000907a80, 0xc000708001, 0x0, 0x0, 0x1f)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:111 +0x2f
sigs.k8s.io/kustomize/api/internal/target.(*KustTarget).MakeCustomizedResMap(...)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/internal/target/kusttarget.go:107
sigs.k8s.io/kustomize/api/krusty.(*Kustomizer).Run(0xc0009f0e30, 0xc0009d24e0, 0x26, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/kustomize/api@v0.7.4/krusty/kustomizer.go:82 +0x31b
github.com/fluxcd/kustomize-controller/controllers.buildKustomization(0x240f540, 0x3275788, 0xc0009d24e0, 0x26, 0x0, 0x6f314d7855544d35, 0x45424d5445544677, 0x78410a4555314147)
	/workspace/controllers/kustomization_generator.go:355 +0x112
github.com/fluxcd/kustomize-controller/controllers.(*KustomizeGenerator).checksum(0xc0009f1d00, 0x23ee0c0, 0xc0009c44e0, 0xc0009d24e0, 0x26, 0x79f, 0x0, 0x0, 0x0)
	/workspace/controllers/kustomization_generator.go:248 +0x134
github.com/fluxcd/kustomize-controller/controllers.(*KustomizeGenerator).WriteFile(0xc0009f1d00, 0x23ee0c0, 0xc0009c44e0, 0xc0009d24e0, 0x26, 0x50df72, 0x7f87befbd3e0, 0xc0009f1ae0, 0x40da90)
	/workspace/controllers/kustomization_generator.go:62 +0x16d
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).generate(0xc0009941e0, 0x23ee0c0, 0xc0009c44e0, 0x240bec0, 0xc0009940a0, 0x1c8ac57, 0xd, 0xc000052ff0, 0x23, 0xc000b45030, ...)
	/workspace/controllers/kustomization_controller.go:503 +0xf8
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009c44e0, 0x1c8ac57, 0xd, 0xc000052ff0, 0x23, 0xc000b45030, 0xb, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:330 +0xa1c
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).Reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009c44e0, 0xc000b45050, 0xb, 0xc000b45030, 0xb, 0xc0009c4400, 0x0, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:233 +0xd3e
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x1e9cfc0, 0xc000b71260)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:298 +0x317
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x40da00)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:253 +0x205
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1.2(0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:216 +0x4a
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0x37
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004b6f50)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0009f7f50, 0x2397620, 0xc000a614d0, 0xc0006d7001, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0004b6f50, 0x3b9aca00, 0x0, 0xc0004b6f01, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x23ee000, 0xc0006d7040, 0xc000735380, 0x3b9aca00, 0x0, 0x1)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0xa6
k8s.io/apimachinery/pkg/util/wait.UntilWithContext(0x23ee000, 0xc0006d7040, 0xc000735380, 0x3b9aca00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:99 +0x57
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:213 +0x45e

goroutine 299 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000774700, 0xc0114d2e516a66e8, 0x3bd65a77a, 0x3243800, 0x23aaa40, 0xc0002c2680, 0xc00007bbc8, 0xc00072d4a0, 0xc00090c4e0, 0x0, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:463 +0x1a5
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000774700, 0xc00090c4e0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:427 +0x6ac
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:221 +0x38
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004b8ef0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00007bef0, 0x2397600, 0xc0006fd590, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000774700, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:220 +0x1c5
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0005d3090, 0xc00042afa0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 312 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x23aaa80, 0xc000b34900, 0xc0009b0750)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:301 +0xaa
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:299 +0x6e

goroutine 268 [chan receive]:
k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000a2e8a0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/util/workqueue/queue.go:198 +0xac
created by k8s.io/client-go/util/workqueue.newQueue
	/go/pkg/mod/k8s.io/client-go@v0.20.2/util/workqueue/queue.go:58 +0x135

goroutine 228 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc0007d73b0, 0xc00090c660)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:628 +0x53
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0009cae30, 0xc000a22ce0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 207 [select]:
golang.org/x/net/http2.(*ClientConn).roundTrip(0xc00028a480, 0xc00a64f200, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:1165 +0xa0a
golang.org/x/net/http2.(*Transport).RoundTripOpt(0xc0007d6850, 0xc00a64f200, 0x1e00500, 0xc000428c30, 0xc008a81f20, 0x5)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:478 +0x170
golang.org/x/net/http2.(*Transport).RoundTrip(...)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:439
golang.org/x/net/http2.noDialH2RoundTripper.RoundTrip(0xc0007d6850, 0xc00a64f200, 0x2399a00, 0xc0007d6850, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:2691 +0x3e
net/http.(*Transport).roundTrip(0xc000263900, 0xc00a64f100, 0x1d7bda0, 0xc000915c01, 0xc00033ab00)
	/usr/local/go/src/net/http/transport.go:527 +0xde2
net/http.(*Transport).RoundTrip(0xc000263900, 0xc00a64f100, 0x20b3bbf, 0xd, 0xc00033abd0)
	/usr/local/go/src/net/http/roundtrip.go:17 +0x35
k8s.io/client-go/transport.(*bearerAuthRoundTripper).RoundTrip(0xc000a0c870, 0xc00a64f000, 0x20afbdf, 0xa, 0xc00033aa58)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/transport/round_trippers.go:298 +0x271
k8s.io/client-go/transport.(*userAgentRoundTripper).RoundTrip(0xc0009e7a40, 0xc00a64ef00, 0xc0009e7a40, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/transport/round_trippers.go:160 +0x1d6
net/http.send(0xc00a64ef00, 0x2397a20, 0xc0009e7a40, 0x0, 0x0, 0x0, 0xc00695c6c8, 0x20b0319, 0x1, 0x0)
	/usr/local/go/src/net/http/client.go:252 +0x453
net/http.(*Client).send(0xc000a0c8a0, 0xc00a64ef00, 0x0, 0x0, 0x0, 0xc00695c6c8, 0x0, 0x1, 0x0)
	/usr/local/go/src/net/http/client.go:176 +0xff
net/http.(*Client).do(0xc000a0c8a0, 0xc00a64ef00, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/http/client.go:718 +0x45f
net/http.(*Client).Do(...)
	/usr/local/go/src/net/http/client.go:586
k8s.io/client-go/rest.(*Request).request(0xc000d401e0, 0x23ee080, 0xc00987c000, 0xc003c87778, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/rest/request.go:891 +0x4ed
k8s.io/client-go/rest.(*Request).Do(0xc000d401e0, 0x23ee080, 0xc00987c000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/rest/request.go:964 +0xf1
k8s.io/client-go/kubernetes/typed/core/v1.(*configMaps).Update(0xc002b85e20, 0x23ee080, 0xc00987c000, 0xc0002cc000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/kubernetes/typed/core/v1/configmap.go:133 +0x1fa
k8s.io/client-go/tools/leaderelection/resourcelock.(*ConfigMapLock).Update(0xc0008f0780, 0x23ee080, 0xc00987c000, 0xc00017ec30, 0x4a, 0xf, 0x0, 0xed7f6b439, 0x3243800, 0xc0114d3377633fa2, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/resourcelock/configmaplock.go:96 +0x214
k8s.io/client-go/tools/leaderelection/resourcelock.(*MultiLock).Update(0xc000a22600, 0x23ee080, 0xc00987c000, 0xc00017ec30, 0x4a, 0xf, 0x0, 0xed7f6b439, 0x3243800, 0xc0114d3377633fa2, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/resourcelock/multilock.go:74 +0x75
k8s.io/client-go/tools/leaderelection.(*LeaderElector).tryAcquireOrRenew(0xc0003d0480, 0x23ee080, 0xc00987c000, 0x23ee000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/leaderelection.go:360 +0x478
k8s.io/client-go/tools/leaderelection.(*LeaderElector).renew.func1.1(0x1d3b480, 0x0, 0xc002a614a0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/leaderelection.go:267 +0x3c
k8s.io/apimachinery/pkg/util/wait.PollImmediateUntil(0x77359400, 0xc003c87d20, 0xc002a614a0, 0x23ee080, 0xc00987c000)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:500 +0x2b
k8s.io/client-go/tools/leaderelection.(*LeaderElector).renew.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/leaderelection.go:266 +0x125
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0008b5ee0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003c87ee0, 0x2397620, 0xc000b73260, 0xc000b1b001, 0xc00090cf00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000f7ee0, 0x77359400, 0x0, 0xc000b1b001, 0xc00090cf00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/leaderelection.(*LeaderElector).renew(0xc0003d0480, 0x23ee000, 0xc000b1b040)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/leaderelection.go:263 +0x107
k8s.io/client-go/tools/leaderelection.(*LeaderElector).Run(0xc0003d0480, 0x23ee000, 0xc000b1b000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/leaderelection/leaderelection.go:208 +0x13b
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElection.func3(0xc0003d0480, 0x23ee000, 0xc0006d7080, 0xc0002fcc40)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:666 +0x3f
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startLeaderElection
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:665 +0x22f

goroutine 203 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveMetrics(0xc0002fcc40)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:393 +0x1fa
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).Start
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:473 +0x474

goroutine 218 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf080630, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc0008dfe18, 0x72, 0x0, 0x0, 0x20ab14f)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc0008dfe00, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc
net.(*netFD).accept(0xc0008dfe00, 0xc000a601b0, 0x40e3f8, 0xc00006e400)
	/usr/local/go/src/net/fd_unix.go:172 +0x45
net.(*TCPListener).accept(0xc000a22660, 0xc0000fbd88, 0x40e3f8, 0x30)
	/usr/local/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc000a22660, 0x1f66c80, 0xc000a601b0, 0x1de58e0, 0x32194d0)
	/usr/local/go/src/net/tcpsock.go:261 +0x65
net/http.(*Server).Serve(0xc000774380, 0x23e7800, 0xc000a22660, 0x0, 0x0)
	/usr/local/go/src/net/http/server.go:2937 +0x266
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveMetrics.func2(0x23ee000, 0xc0006d7040, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:386 +0xdc
sigs.k8s.io/controller-runtime/pkg/manager.RunnableFunc.Start(0xc000a22be0, 0x23ee000, 0xc0006d7040, 0x0, 0xc000455e40)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/manager.go:263 +0x3a
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable.func1(0xc0002fcc40, 0x239a8a0, 0xc000a22be0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:681 +0x7e
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:679 +0x73

goroutine 322 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000b6fe00)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:742 +0x157
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0003934f0, 0xc000735300)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 223 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start(0xc0001b1520, 0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:144 +0x6a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/deleg_map.go:67 +0xce

goroutine 271 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000b74880)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:742 +0x157
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007d7410, 0xc000b6cb80)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 219 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf080548, 0x72, 0x0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc0008dfe98, 0x72, 0x0, 0x0, 0x20ab14f)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Accept(0xc0008dfe80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc
net.(*netFD).accept(0xc0008dfe80, 0x8c7afacef81279f2, 0x0, 0x0)
	/usr/local/go/src/net/fd_unix.go:172 +0x45
net.(*TCPListener).accept(0xc000a22680, 0x6064bd4a, 0xc0000d0da0, 0x4990c6)
	/usr/local/go/src/net/tcpsock_posix.go:139 +0x32
net.(*TCPListener).Accept(0xc000a22680, 0xc0000d0df0, 0x18, 0xc00026b200, 0x7cbb4c)
	/usr/local/go/src/net/tcpsock.go:261 +0x65
net/http.(*Server).Serve(0xc000774460, 0x23e7800, 0xc000a22680, 0x0, 0x0)
	/usr/local/go/src/net/http/server.go:2937 +0x266
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).serveHealthProbes.func1.1(0x23ee000, 0xc0006d7040, 0x0, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:422 +0x47
sigs.k8s.io/controller-runtime/pkg/manager.RunnableFunc.Start(0xc000a22c40, 0x23ee000, 0xc0006d7040, 0x2197380, 0x0)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/manager.go:263 +0x3a
sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable.func1(0xc0002fcc40, 0x239a8a0, 0xc000a22c40)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:681 +0x7e
created by sigs.k8s.io/controller-runtime/pkg/manager.(*controllerManager).startRunnable
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/internal.go:679 +0x73

goroutine 345 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf080460, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc00083d618, 0x72, 0x239ad00, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00083d600, 0xc00091a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
net.(*netFD).Read(0xc00083d600, 0xc00091a000, 0x1000, 0x1000, 0xc000434180, 0xc000255d98, 0xc000255c20)
	/usr/local/go/src/net/fd_posix.go:55 +0x4f
net.(*conn).Read(0xc000119728, 0xc00091a000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
	/usr/local/go/src/net/net.go:182 +0x8e
net/http.(*persistConn).Read(0xc00072e7e0, 0xc00091a000, 0x1000, 0x1000, 0xc000255e60, 0x468820, 0xc000255e60)
	/usr/local/go/src/net/http/transport.go:1890 +0x77
bufio.(*Reader).fill(0xc0002379e0)
	/usr/local/go/src/bufio/bufio.go:101 +0x105
bufio.(*Reader).Peek(0xc0002379e0, 0x1, 0x2, 0x0, 0x0, 0x0, 0xc00090e240)
	/usr/local/go/src/bufio/bufio.go:139 +0x4f
net/http.(*persistConn).readLoop(0xc00072e7e0)
	/usr/local/go/src/net/http/transport.go:2043 +0x1a8
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1711 +0xcb7

goroutine 270 [chan receive]:
k8s.io/client-go/tools/cache.(*processorListener).run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:772 +0x5d
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00038d760)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000252f60, 0x2397620, 0xc000b73ec0, 0x1dcf101, 0xc00090d380)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00038d760, 0x3b9aca00, 0x0, 0xc000b1b801, 0xc00090d380)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*processorListener).run(0xc000b74880)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:771 +0x95
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007d7410, 0xc000b6cb70)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 297 [chan receive]:
k8s.io/client-go/tools/cache.(*sharedProcessor).run(0xc000393490, 0xc000703320)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:628 +0x53
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0005d3070, 0xc00042af40)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 344 [select]:
net/http.(*persistConn).writeLoop(0xc00072ec60)
	/usr/local/go/src/net/http/transport.go:2342 +0x11c
created by net/http.(*Transport).dialConn
	/usr/local/go/src/net/http/transport.go:1712 +0xcdc

goroutine 292 [select]:
k8s.io/client-go/tools/cache.(*processorListener).pop(0xc000aaf000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:742 +0x157
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0007d6760, 0xc000a95b60)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 229 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc00090c4e0, 0xc000a56000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:130 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:129 +0xa5

goroutine 283 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc0004541a0, 0x0)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc000454190)
	/usr/local/go/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000454188, 0xc0000a6e00, 0x200, 0x200, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/pipe.go:65 +0x97
golang.org/x/net/http2.transportResponseBody.Read(0xc000454160, 0xc0000a6e00, 0x200, 0x200, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:2108 +0xaf
encoding/json.(*Decoder).refill(0xc000454420, 0x18, 0x7f87e5eae7d0)
	/usr/local/go/src/encoding/json/stream.go:165 +0xeb
encoding/json.(*Decoder).readValue(0xc000454420, 0x0, 0x0, 0x1deae60)
	/usr/local/go/src/encoding/json/stream.go:140 +0x1ff
encoding/json.(*Decoder).Decode(0xc000454420, 0x1e222e0, 0xc000350fa0, 0x6, 0xc0000574e0)
	/usr/local/go/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc00073f0e0, 0xc000915800, 0x400, 0x400, 0xc000401558, 0x7f87bf21d6f0, 0x38)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/framer/framer.go:152 +0x1a8
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0009957c0, 0x0, 0x23aa640, 0xc00011f180, 0xc000401500, 0xc0007024e0, 0x2, 0x0, 0xc00026ba08)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000350d60, 0xc00038e768, 0xc00038e778, 0x94e825, 0xc00038e700, 0xc00038e6e4, 0x3)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/rest/watch/decoder.go:49 +0x6e
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc00011f100)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:104 +0x14a
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 277 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc00090c4e0, 0xc000a57b00)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:130 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:129 +0xa5

goroutine 298 [chan receive]:
k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc00090c4e0, 0xc000599e60)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:130 +0x34
created by k8s.io/client-go/tools/cache.(*controller).Run
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:129 +0xa5

goroutine 304 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc000adc5c0, 0x0)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc000adc5b0)
	/usr/local/go/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000adc5a8, 0xc000a63a00, 0x200, 0x200, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/pipe.go:65 +0x97
golang.org/x/net/http2.transportResponseBody.Read(0xc000adc580, 0xc000a63a00, 0x200, 0x200, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:2108 +0xaf
encoding/json.(*Decoder).refill(0xc000adc840, 0x18, 0x7f87e5eae108)
	/usr/local/go/src/encoding/json/stream.go:165 +0xeb
encoding/json.(*Decoder).readValue(0xc000adc840, 0x0, 0x0, 0x1deae60)
	/usr/local/go/src/encoding/json/stream.go:140 +0x1ff
encoding/json.(*Decoder).Decode(0xc000adc840, 0x1e222e0, 0xc000900080, 0x6, 0xc0004109e0)
	/usr/local/go/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000a61260, 0xc000ac9800, 0x400, 0x400, 0x2018f40, 0x7f87bf24a868, 0x38)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/framer/framer.go:152 +0x1a8
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc0006fd9f0, 0x0, 0x23aa640, 0xc0002c26c0, 0x0, 0xa, 0x2, 0x0, 0x0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000900060, 0xc000390790, 0xc0007e77b8, 0xc000390780, 0x12e31cb, 0xc0004787c0, 0xc0004109e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/rest/watch/decoder.go:49 +0x6e
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc0002c2680)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:104 +0x14a
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 272 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc000a16528, 0x1)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc000a16518)
	/usr/local/go/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000a16500, 0xc000b6ccd0, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/delta_fifo.go:493 +0x98
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000a57b00)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:183 +0x42
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000253e68)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000253e68, 0x2397620, 0xc000b73f20, 0xc000b44901, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000253e68, 0x3b9aca00, 0x0, 0xc0002fce01, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*controller).Run(0xc000a57b00, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:154 +0x2e5
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000a16460, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:410 +0x42a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).addInformerToMap
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:229 +0x5a5

goroutine 221 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start(0xc0001084e0, 0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:144 +0x6a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*InformersMap).Start
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/deleg_map.go:65 +0x5a

goroutine 236 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc000b64720, 0xc000000001)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc000b64710)
	/usr/local/go/src/sync/cond.go:56 +0x9d
golang.org/x/net/http2.(*pipe).Read(0xc000b64708, 0xc0007b1001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/pipe.go:65 +0x97
golang.org/x/net/http2.transportResponseBody.Read(0xc000b646e0, 0xc0007b1001, 0xdff, 0xdff, 0x0, 0x0, 0x0)
	/go/pkg/mod/golang.org/x/net@v0.0.0-20201110031124-69a78807bb2b/http2/transport.go:2108 +0xaf
encoding/json.(*Decoder).refill(0xc000b649a0, 0xa, 0x9)
	/usr/local/go/src/encoding/json/stream.go:165 +0xeb
encoding/json.(*Decoder).readValue(0xc000b649a0, 0x0, 0x0, 0x1deae60)
	/usr/local/go/src/encoding/json/stream.go:140 +0x1ff
encoding/json.(*Decoder).Decode(0xc000b649a0, 0x1e222e0, 0xc000a22d40, 0x0, 0x0)
	/usr/local/go/src/encoding/json/stream.go:63 +0x79
k8s.io/apimachinery/pkg/util/framer.(*jsonFrameReader).Read(0xc000b680f0, 0xc000793300, 0x1000, 0x1300, 0xc000ae9d98, 0x7f87befbe0a0, 0x38)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/framer/framer.go:152 +0x1a8
k8s.io/apimachinery/pkg/runtime/serializer/streaming.(*decoder).Decode(0xc000994be0, 0x0, 0x23aa640, 0xc0009ac5c0, 0x0, 0x0, 0x464ae0, 0xc00090ca20, 0xc000ae9e80)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/runtime/serializer/streaming/streaming.go:77 +0x89
k8s.io/client-go/rest/watch.(*Decoder).Decode(0xc000b4f180, 0xc000ae9f18, 0x8, 0x23a3f40, 0xc0007f42c0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/rest/watch/decoder.go:49 +0x6e
k8s.io/apimachinery/pkg/watch.(*StreamWatcher).receive(0xc000b1b200)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:104 +0x14a
created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/streamwatcher.go:71 +0xbe

goroutine 230 [select]:
k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000774540, 0xc0114d2a66646e70, 0x18b30f5e, 0x3243800, 0x23aaa40, 0xc000b1b200, 0xc0008b1bc8, 0xc000a2f200, 0xc00090c4e0, 0x0, ...)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:463 +0x1a5
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000774540, 0xc00090c4e0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:427 +0x6ac
k8s.io/client-go/tools/cache.(*Reflector).Run.func1()
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:221 +0x38
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0004bbef0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0008b1ef0, 0x2397600, 0xc0009943c0, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/client-go/tools/cache.(*Reflector).Run(0xc000774540, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:220 +0x1c5
k8s.io/apimachinery/pkg/util/wait.(*Group).StartWithChannel.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:56 +0x2e
k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0009cae40, 0xc000a22d20)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:73 +0x51
created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:71 +0x65

goroutine 311 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x23aaa80, 0xc000b348d0, 0xc000b348a0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:301 +0xaa
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:299 +0x6e

goroutine 326 [syscall]:
syscall.Syscall6(0xf7, 0x1, 0xe, 0xc000af36e8, 0x1000004, 0x0, 0x0, 0x19, 0xc000af3728, 0x470367)
	/usr/local/go/src/syscall/asm_linux_amd64.s:41 +0x5
os.(*Process).blockUntilWaitable(0xc00ba93140, 0x203002, 0xc000455080, 0x160)
	/usr/local/go/src/os/wait_waitid.go:32 +0xa6
os.(*Process).wait(0xc00ba93140, 0x21970e0, 0x21970e8, 0x21970d8)
	/usr/local/go/src/os/exec_unix.go:22 +0x39
os.(*Process).Wait(...)
	/usr/local/go/src/os/exec.go:125
os/exec.(*Cmd).Wait(0xc000455080, 0x0, 0x0)
	/usr/local/go/src/os/exec/exec.go:507 +0x65
os/exec.(*Cmd).Run(0xc000455080, 0xc00bb45ec0, 0x0)
	/usr/local/go/src/os/exec/exec.go:341 +0x5c
os/exec.(*Cmd).CombinedOutput(0xc000455080, 0x7, 0xc000af39c8, 0x2, 0x2, 0xc000455080)
	/usr/local/go/src/os/exec/exec.go:567 +0x91
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).validate(0xc0009941e0, 0x23ee0c0, 0xc0009030e0, 0x1c8ac57, 0xd, 0xc000721920, 0x23, 0xc000b45330, 0x10, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:612 +0x4fe
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009030e0, 0x1c8ac57, 0xd, 0xc000721920, 0x23, 0xc000b45330, 0x10, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:352 +0xb88
github.com/fluxcd/kustomize-controller/controllers.(*KustomizationReconciler).Reconcile(0xc0009941e0, 0x23ee0c0, 0xc0009030e0, 0xc000b45340, 0xb, 0xc000b45330, 0x10, 0xc000903000, 0x0, 0x0, ...)
	/workspace/controllers/kustomization_controller.go:233 +0xd3e
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0x1e9cfc0, 0xc000b71280)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:298 +0x317
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem(0xc000a174a0, 0x23ee000, 0xc0006d7040, 0xc00038ae00)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:253 +0x205
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1.2(0x23ee000, 0xc0006d7040)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:216 +0x4a
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext.func1()
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0x37
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00038af50)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000af9f50, 0x2397620, 0xc000a612f0, 0xc0006d7001, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00038af50, 0x3b9aca00, 0x0, 0x1, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x23ee000, 0xc0006d7040, 0xc0007353f0, 0x3b9aca00, 0x0, 0x1)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:185 +0xa6
k8s.io/apimachinery/pkg/util/wait.UntilWithContext(0x23ee000, 0xc0006d7040, 0xc0007353f0, 0x3b9aca00)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:99 +0x57
created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func1
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/internal/controller/controller.go:213 +0x45e

goroutine 224 [sync.Cond.Wait]:
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:312
sync.runtime_notifyListWait(0xc000a17568, 0x2)
	/usr/local/go/src/runtime/sema.go:513 +0xf8
sync.(*Cond).Wait(0xc000a17558)
	/usr/local/go/src/sync/cond.go:56 +0x9d
k8s.io/client-go/tools/cache.(*DeltaFIFO).Pop(0xc000a17540, 0xc000a4a1d0, 0x0, 0x0, 0x0, 0x0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/delta_fifo.go:493 +0x98
k8s.io/client-go/tools/cache.(*controller).processLoop(0xc000a56000)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:183 +0x42
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0000d2e68)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00072be68, 0x2397620, 0xc000a0de60, 0xc0009cae01, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:156 +0xad
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0000d2e68, 0x3b9aca00, 0x0, 0xc0007f4b01, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(...)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/util/wait/wait.go:90
k8s.io/client-go/tools/cache.(*controller).Run(0xc000a56000, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/controller.go:154 +0x2e5
k8s.io/client-go/tools/cache.(*sharedIndexInformer).Run(0xc000a17400, 0xc00090c4e0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/shared_informer.go:410 +0x42a
created by sigs.k8s.io/controller-runtime/pkg/cache/internal.(*specificInformersMap).Start.func1
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/cache/internal/informers_map.go:137 +0x154

goroutine 263 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x23aaa80, 0xc000b73200, 0xc000b6c5f0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:301 +0xaa
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:299 +0x6e

goroutine 202 [chan receive]:
sigs.k8s.io/controller-runtime/pkg/manager/signals.SetupSignalHandler.func1(0xc000a2e7e0, 0xc000a4a110)
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/signals/signal.go:38 +0x34
created by sigs.k8s.io/controller-runtime/pkg/manager/signals.SetupSignalHandler
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.8.3/pkg/manager/signals/signal.go:37 +0xe8

goroutine 310 [chan receive]:
k8s.io/apimachinery/pkg/watch.(*Broadcaster).loop(0xc0009061c0)
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/mux.go:219 +0x66
created by k8s.io/apimachinery/pkg/watch.NewBroadcaster
	/go/pkg/mod/k8s.io/apimachinery@v0.20.2/pkg/watch/mux.go:73 +0xf7

goroutine 262 [chan receive]:
k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher.func1(0x23aaa80, 0xc000b731d0, 0xc000b731a0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:301 +0xaa
created by k8s.io/client-go/tools/record.(*eventBroadcasterImpl).StartEventWatcher
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/record/event.go:299 +0x6e

goroutine 405 [IO wait]:
internal/poll.runtime_pollWait(0x7f87bf0800c0, 0x72, 0x239ade0)
	/usr/local/go/src/runtime/netpoll.go:222 +0x55
internal/poll.(*pollDesc).wait(0xc00bb64078, 0x72, 0x239ad01, 0x3087798, 0x0)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45
internal/poll.(*pollDesc).waitRead(...)
	/usr/local/go/src/internal/poll/fd_poll_runtime.go:92
internal/poll.(*FD).Read(0xc00bb64060, 0xc00bae9a00, 0x200, 0x200, 0x0, 0x0, 0x0)
	/usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
os.(*File).read(...)
	/usr/local/go/src/os/file_posix.go:31
os.(*File).Read(0xc00695dc28, 0xc00bae9a00, 0x200, 0x200, 0xc00038df50, 0x7f87be70d928, 0xc00038dea0)
	/usr/local/go/src/os/file.go:116 +0x71
bytes.(*Buffer).ReadFrom(0xc00bb45ec0, 0x2397fa0, 0xc00695dc28, 0x7f87bf0881e0, 0xc00bb45ec0, 0x23ee001)
	/usr/local/go/src/bytes/buffer.go:204 +0xb1
io.copyBuffer(0x2394200, 0xc00bb45ec0, 0x2397fa0, 0xc00695dc28, 0x0, 0x0, 0x0, 0x1, 0xc00038df90, 0x1c158ca)
	/usr/local/go/src/io/io.go:395 +0x2ff
io.Copy(...)
	/usr/local/go/src/io/io.go:368
os/exec.(*Cmd).writerDescriptor.func1(0x0, 0xc0002874a0)
	/usr/local/go/src/os/exec/exec.go:311 +0x65
os/exec.(*Cmd).Start.func1(0xc000455080, 0xc00a426e60)
	/usr/local/go/src/os/exec/exec.go:441 +0x27
created by os/exec.(*Cmd).Start
	/usr/local/go/src/os/exec/exec.go:440 +0x629

goroutine 302 [select]:
k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000774700, 0xc00090c4e0, 0xc0007036e0, 0xc00072d4a0)
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:373 +0x16f
created by k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch
	/go/pkg/mod/k8s.io/client-go@v0.20.2/tools/cache/reflector.go:367 +0x2c5

I can't link this to any particular commit to the repo it points at. It seems to be reliably triggered on every startup, and the kustomize-controller pod never becomes healthy.

It looks like this is related to the following upstream bug: kubernetes-sigs/kustomize#3659 which is not yet fixed.

Does it make sense to mutex around buildKustomization to avoid this until the upstream bug is fixed? terraform-provider-kustomization has taken that approach as a temp fix.
@stefanprodan
Copy link
Member

stefanprodan commented Apr 1, 2021 •
edited
Loading

Can you please set this cmd arg --concurrent=1 this would act like a mutex as it completely disables parallel processing of Kustomizations.

@benagricola
Copy link
Author

Yep, that mitigates the issue, thanks

This was referenced May 6, 2021
Closed
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Upgrade controller to Kustomize v4 fluxcd/kustomize-controller
2 participants
@benagricola @stefanprodan