Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

olm spin loop when trying to install operator #1757

Closed
BryanHunt opened this issue Sep 11, 2020 · 6 comments
Closed

olm spin loop when trying to install operator #1757

BryanHunt opened this issue Sep 11, 2020 · 6 comments

Comments

@BryanHunt
Copy link

Bug Report

What did you do?

curl -sL https://github.com/operator-framework/operator-lifecycle-manager/releases/download/0.16.1/install.sh | bash -s 0.16.1
kubectl create -f https://operatorhub.io/install/elastic-cloud-eck.yaml

What did you expect to see?
Operator installed

What did you see instead? Under which circumstances?
Operator not installed

Environment

  • operator-lifecycle-manager version:
quay.io/operator-framework/olm@sha256:b9d011c0fbfb65b387904f8fafc47ee1a9479d28d395473341288ee126ed993b
  • Kubernetes version information:
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.5", GitCommit:"e0fccafd69541e3750d460ba0f9743b90336f24f", GitTreeState:"clean", BuildDate:"2020-04-16T11:35:47Z", GoVersion:"go1.13.9", Compiler:"gc", Platform:"linux/amd64"}
  • Kubernetes cluster kind:

Rancher on-prem

Additional context

Catalog operator logs:

Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=warning msg="an error was encountered during reconciliation" error="Operation cannot be fulfilled on subscriptions.operators.coreos.com \"my-elastic-cloud-eck\": the object has been modified; please apply your changes to the latest version and try again" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:14 am
E0911 14:33:14.333227 1 queueinformer_operator.go:290] sync {"update" "operators/my-elastic-cloud-eck"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "my-elastic-cloud-eck": the object has been modified; please apply your changes to the latest version and try again
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="resolving sources" id=8yCOT namespace=operators
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="checking if subscriptions need update" id=8yCOT namespace=operators
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="checking for existing installplan" channel=stable id=8yCOT namespace=operators pkg=elastic-cloud-eck source=operatorhubio-catalog sub=my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="resolving subscriptions in namespace" id=8yCOT namespace=operators
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:14 am
time="2020-09-11T14:33:14Z" level=debug msg="updating cache" catalog=operatorhubio-catalog/olm
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="resolution caused subscription changes, creating installplan" id=8yCOT namespace=operators
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=warning msg="no installplan found with matching generation, creating new one" id=8yCOT namespace=operators
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing id=LL2cK ip=install-tqr8l namespace=operators phase=
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg="skip processing installplan without status - subscription sync responsible for initial status" id=LL2cK ip=install-tqr8l namespace=operators phase=
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing id=qhE98 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=warning msg="status not equal, updating..." id=qhE98 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="resolving sources" id=iSjVo namespace=operators
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="checking if subscriptions need update" id=iSjVo namespace=operators
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing id=nKdA+ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=nKdA+ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing id=k4LZx ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=warning msg="an error was encountered during reconciliation" error="Operation cannot be fulfilled on subscriptions.operators.coreos.com \"my-elastic-cloud-eck\": the object has been modified; please apply your changes to the latest version and try again" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
E0911 14:33:19.925717 1 queueinformer_operator.go:290] sync {"update" "operators/my-elastic-cloud-eck"} failed: Operation cannot be fulfilled on subscriptions.operators.coreos.com "my-elastic-cloud-eck": the object has been modified; please apply your changes to the latest version and try again
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=k4LZx ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:19 am
time="2020-09-11T14:33:19Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="error fetching csv listed in subscription status" channel=stable currentCSV=elastic-cloud-eck.v1.2.1 error="clusterserviceversions.operators.coreos.com \"elastic-cloud-eck.v1.2.1\" not found" id=iSjVo namespace=operators pkg=elastic-cloud-eck source=operatorhubio-catalog sub=my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="skipping update: no new updates to catalog since last sync at 2020-09-11 14:33:19 +0000 UTC" id=iSjVo namespace=operators
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="all subscriptions up to date" id=iSjVo namespace=operators
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="resolving sources" id=StKWF namespace=operators
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="checking if subscriptions need update" id=StKWF namespace=operators
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="error fetching csv listed in subscription status" channel=stable currentCSV=elastic-cloud-eck.v1.2.1 error="clusterserviceversions.operators.coreos.com \"elastic-cloud-eck.v1.2.1\" not found" id=StKWF namespace=operators pkg=elastic-cloud-eck source=operatorhubio-catalog sub=my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="skipping update: no new updates to catalog since last sync at 2020-09-11 14:33:19 +0000 UTC" id=StKWF namespace=operators
Fri, Sep 11 2020 9:33:20 am
time="2020-09-11T14:33:20Z" level=debug msg="all subscriptions up to date" id=StKWF namespace=operators
Fri, Sep 11 2020 9:33:24 am
time="2020-09-11T14:33:24Z" level=info msg=syncing id=9QyvH ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:24 am
time="2020-09-11T14:33:24Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=9QyvH ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:29 am
time="2020-09-11T14:33:29Z" level=info msg=syncing id=6DGxC ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:29 am
time="2020-09-11T14:33:29Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=6DGxC ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:34 am
time="2020-09-11T14:33:34Z" level=info msg=syncing id=9bFcR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:34 am
time="2020-09-11T14:33:34Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=9bFcR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="syncing catsrc" id=Pb+Of source=operatorhubio-catalog
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="check registry server healthy: true" id=Pb+Of source=operatorhubio-catalog
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="registry state good" id=Pb+Of source=operatorhubio-catalog
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="resolving sources" id=/J4Th namespace=operators
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="checking if subscriptions need update" id=/J4Th namespace=operators
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="error fetching csv listed in subscription status" channel=stable currentCSV=elastic-cloud-eck.v1.2.1 error="clusterserviceversions.operators.coreos.com \"elastic-cloud-eck.v1.2.1\" not found" id=/J4Th namespace=operators pkg=elastic-cloud-eck source=operatorhubio-catalog sub=my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="skipping update: no new updates to catalog since last sync at 2020-09-11 14:33:19 +0000 UTC" id=/J4Th namespace=operators
Fri, Sep 11 2020 9:33:37 am
time="2020-09-11T14:33:37Z" level=debug msg="all subscriptions up to date" id=/J4Th namespace=operators
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=info msg=syncing id=pLRO1 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=info msg=syncing event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="reconciliation successful" event=update reconciling="*v1alpha1.Subscription" selflink=/apis/operators.coreos.com/v1alpha1/namespaces/operators/subscriptions/my-elastic-cloud-eck state="*subscription.catalogHealthyState"
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="resolving sources" id=6WTtR namespace=operators
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="checking if subscriptions need update" id=6WTtR namespace=operators
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=pLRO1 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="error fetching csv listed in subscription status" channel=stable currentCSV=elastic-cloud-eck.v1.2.1 error="clusterserviceversions.operators.coreos.com \"elastic-cloud-eck.v1.2.1\" not found" id=6WTtR namespace=operators pkg=elastic-cloud-eck source=operatorhubio-catalog sub=my-elastic-cloud-eck
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="skipping update: no new updates to catalog since last sync at 2020-09-11 14:33:19 +0000 UTC" id=6WTtR namespace=operators
Fri, Sep 11 2020 9:33:38 am
time="2020-09-11T14:33:38Z" level=debug msg="all subscriptions up to date" id=6WTtR namespace=operators
Fri, Sep 11 2020 9:33:39 am
time="2020-09-11T14:33:39Z" level=info msg=syncing id=SqWUR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:39 am
time="2020-09-11T14:33:39Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=SqWUR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:44 am
time="2020-09-11T14:33:44Z" level=info msg=syncing id=rEdsn ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:44 am
time="2020-09-11T14:33:44Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=rEdsn ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:49 am
time="2020-09-11T14:33:49Z" level=info msg=syncing id=P8kij ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:49 am
time="2020-09-11T14:33:49Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=P8kij ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:54 am
time="2020-09-11T14:33:54Z" level=info msg=syncing id=6I/Vg ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:54 am
time="2020-09-11T14:33:54Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=6I/Vg ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:59 am
time="2020-09-11T14:33:59Z" level=info msg=syncing id=OgRUt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:33:59 am
time="2020-09-11T14:33:59Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=OgRUt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:04 am
time="2020-09-11T14:34:04Z" level=info msg=syncing id=EiB/C ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:04 am
time="2020-09-11T14:34:04Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=EiB/C ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:09 am
time="2020-09-11T14:34:09Z" level=info msg=syncing id=WExiM ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:09 am
time="2020-09-11T14:34:09Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=WExiM ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:14 am
time="2020-09-11T14:34:14Z" level=info msg=syncing id=krSXU ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:14 am
time="2020-09-11T14:34:14Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=krSXU ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:19 am
time="2020-09-11T14:34:19Z" level=info msg=syncing id=1QJ84 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:19 am
time="2020-09-11T14:34:19Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=1QJ84 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:24 am
time="2020-09-11T14:34:24Z" level=info msg=syncing id=TwpYJ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:24 am
time="2020-09-11T14:34:24Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=TwpYJ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:29 am
time="2020-09-11T14:34:29Z" level=info msg=syncing id=j7UOd ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:29 am
time="2020-09-11T14:34:29Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=j7UOd ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:34 am
time="2020-09-11T14:34:34Z" level=info msg=syncing id=NYB/n ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:34 am
time="2020-09-11T14:34:34Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=NYB/n ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:39 am
time="2020-09-11T14:34:39Z" level=info msg=syncing id=l75vt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:39 am
time="2020-09-11T14:34:39Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=l75vt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:44 am
time="2020-09-11T14:34:44Z" level=info msg=syncing id=cEZqV ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:44 am
time="2020-09-11T14:34:44Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=cEZqV ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:49 am
time="2020-09-11T14:34:49Z" level=info msg=syncing id=/jNAj ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:49 am
time="2020-09-11T14:34:49Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=/jNAj ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:54 am
time="2020-09-11T14:34:54Z" level=info msg=syncing id=Mpz// ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:54 am
time="2020-09-11T14:34:54Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=Mpz// ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:59 am
time="2020-09-11T14:34:59Z" level=info msg=syncing id=deSYM ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:34:59 am
time="2020-09-11T14:34:59Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=deSYM ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:04 am
time="2020-09-11T14:35:04Z" level=info msg=syncing id=gshar ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:04 am
time="2020-09-11T14:35:04Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=gshar ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:09 am
time="2020-09-11T14:35:09Z" level=info msg=syncing id=OEhZw ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:09 am
time="2020-09-11T14:35:09Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=OEhZw ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:14 am
time="2020-09-11T14:35:14Z" level=info msg=syncing id=S1pu2 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:14 am
time="2020-09-11T14:35:14Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=S1pu2 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:19 am
time="2020-09-11T14:35:19Z" level=info msg=syncing id=pILKq ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:20 am
time="2020-09-11T14:35:20Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=pILKq ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:25 am
time="2020-09-11T14:35:25Z" level=info msg=syncing id=jltv6 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:25 am
time="2020-09-11T14:35:25Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=jltv6 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:30 am
time="2020-09-11T14:35:30Z" level=info msg=syncing id=ks75B ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:30 am
time="2020-09-11T14:35:30Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=ks75B ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:35 am
time="2020-09-11T14:35:35Z" level=info msg=syncing id=+hhQC ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:35 am
time="2020-09-11T14:35:35Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=+hhQC ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:37 am
time="2020-09-11T14:35:37Z" level=debug msg="syncing catsrc" id=y+gAo source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:37 am
time="2020-09-11T14:35:37Z" level=debug msg="check registry server healthy: true" id=y+gAo source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:37 am
time="2020-09-11T14:35:37Z" level=debug msg="registry state good" id=y+gAo source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="syncing catsrc" id=Un6mR source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="check registry server healthy: true" id=Un6mR source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="registry state good" id=Un6mR source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="syncing catsrc" id=qGHS9 source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="check registry server healthy: true" id=qGHS9 source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:38 am
time="2020-09-11T14:35:38Z" level=debug msg="registry state good" id=qGHS9 source=operatorhubio-catalog
Fri, Sep 11 2020 9:35:40 am
time="2020-09-11T14:35:40Z" level=info msg=syncing id=ejI1w ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:40 am
time="2020-09-11T14:35:40Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=ejI1w ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:45 am
time="2020-09-11T14:35:45Z" level=info msg=syncing id=QZJ3n ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:45 am
time="2020-09-11T14:35:45Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=QZJ3n ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:50 am
time="2020-09-11T14:35:50Z" level=info msg=syncing id=2Ws7H ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:50 am
time="2020-09-11T14:35:50Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=2Ws7H ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:55 am
time="2020-09-11T14:35:55Z" level=info msg=syncing id=JPzgt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:35:55 am
time="2020-09-11T14:35:55Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=JPzgt ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:00 am
time="2020-09-11T14:36:00Z" level=info msg=syncing id=sDBy5 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:00 am
time="2020-09-11T14:36:00Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=sDBy5 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:05 am
time="2020-09-11T14:36:05Z" level=info msg=syncing id=WnYfA ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:05 am
time="2020-09-11T14:36:05Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=WnYfA ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:10 am
time="2020-09-11T14:36:10Z" level=info msg=syncing id=qkCry ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:10 am
time="2020-09-11T14:36:10Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=qkCry ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:15 am
time="2020-09-11T14:36:15Z" level=info msg=syncing id=j93rI ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:15 am
time="2020-09-11T14:36:15Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=j93rI ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:20 am
time="2020-09-11T14:36:20Z" level=info msg=syncing id=2UXAR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:20 am
time="2020-09-11T14:36:20Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=2UXAR ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:25 am
time="2020-09-11T14:36:25Z" level=info msg=syncing id=r4R6/ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:25 am
time="2020-09-11T14:36:25Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=r4R6/ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:30 am
time="2020-09-11T14:36:30Z" level=info msg=syncing id=212IV ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:30 am
time="2020-09-11T14:36:30Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=212IV ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:35 am
time="2020-09-11T14:36:35Z" level=info msg=syncing id=mayxj ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:35 am
time="2020-09-11T14:36:35Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=mayxj ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:40 am
time="2020-09-11T14:36:40Z" level=info msg=syncing id=/6vjA ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:40 am
time="2020-09-11T14:36:40Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=/6vjA ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:45 am
time="2020-09-11T14:36:45Z" level=info msg=syncing id=/sxBb ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:45 am
time="2020-09-11T14:36:45Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=/sxBb ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:50 am
time="2020-09-11T14:36:50Z" level=info msg=syncing id=TTc8X ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:50 am
time="2020-09-11T14:36:50Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=TTc8X ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:55 am
time="2020-09-11T14:36:55Z" level=info msg=syncing id=vJzcx ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:36:55 am
time="2020-09-11T14:36:55Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=vJzcx ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:00 am
time="2020-09-11T14:37:00Z" level=info msg=syncing id=vM48e ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:00 am
time="2020-09-11T14:37:00Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=vM48e ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:05 am
time="2020-09-11T14:37:05Z" level=info msg=syncing id=2N+T+ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:05 am
time="2020-09-11T14:37:05Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=2N+T+ ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:10 am
time="2020-09-11T14:37:10Z" level=info msg=syncing id=4SXd6 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:10 am
time="2020-09-11T14:37:10Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=4SXd6 ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:15 am
time="2020-09-11T14:37:15Z" level=info msg=syncing id=5loxv ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:15 am
time="2020-09-11T14:37:15Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=5loxv ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:20 am
time="2020-09-11T14:37:20Z" level=info msg=syncing id=QeLSz ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:20 am
time="2020-09-11T14:37:20Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=QeLSz ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:25 am
time="2020-09-11T14:37:25Z" level=info msg=syncing id=KxeJL ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:25 am
time="2020-09-11T14:37:25Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=KxeJL ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:30 am
time="2020-09-11T14:37:30Z" level=info msg=syncing id=6hkxo ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:30 am
time="2020-09-11T14:37:30Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=6hkxo ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:35 am
time="2020-09-11T14:37:35Z" level=info msg=syncing id=Igd3q ip=install-tqr8l namespace=operators phase=Installing
Fri, Sep 11 2020 9:37:35 am
time="2020-09-11T14:37:35Z" level=debug msg="install plan not yet populated from bundle image, requeueing" id=Igd3q ip=install-tqr8l namespace=operators phase=Installing
@BryanHunt
Copy link
Author

My problem appears to be independent of which operator I try to deploy. I just tried to deploy the Jaeger operator and got the same spin loop.

@benluddy
Copy link
Contributor

Hi Bryan,

Can you share the contents of the InstallPlan that is stuck? At this point, there should be a job in the "olm" namespace that is fetching and unpacking the contents of the requested bundle. It sounds like something has gone wrong there.

@BryanHunt
Copy link
Author

Yep, makes sense now:

Warning  FailedCreate  4m57s (x267 over 26h)  job-controller  Error creating: pods "7ff2abb79520552bb5bf66b5203cee33a1b84a32a2f53d65f9aca3e20f5f12d-" is forbidden: unable to validate against any pod security policy: []

Is there documentation on installing olm when using PSP's? I'm not sure what PSP the olm namespace is using since I allowed the script to create the namespace and it did so outside of any Rancher project that would normally have a specific PSP.

@BryanHunt
Copy link
Author

I think I'm getting closer.

I deleted the olm and operator namespaces. I then created namespaces under a Rancher project that had a PSP defined. I created a values.yaml as follows and ran the script to create the yaml files:

namespace: hwinf-k8s-olm
catalog_namespace: hwinf-k8s-olm
operator_namespace: hwinf-k8s-operators

I applied the yaml files and everything looked ok, so I tried the following subscription:

apiVersion: operators.coreos.com/v1alpha1
kind: Subscription
metadata:
  name: my-elastic-cloud-eck
  namespace: hwinf-k8s-operators
spec:
  channel: stable
  name: elastic-cloud-eck
  source: operatorhubio-catalog
  sourceNamespace: hwinf-k8s-olm

Now, I get the following:

kubectl get csvs
NAME                             DISPLAY                       VERSION       REPLACES                   PHASE
elastic-cloud-eck.v1.0.0-beta1   Elastic Cloud on Kubernetes   1.0.0-beta1   elastic-cloud-eck.v0.9.0   Pending
elastic-cloud-eck.v1.2.1         Elastic Cloud on Kubernetes   1.2.1         elastic-cloud-eck.v1.2.0   Failed
kubectl get csvs
NAME                             DISPLAY                       VERSION       REPLACES                   PHASE
elastic-cloud-eck.v1.0.0-beta1   Elastic Cloud on Kubernetes   1.0.0-beta1   elastic-cloud-eck.v0.9.0   Pending
elastic-cloud-eck.v1.2.1         Elastic Cloud on Kubernetes   1.2.1         elastic-cloud-eck.v1.2.0   Pending

And, I'm getting errors in the catalog-operator:

E0914 22:40:18.125871       1 queueinformer_operator.go:290] sync "hwinf-k8s-operators" failed: constraints not satisfiable: elastic-cloud-eck is mandatory, gvkunique/elasticsearch.k8s.elastic.co/v1beta1/Elasticsearch permits at most 1 of operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.0, @existing/hwinf-k8s-operators//elastic-cloud-eck.v1.0.0-beta1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.0-beta1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v0.9.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.2, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.1, @existing/hwinf-k8s-operators//elastic-cloud-eck.v1.0.0-beta1 is mandatory, elastic-cloud-eck requires at least one of operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.2, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.0-beta1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v0.9.0, gvkunique/elasticsearch.k8s.elastic.co/v1/Elasticsearch permits at most 1 of @existing/hwinf-k8s-operators//elastic-cloud-eck.v1.2.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.1, o
peratorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.0, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.1.2, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.0.1, operatorhubio-catalog/hwinf-k8s-olm/stable/elastic-cloud-eck.v1.2.1, @existing/hwinf-k8s-operators//elastic-cloud-eck.v1.2.1 is mandatory

@BryanHunt
Copy link
Author

I deleted the subscription and tried again. Now, I see the operator trying to start up, but has the error:

No API token found for service account "elastic-operator", retry after the token is automatically created and added to the service account

The error message is correct. The service account exists, but there is no API token.

@BryanHunt
Copy link
Author

This issue is getting off track. For anyone that ends up here, the original problem was caused by deploying olm to the default namespaces which did not have a proper pod security policy. The fix was to deploy to custom namespaces that had a proper PSP.

@0xff-dev 0xff-dev mentioned this issue Mar 30, 2021
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@BryanHunt @benluddy