Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Issue when a CheCluster CR doesn't have devworkspace.enabled=true #21166

Closed
l0rd opened this issue Feb 14, 2022 · 6 comments
Closed

Issue when a CheCluster CR doesn't have devworkspace.enabled=true #21166

l0rd opened this issue Feb 14, 2022 · 6 comments
Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator area/install Issues related to installation, including offline/air gap and initial setup kind/bug Outline of a bug - must adhere to the bug report template. severity/P2 Has a minor but important impact to the usage or development of the system. sprint/current
Milestone
7.44

Comments

@l0rd
Copy link
Contributor

l0rd commented Feb 14, 2022 •
edited
Loading

Describe the bug

After subscribing to next channels of Che and DevWorkspace I have applied the following CheCluster CR (note that there is no devWorkspace section):

apiVersion: org.eclipse.che/v1
kind: CheCluster
metadata:
  name: eclipse-che
  namespace: eclipse-che
spec:
  server:
    cheLogLevel: INFO
    dashboardIngress: {}
    externalDevfileRegistry: false
    pluginRegistryIngress: {}
    cheServerRoute: {}
    devfileRegistryIngress: {}
    selfSignedCert: false
    cheServerIngress: {}
    cheDebug: 'false'
    tlsSupport: true
    dashboardRoute: {}
    allowUserDefinedWorkspaceNamespaces: false
    pluginRegistryRoute: {}
    devfileRegistryRoute: {}
    externalPluginRegistry: false
    workspaceNamespaceDefault: <username>-che
    gitSelfSignedCert: false
    useInternalClusterSVCNames: false

Che and the DevWorkspace Operator are deployed successfully but when I try to start a workspace it fails after timeout.

This is the error message in the dashboard (see screenshot below):

Initializing DevWorkspace
Provisioning storage: Updated common PVC on cluster
Preparing networking
(...x5 times...)
devworkspace failed to progress past phase 'Starting' for longer than timeout (5m)

Here is the error message in the DevWorkspace controller logs (see full logs below):

{"level":"info","ts":1644863109.2141204,"logger":"controllers.DevWorkspace","msg":"Waiting on routing to be ready","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863109.2357876,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
(...x63 times)
{"level":"info","ts":1644863411.7341638,"logger":"controllers.DevWorkspace","msg":"DevWorkspace failed to start: devworkspace failed to progress past phase 'Starting' for longer than timeout (5m)","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}

Note that the CheCluster CR is updated and the spec.devWorspace.enabled is set to false:

  devWorkspace:
    enable: false

WORKAROUND: If CheCluster is patched with spec.devWorkspace.enabled=true everything work as expected

Che version

next (development version)

Steps to reproduce

Start a new OpenShift cluster and add CatalogSources and Subscriptions for Che and DevWorkspace

kubectl apply -f - <<EOF
apiVersion: operators.coreos.com/v1alpha1
kind: CatalogSource
metadata:
  name: devworkspace-operator-catalog
  namespace: openshift-marketplace
spec:
  sourceType: grpc
  image: quay.io/devfile/devworkspace-operator-index:next
  publisher: Red Hat
  displayName: DevWorkspace Operator Catalog
  updateStrategy:
    registryPoll:
      interval: 5m
---
apiVersion: operators.coreos.com/v1alpha1
kind: Subscription
metadata:
  name: devworkspace-operator
  namespace: openshift-operators
spec:
  channel: next
  installPlanApproval: Automatic
  name: devworkspace-operator
  source: devworkspace-operator-catalog
  sourceNamespace: openshift-marketplace
---
apiVersion: operators.coreos.com/v1alpha1
kind: CatalogSource
metadata:
  name: eclipse-che-preview
  namespace: openshift-marketplace
spec:
  sourceType: grpc
  image: quay.io/eclipse/eclipse-che-openshift-opm-catalog:next
  updateStrategy:
    registryPoll:
      interval: 5m
---
apiVersion: operators.coreos.com/v1alpha1
kind: Subscription
metadata:
  name: eclipse-che-preview-openshift
  namespace: openshift-operators
spec:
  channel: next
  installPlanApproval: Automatic
  name: eclipse-che-preview-openshift
  source: eclipse-che-preview
  sourceNamespace: openshift-marketplace
EOF

Apply the CheCluster CR above and wait that Che and the DWO gets deployed succesfully

Start the SpringBoot petclinic sample from the dashboard

Expected behavior

The Pet Clinic workspace sample start successfully

Runtime

OpenShift

Screenshots

image

Installation method

other (please specify in additional context)

Environment

Amazon

Eclipse Che Logs

DevWorkspace operator logs:


{"level":"info","ts":1644856701.8384478,"logger":"setup","msg":"Operator Version: v0.13.0-dev"}
{"level":"info","ts":1644856701.8384805,"logger":"setup","msg":"Go Version: go1.16.12"}
{"level":"info","ts":1644856701.8384876,"logger":"setup","msg":"Go OS/Arch: linux/amd64"}
{"level":"info","ts":1644856701.8384936,"logger":"setup","msg":"Commit: 9c98820d327ebd97aef3e6eda6dba00e6439f867"}
{"level":"info","ts":1644856701.8384995,"logger":"setup","msg":"BuildTime: 2022-02-09T19:45:23Z"}
I0214 16:38:22.890307       1 request.go:668] Waited for 1.017764158s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/snapshot.storage.k8s.io/v1?timeout=32s
{"level":"info","ts":1644856704.3389964,"logger":"controller-runtime.metrics","msg":"metrics server is starting to listen","addr":"127.0.0.1:8080"}
{"level":"info","ts":1644856706.7950656,"logger":"controller_devworkspace_config","msg":"Searching for config map 'devworkspace-controller-configmap' in namespace 'openshift-operators'"}
{"level":"info","ts":1644856707.126548,"logger":"operator-configuration","msg":"Updated config to [(default config)]"}
{"level":"info","ts":1644856709.5840747,"logger":"setup","msg":"setting up webhooks"}
{"level":"info","ts":1644856712.0418024,"logger":"webhook","msg":"Setting up the init webhooks configurations"}
{"level":"info","ts":1644856712.0980406,"logger":"webhook","msg":"Created webhooks configuration controller.devfile.io"}
{"level":"info","ts":1644856712.0980732,"logger":"webhook","msg":"Setting up the webhook server service account"}
{"level":"info","ts":1644856712.1121366,"logger":"webhook","msg":"Created webhook server service account"}
{"level":"info","ts":1644856712.1122854,"logger":"webhook","msg":"Setting up the webhook server cluster roles"}
{"level":"info","ts":1644856712.406692,"logger":"webhook","msg":"Created webhook server cluster role"}
{"level":"info","ts":1644856712.406722,"logger":"webhook","msg":"Setting up the webhook server cluster role binding"}
{"level":"info","ts":1644856712.5840719,"logger":"webhook","msg":"Created webhook server cluster role binding"}
{"level":"info","ts":1644856712.5841975,"logger":"webhook","msg":"Setting up the OpenShift webhook server secure service"}
{"level":"info","ts":1644856712.5842733,"logger":"webhook","msg":"Injecting serving cert using the Service CA operator"}
{"level":"info","ts":1644856712.584317,"logger":"webhook-openshift","msg":"Attempting to create the secure service"}
{"level":"info","ts":1644856712.6695426,"logger":"service","msg":"Created webhook server service"}
{"level":"info","ts":1644856712.6695762,"logger":"webhook","msg":"Creating the webhook server deployment"}
{"level":"info","ts":1644856712.7128081,"logger":"webhook","msg":"Created webhook server deployment"}
{"level":"info","ts":1644856712.7129622,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, admission.Defaulter interface is not implemented","GVK":"workspace.devfile.io/v1alpha1, Kind=DevWorkspace"}
{"level":"info","ts":1644856712.7130494,"logger":"controller-runtime.builder","msg":"skip registering a validating webhook, admission.Validator interface is not implemented","GVK":"workspace.devfile.io/v1alpha1, Kind=DevWorkspace"}
{"level":"info","ts":1644856712.713293,"logger":"controller-runtime.webhook","msg":"registering webhook","path":"/convert"}
{"level":"info","ts":1644856712.7134213,"logger":"controller-runtime.builder","msg":"conversion webhook enabled","object":{"name":""}}
{"level":"info","ts":1644856712.7135043,"logger":"controller-runtime.builder","msg":"skip registering a mutating webhook, admission.Defaulter interface is not implemented","GVK":"workspace.devfile.io/v1alpha2, Kind=DevWorkspace"}
{"level":"info","ts":1644856712.7135549,"logger":"controller-runtime.builder","msg":"skip registering a validating webhook, admission.Validator interface is not implemented","GVK":"workspace.devfile.io/v1alpha2, Kind=DevWorkspace"}
{"level":"info","ts":1644856712.7136345,"logger":"controller-runtime.builder","msg":"conversion webhook enabled","object":{"name":""}}
{"level":"info","ts":1644856712.7136993,"logger":"setup","msg":"starting manager"}
I0214 16:38:32.715101       1 leaderelection.go:243] attempting to acquire leader lease openshift-operators/8d217f93.devfile.io...
{"level":"info","ts":1644856712.7159817,"logger":"controller-runtime.webhook.webhooks","msg":"starting webhook server"}
{"level":"info","ts":1644856712.715583,"logger":"controller-runtime.manager","msg":"starting metrics server","path":"/metrics"}
{"level":"info","ts":1644856712.7345939,"logger":"controller-runtime.certwatcher","msg":"Updated current TLS certificate"}
{"level":"info","ts":1644856712.7347565,"logger":"controller-runtime.webhook","msg":"serving webhook server","host":"","port":9443}
{"level":"info","ts":1644856712.7348597,"logger":"controller-runtime.certwatcher","msg":"Starting certificate watcher"}
I0214 16:38:32.869508       1 leaderelection.go:253] successfully acquired lease openshift-operators/8d217f93.devfile.io
{"level":"info","ts":1644856713.9265547,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9266233,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9266376,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.926647,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.926657,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.926667,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9266756,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9266837,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.926692,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9267037,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting EventSource","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9267125,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting Controller","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace"}
{"level":"info","ts":1644856713.9269164,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting EventSource","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9270828,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting EventSource","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9271584,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting EventSource","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.927234,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting EventSource","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting","source":"kind source: /, Kind="}
{"level":"info","ts":1644856713.9273937,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting Controller","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting"}
{"level":"info","ts":1644856715.8320868,"logger":"controller-runtime.manager.controller.devworkspacerouting","msg":"Starting workers","reconciler group":"controller.devfile.io","reconciler kind":"DevWorkspaceRouting","worker count":5}
{"level":"info","ts":1644856715.8346317,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Starting workers","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","worker count":5}
{"level":"info","ts":1644863108.3587277,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":""}
{"level":"info","ts":1644863108.3801727,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863108.3921304,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863108.7148635,"logger":"controllers.DevWorkspace","msg":"Created object","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","kind":"v1.Role","name":"workspace"}
{"level":"info","ts":1644863108.9260767,"logger":"controllers.DevWorkspace","msg":"Created object","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","kind":"v1.RoleBinding","name":"devworkspacedw"}
{"level":"info","ts":1644863108.9337678,"logger":"controllers.DevWorkspace","msg":"Error updating workspace status: Operation cannot be fulfilled on devworkspaces.workspace.devfile.io \"java-guestbook\": the object has been modified; please apply your changes to the latest version and try again","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863108.9341285,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863109.0018125,"logger":"controllers.DevWorkspace","msg":"Created object","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","kind":"v1.PersistentVolumeClaim","name":"claim-devworkspace"}
{"level":"info","ts":1644863109.0020022,"logger":"controllers.DevWorkspace","msg":"Updated common PVC on cluster","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863109.0433245,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863109.2140806,"logger":"controllers.DevWorkspace","msg":"Created object","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","kind":"v1alpha1.DevWorkspaceRouting","name":"routing-workspace3045683e47a24699"}
{"level":"info","ts":1644863109.2141204,"logger":"controllers.DevWorkspace","msg":"Waiting on routing to be ready","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863109.2357876,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}

(...)
{"level":"info","ts":1644863411.7341638,"logger":"controllers.DevWorkspace","msg":"DevWorkspace failed to start: devworkspace failed to progress past phase 'Starting' for longer than timeout (5m)","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.7484381,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.7694147,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.7879093,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.8181357,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.8305495,"logger":"controllers.DevWorkspace","msg":"Got conflict when trying to apply timing annotations to workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"info","ts":1644863411.8419416,"logger":"controllers.DevWorkspace","msg":"Error updating workspace status: Operation cannot be fulfilled on devworkspaces.workspace.devfile.io \"java-guestbook\": the object has been modified; please apply your changes to the latest version and try again","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}
{"level":"error","ts":1644863411.842013,"logger":"controller-runtime.manager.controller.devworkspace","msg":"Reconciler error","reconciler group":"workspace.devfile.io","reconciler kind":"DevWorkspace","name":"java-guestbook","namespace":"che-kube-admin-che-hwgvnq","error":"Operation cannot be fulfilled on devworkspaces.workspace.devfile.io \"java-guestbook\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.9.5/pkg/internal/controller/controller.go:253\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.9.5/pkg/internal/controller/controller.go:214"}
{"level":"info","ts":1644863411.8477356,"logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"che-kube-admin-che-hwgvnq","Request.Name":"java-guestbook","devworkspace_id":"workspace3045683e47a24699"}

Che operator logs:

2022-02-14T16:38:27.657Z	INFO	Binary info 	{"Go version": "go1.16.12"}
2022-02-14T16:38:27.657Z	INFO	Binary info 	{"OS": "linux", "Arch": "amd64"}
2022-02-14T16:38:27.657Z	INFO	Address 	{"Metrics": ":60000"}
2022-02-14T16:38:27.657Z	INFO	Address 	{"Probe": ":6789"}
2022-02-14T16:38:27.657Z	INFO	Operator is running on 	{"Infrastructure": "OpenShift v4.x"}
I0214 16:38:28.754969       1 request.go:668] Waited for 1.044094382s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/security.openshift.io/v1?timeout=32s
time="2022-02-14T16:38:30Z" level=info msg="Limit cache by selector: app.kubernetes.io/part-of=che.eclipse.org"
2022-02-14T16:38:32.617Z	INFO	controller-runtime.metrics	metrics server is starting to listen	{"addr": ":60000"}
time="2022-02-14T16:38:35Z" level=info msg="Use 'terminationGracePeriodSeconds' 20 sec. from operator deployment."
time="2022-02-14T16:38:35Z" level=info msg="Set up process signal handler"
2022-02-14T16:38:37.601Z	INFO	setup	DevWorkspace support disabled. Will initiate restart when CheCluster with devworkspaces enabled will appear
2022-02-14T16:38:37.601Z	INFO	setup	starting manager
I0214 16:38:37.602018       1 leaderelection.go:243] attempting to acquire leader lease openshift-operators/e79b08a4.org.eclipse.che...
2022-02-14T16:38:37.602Z	INFO	controller-runtime.manager	starting metrics server	{"path": "/metrics"}
I0214 16:38:37.643741       1 leaderelection.go:253] successfully acquired lease openshift-operators/e79b08a4.org.eclipse.che
2022-02-14T16:38:37.644Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.644Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.644Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.644Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.646Z	INFO	controller-runtime.manager.controller.checluster	Starting Controller	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster"}
2022-02-14T16:38:37.645Z	INFO	controller-runtime.manager.controller.checluster	Starting EventSource	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "source": "kind source: /, Kind="}
2022-02-14T16:38:37.649Z	INFO	controller-runtime.manager.controller.checluster	Starting Controller	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster"}
2022-02-14T16:38:37.759Z	INFO	controller-runtime.manager.controller.checluster	Starting workers	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "worker count": 1}
2022-02-14T16:38:37.759Z	INFO	controller-runtime.manager.controller.checluster	Starting workers	{"reconciler group": "org.eclipse.che", "reconciler kind": "CheCluster", "worker count": 1}
I0214 17:56:12.708428       1 request.go:668] Waited for 1.044793039s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/k8s.cni.cncf.io/v1?timeout=32s
time="2022-02-14T17:56:16Z" level=info msg="Creating a new object: v1.ConfigMap, name: ca-certs-merged"
time="2022-02-14T17:56:17Z" level=info msg="Creating a new object: v1.Secret, name: self-signed-certificate"
time="2022-02-14T17:56:20Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che"
time="2022-02-14T17:56:20Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-che-gateway"
time="2022-02-14T17:56:20Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-che-gateway"
time="2022-02-14T17:56:20Z" level=info msg="Added finalizer: cheGateway.clusterpermissions.finalizers.che.eclipse.org"
time="2022-02-14T17:56:20Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Added finalizer: cheWorkspaces.clusterpermissions.finalizers.che.eclipse.org"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-namespaces-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-namespaces-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Added finalizer: namespaces-editor.permissions.finalizers.che.eclipse.org"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.ClusterRole, name: eclipse-che-cheworkspaces-devworkspace-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.ClusterRoleBinding, name: eclipse-che-cheworkspaces-devworkspace-clusterrole"
time="2022-02-14T17:56:21Z" level=info msg="Added finalizer: devWorkspace.permissions.finalizers.che.eclipse.org"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.Secret, name: che-postgres-secret"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with Postgres Secret: che-postgres-secret"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with Postgres DB: dbche"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with Postgres hostname: postgres"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with Postgres port: 5432"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with pvc strategy: common"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with pvc claim size: 10Gi"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.Route, name: che"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.Service, name: che-host"
time="2022-02-14T17:56:21Z" level=info msg="Custom resource spec eclipse-che updated with CheHost URL: che-eclipse-che.apps.mloriedo-devworkspaces.devcluster.openshift.com"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.Service, name: postgres"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.PersistentVolumeClaim, name: postgres-data"
time="2022-02-14T17:56:21Z" level=info msg="Creating a new object: v1.Deployment, name: postgres"
I0214 17:56:22.708784       1 request.go:668] Waited for 1.207578676s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/build.openshift.io/v1?timeout=32s
I0214 17:56:32.715272       1 request.go:668] Waited for 3.647007911s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/oauth.openshift.io/v1?timeout=32s
I0214 17:57:38.892990       1 request.go:668] Waited for 1.042996013s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/discovery.k8s.io/v1beta1?timeout=32s
time="2022-02-14T17:57:45Z" level=info msg="Running exec for 'get PostgreSQL version' in the pod 'postgres-68c74b6f99-b9cxh'"
time="2022-02-14T17:57:45Z" level=info msg="Exec successfully completed."
time="2022-02-14T17:57:45Z" level=info msg="Custom resource spec eclipse-che updated with database.postgresVersion: 13.3"
time="2022-02-14T17:57:45Z" level=info msg="Custom resource spec eclipse-che updated with oAuthClient name: eclipse-che-openshift-identity-provider-r0n3gz"
time="2022-02-14T17:57:45Z" level=info msg="Custom resource spec eclipse-che updated with oAuth secret name: BAjJFr5YECcm"
time="2022-02-14T17:57:45Z" level=info msg="Creating a new object: v1.OAuthClient, name: eclipse-che-openshift-identity-provider-r0n3gz"
time="2022-02-14T17:57:45Z" level=info msg="Added finalizer: oauthclients.finalizers.che.eclipse.org"
time="2022-02-14T17:57:45Z" level=info msg="Creating a new object: v1.Service, name: devfile-registry"
time="2022-02-14T17:57:45Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-devfile-registry"
time="2022-02-14T17:57:45Z" level=info msg="Custom resource status eclipse-che updated with status: Devfile Registry URL: https://che-eclipse-che.apps.mloriedo-devworkspaces.devcluster.openshift.com/devfile-registry"
time="2022-02-14T17:57:45Z" level=info msg="Creating a new object: v1.ConfigMap, name: devfile-registry"
time="2022-02-14T17:57:45Z" level=info msg="Creating a new object: v1.Deployment, name: devfile-registry"
I0214 17:57:48.906200       1 request.go:668] Waited for 2.905950672s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/migration.k8s.io/v1alpha1?timeout=32s
I0214 17:57:59.066593       1 request.go:668] Waited for 1.044600224s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/org.eclipse.che/v1?timeout=32s
I0214 17:58:09.621777       1 request.go:668] Waited for 1.045930611s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/template.openshift.io/v1?timeout=32s
time="2022-02-14T17:58:13Z" level=info msg="Creating a new object: v1.Service, name: plugin-registry"
time="2022-02-14T17:58:13Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-plugin-registry"
time="2022-02-14T17:58:13Z" level=info msg="Custom resource status eclipse-che updated with status: Plugin Registry URL: https://che-eclipse-che.apps.mloriedo-devworkspaces.devcluster.openshift.com/plugin-registry/v3"
time="2022-02-14T17:58:13Z" level=info msg="Creating a new object: v1.ConfigMap, name: plugin-registry"
time="2022-02-14T17:58:13Z" level=info msg="Creating a new object: v1.Deployment, name: plugin-registry"
I0214 17:58:19.642330       1 request.go:668] Waited for 2.193259555s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/migration.k8s.io/v1alpha1?timeout=32s
I0214 17:58:29.802971       1 request.go:668] Waited for 1.045122288s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/operator.openshift.io/v1alpha1?timeout=32s
time="2022-02-14T17:58:31Z" level=info msg="Creating a new object: v1.Service, name: che-dashboard"
time="2022-02-14T17:58:31Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-che-dashboard"
time="2022-02-14T17:58:31Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che-dashboard"
time="2022-02-14T17:58:31Z" level=info msg="Creating a new object: v1.Deployment, name: che-dashboard"
I0214 17:58:39.810563       1 request.go:668] Waited for 2.195626191s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/user.openshift.io/v1?timeout=32s
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ServiceAccount, name: che-gateway"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.Role, name: che-gateway"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.RoleBinding, name: che-gateway"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.Secret, name: che-gateway-oauth-secret"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config-oauth-proxy"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config-kube-rbac-proxy"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config-header-rewrite-traefik-plugin"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-config"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.Deployment, name: che-gateway"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.Service, name: che-gateway"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che-gateway-route-server"
time="2022-02-14T17:58:49Z" level=info msg="Creating a new object: v1.ConfigMap, name: che"
I0214 17:58:50.366593       1 request.go:668] Waited for 1.006737959s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2022-02-14T17:58:57Z" level=info msg="Creating a new object: v1.Deployment, name: che"
I0214 17:59:00.375094       1 request.go:668] Waited for 2.44348362s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/console.openshift.io/v1alpha1?timeout=32s
I0214 17:59:10.382054       1 request.go:668] Waited for 3.647145593s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/whereabouts.cni.cncf.io/v1alpha1?timeout=32s
I0214 17:59:20.491457       1 request.go:668] Waited for 1.04531374s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/cloudcredential.openshift.io/v1?timeout=32s
I0214 18:00:19.081749       1 request.go:668] Waited for 1.04410695s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
time="2022-02-14T18:00:25Z" level=info msg="Eclipse Che is now available at: https://che-eclipse-che.apps.mloriedo-devworkspaces.devcluster.openshift.com"
time="2022-02-14T18:00:25Z" level=info msg="Custom resource status eclipse-che updated with status: Che API: Available"
time="2022-02-14T18:00:25Z" level=info msg="Custom resource status eclipse-che updated with che server URL: https://che-eclipse-che.apps.mloriedo-devworkspaces.devcluster.openshift.com"
time="2022-02-14T18:00:25Z" level=info msg="Custom resource status eclipse-che updated with version: next"
I0214 18:00:29.089118       1 request.go:668] Waited for 3.544762183s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/workspace.devfile.io/v1alpha1?timeout=32s
time="2022-02-14T18:00:29Z" level=info msg="Creating a new object: v1.ConsoleLink, name: che"
time="2022-02-14T18:00:29Z" level=info msg="Added finalizer: consolelink.finalizers.che.eclipse.org"
time="2022-02-14T18:00:29Z" level=info msg="Successfully reconciled."
I0214 18:00:39.344898       1 request.go:668] Waited for 1.044687614s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
time="2022-02-14T18:00:42Z" level=info msg="Added finalizer: consolelink.finalizers.che.eclipse.org"
time="2022-02-14T18:00:42Z" level=info msg="Successfully reconciled."
I0214 18:00:49.601753       1 request.go:668] Waited for 1.044618665s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/console.openshift.io/v1?timeout=32s
time="2022-02-14T18:00:54Z" level=info msg="Successfully reconciled."
I0214 18:00:59.954896       1 request.go:668] Waited for 1.045670554s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/org.eclipse.che/v1?timeout=32s
time="2022-02-14T18:01:07Z" level=info msg="Successfully reconciled."
@l0rd l0rd added the kind/bug Outline of a bug - must adhere to the bug report template. label Feb 14, 2022
@che-bot che-bot added the status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. label Feb 14, 2022
@l0rd l0rd added area/devworkspace-che-operator area/install Issues related to installation, including offline/air gap and initial setup area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator and removed status/need-triage An issue that needs to be prioritized by the curator responsible for the triage. See https://github. labels Feb 14, 2022
@amisevsk
Copy link
Contributor

If DevWorkspace is not enabled on the CheCluster, I believe Che will not start the che routing controller, which would result in this occurring if a DevWorkspace that uses the che routingClass is created.

@l0rd l0rd added the severity/P2 Has a minor but important impact to the usage or development of the system. label Feb 14, 2022
@tolusha
Copy link
Contributor

tolusha commented Feb 15, 2022

I got the problem.
There are still some code with logic depending on devworkspace.enable field.

This was referenced Feb 15, 2022
Closed
Merged
@tolusha tolusha added this to the 7.44 milestone Feb 16, 2022
@tolusha
Copy link
Contributor

tolusha commented Feb 16, 2022

Fixed by eclipse-che/che-operator#1321
devworkspace.enable will be ignored.
It is supposed to be true anytime.

@tolusha tolusha closed this as completed Feb 16, 2022
@Divine1
Copy link

Divine1 commented May 8, 2022

@tolusha i'm facing an error and i think it is related to this issue. i have detailed the issue in this link #21380

please help me on this

@tolusha
Copy link
Contributor

tolusha commented May 9, 2022

@Divine1
The issue describes a different cause than yours.
Pls. have a look #21380 (comment)

@Divine1
Copy link

Divine1 commented May 9, 2022

@tolusha thank you for the details. have a nice day.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator area/install Issues related to installation, including offline/air gap and initial setup kind/bug Outline of a bug - must adhere to the bug report template. severity/P2 Has a minor but important impact to the usage or development of the system. sprint/current
Projects
None yet
Milestone
7.44
Development

No branches or pull requests
5 participants
@l0rd @tolusha @Divine1 @amisevsk @che-bot