Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

che-operator container failed to create on minikube because of error "RELATED_IMAGE_gateway_authentication_sidecar_k8s" #20883

Closed
Tracked by #20839
dmytro-ndp opened this issue Dec 6, 2021 · 1 comment
Closed
Tracked by #20839

che-operator container failed to create on minikube because of error "RELATED_IMAGE_gateway_authentication_sidecar_k8s" #20883

dmytro-ndp opened this issue Dec 6, 2021 · 1 comment
Assignees
@tolusha
Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator area/chectl Issues related to chectl, the CLI of Che e2e-test/failure Issues that is related to a test failures reported by our CI platform and our QE. kind/bug Outline of a bug - must adhere to the bug report template. severity/blocker Causes system to crash and be non-recoverable or prevents Che developers from working on Che code.
Milestone
7.41

Comments

@dmytro-ndp
Copy link
Contributor

dmytro-ndp commented Dec 6, 2021 •
edited
Loading

Describe the bug

Deployment of Eclipse Che 7.41.0-SNAPSHOT failed on minikube because of che-operator container creation error:

time="2021-12-05T07:27:31Z" level=fatal msg="Failed to initialize default value: 'RELATED_IMAGE_gateway_authentication_sidecar_k8s'. Environment variable with default value was not found."

https://main-jenkins-csb-crwqe.apps.ocp4.prod.psi.redhat.com/job/Che/job/e2e/job/minikube/job/basic/job/che-server/1213/consoleFull

Version: chectl/0.0.20211203-next.e86c758 linux-x64 node-v12.22.7

chectl log:

+ /mnt/hudson_workspace/workspace/Che/e2e/minikube/basic/che-server/chectl server:deploy --k8spodreadytimeout=600000 --k8spodwaittimeout=600000 --k8spoddownloadimagetimeout=600000 --listr-renderer=verbose --platform=minikube --che-operator-cr-patch-yaml=/mnt/hudson_workspace/workspace/Che/e2e/minikube/basic/che-server/custom-resource-patch.yaml --telemetry=off --chenamespace=eclipse-che
 (node:6026) Warning: Setting the NODE_TLS_REJECT_UNAUTHORIZED environment variable to '0' makes TLS connections and HTTPS requests insecure by disabling certificate verification.
 › Installer type is set to: 'operator'
 [00:04:50] Verify Kubernetes API [started]
 › Current Kubernetes context: 'minikube'
 [00:04:50] Verify Kubernetes API...OK [title changed]
 [00:04:50] Verify Kubernetes API...OK [completed]
 [00:04:50] 👀  Looking for an already existing Eclipse Che instance [started]
 [00:04:50] Verify if Eclipse Che is deployed into namespace "eclipse-che" [started]
 [00:04:50] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [title changed]
 [00:04:50] Verify if Eclipse Che is deployed into namespace "eclipse-che"...it is not [completed]
 [00:04:50] 👀  Looking for an already existing Eclipse Che instance [completed]
 [00:04:50] ✈️  Minikube preflight checklist [started]
 [00:04:50] Verify if kubectl is installed [started]
 [00:04:50] Verify if kubectl is installed [completed]
 [00:04:50] Verify if minikube is installed [started]
 [00:04:50] Verify if minikube is installed [completed]
 [00:04:50] Verify if minikube is running [started]
 [00:04:51] Verify if minikube is running [completed]
 [00:04:51] Start minikube [started]
 [00:04:51] Start minikube [skipped]
 [00:04:51] → Minikube is already running.
 [00:04:51] Check Kubernetes version [started]
 [00:04:51] Check Kubernetes version: Found v1.20.2. [title changed]
 [00:04:51] Check Kubernetes version: Found v1.20.2. [completed]
 [00:04:51] Verify if minikube ingress addon is enabled [started]
 [00:04:51] Verify if minikube ingress addon is enabled [completed]
 [00:04:51] Enable minikube ingress addon [started]
 [00:04:56] Enable minikube ingress addon [completed]
 [00:04:56] Retrieving minikube IP and domain for ingress URLs [started]
 [00:04:56] Retrieving minikube IP and domain for ingress URLs...10.0.208.74.nip.io. [title changed]
 [00:04:56] Retrieving minikube IP and domain for ingress URLs...10.0.208.74.nip.io. [completed]
 [00:04:56] Checking minikube version [started]
 [00:04:56] Checking minikube version... 1.22.0 [title changed]
 [00:04:56] Checking minikube version... 1.22.0 [completed]
 [00:04:56] Check if cluster accessible [started]
 [00:04:56] Check if cluster accessible [skipped]
 [00:04:56] ✈️  Minikube preflight checklist [completed]
 [00:04:56] Following Eclipse Che logs [started]
 [00:04:56] Start following Operator logs [started]
 [00:04:56] Start following Operator logs...done [title changed]
 [00:04:56] Start following Operator logs...done [completed]
 [00:04:56] Start following Eclipse Che Server logs [started]
 [00:04:56] Start following Eclipse Che Server logs...done [title changed]
 [00:04:56] Start following Eclipse Che Server logs...done [completed]
 [00:04:56] Start following PostgreSQL logs [started]
 [00:04:56] Start following PostgreSQL logs...done [title changed]
 [00:04:56] Start following PostgreSQL logs...done [completed]
 [00:04:56] Start following Keycloak logs [started]
 [00:04:56] Start following Keycloak logs...done [title changed]
 [00:04:56] Start following Keycloak logs...done [completed]
 [00:04:56] Start following Plug-in Registry logs [started]
 [00:04:56] Start following Plug-in Registry logs...done [title changed]
 [00:04:56] Start following Plug-in Registry logs...done [completed]
 [00:04:56] Start following Devfile Registry logs [started]
 [00:04:56] Start following Devfile Registry logs...done [title changed]
 [00:04:56] Start following Devfile Registry logs...done [completed]
 [00:04:56] Start following Eclipse Che Dashboard logs [started]
 [00:04:56] Start following Eclipse Che Dashboard logs...done [title changed]
 [00:04:56] Start following Eclipse Che Dashboard logs...done [completed]
 [00:04:56] Start following namespace events [started]
 [00:04:56] Start following namespace events...done [title changed]
 [00:04:56] Start following namespace events...done [completed]
 [00:04:56] Following Eclipse Che logs [completed]
 [00:04:56] Create Namespace eclipse-che [started]
 [00:04:56] Create Namespace eclipse-che...[OK] [title changed]
 [00:04:56] Create Namespace eclipse-che...[OK] [completed]
 [00:04:56] 🏃‍  Running the Eclipse Che operator [started]
 [00:04:56] Create ServiceAccount che-operator in namespace eclipse-che [started]
 [00:04:56] Create ServiceAccount che-operator in namespace eclipse-che...done. [title changed]
 [00:04:56] Create ServiceAccount che-operator in namespace eclipse-che...done. [completed]
 [00:04:56] Read Roles and Bindings [started]
 [00:04:56] Read Roles and Bindings...done. [title changed]
 [00:04:56] Read Roles and Bindings...done. [completed]
 [00:04:56] Creating Roles and Bindings [started]
 [00:04:56] Creating Roles and Bindings...done. [title changed]
 [00:04:56] Creating Roles and Bindings...done. [completed]
 [00:04:56] Create CRD checlusters.org.eclipse.che [started]
 [00:04:56] Create CRD checlusters.org.eclipse.che...done. [title changed]
 [00:04:57] Create CRD checlusters.org.eclipse.che...done. [completed]
 [00:04:57] Create backup and restore CRDs [started]
 [00:04:57] Create backup and restore CRDs...done. [title changed]Execute next command on 
 [00:04:57] Create backup and restore CRDs...done. [completed]
 [00:04:57] Waiting 5 seconds for the new Kubernetes resources to get flushed [started]
 [00:05:02] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [title changed]
 [00:05:02] Waiting 5 seconds for the new Kubernetes resources to get flushed...done. [completed]
 [00:05:02] Create deployment che-operator in namespace eclipse-che [started]
 [00:05:02] Create deployment che-operator in namespace eclipse-che...done. [title changed]
 [00:05:02] Create deployment che-operator in namespace eclipse-che...done. [completed]
 [00:05:02] Operator pod bootstrap [started]
 [00:05:02] Scheduling [started]
 [00:05:02] Scheduling...done [title changed]
 [00:05:02] Scheduling...done [completed]
 [00:05:02] Downloading images [started]
 [00:05:09] Downloading images...done [title changed]
 [00:05:09] Downloading images...done [completed]
 [00:05:09] Starting [started]
 [00:05:10] Starting...failed [title changed]
 [00:05:10] Starting...failed [failed]
 [00:05:10] → Failed to start a pod, reason: Error, exitCode: 1
 [00:05:10] Operator pod bootstrap [failed]
 [00:05:10] → Failed to start a pod, reason: Error, exitCode: 1
 [00:05:10] 🏃‍  Running the Eclipse Che operator [failed]
 [00:05:10] → Failed to start a pod, reason: Error, exitCode: 1
     Error: Command server:deploy failed. Error log: 
     /home/hudson/.cache/chectl/error.log.

Che version

next (development version)

Steps to reproduce

  1. Download chectl : next
  2. Deploy Eclipse Che next on minikube by the next command:
chectl server:deploy --k8spodreadytimeout=600000 --k8spodwaittimeout=600000 --k8spoddownloadimagetimeout=600000 --listr-renderer=verbose --platform=minikube --che-operator-cr-patch-yaml=custom-resource-patch.yaml --telemetry=off --chenamespace=eclipse-che

where custom-resource-patch.yaml :

spec:
  server:
    cheImage: 'quay.io/eclipse/che-server'
    cheImageTag: 'next'
    customCheProperties:
      CHE_LIMITS_USER_WORKSPACES_RUN_COUNT: '-1'
      CHE_WORKSPACE_SIDECAR_IMAGE__PULL__POLICY: IfNotPresent
      CHE_WORKSPACE_PLUGIN__BROKER_PULL__POLICY: IfNotPresent
      CHE_INFRA_KUBERNETES_WORKSPACE_START_TIMEOUT_MIN: '12'
  auth:
    updateAdminPassword: false

Expected behavior

Eclipse Che installed successfully.

Runtime

minikube

Screenshots

No response

Installation method

chectl/next

Environment

Linux

Eclipse Che Logs

No response

Additional context

Recent changes: https://github.com/eclipse-che/che-operator/pull/1185/files#diff-7652e40a3e777d579553a2c8b841e0a36cb13d11af67cc55b3cf27340396f7deR1137
@dmytro-ndp dmytro-ndp added kind/bug Outline of a bug - must adhere to the bug report template. severity/blocker Causes system to crash and be non-recoverable or prevents Che developers from working on Che code. team/deploy e2e-test/failure Issues that is related to a test failures reported by our CI platform and our QE. labels Dec 6, 2021
@tolusha tolusha mentioned this issue Dec 6, 2021
Closed
28 tasks
@dmytro-ndp dmytro-ndp added area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator area/chectl Issues related to chectl, the CLI of Che labels Dec 6, 2021
@tolusha tolusha added this to the 7.41 milestone Dec 6, 2021
@tolusha tolusha closed this as completed Dec 6, 2021
@tolusha
Copy link
Contributor

tolusha commented Dec 6, 2021

Fixed after updating chectl templates

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tolusha tolusha

Labels
area/che-operator Issues and PRs related to Eclipse Che Kubernetes Operator area/chectl Issues related to chectl, the CLI of Che e2e-test/failure Issues that is related to a test failures reported by our CI platform and our QE. kind/bug Outline of a bug - must adhere to the bug report template. severity/blocker Causes system to crash and be non-recoverable or prevents Che developers from working on Che code.
Projects
None yet
Milestone
7.41
Development

No branches or pull requests
2 participants
@dmytro-ndp @tolusha