Release Che 7.23.0

[nickboldt]

List of pending issues / PRs

• [NO] [Hosted Che] Failed to rollout 7.23.0-SNAPSHOT - Jwks endpoint url not found in keycloak [Hosted Che] Failed to rollout 7.23.0-SNAPSHOT - Jwks endpoint url not found in keycloak #18553 / Fix che-server when used external oidc provider. #18563 - not a blocker, will slip to Che 7.23.1
• Che dashboard workspace is not loading on the UI Che dashboard workspace is not loading on the UI #18499 - not a blocker, has status needsinfo

Release status

In series, the following will be released via che-release:

• che-theia, che-machine-exec, che-devfile registry,
• che-plugin-registry (once che-theia and machine-exec are done)
• che-parent, che-dashboard, che-workspace-loader, and che (server assembly), including release to Maven Central
• che-operator

Then, these steps will be done, which still require some manual intervention (PR verification is not yet automated):

• generation of OperatorHub PRs
• chectl

• che-theia, che-machine-exec, che-devfile-registry, che-plugin-registry
• che-parent, che-dashboard, che-workspace-loader, che
• che-operator (depends on all of the above)
• Che community operator PRs (depends on all of the above)
• chectl (depends on all of the above)

If this is a .0 release:

• send reminder to TLs to triage unresolved issues
• complete current milestone
  • move incomplete deferred issues to backlog
  • move incomplete WIP issues to next milestone
  • close completed issues
  • close milestone

Owner	Process	Script	CI	Artifact(s) + Container(s)
@mkuznyetsov	che-theia	cico_release.sh	centos	eclipse/che-theia
@mkuznyetsov	che-machine-exec	cico_release.sh	centos	eclipse/che-machine-exec
@mkuznyetsov	che-plugin-registry	cico_release.sh	centos	eclipse/che-plugin-registry
@mkuznyetsov	che-devfile-registry	cico_release.sh	centos	eclipse/che-devfile-registry
@mkuznyetsov	che-parent	cico_release.sh	centos	che-parent
@mkuznyetsov	che-dashboard	cico_release.sh	centos	che-dashboard
@mkuznyetsov	che-workspace-loader	cico_release.sh	centos	che-workspace-loader
@mkuznyetsov	che	cico_release.sh	centos	che.core, eclipse/che-server, eclipse/che-endpoint-watcher, eclipse/che-keycloak, eclipse/che-postgres, eclipse/che-server, eclipse/che-e2e
@tolusha	che-operator	make-release.sh	centos	eclipse/che-operator
@tolusha	chectl	make-release.sh	travis	chectl releases

[ibuziuk]

Have added [Hosted Che] Failed to rollout 7.23.0-SNAPSHOT - Jwks endpoint url not found in keycloak #18553 to the list of pending issues

[nickboldt]

E2E tests for Che 7.23.0 are failing in https://ci.centos.org/job/devtools-che-release-che-release/244/console

2020-12-10 01:12:08,649[main]             [ERROR] [s.c.u.WorkspaceDtoDeserializer 55]   - Fail to read workspace template broken_workspace.json for infrastructure /templates/workspace/openshift/broken_workspace.json because com.google.gson.stream.MalformedJsonException: Expected ':' at line 3 column 8 path $.werwerw 

[[1;34mINFO[m] Che Legacy E2E :: Test ............................. [1;31mFAILURE[m [18:13 min]
[[1;34mINFO[m] [1m------------------------------------------------------------------------[m
[[1;34mINFO[m] [1;31mBUILD FAILURE[m
[[1;34mINFO[m] [1m------------------------------------------------------------------------[m
[[1;34mINFO[m] Total time:  45:27 min
[[1;34mINFO[m] Finished at: 2020-12-10T01:30:37Z
[[1;34mINFO[m] [1m------------------------------------------------------------------------[m
[[1;31mERROR[m] Failed to execute goal [32morg.sonatype.plugins:nexus-staging-maven-plugin:1.6.7:deploy[m [1m(default-deploy)[m on project [36mche-selenium-test[m: [1;31mExecution default-deploy of goal org.sonatype.plugins:nexus-staging-maven-plugin:1.6.7:deploy failed: Staging rules failure![m -> [1m[Help 1][m

any advice?

[nickboldt]

Re-ran build, and it worked. Che server released. Che operator done (except for PR merging).

[nickboldt]

operator release in progress:

• add new generated CSV files in olm/ folder... che-operator#573
• Release version 7.23.0 che-operator#570 -> Release version 7.23.0 che-operator#574
• Copy 7.23.0 csv to master che-operator#571 -> Copy 7.23.0 csv to master che-operator#575

Once merged, a new GH action should auto-trigger the community operators PR creation from here:

https://github.com/eclipse/che-operator/actions?query=workflow%3A%22Release+community+operator+PRs%22

[ibuziuk]

@nickboldt Are there any community PRs opened?
It is strange that release takes such a long time, assuming that respin is planned tomorrow

[nickboldt]

As noted above, https://github.com/eclipse/che-operator/actions?query=workflow%3A%22Release+community+operator+PRs%22 was set to auto-generate the PRs, but through the last day we've encountered various issues w/ tokens and permissions.

The most recent:

   - Push branch update-eclipse-che-upstream-operator-7.23.0 to https://github.com/che-incubator/community-operators.git
To https://github.com/che-incubator/community-operators.git
 ! [remote rejected]   update-eclipse-che-upstream-operator-7.23.0 -> update-eclipse-che-upstream-operator-7.23.0 (refusing to allow a Personal Access Token to create or update workflow `.github/workflows/deploy_image.yaml` without `workflow` scope)
error: failed to push some refs to 'https://github.com/che-incubator/community-operators.git'

So the plan is to explore splitting this into two actions:

• one that runs in eclipse/che-operator on push
• one that is triggered by the above push in https://github.com/che-incubator/community-operators/ to generate the PRs

See #18627

[nickboldt]

Since I can't yet do the above generation via GH action, I ran the script manually today. Resulting PRs:

• Update eclipse-che operator for kubernetes to release 7.23.0 operator-framework/community-operators#2850
• Update eclipse-che operator for openshift to release 7.23.0 operator-framework/community-operators#2851

[nickboldt]

I was also told recently that the chectl release does not depend on the community operators being merged (and in fact @flacatus already released chectl 7.23.0!), so we can change that via this issue:

• Improve usability and flow for chectl releases #18628
• https://github.com/eclipse/che-release/pull/15/files

[nickboldt]

Release is done, guide is updated. Followup work in #18627