feat: Support node selector and pod tolerations in devworkspaces

[metlos]

What does this PR do?

This adds support for a couple of things:

• adds support for workspace pod tolerations and node selector as properties in
  the CheCluster CRD v1 under spec.server.workspacePodTolerations and spec.server.workspacePodNodeSelector
  in addition to the CHE_WORKSPACE_POD_NODE__SELECTOR and CHE_WORKSPACE_POD_TOLERATIONS__JSON custom
  properties,
• adds support for the same as properties in the CRD v2alpha1 under spec.workspaces.podTolerations and
  spec.workspaces.podNodeSelector,
• implements conversion between the two (when converting to v2alpha1, the values are read out of either
  the properties, or if not found there, from the custom che properties)
• the usernamespace reconciler now annotates the user namespace/project with annotations understood by
  the devworkspace operator to apply the node selector and pod toleration configuration to the actual
  devworkspace pods.

Screenshot/screencast of this PR

none

What issues does this PR fix or reference?

eclipse-che/che#20884

How to test this PR?

1. Install the che-operator from this PR (I've pre-built an image quay.io/lkrejci/che-operator:issue-20884)
2. Configure node selector and/or pod tolerations in the CheCluster CR
3. Create a devworkspace
4. The configuration should be applied to the workspace pod

PR Checklist

As the author of this Pull Request I made sure that:

• The Eclipse Contributor Agreement is valid
• Code produced is complete
• Code builds without errors
• Tests are covering the bugfix
• Custom resource definition file is up to date
• OLM bundles are up to date
• The repository devfile is up to date and works
• Sections What issues does this PR fix or reference and How to test this PR completed
• Relevant user documentation updated
• Relevant contributing documentation updated
• CI/CD changes implemented, documented and communicated

Reviewers

Reviewers, please comment how you tested the PR when approving it.

[metlos]

/retest

[metlos]

@tolusha, help please! How do I unblock the two stuck jobs?

[tolusha]

/retest

[tolusha]

I don't know. We can wait or close/opene the PR (I hope it will work)

[metlos]

/retest

[tolusha]

/retest

[codecov]

Codecov Report

Merging #1301 (39775a0) into main (4f08657) will increase coverage by 0.08%.
The diff coverage is 73.33%.

@@            Coverage Diff             @@
##             main    #1301      +/-   ##
==========================================
+ Coverage   60.35%   60.43%   +0.08%     
==========================================
  Files          77       77              
  Lines        6275     6337      +62     
==========================================
+ Hits         3787     3830      +43     
- Misses       2112     2121       +9     
- Partials      376      386      +10     

Impacted Files	Coverage Δ
controllers/devworkspace/solver/che_routing.go	77.49% <ø> (ø)
controllers/devworkspace/controller.go	47.80% <50.00%> (ø)
controllers/usernamespace/controller.go	64.31% <57.14%> (-1.02%)	⬇️
api/conversion.go	80.32% <88.23%> (+1.38%)	⬆️
...ontrollers/devworkspace/solver/endpoint_exposer.go	95.31% <100.00%> (ø)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4f08657...39775a0. Read the comment docs.

[openshift-ci]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: metlos, tolusha

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci]

New changes are detected. LGTM label has been removed.