Create automated E2E system tests of IntelliJ IDEA as a Che editor

[dmytro-ndp]

Is your task related to a problem? Please describe.

Eclipse Che 7.20.0 planned to support IntelliJ IDEA as a Che editor #17790

So, we need to automate verification of workspaces with IntelliJ IDEA as embedded editor.

[l0rd]

Testing intelliJ running in the browser may be tricky. Checking that the workspace is started successfully should be enough.

[azatsarynnyy]

Testing intelliJ running in the browser may be tricky. Checking that the workspace is started successfully should be enough.

+1 as noVNC web client is used here. It draws the UI within HTML Canvas. So, there're no DOM elements to check.

[rhopp]

From meeting with @l0rd
Mandatory check (to automate):

• Workspace startup & health.

Good to check (automate if possible):

• Activity checker (when active, pings are sent, when inactive, pings are not sent)
  • Idling (connected to activity checker)
• Configuration persistence.
• Source code (defined in devfile) is mounted & imported in IDE (InteliJ Idea)

This could/should be done mostly by monitoring server logs and InteliJ Idea logs/standard output.

DoD:

• Job starting Workspace with InteliJ Idea as an editor is created. The job checks workspace status & health after the startup.
• Investigation of possible solutions for "Good to Check" steps is done (and implemented, if possible. Or followup issues are created)

[vzhukovs]

Activity checker (when active, pings are sent, when inactive, pings are not sent)

Note, at this moment there's a simple implementation of activity tracker, that always pings ws master, no matter if browser window in focus or not.

[rhopp]

@l0rd Question about the configuration persistance.
This is meant in the scope of single workspace (config is persisted between restarts)?
Not in the "user" scope (the settings are the same for all Idea-based workspaces of particular user), right?

[l0rd]

@l0rd Question about the configuration persistance.
This is meant in the scope of single workspace (config is persisted between restarts)?
Not in the "user" scope (the settings are the same for all Idea-based workspaces of particular user), right?

@rhopp correct, workspace scope, at least as a first iteration.

[Ohrimenko1988]

@rhopp @l0rd Looks like persistence doesn't work.
When workspace stopped by dashboard related pod also removed
and if start the same workspace again it will be launched without any previous changes.

[l0rd]

@rhopp @l0rd Looks like persistence doesn't work.
When workspace stopped by dashboard related pod also removed
and if start the same workspace again it will be launched without any previous changes.

cc @vzhukovskii

[vzhukovs]

@Ohrimenko1988 @rhopp how are you trying to change the preferences, through the Intellij UI?

[Ohrimenko1988]

@vzhukovskii I haven't tried to change preferences.
I created a new project and after that stopped workspace.
After restart the previous project was absent and legal agreement was shown.
After that, I tried to investigate a reason and found that pod deletes already after the workspace stop.

[l0rd]

@Ohrimenko1988 pod delete is normal, sources are persisted in a volume.

[Ohrimenko1988]

@l0rd
Yes, thanks to @vzhukovskii explanation I can confirm that project restores if save it to the /projects directory.
But additional issue that the "~/IdeaProjects" folder configured by default.
So maybe it worth to mount such folder into the volume if it is impossible to reconfigure Intelij default project folder.

[vzhukovs]

@Ohrimenko1988 Iegal agreement will be shown, there's a plan to hide it in future.

As for preferences:

As for project restoring:

Note, that projects has to be created in /projects directory, then they will be persisted. To be sure, that Intellij Idea persisted information about opened projects I can suggest to call File > Save All. Maybe some actions are performed to fast.

[vzhukovs]

So maybe it worth to mount such folder into the volume if it is impossible to reconfigure Intelij default project folder.

We're limited in volume mount amount per container. We can mount only one volume, which is reserved for storing Intellij Idea preferences and caches.

[Ohrimenko1988]

Done:

• Covered functionality: https://gitlab.cee.redhat.com/codeready-workspaces/jenkins-jobs/-/merge_requests/68
• Uncovered functionality: Implement checking of the mounting source code defined in the yaml to the workspace based on the "Intellij" IDE #18239