CI: run .NET Framework Integration Tests on Windows #1615
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This runs the .NET Framework tests on Windows by setting up WSL2 in the Windows VM with Vampire/setup-wsl and starting the SSH server container with podman in the Ubuntu VM. This should catch more Windows specific issues than the current mono solution does.
To my surprise, this actually works. It's pretty slow though. A full test run takes about an hour. Also the already flaky test from #1253 has failed on every run so far. I assume the bad performance is somehow due to the nested virtualization.
We could either disable the flaky test and live with the long CI time or only test specific tests here, like before with mono. Or not do this at all since it still feels a little experimental...
Why not with docker? Docker Desktop is not supported on Windows Server. Setting up docker in the ubuntu VM manually is a lot more complex than podman since it must be run as a daemon. I tried this as well, but couldn't get it to work. It can't connect to the Ubuntu VM for some reason.