Improve CI times by switching from conda to mamba #981
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* remove push docs, as this is legacy * in package and test: - break the job into small tasks with separate names, like checkout, install env, run tests, etc - switch from conda to mamba in order to speed up the conda env creation which has become very on many occasions
|
Please note, the 'old' CI tests set up python 3.7 (macos-latest|ubuntu-latest) are obsolete as they are being replaced by Python package and test. |
Ezward
approved these changes
Jan 20, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Improve CI performance
The CI is slow on OSX and very slow on Ubuntu as mentioned in #980. We are changing the packet manager from conda to mamba which performs the install much faster.
I spent some time trying to setup the CI also for windows, but many tests fail, because of the windows filesystem not coping with the Tub and Datastore tests, and the missing integration of trt in tensorflow. Also mamba is not supported, so currently it cannot be added easily and if the install is only patchy and many tests are not working then there is no point in maintaining integration test for windows.
I will update the docs to describe the mamba install as this is helpful also outside of the CI after this gets merged.