Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using unified conda-lock file in postBuild for reproducible conda environment #14

Draft
wants to merge 31 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
5857db0
Rename environment.yml file to environment-cryocloud.yml
weiji14 Nov 29, 2022
90fe9f6
Bump to cartopy 0.21.0, rasterio 1.3.3, hdf5 1.12.2, qgis 3.22.11
weiji14 Nov 29, 2022
1d23d26
Replace explicit conda-linux-64.lock file with unified conda-lock.yml
weiji14 Nov 29, 2022
95d8ec8
Temporarily rename environment-cryocloud.yml back to environment.yml
weiji14 Nov 29, 2022
09ecd55
Revert "Temporarily rename environment-cryocloud.yml back to environm…
weiji14 Nov 29, 2022
00cc297
Add postBuild script to install dependencies from unified conda-lock.yml
weiji14 Nov 29, 2022
d07eafb
Minimal conda-lock.yml with only Python 3.10
weiji14 Nov 29, 2022
ef9cc29
Fix conda-lock install command in postBuild
weiji14 Nov 29, 2022
e609d9c
Pin to conda-lock 1.0.5 to keep relative paths
weiji14 Nov 29, 2022
4ea512b
Document how to update conda-lock.yml file in the main README.md
weiji14 Nov 29, 2022
abb8710
Install conda-lock with pip_support extras
weiji14 Nov 29, 2022
33436bc
Run docker build and test workflow when conda-linux.yml is modified
weiji14 Nov 29, 2022
3e08468
Pin minimum jupyterlab to 3.5
weiji14 Nov 29, 2022
85b01cb
[condalock-command] autogenerated conda-lock files
actions-bot Nov 29, 2022
f82355e
Set notebook as conda environment name in docker image
weiji14 Nov 29, 2022
f0b86fe
Bump conda-lock from 1.0.5 to 1.2.1
weiji14 Nov 29, 2022
20ec34b
Update conda-lock's dependency file source
weiji14 Nov 29, 2022
3c6a826
[condalock-command] autogenerated conda-lock files
actions-bot Nov 29, 2022
70fb920
Improvements to postBuild script
weiji14 Nov 29, 2022
57e22d2
Merge branch 'main' into unified-lockfile
weiji14 Nov 30, 2022
9f36ec5
Merge branch 'main' into unified-lockfile
weiji14 Dec 4, 2022
7f9db0c
Fix incorrect merge conflict omission
weiji14 Dec 4, 2022
27f3a8b
Delete conda-linux-64.lock
weiji14 Dec 4, 2022
5486608
Merge branch 'main' into unified-lockfile
weiji14 May 28, 2023
18b1b25
Bump conda-lock to 2.0.0
weiji14 May 28, 2023
8353e4d
Use conda-lock 2.0.0 in postBuild
weiji14 May 28, 2023
4a21b81
Update conda-lock.yml to v1 schema
weiji14 May 28, 2023
71a2f4e
Fix typo conda-linux.yml to conda-lock.yml
weiji14 Jun 10, 2023
4cff62b
Merge branch 'main' into unified-lockfile
weiji14 Jun 10, 2023
bccefa2
Merge branch 'main' into unified-lockfile
weiji14 Jun 17, 2023
9c8e894
Bump conda-lock from 2.0.0 to 2.1.0
weiji14 Jun 17, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions .github/workflows/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,10 @@ on:
- main
paths:
- 'apt.txt'
- 'conda-linux-64.lock'
- 'environment.yml'
- 'start'
- 'conda-linux.yml'
weiji14 marked this conversation as resolved.
Show resolved Hide resolved
- 'environment-cryocloud.yml'
- 'postBuild'
- 'start'
# Trigger rebuilds if the build process changes
- '.github/workflows/build.yaml'

Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/conda-lock-command.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,12 +44,12 @@ jobs:
# HACK: Temporarily pin urllib3<2 to resolve incompatibilities:
# https://github.com/ionrock/cachecontrol/issues/292
- name: Install conda-lock
run: 'pip install conda-lock "urllib3<2"'
run: 'pip install "conda-lock>=2.0.0" "urllib3<2"'

# Run "conda-lock" for linux-64 only
- name: Run conda-lock
run: |
conda-lock lock --mamba --kind explicit --file environment.yml --platform linux-64
conda-lock lock --mamba --file environment-cryocloud.yml --platform linux-64

# Commit the change to the PR branch if any changes
- name: Commit condalock files to PR
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@ on:
pull_request:
paths:
- 'apt.txt'
- 'conda-linux-64.lock'
- 'environment.yml'
- 'conda-linux.yml'
weiji14 marked this conversation as resolved.
Show resolved Hide resolved
- 'environment-cryocloud.yml'
- 'postBuild'
- 'start'
# Trigger rebuilds if the test process changes
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ doc](https://repo2docker.readthedocs.io/en/latest/config_files.html#config-files
You can add or update packages on the cryointhecloud hub by making pull requests to this
repository. Follow these steps:

1. Edit either the [`environment.yml`](https://github.com/CryoInTheCloud/hub-image/edit/main/environment.yml)
1. Edit either the [`environment-cryocloud.yml`](https://github.com/CryoInTheCloud/hub-image/edit/main/environment-cryocloud.yml)
file (for most packages) or [`apt.txt`](https://github.com/CryoInTheCloud/hub-image/edit/main/apt.txt)
file (for packages that need to be used in the Linux Desktop environment in the cloud).
2. Start a [pull request](https://github.com/CryoInTheCloud/hub-image/pulls) -
Expand Down
562 changes: 0 additions & 562 deletions conda-linux-64.lock

This file was deleted.

Loading