Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add icepyx and other basic pangeo/pydata packages #4

Merged
merged 6 commits into from
Oct 10, 2022
Merged

Conversation

weiji14
Copy link
Member

@weiji14 weiji14 commented Oct 10, 2022

Include more Cryosphere-focused packages (e.g. icepyx) in the docker image, and throw in a few others from the scientific Pangeo/PyData ecosystem.

Once the conda/environmen.yml file is updated with new dependencies, the lockfiles (conda/conda-lock.yml and conda/conda-linux-64.lock.yml) are generated using:

cd conda/
./lock-environment.sh

TODO:

  • Commit the conda-lock generated *.lock files used for reproducing the software environment exactly
  • Add Cryo-specific Python packages like icepyx

Continuation of #2, part of #1.

@weiji14 weiji14 self-assigned this Oct 10, 2022
@github-actions
Copy link

Binder 👈 Launch a binder notebook on this branch

Python tools for obtaining and working with ICESat-2 data! https://github.com/icesat2py/icepyx
So that binder and repo2docker can build the virtual environment with the correct dependencies (refer to https://mybinder.readthedocs.io/en/latest/introduction.html#what-is-a-binder on how the `binder/` folder works). Following uwhackweek template at https://github.com/uwhackweek/jupyterbook-template/blob/2022.04.08/binder/environment.yml
@weiji14
Copy link
Member Author

weiji14 commented Oct 10, 2022

Binder point_left Launch a binder notebook on this branch

Tested this on binder, and import icepyx now works. For reference, here's the output of import xarray as xr; xr.show_versions() that shows other PyData packages installed/not-installed:

INSTALLED VERSIONS
------------------
commit: None
python: 3.9.13 | packaged by conda-forge | (main, May 27 2022, 16:56:21) 
[GCC 10.3.0]
python-bits: 64
OS: Linux
OS-release: 5.4.188+
machine: x86_64
processor: x86_64
byteorder: little
LC_ALL: en_US.UTF-8
LANG: en_US.UTF-8
LOCALE: ('en_US', 'UTF-8')
libhdf5: 1.12.2
libnetcdf: 4.8.1

xarray: 2022.9.0
pandas: 1.5.0
numpy: 1.23.3
scipy: 1.9.1
netCDF4: 1.6.1
pydap: None
h5netcdf: 1.0.2
h5py: 3.7.0
Nio: None
zarr: 2.13.3
cftime: 1.6.2
nc_time_axis: None
PseudoNetCDF: None
rasterio: None
cfgrib: None
iris: None
bottleneck: None
dask: 2022.6.1
distributed: 2022.6.1
matplotlib: 3.6.0
cartopy: 0.21.0
seaborn: None
numbagg: None
fsspec: 2022.8.2
cupy: None
pint: None
sparse: None
flox: None
numpy_groupies: None
setuptools: 65.4.1
pip: 22.2.2
conda: installed
pytest: None
IPython: 8.5.0
sphinx: 4.5.0

@weiji14 weiji14 marked this pull request as ready for review October 10, 2022 18:03
Comment on lines 1 to 3
# Generated by conda-lock.
# platform: osx-64
# input_hash: dd4cd8b2bfa13dad2a079f834ddc75bc178b28ecc4cb931ce6669470d2ec2619
Copy link
Member Author

@weiji14 weiji14 Oct 10, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What are people's thoughts on having an OSX-specific lockfile? Do we need a conda-osx-64.lock.yml file or could we remove it?

For the hackweeks, it made sense to have OSX (and possibly Windows) since the hackweek participants may want to install a virtual environment locally on their laptop. For the hosted Cryo JupyterHub though, it will just be using the Linux-built docker image, and I'm not sure if there's the expectation that users will be copying this environment locally?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Decided to remove the osx lockfile for now (see c274c75) to keep things minimal. Can always add it back later if requested.

Keeping it minimal and Linux-only for now.
@weiji14 weiji14 merged commit 78ef405 into main Oct 10, 2022
@weiji14 weiji14 deleted the cryo-image-2 branch October 11, 2022 17:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant