Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade bufr to 12.1.0, build met/metplus 9.1.3/3.1.1 in the unified environment #1259

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
af643cc
Bump Python to 3.11.7
climbfuji Aug 5, 2024
a12300c
Update .gitmodules and submodule pointer for spack for code review an…
climbfuji Aug 5, 2024
89fa6ea
Bump Python in Github actions to 3.11.7
climbfuji Aug 5, 2024
ee7ca35
Revert .gitmodules and update submodule pointer for spack
climbfuji Aug 6, 2024
34a66d1
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 8, 2024
559fca5
Update submodule pointer for spack
climbfuji Aug 9, 2024
b74f34b
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 9, 2024
4152e8d
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 15, 2024
85fe5d4
Add 'py-dask +delayed' to gmao-swell-env and add comments in that pac…
climbfuji Aug 15, 2024
f1f1e54
Merge branch 'develop' into feature/py-dask-in-ue
climbfuji Aug 16, 2024
73f280b
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 16, 2024
89f8983
Merge branch 'develop' into feature/py-dask-in-ue
climbfuji Aug 16, 2024
2a996bd
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 16, 2024
ea57f81
Merge branch 'develop' of https://github.com/jcsda/spack-stack into f…
climbfuji Aug 16, 2024
f75dd84
Merge branch 'develop' into feature/py-dask-in-ue
climbfuji Aug 16, 2024
81879f8
Merge branch 'feature/py-dask-in-ue' of https://github.com/climbfuji/…
climbfuji Aug 16, 2024
8a47c7e
Add MET/METplus v9.1.3/v3.1.1 to the unified-env requirements matrix
DavidHuber-NOAA Aug 19, 2024
8673c47
Add MET/METplus v9.1.3/v3.1.1 to the unified-env requirements matrix
DavidHuber-NOAA Aug 19, 2024
324c27c
Merge branch 'develop' into feature/MET_METp_3.1.1
climbfuji Aug 19, 2024
a39d81e
Update to Python 3.11.7 in the gsi-addon and pull upstream python pac…
DavidHuber-NOAA Aug 19, 2024
ebb4d2f
Revert mandatory met/metplus versions in the global-workflow env
DavidHuber-NOAA Aug 19, 2024
c11f7f5
Merge branch 'feature/MET_METp_3.1.1' of github.com:davidhuber-noaa/s…
DavidHuber-NOAA Aug 19, 2024
31c876d
Add Python library dependencies to verif-global
DavidHuber-NOAA Aug 19, 2024
5b92456
De-specify met/metplus versions for the global-workflow
DavidHuber-NOAA Aug 20, 2024
fa34fb6
Add emc-verif-global-env to gsi-addon-dev
DavidHuber-NOAA Aug 20, 2024
3a4144c
Upgrade BUFR to 12.1.0
DavidHuber-NOAA Aug 21, 2024
2fb52fa
Merge remote-tracking branch 'jcsda/develop' into feature/bufr_12.1.0
DavidHuber-NOAA Aug 21, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/macos-ci-aarch64.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@ jobs:
module use ${ENVDIR}/install/modulefiles/Core
module load stack-apple-clang/14.0.3
module load stack-openmpi/5.0.3
module load stack-python/3.10.13
module load stack-python/3.11.7
module available

module load jedi-ufs-env
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/ubuntu-ci-x86_64-gnu.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -199,7 +199,7 @@ jobs:
module use ${ENVDIR}/install/modulefiles/Core
module load stack-gcc/11.4.0
module load stack-openmpi/5.0.3
module load stack-python/3.10.13
module load stack-python/3.11.7
module available

module load jedi-ufs-env
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/ubuntu-ci-x86_64-intel.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@ jobs:
module use ${ENVDIR}/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.10.13
module load stack-python/3.11.7
module available

module load jedi-ufs-env
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/ubuntu-ci-x86_64-oneapi.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -239,7 +239,7 @@ jobs:
module use ${ENVDIR}/install/modulefiles/Core
module load stack-oneapi/2024.2.0
module load stack-intel-oneapi-mpi/2021.13
module load stack-python/3.10.13
module load stack-python/3.11.7
module available

module load jedi-ufs-env
Expand Down
13 changes: 9 additions & 4 deletions configs/common/packages.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,9 @@ packages:
boost:
require: '@1.84 ~atomic +chrono +date_time +exception +filesystem ~graph ~iostreams ~locale ~log ~math ~mpi ~numpy +pic +program_options +python ~random +regex +serialization ~signals +system +test +thread +timer ~wave cxxstd=17 visibility=hidden'
bufr:
require: '@12.0.1 +python'
require:
- '+python'
- '@=12.1.0'
cairo:
require: '+pic'
cdo:
Expand Down Expand Up @@ -132,9 +134,12 @@ packages:
variants: '+pflogger'
# If making changes here, also check the Discover site configs and the CI workflows
met:
require: '@11.1.1 +python +grib2'
require:
- any_of: ['@=11.1.1', '@=9.1.3']
- '+python +grib2'
metplus:
require: '@5.1.0'
require:
- any_of: ['@=5.1.0', '@=3.1.1']
metis:
require: '+int64 +real64'
mpich:
Expand Down Expand Up @@ -182,7 +187,7 @@ packages:
proj:
require: '~tiff'
python:
require: '@3.10.13'
require: '@3.11.7'
py-attrs:
# https://github.com/JCSDA/spack-stack/issues/740
require: '@21.4.0'
Expand Down
2 changes: 1 addition & 1 deletion configs/containers/specs/jedi-ci.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
### spack-stack-1.6.0 / skylab-7.x.y containers for fv3-jedi and mpas-jedi (but not for ufs-jedi)
specs: [base-env@1.0.0, jedi-base-env@1.0.0, ewok-env@1.0.0, jedi-fv3-env@1.0.0,
jedi-mpas-env@1.0.0, bacio@2.4.1, bison@3.8.2, bufr@12.0.1, ecbuild@3.7.2, eccodes@2.33.0, ecflow@5,
jedi-mpas-env@1.0.0, bacio@2.4.1, bison@3.8.2, bufr@12.1.0, ecbuild@3.7.2, eccodes@2.33.0, ecflow@5,
eckit@1.24.5, ecmwf-atlas@0.38.1 +fckit +trans +tesselation +fftw, fiat@1.2.0, ectrans@1.2.0 +fftw,
eigen@3.4.0, fckit@0.11.0, fms@2024.02, g2@3.4.9, g2tmpl@1.10.2,
gsibec@1.2.1, hdf@4.2.15, hdf5@1.14.3, ip@5.0.0, jasper@2.0.32, jedi-cmake@1.4.0,
Expand Down
10 changes: 2 additions & 8 deletions configs/templates/gsi-addon-dev/spack.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,20 +12,14 @@ spack:
- site
- common
definitions:
# Note: Set 'compilers' manually; must match upstream list
- compilers: []
- compilers: ['%aocc', '%apple-clang', '%gcc', '%intel', '%oneapi']
- packages:
- global-workflow-env ^bufr@11.7.0 ^metplus@3.1.1 ^met@9.1.3
- ufs-weather-model-env
- emc-verif-global-env
- gsi-env

specs:
- matrix:
- [$packages]
- [$compilers]

packages:
python::
require: ['@3.11.6']
py-numpy::
require: ['@1.23.4']
4 changes: 2 additions & 2 deletions configs/templates/ufs-srw-dev/spack.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ spack:
- parallelio@2.5.10
- esmf@8.4.2
- fms@2023.01
- bufr@12.0.0
- bufr@12.1.0
- bacio@2.4.1
- crtm@2.4.0
- g2@3.4.5
Expand All @@ -54,5 +54,5 @@ spack:
- wrf-io@1.2.0
- ncio@1.1.2
- gsi-ncdiag@1.1.2
- met@11.1.0
- met@11.1.1
- metplus@5.1.0
2 changes: 1 addition & 1 deletion configs/templates/unified-dev/spack.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ spack:
- jedi-um-env
- neptune-env ~python ^esmf@=8.7.0b11 snapshot=b11
- soca-env
- ufs-srw-app-env ^esmf@=8.6.1
- ufs-srw-app-env ^esmf@=8.6.1 ^metplus@5.1.0 ^met@11.1.1
- ufs-weather-model-env ^esmf@=8.6.1

# Various crtm tags (list all to avoid duplicate packages)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,11 @@ class EmcVerifGlobalEnv(BundlePackage):
depends_on("nco")
depends_on("prod-util")
depends_on("grib-util")
depends_on("py-cartopy")
depends_on("py-numpy")
depends_on("py-netcdf4")
depends_on("py-matplotlib")
depends_on("py-pandas")
# Test grads
# depends_on('grads')
# Currently, wgrib2 doesn't build with oneapi,
Expand All @@ -31,7 +36,9 @@ class EmcVerifGlobalEnv(BundlePackage):
depends_on("wgrib2", when="%intel")
depends_on("python")
depends_on("prod-util")
depends_on("met")
depends_on("metplus")
depends_on("met@9.1.3", when="%gcc")
depends_on("met@9.1.3", when="%intel")
depends_on("metplus@3.1.1", when="%gcc")
depends_on("metplus@3.1.1", when="%intel")

# There is no need for install() since there is no code.
Original file line number Diff line number Diff line change
Expand Up @@ -43,8 +43,10 @@ class GlobalWorkflowEnv(BundlePackage):
depends_on("wgrib2", when="%apple-clang")
depends_on("wgrib2", when="%gcc")
depends_on("wgrib2", when="%intel")
depends_on("met")
depends_on("metplus")
depends_on("met@9.1.3", when="%gcc")
depends_on("met@9.1.3", when="%intel")
depends_on("metplus@3.1.1", when="%gcc")
depends_on("metplus@3.1.1", when="%intel")
depends_on("gsi-ncdiag")
depends_on("crtm@2.4.0.1")
depends_on("py-wxflow", when="+python")
Expand Down
Loading