-
Notifications
You must be signed in to change notification settings - Fork 144
Conference call notes 20230201
Kenneth Hoste edited this page Feb 15, 2023
·
9 revisions
(back to Conference calls)
Notes on the 215th EasyBuild conference call, Wednesday 1 February 2023 (09:00 UTC)
List of attendees (11):
- Simon Branford (Univ. of Birmingham, UK)
- Alex Domingo (Vrije Universiteit Brussel, Belgium)
- Jasper Grimm (University of York, UK)
- Kenneth Hoste (HPC-UGent)
- Adam Huffman (Big Data Institute, Oxford, UK)
- Kurt Lust (UAntwerpen & LUST)
- Sebastien Moretti (SIB, Switzerland)
- Jakub Kropáček (IT4Innovations, Czech Republic)
- Jurij Pečar (EMBL, Germany)
- Mikael Öhman (Chalmers University of Technology, Sweden)
- Åke Sandgren (Umeå University, Sweden)
- overview of recent developments + outlook to next EasyBuild release
- update on porting of EasyBuild docs to MarkDown (done!)
- source tarballs provided by GitHub will change
- Q&A
- release timeline
- latest release: EasyBuild v4.7.0 (9 Jan 2023)
- ETA next release (EasyBuild v4.7.1): mid Feb'23
- recent changes
-
framework
-
bug fixes
- fix use of locate in check_os_dependency (PR #4166)
- use better test assertions by replacing use of
assertFalse
/assertTrue
(PR #4170) - avoid GC3Pie deprecation warning (PR #4185)
- correctly restore
sys.path
in tests (PR #4186) - suppress output of
--skip-test-step
test (PR #4187) - fix flaky
test_search_file
due to accidental matches for .*C++ search pattern (PR #4190) - print warning when non-existing
start_dir
is specified for extension (PR #4201)
- enhancements
-
changes
- ...
-
docs
- ...
-
bug fixes
-
easyblocks
- bug fixes
-
enhancements
- make NAMD easyblock aware of (pre)testopts (PR #2856)
-
updates
- ...
-
changes
- use start dir of extension to install R packages (PR #2867)
- required because of framework PR #4196
- use start dir of extension to install R packages (PR #2867)
- new software
- ...
-
easyconfigs
- ~75 easyconfig PRs were merged since last conf call
-
bug fixes
- add patches for Qt5 5.15.5 to fix compilation failures in abseil and breakpad with glibc 2.34 (PR #17165)
- add patch to make ncbi-vdb 3.0.0 compatible with HDF5 1.12.2 (PR #17140)
- add patches for Qt5 5.15.5 to fix compilation failures in abseil and breakpad with glibc 2.34 (PR #17165)
- fix typo in PMIx-4.1.0 for EBROOTLIBFABRIC (PR #17204)
- remove dependency on Pillow from scikit-bio v0.5.7 (PR #17178)
-
enhancements
- add sanity check command to OpenMolcas v22.10 (PR #17128)
- add
Set::Object
andHeap::Fibonacci
extensions to Perl 5.32.1 (PR #17151) - add additional extensions to Python 3.10.8 (required for scipy test suite) (PR #17159)
- add SDL2 dependency for FFmpeg 5.0.1 to build ffplay (PR #17213)
- enhance OpenFold 1.0.1 for standalone usage (PR #17206)
- (noteworthy) new software
- noteworthy software updates
- changes
- use proper source tarball instead of cloning GitHub repository for wxWidgets v3.2.1 (PR #17167)
- stick to older PyQt-builder in easyconfig for PyQt5 5.15.5, so that 'pip check' passes (PR #16703)
- HDF5 has a FORTRAN api so must be at compiler level (PR #17221)
- should we add a check in EasyBuild framework that produces a warning (or opt-in installation failure) if
.mod
files are being found in the installation directory andGCCcore
;
- should we add a check in EasyBuild framework that produces a warning (or opt-in installation failure) if
-
framework
- work in progress
-
framework
-
reported bugs / bug fixes
- Python packages are being installed to
local/lib/python*/dist-packages
due to tweaks tosysconfig.py
in OS (issue #4128) - check type of
versionsuffix
value indet_full_ec_version
, and raise useful error message if it's not a string (PR #4184) - use skip markers and
skipTest
in tests (PR #4188) - reduce number of CI jobs by testing for Lua and Tcl module syntax in a single CI job (PR #4192)
- dependencies of first build are still loaded for all next builds with an easystack file (issue #4194)
- using multiple PRs in
--from-pr
gives symlink error when combined with--copy-ec
(issue #4197)
- Python packages are being installed to
-
enhancements
- fixes/enhancements w.r.t. checksums (PR #4159, PR #4150, PR #4164)
- allow to directly import
EasyConfig
constants from the module (PR #4144) - providing
OS_LIBCUDA_FOUND
andGPU_AVAILABLE
type constants to easyconfigs for convenient checking (issue #4183) - make
--search
aware of extensions (issue #4189) - add pre/post extension hook (triggered before/after individual extension installations) (PR #4193, fixes issue #4191)
- adding
pre_extension_hook
is confusing w.r.t. existingpre_extensions_hook
- better naming?
-
pre_install_extension_hook
? -
pre_single_extension_hook
? - other suggestions?
-
- adding
- enhance documentation of checksums easyconfig parameter (docs PR #853)
-
changes
- ...
-
reported bugs / bug fixes
-
easyblocks
- bug reports/fixes
- enhancements
- updates
- new software
- ...
-
changes
- ...
-
easyconfigs
- still close to 800 open easyconfig PRs...
- bug fixes/reports
- fix patch for TensorFlow 2.5+ on ARM (PR #17101)
- ELPA repos changed address (issue #17162)
- in-place update of R extension spatial-7.3-14.tar.gz (issue #17233)
- add pmix patch to iomkl OpenMPI 4.1.1 (PR #17240)
- source tarball for XZ 5.2.7 no longer available (issue #17157)
- enhancements
- ...
- new software
-
noteworthy software updates
- CP2K v9.1 & v2022.1 for foss 2022a (PR #16007)
- TensorFlow 2.9.1 (PR #16008)
-
SciPy-bundle
v2022.11 withfoss/2022.10
(PR #16912)- WIP because requires update to
scipy
easyblock (see easyblock PR #2862)
- WIP because requires update to
-
WRF
v4.4.1 withfoss/2022.10
(PR #16835)- should be updated to
foss/2022b
- requires netCDF (PR #16834)
- should be updated to
- HDF5 1.14.0 (PR #17093 + PR #17107 vs PR #16834)
- stick to HDF5 1.12.x for 2022b generation, or use latest HDF5 1.14.0?
- HDF5 supports building in "compatibility mode" for software that is not compatible yet with HDF5 1.14.x
- changes
- ...
-
framework
- revamped EasyBuild documentation now available at https://docs.easybuild.io
- automatic redirects are in place, there should be no broken links (
docs.easybuild.io/en/latest/...
andeasybuild.readthedocs.io/...
)
- see (old and re-opened) easyconfigs issue #5151
- see also https://github.blog/changelog/2023-01-30-git-archive-checksums-may-change/ + https://github.com/orgs/community/discussions/45830
- workaround could be to start using NAR hashes: a checksum on the contents of the source tarball (see framework issue #4200)
- big caveat here: we would need to unpack tarballs in order to compute checksum, which implies being vulnerable to zip bombs, etc.
- so doesn't seem like a good idea
- this also requires
- only other option is to add alternative SHA256 checksums for (generated) source tarballs we download from GitHub...
- Mikael: UCC 1.1.0 (used as dep for OpenMPI in 4.1.4 in foss/2022b) is not compatible with CUDA 12
- can we patch UCC 1.1.0 in UCC-CUDA to make it compatible with CUDA 12?
- maybe with https://github.com/openucx/ucc/pull/700 ?
- other option is in-place update of UCC in OpenMPI 4.1.4
- but there's no new UCC release yet (expected April 2023)