Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: add pangea-4 spack conf #295

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Conversation

Bubusch
Copy link
Contributor

@Bubusch Bubusch commented Feb 18, 2025

Add spack configuration for pangea-4 based on :

  • gcc@12.2.1
  • hpcx@2.20.0
  • intel-oneapi-mkl@2023.2.0

Prerequisites:

  • redirect your ~/.spack folder to another filer with more space quota and visible to the cluster (see internal documentation)
  • use default proxy of pangea-4 developer nodes

To test :

# 0 - setup
module purge
mkdir spack_test
cd spack_test
export GEOS_TPL_DIR=$(pwd)/build
git clone https://github.com/GEOS-DEV/GEOS.git
git clone https://github.com/GEOS-DEV/thirdPartyLibs.git

# 1 - compile tpls
cd thirdPartyLibs
git checkout feature/bubusch/p4-spack
git submodule init
git submodule update
./scripts/uberenv/uberenv.py --spec "%gcc@12.2.1 ~pygeosx~openmp+docs" --spack-env-file=scripts/spack_configs/pangea-4/spack.yaml --project-json=.uberenv_config.json --prefix $GEOS_TPL_DIR

# 2 - compile/test geos
cd ../GEOS
git submodule init
git submodule update
module load PrgEnv-gnu/8.4.0 craype-x86-milan
module unload cray-libsci cray-mpich
module load cmake/3.27.2 python/3.11.6 hpcx/2.20.0 intel-oneapi-mkl/2023.2.0  
python scripts/config-build.py -hc ../thirdPartyLibs/p4log-linux-rhel8-zen3-gcc@12.2.1.cmake -bt Release
cd build-p4log-linux-rhel8-zen3-gcc@12.2.1-release
make -j32
export OMP_NUM_THREADS=1
ctest -V

@Bubusch Bubusch self-assigned this Feb 18, 2025
@Bubusch Bubusch requested a review from MelReyCG February 18, 2025 13:20
@Bubusch Bubusch added the enhancement New feature or request label Feb 18, 2025
@Bubusch Bubusch marked this pull request as ready for review February 20, 2025 09:09
@Bubusch Bubusch requested a review from jhuang2601 February 21, 2025 16:51
@jhuang2601
Copy link

Try to test it on P4 (using p4log03), when compiling TPLs, following error was received

==> Installing "clingo-bootstrap@=spack%gcc@=10.2.1~docs+ipo+optimized+python+static_libstdcpp build_system=cmake build_type=Release generator=make patches=bebb819,ec99431 arch=linux-centos7-x86_64" from a buildcache
fatal: write error: Input/output error
fatal: fetch-pack: invalid index-pack output
==> Error: Command exited with status 128:
'/usr/bin/git' '-c' 'advice.detachedHead=false' '-c' 'advice.detachedHead=false' 'clone' '--bare' '--quiet' 'https://github.com/hypre-space/hypre.git' '/users/j0551570/.spack/git_repos/rzyxd42'
[spack version: 0.22.1 (d66dce2d668a6234504594661506cdd1eaca4adc)
]
[exe: /scratchP4/workspace/j0551570/spack_test/build/spack/bin/spack -D /scratchP4/workspace/j0551570/spack_test/build/spack_env spec --fresh --install-status --very-long]
fatal: write error: Input/output error
fatal: fetch-pack: invalid index-pack output
==> Error: Command exited with status 128:
'/usr/bin/git' '-c' 'advice.detachedHead=false' 'clone' '--bare' '--quiet' 'https://github.com/hypre-space/hypre.git' '/users/j0551570/.spack/git_repos/rzyxd42'

[exe: /scratchP4/workspace/j0551570/spack_test/build/spack/bin/spack -D /scratchP4/workspace/j0551570/spack_test/build/spack_env install --fresh --keep-stage -u lvarray_hostconfig ]
fatal: write error: Input/output error
fatal: fetch-pack: invalid index-pack output
==> Error: Command exited with status 128:
'/usr/bin/git' '-c' 'advice.detachedHead=false' 'clone' '--bare' '--quiet' 'https://github.com/hypre-space/hypre.git' '/users/j0551570/.spack/git_repos/rzyxd42'
[ERROR: Failure of spack install]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants