Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a tier2 site config for AWS AMIs #1393

Merged
merged 35 commits into from
Jan 2, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
c007a91
Initial commit of Tier2 AWS support
stiggy87 Dec 4, 2024
fa28e55
Updated READMEs to match formatting and corrected bash code
stiggy87 Dec 5, 2024
5c73a21
Cleaned up formatting for ubuntu README
stiggy87 Dec 5, 2024
bac62d0
Fixed some wrong versioning and cleaned up formatting for rocky8 README
stiggy87 Dec 5, 2024
459c1bb
Fixed file hierarchy for unit tests
stiggy87 Dec 5, 2024
926f541
Updated READMEs based on comments.
stiggy87 Dec 6, 2024
3892755
Added extra line at the end of file
stiggy87 Dec 6, 2024
e15a417
Added extra line end of intel yaml file
stiggy87 Dec 6, 2024
f1a5264
Removed openmpi from the mpi providers
stiggy87 Dec 6, 2024
e51ae22
Updated Rocky8 compiler.yaml
stiggy87 Dec 9, 2024
9c24649
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 9, 2024
78007a2
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 9, 2024
a9c136a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 10, 2024
9576ce8
Updated Ubuntu README
stiggy87 Dec 11, 2024
1ddb3ad
Update Rocky8 README and yaml files
stiggy87 Dec 11, 2024
193b1a5
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 11, 2024
e182c6f
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 11, 2024
3bc3e01
Addressed comments.
stiggy87 Dec 12, 2024
6e65ab1
Fixed misspelings for update-alternatives
stiggy87 Dec 12, 2024
21a7fc7
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
b4dae92
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 12, 2024
f7a28fc
Changed version of gcc to install to gcc-11
stiggy87 Dec 12, 2024
d9d381f
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 12, 2024
7b2657c
Change the gcc from 12.3.0 to 11.4.0 for both gcc and intel builds.
stiggy87 Dec 13, 2024
eddb0a2
Added lines to have spack-stack Core modulefile to profile
stiggy87 Dec 17, 2024
e895b3b
Added:
stiggy87 Dec 17, 2024
450d01a
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 17, 2024
c4edee1
Merge branch 'feature/tier2-aws-ami' of https://github.com/stiggy87/s…
stiggy87 Dec 17, 2024
3b72fd0
Fixed openmpi version for module load
stiggy87 Dec 19, 2024
5b0464d
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 19, 2024
fc0d0b5
Merge branch 'develop' into feature/tier2-aws-ami
stiggy87 Dec 24, 2024
30c9877
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Dec 30, 2024
8dcfe6c
Updated script to find external grep
stiggy87 Dec 30, 2024
c911ddd
Merge branch 'JCSDA:develop' into feature/tier2-aws-ami
stiggy87 Jan 2, 2025
56e250a
Synced with latest spack changes and whitespaces
stiggy87 Jan 2, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
452 changes: 452 additions & 0 deletions configs/sites/tier2/aws-rocky8/README.md

Large diffs are not rendered by default.

32 changes: 32 additions & 0 deletions configs/sites/tier2/aws-rocky8/compilers.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
compilers:
- compiler:
spec: intel@=2021.10.0
paths:
cc: /opt/intel/oneapi/compiler/2023.2.3/linux/bin/intel64/icc
cxx: /opt/intel/oneapi/compiler/2023.2.3/linux/bin/intel64/icpc
f77: /opt/intel/oneapi/compiler/2023.2.3/linux/bin/intel64/ifort
fc: /opt/intel/oneapi/compiler/2023.2.3/linux/bin/intel64/ifort
flags: {}
operating_system: rocky8
target: x86_64
modules: []
environment:
prepend_path:
PATH: /opt/rh/gcc-toolset-11/root/user/bin
LD_LIBRARY_PATH: '/opt/intel/oneapi/compiler/2023.2.3/linux/compiler/lib/intel64_lin:/usr/lib64:/usr/lib'
CPATH: /opt/rh/gcc-toolset-11/root/user/include
extra_rpaths: []
- compiler:
spec: gcc@11.2.1
paths:
cc: /opt/rh/gcc-toolset-11/root/user/bin/gcc
cxx: /opt/rh/gcc-toolset-11/root/user/bin/g++
f77: /opt/rh/gcc-toolset-11/root/user/bin/gfortran
fc: /opt/rh/gcc-toolset-11/root/user/bin/gfortran
flags: {}
operating_system: rocky8
target: x86_64
modules: []
environment: {}
extra_rpaths: []

stiggy87 marked this conversation as resolved.
Show resolved Hide resolved
9 changes: 9 additions & 0 deletions configs/sites/tier2/aws-rocky8/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
config:
build_jobs: 8

# Overrides for spack build and staging areas to speed up builds
# by using a local directory instead of the EFS shared filesystem
build_stage: /tmp/spack-stack/cache/build_stage
test_stage: /tmp/spack-stack/cache/test_stage
source_cache: /tmp/spack-stack/cache/source_cache
misc_cache: /tmp/spack-stack/cache/misc_cache
7 changes: 7 additions & 0 deletions configs/sites/tier2/aws-rocky8/modules.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
modules:
default:
enable::
- lmod
lmod:
include:
- python
94 changes: 94 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,94 @@
packages:
mysql:
externals:
- spec: mysql@8.0.37
prefix: /usr
wget:
externals:
- spec: wget@1.21.2
prefix: /usr
binutils:
externals:
- spec: binutils@2.38
prefix: /usr
coreutils:
externals:
- spec: coreutils@8.32
prefix: /usr
diffutils:
externals:
- spec: diffutils@3.8
prefix: /usr
findutils:
externals:
- spec: findutils@4.8.0
prefix: /usr
gawk:
externals:
- spec: gawk@5.1.0
prefix: /usr
tar:
externals:
- spec: tar@1.34
prefix: /usr
autoconf:
externals:
- spec: autoconf@2.71
prefix: /usr
automake:
externals:
- spec: automake@1.16.5
prefix: /usr
flex:
externals:
- spec: flex@2.6.4+lex
prefix: /usr
gettext:
externals:
- spec: gettext@0.21
prefix: /usr
git:
externals:
- spec: git@2.34.1~tcltk
prefix: /usr
git-lfs:
externals:
- spec: git-lfs@3.0.2
prefix: /usr
gmake:
externals:
- spec: gmake@4.3
prefix: /usr
groff:
externals:
- spec: groff@1.22.4
prefix: /usr
libtool:
externals:
- spec: libtool@2.4.6
prefix: /usr
m4:
externals:
- spec: m4@1.4.18
prefix: /usr
perl:
externals:
- spec: perl@5.34.0~cpanm+opcode+open+shared+threads
prefix: /usr
pkg-config:
externals:
- spec: pkg-config@0.29.2
prefix: /usr
qt:
buildable: false
externals:
- spec: qt@5.15.3
prefix: /usr
sed:
externals:
- spec: sed@4.8
prefix: /usr
lcms:
externals:
- spec: lcms@2.13.1
prefix: /usr
5 changes: 5 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages_gcc.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
packages:
all:
compiler:: [gcc@11.2.1]
providers:
mpi:: [openmpi@4.1.6]
29 changes: 29 additions & 0 deletions configs/sites/tier2/aws-rocky8/packages_intel.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
packages:
all:
compiler:: [intel@2021.10.0,gcc@11.2.1]
providers:
mpi:: [intel-oneapi-mpi@2021.10.0]
# Remove the next three lines to switch to intel-oneapi-mkl
blas:: [openblas]
fftw-api:: [fftw]
lapack:: [openblas]
intel-oneapi-mpi:
buildable: false
externals:
- spec: intel-oneapi-mpi@2021.10.0%intel@2021.10.0
prefix: /opt/intel/oneapi
intel-oneapi-mkl:
# Remove buildable: False and configure version+uncomment externals section below to use intel-oneapi-mkl
buildable: False
#externals:
#- spec: intel-oneapi-mkl@2022.0.2%intel@2021.10.0
# prefix: /opt/intel/oneapi
ectrans:
require::
- '@1.2.0 ~mkl +fftw'
gsibec:
require::
- '@1.2.1 ~mkl'
py-numpy:
require::
- '@:1.23 ^openblas'
Loading
Loading