Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build updates for WCOSS2 #1002

Merged
merged 26 commits into from
Aug 26, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
5041005
Move transfer files into new transfer folder
KateFriedman-NOAA Jul 19, 2022
d133ad8
Updated transfer list files from WCOSS2 ops
KateFriedman-NOAA Jul 19, 2022
a6b63d9
Add GFSv16.1 and GFSv16.2 release notes
KateFriedman-NOAA Jul 19, 2022
5b54d52
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Jul 19, 2022
c7d20de
WCOSS2 updates to gempak ush scripts
KateFriedman-NOAA Jul 20, 2022
2179e44
Removing older release notes
KateFriedman-NOAA Jul 20, 2022
b9bc730
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Jul 22, 2022
032767a
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Jul 26, 2022
1a1a1e3
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Jul 26, 2022
829459d
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Jul 28, 2022
2c24858
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Aug 1, 2022
9ce7ee6
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Aug 4, 2022
20d37e2
Add WCOSS2 to module-setup.sh.inc
KateFriedman-NOAA Aug 5, 2022
9c6a638
Add WCOSS2 to link_workflow.sh
KateFriedman-NOAA Aug 5, 2022
012ee4b
Add WCOSS2 and module reset to machine-setup.sh
KateFriedman-NOAA Aug 5, 2022
361ed89
Add WCOSS2 to load_fv3gfs_modules.sh
KateFriedman-NOAA Aug 5, 2022
6fe0457
Create LUA module_base for WCOSS2
KateFriedman-NOAA Aug 5, 2022
fd02351
Create LUA modulefile for WW3 on WCOSS2
KateFriedman-NOAA Aug 5, 2022
cbeb5f7
Create LUA modulefile for workflow_utils on WCOSS2
KateFriedman-NOAA Aug 5, 2022
2b20ea5
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Aug 15, 2022
83254fd
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Aug 22, 2022
73fca8c
Add WCOSS2 to module-setup.csh.inc
KateFriedman-NOAA Aug 22, 2022
a2c9f8f
Change WCOSS2 FIX_DIR to noscrub space
KateFriedman-NOAA Aug 23, 2022
1e15d22
Change WCOSS2 machine detection path
KateFriedman-NOAA Aug 23, 2022
8ce585e
Merge branch 'develop' into feature/dev-wcoss2
KateFriedman-NOAA Aug 26, 2022
ccd154b
Revert module reset changes for R&D
KateFriedman-NOAA Aug 26, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 7 additions & 1 deletion modulefiles/module-setup.csh.inc
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,13 @@ set __ms_shell=csh

eval "if ( -d / ) set __ms_shell=tcsh"

if ( { test -d /lfs3 } ) then
if ( { test -d /lfs/f1 } ) then
aerorahul marked this conversation as resolved.
Show resolved Hide resolved
# We are on NOAA Cactus or Dogwood
if ( ! { module help >& /dev/null } ) then
source /usr/share/lmod/lmod/init/$__ms_shell
fi
module reset
else if ( { test -d /lfs3 } ) then
if ( ! { module help >& /dev/null } ) then
source /apps/lmod/lmod/init/$__ms_shell
endif
Expand Down
8 changes: 7 additions & 1 deletion modulefiles/module-setup.sh.inc
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,13 @@ else
__ms_shell=sh
fi

if [[ -d /lfs3 ]] ; then
if [[ -d /lfs/f1 ]] ; then
# We are on NOAA Cactus or Dogwood
if ( ! eval module help > /dev/null 2>&1 ) ; then
source /usr/share/lmod/lmod/init/$__ms_shell
fi
module reset
elif [[ -d /lfs3 ]] ; then
# We are on NOAA Jet
if ( ! eval module help > /dev/null 2>&1 ) ; then
source /apps/lmod/lmod/init/$__ms_shell
Expand Down
39 changes: 39 additions & 0 deletions modulefiles/module_base.wcoss2.lua
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
help([[
Load environment to run GFS on WCOSS2
]])

load(pathJoin("PrgEnv-intel", "8.1.0"))
load(pathJoin("craype", "2.7.10"))
load(pathJoin("intel", "19.1.3.304"))
load(pathJoin("cray-mpich", "8.1.9"))
load(pathJoin("cray-pals", "1.0.17"))
load(pathJoin("esmf", "8.0.1"))
load(pathJoin("cfp", "2.0.4"))
setenv("USE_CFP","YES")

load(pathJoin("python", "3.8.6"))
load(pathJoin("prod_envir", "2.0.4"))
load(pathJoin("gempak", "7.14.1"))
load(pathJoin("perl", "5.32.0"))
load(pathJoin("libjpeg", "9c"))

load(pathJoin("cdo", "1.9.8"))

load(pathJoin("hdf5", "1.10.6"))
load(pathJoin("netcdf", "4.7.4"))

load(pathJoin("udunits", "2.2.28"))
load(pathJoin("gsl", "2.7"))
load(pathJoin("nco", "4.7.9"))
load(pathJoin("prod_util", "2.0.9"))
load(pathJoin("grib_util", "1.2.3"))
load(pathJoin("bufr_dump", "1.0.0"))
load(pathJoin("util_shared", "1.4.0"))
load(pathJoin("crtm", "2.3.0"))
load(pathJoin("g2tmpl", "1.9.1"))
load(pathJoin("wgrib2", "2.0.7"))

prepend_path("MODULEPATH", pathJoin("/lfs/h2/emc/global/save/emc.global/git/prepobs/v1.0.1/modulefiles"))
load(pathJoin("prepobs", "1.0.1"))

whatis("Description: GFS run environment")
22 changes: 22 additions & 0 deletions modulefiles/modulefile.ww3.wcoss2.lua
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
help([[
aerorahul marked this conversation as resolved.
Show resolved Hide resolved
Build environment for WW3 on WCOSS2
]])

load(pathJoin("PrgEnv-intel", "8.1.0"))
load(pathJoin("craype", "2.7.10"))
load(pathJoin("intel", "19.1.3.304"))
load(pathJoin("cray-mpich", "8.1.9"))

load(pathJoin("cmake", "3.20.2"))

load(pathJoin("jasper", "2.0.25"))
load(pathJoin("zlib", "1.2.11"))
load(pathJoin("libpng", "1.6.37"))

load(pathJoin("bacio", "2.4.1"))
load(pathJoin("g2", "3.4.5"))

load(pathJoin("hdf5", "1.10.6"))
load(pathJoin("netcdf", "4.7.4"))

load(pathJoin("w3nco", "2.4.1"))
32 changes: 32 additions & 0 deletions modulefiles/workflow_utils.wcoss2.lua
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
help([[
Build environment for workflow utilities on WCOSS2
]])

load(pathJoin("PrgEnv-intel", "8.1.0"))
load(pathJoin("craype", "2.7.10"))
load(pathJoin("intel", "19.1.3.304"))
load(pathJoin("cray-mpich", "8.1.9"))

load(pathJoin("cmake", "3.20.2"))

load(pathJoin("jasper", "2.0.25"))
load(pathJoin("zlib", "1.2.11"))
load(pathJoin("libpng", "1.6.37"))

load(pathJoin("hdf5", "1.10.6"))
load(pathJoin("netcdf", "4.7.4"))

load(pathJoin("bacio", "2.4.1"))
load(pathJoin("g2", "3.4.5"))
load(pathJoin("ip", "3.3.3"))
load(pathJoin("nemsio", "2.5.2"))
load(pathJoin("sp", "2.3.3"))
load(pathJoin("w3emc", "2.9.2"))
load(pathJoin("w3nco", "2.4.1"))
load(pathJoin("nemsiogfs", "2.5.3"))
load(pathJoin("ncio", "1.0.0"))
load(pathJoin("landsfcutil", "2.4.1"))
load(pathJoin("sigio", "2.3.2"))
load(pathJoin("bufr", "11.5.0"))

load(pathJoin("wgrib2", "2.0.8"))
12 changes: 7 additions & 5 deletions sorc/link_workflow.sh
Original file line number Diff line number Diff line change
Expand Up @@ -8,16 +8,16 @@ machine=${2}

if [ $# -lt 2 ]; then
echo '***ERROR*** must specify two arguements: (1) RUN_ENVIR, (2) machine'
echo ' Syntax: link_workflow.sh ( nco | emc ) ( hera | orion | jet | stampede )'
echo ' Syntax: link_workflow.sh ( nco | emc ) ( wcoss2 | hera | orion | jet | stampede )'
exit 1
fi

if [ $RUN_ENVIR != emc -a $RUN_ENVIR != nco ]; then
echo ' Syntax: link_workflow.sh ( nco | emc ) ( hera | orion | jet | stampede )'
echo ' Syntax: link_workflow.sh ( nco | emc ) ( wcoss2 | hera | orion | jet | stampede )'
exit 1
fi
if [ $machine != hera -a $machine != orion -a $machine != jet -a $machine != stampede ]; then
echo ' Syntax: link_workflow.sh ( nco | emc ) ( hera | orion | jet | stampede )'
if [ $machine != wcoss2 -a $machine != hera -a $machine != orion -a $machine != jet -a $machine != stampede ]; then
echo ' Syntax: link_workflow.sh ( nco | emc ) ( wcoss2 | hera | orion | jet | stampede )'
exit 1
fi

Expand All @@ -34,7 +34,9 @@ $LINK ufs_model.fd/FV3/upp upp.fd
#------------------------------
#--model fix fields
#------------------------------
if [ $machine = "hera" ]; then
if [ $machine = "wcoss2" ]; then
FIX_DIR="/lfs/h2/emc/global/noscrub/emc.global/FIX/fix_NEW"
elif [ $machine = "hera" ]; then
FIX_DIR="/scratch1/NCEPDEV/global/glopara/fix_NEW"
elif [ $machine = "orion" ]; then
FIX_DIR="/work/noaa/global/glopara/fix_NEW"
Expand Down
11 changes: 10 additions & 1 deletion sorc/machine-setup.sh
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,16 @@ target=""
USERNAME=$(echo $LOGNAME | awk '{ print tolower($0)'})
##---------------------------------------------------------------------------
export hname=$(hostname | cut -c 1,1)
if [[ -d /work ]] ; then
if [[ -d /lfs/f1 ]] ; then
# We are on NOAA Cactus or Dogwood
if ( ! eval module help > /dev/null 2>&1 ) ; then
echo load the module command 1>&2
source /usr/share/lmod/lmod/init/$__ms_shell
fi
target=wcoss2
module reset

elif [[ -d /work ]] ; then
# We are on MSU Orion
if ( ! eval module help > /dev/null 2>&1 ) ; then
echo load the module command 1>&2
Expand Down
5 changes: 4 additions & 1 deletion ush/load_fv3gfs_modules.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,10 @@ source "$HOMEgfs/modulefiles/module-setup.sh.inc"
# Load our modules:
module use "$HOMEgfs/modulefiles"

if [[ -d /lfs3 ]] ; then
if [[ -d /lfs/f1 ]]; then
# We are on WCOSS2 (Cactus or Dogwood)
module load module_base.wcoss2
elif [[ -d /lfs3 ]] ; then
# We are on NOAA Jet
module load module_base.jet
elif [[ -d /scratch1 ]] ; then
Expand Down