Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates from testing dev_v16 on Hera #845

Merged
merged 5 commits into from
Jun 8, 2022

Conversation

KateFriedman-NOAA
Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA commented Jun 8, 2022

Description

This PR includes updates from cycled tests of the dev_v16 branch on Hera @ C192C96L127 and C384C192L127:

  • add USE_CFP="NO" in env/HERA.env, similar to on Orion, don't run GLDAS with CFP on R&D machines
  • change anaconda_ver to 2.3.0 in versions/hera.ver to match version that GSI tag uses (GSI jobs have failing python instances otherwise)
  • add append_path for MODULEPATH in module_base.hera.lua to get anaconda module
  • removed HERA if-blocks in eupd section of config.resources.emc.dyn that set job to use 40 threads, tested values that worked on Orion and then added in new HERA if-blocks in eupd section to double thread # over Orion values since Hera nodes have half as much memory compared to Orion = use double the nodes on Hera for eupd job compared to Orion
  • Set DO_WAVE=NO by default in config.base.emc.dyn. Decision was made to disable waves in v16 on R&D machines because a code change would be required to get it working on R&D machines in hpc-stack and code changes aren't possible for v16.2.0 anymore. Users will need to turn waves on themselves now, works fine on WCOSS2.

Refs: #665

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • Clone and Build tests on Hera
  • Cycled tests on Hera: ~20 cycles of C192C96L127 and 2.5 cycles of C384C192L127

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes need updates to the documentation. I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • Any dependent changes have been merged and published

- Similar to setting for Orion, don't use CFP on R&D for GLDAS

Refs: NOAA-EMC#665
- Removed HERA blocks in eupd block that used 40 threads.
- Hera nodes have half as much memory as Orion, so added new
HERA blocks to eupd block to double thread number (2->4) to use
double the nodes for more memory.

Refs: NOAA-EMC#665
- Add append_path for anaconda MODULEPATH in module_base.hera.lua
- Change anaconda_ver to match version that GSI tag uses

Refs: NOAA-EMC#665
@KateFriedman-NOAA KateFriedman-NOAA added the maintenance Regular updates and maintenance work label Jun 8, 2022
@KateFriedman-NOAA KateFriedman-NOAA added this to the WCOSS2 - GFSv16.2.0 milestone Jun 8, 2022
@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Jun 8, 2022
- Decision was made to disable waves on R&D machines in v16
while a code change is needed to renable waves.
- Add DO_WAVE to setup scripts and override in config.base.emc.dyn
so it can be enabled/disabled.
- Set do_wave=YES on WCOSSes and NO on R&D machines in setup scripts.

Refs: NOAA-EMC#665
- remove do_wave from setup_expt*py scripts
- remove override in config.base.emc.dyn and set DO_WAVE=NO by default

Refs: NOAA-EMC#665
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintenance Regular updates and maintenance work
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants