Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize PE layouts for Derecho #2244

Closed
samsrabin opened this issue Nov 9, 2023 · 4 comments
Closed

Optimize PE layouts for Derecho #2244

samsrabin opened this issue Nov 9, 2023 · 4 comments
Assignees

Comments

@samsrabin
Copy link
Collaborator

Waiting on #1995, where some initial PE layouts will be implemented.

@ekluzek
Copy link
Collaborator

ekluzek commented Nov 10, 2023

For this we should optimize PE layouts for important grids. Here's my initial cut at that list:

f09
f19
ne30np4.pg3
hcru
nldas2
f45
f10
C96
mpasa120

We might need to optimize for high and ultra-high resolutions grids if that's important for CAM and groups working on these resolutions (if they are going to simulations with standalone CLM).

@ekluzek
Copy link
Collaborator

ekluzek commented Nov 10, 2023

There's also "S" PE layouts for f09 and f19 as well as nldas2 and those should be optimized as well.

We currently also have PE layouts for: f05, f02, ne240, C384, C192, and T31 that we can drop.

And there are specific PE layouts for the following (from grep on the config_pes.xml file). We should check if all of these should be supported as well @adamrher?...)

  <grid name="l%ne0np4CONUS" >
  <grid name="l%ne0np4CONUS" >
  <grid name="l%ne0np4.ARCTICGRIS.ne30" >
  <grid name="l%ne0np4.ARCTICGRIS.ne30" >
  <grid name="l%ne0np4.ARCTIC.ne30" >
  <grid name="l%ne0np4.ARCTIC.ne30" >
  <grid name="l%ne120">

@ekluzek
Copy link
Collaborator

ekluzek commented Mar 2, 2024

In #1967 here #1967 (comment)

I found that the PE layouts for a lot of resolutions just use one node, and if memory increases just a bit, that tests can fail because not enough processors are used. So it would be good to increase the PE layout size for the resolutions I discovered problems with there.

@wwieder
Copy link
Contributor

wwieder commented Nov 6, 2024

also closing this issue (for now)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

3 participants