Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update config_pes for OMIP-2 simulations on Betzy #248

Merged
merged 2 commits into from
Jun 1, 2023

Conversation

TomasTorsvik
Copy link
Contributor

I wanted to run OMIP-2 simulations on Betzy, and found that I could not find a suitable config_pes definition for NOIIAJRA for runnig on Betzy. I have made a new definition for running on 512 cores (4 nodes), but I'm not sure it's an optimal setting. Should it be defined for "betzy" only, or for some particular compset (e.g. "DATM") only?

@TomasTorsvik TomasTorsvik self-assigned this Mar 29, 2023
@TomasTorsvik TomasTorsvik added enhancement New feature or request help wanted Extra attention is needed labels Mar 29, 2023
@@ -602,4 +602,42 @@
</mach>
</grid>

<grid name="a%TL319.+oi%tnx1v4">
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The configuration above (line 153) seems to be fine for fram, whereas on betzy your configuration has less idle processors. But I would suggest to move this configuration up, below the one in line 153. Then it might make sense to specify mach="betzy" here, and maybe compset="_DATM.*_BLOM%ECO" to avoid that this configuration is picked unintendely instead of the one in line 415

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for input, I will set mach="betzy" and compset="_DATM.*_BLOM"
I would like to keep the option to run with and without iHAMOCC. Once in a while it is interesting to check how much extra resources are needed for running the model with BGC.

@matsbn
Copy link
Contributor

matsbn commented May 15, 2023

Sorry for not responding sooner to this PR. Actually, it seems that hardly any processor configuration for TL319+tnx1v4 is utilizing betzy nodes well (e.g for compset _DATM.*_BLOM%ECO, more than 70% of the 5th node is not used), so some overhaul of this probably needed. Specific comments to this PR:

  • CICE can be quite performance sensitive to processor count. Did you test the speed of the particular choice of CICE processors?
  • CICE does not generally reproduce results with different processor counts. It could be beneficial to get the same ice/ocn results with or without HAMOCC enabled, but then number of CICE processors must be the same.

@monsieuralok has quite some experience in benchmarking this, so maybe he can provide some recommendations.

@monsieuralok
Copy link
Collaborator

@TomasTorsvik You can merge this pull request as it is for tnx1v4 it would not impact much with CICE only check in CASE folder in env_build.xml that it exist. Usually, that is the fastest decomposition type especially for tripolar grid.

@TomasTorsvik
Copy link
Contributor Author

Thanks for the feedback!
@monsieuralok I'm not sure I understand what I should look for in env_build.xml. There is a reference to the case build directory, but that is set to $EXEROOT by default. Do you mean I should check if the env_build.xml file exist in the CASE folder?

@TomasTorsvik TomasTorsvik merged commit 7be980d into NorESMhub:master Jun 1, 2023
@TomasTorsvik TomasTorsvik deleted the update_config_pes branch June 1, 2023 11:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants