Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/update model namelist definitions #377

Conversation

mkavulich
Copy link
Collaborator

@mkavulich mkavulich commented Dec 10, 2020

DESCRIPTION OF CHANGES:

Part of the effort described in ufs-community/ufs-srweather-app#71 to update the master branch of ufs-srweather-app to a functioning state.

Updates include:

  • Cherry-picking 5a4b90e from release branch in order to include the RRFS_v1alpha CCPP suite, as well as fixing some updated namelist settings in the ufs-weather-model
  • Fixing other namelist options that have been updated in ufs-weather-model

This PR must be merged prior to ufs-community/ufs-srweather-app#71, then that PR updated to point to this PR's hash.

TESTS CONDUCTED:

The following end-to-end tests are now all successful on Hera (/scratch2/BMC/det/kavulich/workdir/update_app_master/expt_dirs/):

  • DOT_OR_USCORE
  • GST_release_public_v1
  • get_extrn_files_from_hpss_FV3GFS_FV3GFS
  • get_extrn_files_from_hpss_GSMGFS_GSMGFS
  • get_extrn_files_from_hpss_HRRR_RAP
  • get_extrn_files_from_hpss_RAP_RAP
  • grid_GSD_HRRR_AK_50km
  • grid_GSD_RAP13km
  • grid_RRFS_AK_13km_FV3GFS_FV3GFS
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16beta
  • grid_RRFS_CONUS_13km_ics_HRRR_lbcs_RAP_suite_GSD_SAR
  • grid_RRFS_CONUS_13km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16beta
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_GSD_SAR
  • grid_RRFS_CONUS_25km_ics_HRRR_lbcs_RAP_suite_RRFS_v1beta
  • new_ESGgrid
  • new_GFDLgrid
  • new_GFDLgrid__GFDLgrid_USE_GFDLgrid_RES_IN_FILENAMES_eq_FALSE
  • new_GFDLgrid__GFDLgrid_USE_GFDLgrid_RES_IN_FILENAMES_eq_TRUE
  • regional_001
  • regional_002
  • suite_FV3_GFS_v15p2
  • suite_FV3_GFS_v16beta
  • suite_FV3_GSD_SAR
  • suite_FV3_GSD_v0
  • suite_FV3_RRFS_v1beta

The following end-to-end tests were successful on Jet (/mnt/lfs4/HFIP/dtc-hurr/kavulich/workdir/UFS_SRW_PR_71/expt_dirs):

  • DOT_OR_USCORE
  • get_extrn_files_from_hpss_FV3GFS_FV3GFS
  • get_extrn_files_from_hpss_GSMGFS_GSMGFS
  • get_extrn_files_from_hpss_HRRR_RAP
  • get_extrn_files_from_hpss_RAP_RAP
  • grid_RRFS_AK_13km_FV3GFS_FV3GFS
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16beta
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
  • grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16beta
  • new_ESGgrid
  • new_GFDLgrid
  • new_GFDLgrid__GFDLgrid_USE_GFDLgrid_RES_IN_FILENAMES_eq_FALSE
  • regional_001
  • regional_002
  • suite_FV3_GFS_v16beta

A few tests on Hera and Jet are still failing, but they are known errors and will be fixed at a later date.

Cheyenne tests are failing but this is fixed by #378

ISSUE (optional):

In conjunction with ufs-community/ufs-srweather-app#71, will solve ufs-community/ufs-srweather-app#57, fixing the master branch of ufs-srweather-app so everyone will be happy and nothing will be broken and we will all live happily ever after.

@JeffBeck-NOAA
Copy link
Collaborator

Just took a cursory look at the code changes, everything looks good. Based on all successful tests listed and known failures that will be fixed in the future (13-km AK domain and CPT SDF crashes), I'm approving.

Copy link
Contributor

@christinaholtNOAA christinaholtNOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm a little late with these comments, but they are no big deal. We can shuffle things in the future. I appreciate the speedy turnaround! :)

@@ -11,11 +11,14 @@


FV3_GSD_v0:
gfs_physics_nml:
effr_in: True
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd suggest putting this in the file input.nml.FV3 to keep this section empty always. It will not be needed in the other sections unless you want set to False, or need to leave it out altogether.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was the one who added that line, and I definitely prefer putting it in input.nml.FV3, but I wasn't (and still am not) sure which suites require it to be set to False, or what the default value is in FV3 if it is not specified.

The whole approach to namelist settings needs to be changed so it is centralized in one place -- the ufs-weather-model repo -- i.e. we should get all required namelist settings for each suite from the ufs-weather-model repo instead of setting them here and risking our settings being wrong or becoming outdated.

@@ -139,7 +139,8 @@
debug = .false.
do_mynnedmf = .true.
do_mynnsfclay = .false.
do_sfcperts = .false.
lndp_type = 0
n_var_lndp = 0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, keeping these lists alphabetically organized makes it easier to find items..

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree. I try, but it degrades over time as different users contribute changes. Occasional cleanup will be needed.

mkavulich referenced this pull request in ufs-community/ufs-srweather-app Dec 11, 2020
## DESCRIPTION OF CHANGES: 
Currently master is broken and will not build and/or run on any platform due to incompatible hashes and outdated changes. Several fixes are needed to get master back in working order, most of which will be included in this PR.

The direct changes made in ufs-srweather-app for this PR are:
 - Partially cherry-picking release-branch changes to update build system and documentation
 - Updating static hashes to the latest versions of `develop` branches for ufs-weather-model, EMC_post, UFS_UTILS, and regional_workflow

Some changes that were needed prior to this PR being merged are:

- [x] EMC_post needs to be updated to include an updated executable name and flat config files
   - NOAA-EMC/UPP#237
- [x] regional_workflow needs to be updated for the new ufs-weather-model executable name
   - https://github.com/NOAA-EMC/regional_workflow/pull/374
- [x] regional_workflow also needs to be updated for changed namelist options in the latest ufs-weather-model develop branch
   - https://github.com/NOAA-EMC/regional_workflow/pull/377
- [x] regional_workflow also needs to be updated with the commit in https://github.com/NOAA-EMC/regional_workflow/pull/343 in order for the workflow and automated tests to work on Cheyenne
   - https://github.com/NOAA-EMC/regional_workflow/pull/378

These PRs have been merged and this PR updated with the latest hashes.

## TESTS CONDUCTED: 
Compiles and workflow is successfully generated on Cheyenne, Hera, and Jet; ran many tests that all passed; reference PR on Github for full list.

## ISSUE: 
Resolves #57
christinaholtNOAA referenced this pull request in christinaholtNOAA/ufs-srweather-app Dec 14, 2020
## DESCRIPTION OF CHANGES: 
Currently master is broken and will not build and/or run on any platform due to incompatible hashes and outdated changes. Several fixes are needed to get master back in working order, most of which will be included in this PR.

The direct changes made in ufs-srweather-app for this PR are:
 - Partially cherry-picking release-branch changes to update build system and documentation
 - Updating static hashes to the latest versions of `develop` branches for ufs-weather-model, EMC_post, UFS_UTILS, and regional_workflow

Some changes that were needed prior to this PR being merged are:

- [x] EMC_post needs to be updated to include an updated executable name and flat config files
   - NOAA-EMC/UPP#237
- [x] regional_workflow needs to be updated for the new ufs-weather-model executable name
   - https://github.com/NOAA-EMC/regional_workflow/pull/374
- [x] regional_workflow also needs to be updated for changed namelist options in the latest ufs-weather-model develop branch
   - https://github.com/NOAA-EMC/regional_workflow/pull/377
- [x] regional_workflow also needs to be updated with the commit in https://github.com/NOAA-EMC/regional_workflow/pull/343 in order for the workflow and automated tests to work on Cheyenne
   - https://github.com/NOAA-EMC/regional_workflow/pull/378

These PRs have been merged and this PR updated with the latest hashes.

## TESTS CONDUCTED: 
Compiles and workflow is successfully generated on Cheyenne, Hera, and Jet; ran many tests that all passed; reference PR on Github for full list.

## ISSUE: 
Resolves ufs-community#57
christinaholtNOAA referenced this pull request in christinaholtNOAA/ufs-srweather-app Dec 14, 2020
## DESCRIPTION OF CHANGES: 
Currently master is broken and will not build and/or run on any platform due to incompatible hashes and outdated changes. Several fixes are needed to get master back in working order, most of which will be included in this PR.

The direct changes made in ufs-srweather-app for this PR are:
 - Partially cherry-picking release-branch changes to update build system and documentation
 - Updating static hashes to the latest versions of `develop` branches for ufs-weather-model, EMC_post, UFS_UTILS, and regional_workflow

Some changes that were needed prior to this PR being merged are:

- [x] EMC_post needs to be updated to include an updated executable name and flat config files
   - NOAA-EMC/UPP#237
- [x] regional_workflow needs to be updated for the new ufs-weather-model executable name
   - https://github.com/NOAA-EMC/regional_workflow/pull/374
- [x] regional_workflow also needs to be updated for changed namelist options in the latest ufs-weather-model develop branch
   - https://github.com/NOAA-EMC/regional_workflow/pull/377
- [x] regional_workflow also needs to be updated with the commit in https://github.com/NOAA-EMC/regional_workflow/pull/343 in order for the workflow and automated tests to work on Cheyenne
   - https://github.com/NOAA-EMC/regional_workflow/pull/378

These PRs have been merged and this PR updated with the latest hashes.

## TESTS CONDUCTED: 
Compiles and workflow is successfully generated on Cheyenne, Hera, and Jet; ran many tests that all passed; reference PR on Github for full list.

## ISSUE: 
Resolves ufs-community#57
christinaholtNOAA pushed a commit to christinaholtNOAA/regional_workflow that referenced this pull request May 16, 2022
* Add archive for ensemble data

* Fix observer_gsi data path and NWGES data for archiving

* Cosmetic changes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants