Skip to content

Commit

Permalink
Remove / rework some expensive tests
Browse files Browse the repository at this point in the history
In an effort to reduce the cost of the test suite, I have looked at some
of the most expensive tests
(ESCOMP#275 (comment)).

Some general things I did:
- Changing ERI tests to short SMS tests or coarser-resolution
- Shortening some tests
- Changing some tests to lower-resolution where it doesn't seem
  important to use high-resolution
- Removed some expensive tests for which there were very similar tests
  (or multiple tests that individually covered the various things covered
  in this one test) already in the test suite

Some specific notes:

- ERI_D_Ld9.f09_g16.I1850Clm45BgcCruGs.cheyenne_intel.clm-default: This
  is the only test of this compset (which is scientifically supported),
  and the only ERI Clm45 test. I changed
  ERP_P36x2_D_Ld5.f10_f10_musgs.I1850Clm45Bgc.cheyenne_gnu.clm-default
  (which is a duplicate of an intel test) to an ERI_D_Ld9 test, so we
  have an ERI Clm45 test. Then I changed the above ERI test to
  SMS_D_Ld1.f09_g17

- SMS_Lm1.f09_g17_gl4.I1850Clm50Bgc.cheyenne_intel.clm-clm50KitchenSink,
  ERS_D_Ld3.f09_g17_gl4.I1850Clm50BgcCrop.cheyenne_intel.clm-clm50KitchenSink,
  ERS_Ly3.f10_f10_musgs.I1850Clm50BgcCrop.cheyenne_intel.clm-clm50KSinkMOut:
  We don't need clm50KitchenSink or clm50KSinkMOut any more, since they
  just have the clm50 options.  However, I need to then have a test of
  human stress indices. Introduced a new "extra_outputs" testmod, and
  have an ERP_P36x2_D_Ld3 test of this at coarse resolution.

- ERI_D_Ld9.f09_g16.I1850Clm50Sp.cheyenne_intel.clm-default: Want a test
  of this scientifically-supported compset. Changed to
  SMS_D_Ld1.f09_g17. Similarly for
  ERP_D_Ld9.f09_g16.I1850Clm50SpCru.cheyenne_intel.clm-default.

- ERI_Ld9.f09_g17.I1850Clm50Bgc.cheyenne_intel.clm-drydepnomegan:
  Changed this to have a coarse-resolution ERI test and a short SMS
  test: Changed
  ERP_Ld5.f10_f10_musgs.I1850Clm50Bgc.cheyenne_gnu.clm-drydepnomegan to
  ERI_Ld9 (there's still an intel version of that ERP test), changed the
  above to SMS_Ld1.

- ERP_D_Ld5.f19_g17_gl4.I1850Clm50BgcCropG.cheyenne_intel.clm-glcMEC_changeFlags
  Redundant with
  ERP_D_Ld5.f19_g17_gl4.I1850Clm50BgcCrop.cheyenne_intel.clm-glcMEC_changeFlags
  Looking through the history, I think it was an accident that we have
  both. I'm keeping the one without evolving ice sheet, because I don't
  think we gain anything from having an evolving ice sheet in this short
  test.

Addresses ESCOMP#275
  • Loading branch information
billsacks committed Jan 11, 2019
1 parent 969984a commit a3f49d4
Show file tree
Hide file tree
Showing 7 changed files with 36 additions and 58 deletions.
81 changes: 34 additions & 47 deletions cime_config/testdefs/testlist_clm.xml
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,13 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_D_Ld9" grid="f09_g16" compset="I1850Clm45BgcCruGs" testmods="clm/default">
<test name="SMS_D_Ld1" grid="f09_g17" compset="I1850Clm45BgcCruGs" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
<option name="comment" >Include a debug test of this scientifically-supported compset, at a scientifically-supported resolution</option>
</options>
</test>
<test name="ERI_D_Ld9" grid="f10_f10_musgs" compset="I2000Clm50BgcCruGs" testmods="clm/default">
Expand Down Expand Up @@ -49,20 +50,22 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_D_Ld9" grid="f09_g16" compset="I1850Clm50Sp" testmods="clm/default">
<test name="SMS_D_Ld1" grid="f09_g17" compset="I1850Clm50Sp" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
<option name="comment" >Include a test of this scientifically-supported compset at a scientifically-supported resolution</option>
</options>
</test>
<test name="ERP_D_Ld9" grid="f09_g16" compset="I1850Clm50SpCru" testmods="clm/default">
<test name="SMS_D_Ld1" grid="f09_g17" compset="I1850Clm50SpCru" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
<option name="comment" >Include a test of this scientifically-supported compset, at a scientifically-supported resolution</option>
</options>
</test>
<test name="ERI_D_Ld9_P48x1" grid="f10_f10_musgs" compset="I2000Clm50BgcCruGs" testmods="clm/reduceOutput">
Expand All @@ -89,7 +92,7 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_Ld9" grid="f09_g17" compset="I1850Clm50Bgc" testmods="clm/drydepnomegan">
<test name="SMS_Ld1" grid="f09_g17" compset="I1850Clm50Bgc" testmods="clm/drydepnomegan">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand All @@ -105,15 +108,7 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_Ld9" grid="f09_g17" compset="I2000Clm50BgcCruGs" testmods="clm/cn_conly">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_Ld9" grid="f09_g17" compset="I2000Clm50BgcCruGs" testmods="clm/drydepnomegan">
<test name="ERP_D_P36x2_Ld3" grid="f10_g10_musgs" compset="I2000Clm50BgcCruGs" testmods="clm/cn_conly">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand Down Expand Up @@ -204,14 +199,6 @@
<option name="wallclock">00:60:00</option>
</options>
</test>
<test name="ERP_D_Ld5" grid="f19_g17_gl4" compset="I1850Clm50BgcCropG" testmods="clm/glcMEC_changeFlags">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERP_D_Ld5" grid="f10_f10_musgs" compset="IHistClm50BgcCrop" testmods="clm/allActive">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
Expand Down Expand Up @@ -261,12 +248,13 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERP_D_P720x1_Ld5" grid="hcru_hcru" compset="I2000Clm50BgcCruGs">
<test name="SMS_P720x1_Ln3" grid="hcru_hcru" compset="I2000Clm50BgcCruGs" testmods="clm/coldStart">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:60:00</option>
<option name="wallclock">00:10:00</option>
<option name="comment" >Very short test at the hcru resolution just to make sure we can run a case at this resolution. Cold start to avoid the cost of interpolating initial conditions.</option>
</options>
</test>
<test name="ERP_D_Ld5" grid="f10_f10_musgs" compset="I2000Clm50Sp" testmods="clm/decStart">
Expand Down Expand Up @@ -451,12 +439,19 @@
<test name="ERP_Ld5" grid="f10_f10_musgs" compset="I1850Clm50Bgc" testmods="clm/drydepnomegan">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERI_Ld9" grid="f10_f10_musgs" compset="I1850Clm50Bgc" testmods="clm/drydepnomegan">
<machines>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:40:00</option>
</options>
</test>
<test name="ERP_Ld5" grid="f10_f10_musgs" compset="I1850Clm50Bgc" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
Expand Down Expand Up @@ -515,7 +510,7 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="ERP_Ld5" grid="f09_g17" compset="I1850Clm50BgcCropCru" testmods="clm/ciso">
<test name="ERP_Ld3" grid="f09_g17" compset="I1850Clm50BgcCropCru" testmods="clm/ciso">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand Down Expand Up @@ -575,13 +570,21 @@
<test name="ERP_P36x2_D_Ld5" grid="f10_f10_musgs" compset="I1850Clm45Bgc" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
<option name="comment" >include a debug test of I1850Clm45Bgc</option>
</options>
</test>
<test name="ERI_D_Ld9" grid="f10_f10_musgs" compset="I1850Clm45Bgc" testmods="clm/default">
<machines>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:40:00</option>
<option name="comment" >include a Clm45 ERI test</option>
</options>
</test>
<test name="ERP_P36x2_D_Ld5" grid="f10_f10_musgs" compset="I1850Clm45BgcCru" testmods="clm/ciso">
<machines>
<machine name="cheyenne" compiler="intel" category="prealpha"/>
Expand Down Expand Up @@ -750,7 +753,7 @@
</machine>
</machines>
</test>
<test name="ERS_D" grid="f19_g17" compset="I1850Clm50BgcCrop" testmods="clm/reseedresetsnow">
<test name="ERS_D" grid="f10_f10_musgs" compset="I1850Clm50BgcCrop" testmods="clm/reseedresetsnow">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand Down Expand Up @@ -785,9 +788,9 @@
<option name="comment" >Tests updates of BGC variables with increasing and decreasing glacier areas</option>
</options>
</test>
<test name="ERS_D_Ld3" grid="f09_g17_gl4" compset="I1850Clm50BgcCrop" testmods="clm/clm50KitchenSink">
<test name="ERP_P36x2_D_Ld3" grid="f10_f10_musgs" compset="I1850Clm50BgcCrop" testmods="clm/extra_outputs">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
Expand Down Expand Up @@ -940,14 +943,6 @@
<option name="comment" >Include a long ERS test of the cmip6 configuration, though at coarse resolution. This gives a year+ test covering the output_crop usermod, which is something we want: if this is removed, we should add a test of at least a year duration covering the output_crop usermod. This test needs to use init_interp to work, because of adding virtual Antarctica columns (currently the default out-of-the-box setting uses init_interp for this).</option>
</options>
</test>
<test name="ERS_Ly3" grid="f10_f10_musgs" compset="I1850Clm50BgcCrop" testmods="clm/clm50KSinkMOut">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">01:40:00</option>
</options>
</test>
<test name="ERS_Ly3_Mmpi-serial" grid="1x1_smallvilleIA" compset="IHistClm50BgcCropGs" testmods="clm/cropMonthOutput">
<machines>
<machine name="cheyenne" compiler="gnu" category="aux_clm"/>
Expand Down Expand Up @@ -1082,7 +1077,7 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="SMS_D" grid="f09_g16" compset="I1850Clm50BgcSpinup" testmods="clm/cplhist">
<test name="SMS_D_Ld1" grid="f09_g17" compset="I1850Clm50BgcSpinup" testmods="clm/cplhist">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand Down Expand Up @@ -1349,7 +1344,7 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="SMS_Ld5_D" grid="f09_g17" compset="I1850Clm50BgcCropCmip6" testmods="clm/basic">
<test name="SMS_Ld2_D" grid="f09_g17" compset="I1850Clm50BgcCropCmip6" testmods="clm/basic">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
Expand All @@ -1374,14 +1369,6 @@
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="SMS_Lm1" grid="f09_g17_gl4" compset="I1850Clm50Bgc" testmods="clm/clm50KitchenSink">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
</machines>
<options>
<option name="wallclock">00:20:00</option>
</options>
</test>
<test name="SMS_Lm1" grid="f19_g17_gl4" compset="I1850Clm50Bgc" testmods="clm/clm50dynroots">
<machines>
<machine name="cheyenne" compiler="intel" category="aux_clm"/>
Expand Down

This file was deleted.

This file was deleted.

This file was deleted.

Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
This test mod turns on extra diagnostic fields
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
calc_human_stress_indices = 'ALL'

0 comments on commit a3f49d4

Please sign in to comment.