EE2 compliance, dbn_alert issues and err_chk #131

GuangPingLou-NOAA · 2020-09-15T00:14:16Z

DBNROOT and dbn_alert are not working on EMC parallel runs even though it works fine in operations. This update removes error messages in the real time EMC parallel runs.

KateFriedman-NOAA · 2020-09-17T17:49:51Z

@GuangPingLou-NOAA May this issue now be closed? Thanks!

GuangPingLou-NOAA · 2020-09-17T19:44:33Z

will update new scripts soon and a PR will be requested.

GuangPingLou-NOAA · 2020-09-18T20:04:54Z

This issue is resolved.

Squashed commit of the following: commit 636ded675b81b15e8b3af2a211edf44f17972cf0 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 20 19:23:16 2020 +0000 Issue #1 - add wtime_fcst_gfs time of 4hrs for C384 commit 4007f116adcde8372e590489d0faa0181babbc15 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 20 18:29:15 2020 +0000 Issue #1 - fix firstcyc queue bug in workflow_utils.py on WCOSS commit ebdb058fd138a7aa408d69c967747686ea5b77d9 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 20 13:23:05 2020 -0500 Issue #1 - resource updates from low res testing - set io_layout to "1,1" for low res gfs in config.fcst - set npe_wav[_gfs] to 140 for all resolutions, same wave grid - increase nth_fv3 to 4 for C192 and C384 - set smaller walltime for gfsfcst when resolutions less than C768 commit 3f0ab6ff2dd4ca42a45e68972b1936d398b32097 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Tue Oct 20 17:55:18 2020 +0000 Issue #1 - increase C768 npe_eobs to 200 for Hera nodes with less memory commit d5b69c49ddbd03982db79f09707a49d01ef0b443 Merge: 4ebdd230 794e6655 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Tue Oct 20 16:56:27 2020 +0000 Merge remote-tracking branch 'origin/release/gfsv16.0.0' into port2orion * origin/release/gfsv16.0.0: Issue #1 - pull in corrected npe_eobs values in config.resources Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support commit 4ebdd230c121a3c839829aa4ef855d80eb462549 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Tue Oct 20 16:53:46 2020 +0000 Add UPP netcdf module library load to HERA.env to resolve runtime netcdf version mismatch commit 794e6655cb227973e47b2373d0e4c97bf297479e Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 20 16:45:58 2020 +0000 Issue #1 - pull in corrected npe_eobs values in config.resources commit 1d0cad425b1e163377bba8ace6622bbbb2d81de0 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Mon Oct 19 19:24:55 2020 +0000 Issue #1 - add parm mon folder to ignore list and move parm section of ignore list up commit d632c87a8f2ce85d54fa45da14aa09f91a0ec680 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Mon Oct 19 19:20:31 2020 +0000 Issue #1 - add FDATE to config.base commit 22d4118f4bc7853fa81f6505fd9aaf5bc6dab4f8 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Mon Oct 19 19:12:29 2020 +0000 Issue #1 - save GFSv16 hand-off resource settings into new static nco configs commit 6fd73d7fdf40b291ff49193b606538b540e46139 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Mon Oct 19 19:11:37 2020 +0000 Issue #1 - new FV3 tag that builds on Hera/Orion and update for building/running high res system on Hera commit 484550c13d8ef957478f20afd6e722f7f610bb8f Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Oct 16 15:40:35 2020 +0000 Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support commit 58dcf6d961f7478fec64a850e7bcd19ffd8f3741 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 15 15:08:38 2020 -0500 Update .gitignore for script renaming and removed external files commit e3f8df65082853baa5a22ed3b242efdae66d40ba Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 15 11:59:58 2020 -0500 Add wave env updates into ORION.env, increase waveinit tasks, and update resources for analysis and efcs walltimes commit e5e7cf1ea61d99080ec95b446c1bee45a57321a3 Merge: a1a7ac94 4b2d26db Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 13 14:25:56 2020 -0500 Sync merge with release/gfsv16.0.0 branch commit 4b2d26db3b9b66ecfdd4756bfcddb6e16f255b03 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 13 17:41:24 2020 +0000 Issue #1 - adjust WAFS dependencies to wait for f036 post output commit 9ef1999270e05c1ff5bae5ea5f737d9474c98b3d Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Oct 9 19:27:09 2020 +0000 Issue #1 - adding release notes for GFSv16 commit bf21010067bf7587be93229a979da347278fd7eb Merge: d5e8be98 31563a59 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Oct 9 18:15:36 2020 +0000 Merge remote-tracking branch 'origin/feature/gfsv16b' into release/gfsv16.0.0 commit d5e8be989d1f2f45095fea17fcb5ed1385759e89 Merge: 7728ce18 561e1953 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Oct 9 18:13:53 2020 +0000 GFSv16 package changes from feature/gfsv16b before final wave updates commit 31563a5982b26d7441e2673d68d1d1dac4fe231d Merge: bf27d0b4 6edf0f7b Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 19:03:10 2020 -0400 Merge pull request #158 from RobertoPadilla-NOAA/feature/gfsv16_wave_prdgen Feature/gfsv16 wave prdgen commit 6edf0f7b396587c4e014ba08fb6199461a970c41 Merge: 896ba312 bf27d0b4 Author: wx21rph <Roberto.Padilla@m71a3.ncep.noaa.gov> Date: Thu Oct 8 22:54:12 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16_wave_prdgen Generating awips files with masks and elimination wmo headers for Arctic Ocean commit 896ba31270185a1edaa3c6d32ec3c4295badf136 Author: wx21rph <Roberto.Padilla@m71a3.ncep.noaa.gov> Date: Thu Oct 8 22:50:48 2020 +0000 Issue #94 producing awips files with masks and deleting wmo headers for arctic ocean commit bf27d0b4de54e6b873e20d784012c93384ad2358 Merge: 561e1953 959dac21 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 18:23:17 2020 -0400 Merge pull request #157 from JessicaMeixner-NOAA/feature/gfsv16b-wavegrids Adding wave grids to grib interpolation commit 959dac21e98ff96130f8e8c90a4b94b18c76f4f3 Merge: 50f33dd9 561e1953 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Oct 8 21:57:29 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-wavegrids commit 50f33dd92e1f78f8879cb037652b1b4393511842 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Oct 8 21:44:23 2020 +0000 updates to add glo_30m to the created grib files for waves for awips processing commit 561e19532e68aaff69f5b2568c3ebb2a536b7149 Merge: 7421143a 853a4619 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 16:10:32 2020 -0400 Merge pull request #156 from lgannoaa/feature/gfsv16b Modify gfs/gdas post job to 20 minutes in wall clock. commit 853a46199f2c59ff84422024b55a70e2679213ee Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Oct 8 19:55:56 2020 +0000 Modify gfs/gdas post job to 20 minutes in wall clock. commit 7421143a169264c8480aea5970a6d67f9bc56c43 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 18:40:28 2020 +0000 Issue #1 - update link_fv3gfs.sh to point to newly frozen fix_nco_gfsv16 FIX_DIR commit 8ac89aee11e7099303600ba6df8e3d4bf4d70a66 Merge: db9fa173 eb4ad338 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 14:37:11 2020 -0400 Merge pull request #155 from lgannoaa/feature/gfsv16b Further ecflow updates commit eb4ad338dfa1f51c9ec4ada58601ffd3f6894d7f Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Oct 8 17:58:29 2020 +0000 Modify two wafs jobs trigger as: jgfs_atmos_wafs_grib2 trigger ../../post/jgfs_atmos_post_f000 == complete jgfs_atmos_wafs_grib2_0p25 trigger ../../post/jgfs_atmos_post_f036 == complete commit 589b1df4d5637f6e4521e79d4f286a463da477f3 Merge: 445a16b0 db9fa173 Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Oct 8 17:46:36 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit db9fa173028efd7ed796024a2f4753629e91922b Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 16:01:50 2020 +0000 Issue #1 - update WAFS tag to gfs_wafs.v6.0.10 and change WAFS job dependencies commit 2a0c9739631ae4b1305a2653a1783cce287aeb96 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 15:12:10 2020 +0000 Issue #1 - update config.fv3 and config.resources with v16rt2 values commit b5fbac7affc200e2c9a420f81615d0ae80b1dacf Merge: 5dac3374 6402996f Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 10:36:43 2020 -0400 Merge pull request #154 from CoryMartin-NOAA/bugfix/eobs_resources Change config.resources for eobs for low resolution cases commit 5dac33742edd372a4e9b08c0b3029bb928cc569b Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 14:35:23 2020 +0000 Issue #1 - update gfs_util modulefiles commit 6402996f0cb5f787d04ac08efc8dd92dca767618 Author: CoryMartin-NOAA <cory.r.martin@noaa.gov> Date: Thu Oct 8 14:28:02 2020 +0000 Change config.resources for eobs for low resolution cases commit aae0912df6b1398cdad563495475916970590b1a Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 13:51:06 2020 +0000 Issue #1 - update to fbwndgfs modulefiles for WCOSS-Dell and WCOSS-Cray commit 244e91ca0caf433f82e6e709413db4bac40aade2 Merge: 3bdda7fb 3b051e93 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 8 09:40:24 2020 -0400 Merge pull request #153 from JessicaMeixner-NOAA/bugfix/wavedependency update wave post pnt dependency commit 5962e117f93f1fc9f040f97b9446bcf9dc1138e1 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Oct 8 11:24:41 2020 +0000 updates to parm to reduce the number of wave variables changes to the config so that wave models are interpolated to the multi_1 masked files for the regional output grids commit 445a16b030384a84c60318600a5ccdeeccbd063b Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Oct 8 04:03:32 2020 +0000 Modify module for each job to match implementation package change Modify two wafs jobs trigger Modify wall clock and resource for running jobs in NCO Modify obsproc package location commit 3b051e93adf60717f446564a08e5f3a11fd742af Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Oct 8 01:10:14 2020 +0000 add a dependency for the wavepostpnt on wavepostbndpnt for just gfs as this job does not exist for gdas commit 3bdda7fb50676d25dbc03fffa739889a141b913c Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Oct 7 17:36:27 2020 +0000 Issue #1 - update WAFS tag to gfs_wafs.v6.0.9 commit 3a700dbda1d6f6ef965cf2fbf30cfdf6cb2a8fe2 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Oct 7 14:36:02 2020 +0000 Issue #1 - remove POE/BACK block from config.prep and set POE=YES/BACK=off as defaults in env/WCOSS_DELL_P3.env prep section commit 8cc7d57be3c1d08529dd37633a83a6ffa8ca94b3 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Oct 7 14:30:19 2020 +0000 Issue #1 - remove unneeded DMPDIR and ICSDIR from config.base.nco.static commit 343ea3daece25bfeb1f8e870d361a364d1c228f0 Merge: 22f2a407 b57cd17d Author: Kate Friedman <kate.friedman@noaa.gov> Date: Wed Oct 7 09:47:18 2020 -0400 Merge pull request #152 from JessicaMeixner-NOAA/feature/addwavedependency for rocoto add a dependency to wavepostpnt job on wavepostbndpnt commit b57cd17dafee5415b4955fcd8bbc76eb27e88740 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Wed Oct 7 13:19:50 2020 +0000 for rocoto add a dependency to wavepostpnt job on wavepostbndpnt so that both jobs will not run at the same time which will slow both jobs down. This is the reason for the dependency, otherwise there is not a "true" dependency between the jobs commit 22f2a407e853b7d5342ee52faa53affdb25ac44e Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 20:38:42 2020 +0000 Issue #1 - return POE=YES and BACK=off setting for prep on WCOSS_DELL_P3 commit c530316d07ae129f26907b2cae2079b55b37d0c2 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 19:32:52 2020 +0000 Issue #1 - remove hardcoded POE and BACK values from config.prep commit aece8baef1cd2f46991cb1235c315e228f7b661e Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 19:02:37 2020 +0000 Issue #1 - move ABIBF, AHIBF, and HDOB pointers into RUN_ENVIR=emc block commit c75766cd176802242f003ad3612aadff02563fb2 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 18:17:35 2020 +0000 Issue #1 - update config.fv3 based on real-time parallel commit f79ec7e0ce356213681e8c87655bb3fb66df16f1 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 17:40:16 2020 +0000 Issue #1 - update prep job resources commit 577b060e63b1f47c77fd8e7a2d1b7f111fe6fcd4 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 16:08:07 2020 +0000 Issue #1 - update g2tmpl module load in modulefiles/module_base.wcoss_dell_p3 commit c28d8cea538cdcdfc8557cb71120436edd86e313 Merge: 6197bc62 1b79fd35 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 11:16:32 2020 -0400 Merge pull request #150 from NOAA-EMC/feature/gfsv16b_updates nwtest module library and tag updates commit 1b79fd35e79fe7d0bc8eb460dfc08d44261fc470 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 14:34:26 2020 +0000 Issue #1 - config updates from real-time parallel commit 11ca41294784278dc425e1ca1320253239a85d40 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Oct 6 13:44:29 2020 +0000 Issue #1 - remove unneeded line in vrfy.sh and update link_fv3gfs.sh for UFS_UTILS execs commit 97e9d7f2d75bb7167b56aaa70c53f53e4a189192 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 18:50:40 2020 +0000 Issue #1 - update GSI tag to gfsda.v16.0.0 commit f6689d462ba4528c99a2a331ae8890759ba25ecb Merge: 01e36208 8048cd02 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 14:05:27 2020 -0400 Merge pull request #149 from GuangPingLou-NOAA/feature/gfsv16b Add 6 bufr stations to the bufr sounding output commit 01e362089fbf71a962fcdfc7db48f243b74e2e50 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 17:09:04 2020 +0000 Issue #1 - update component tags and modulefiles for nwtest lib updates, remove unneeded module load and modulefile from downstream wave job rocoto scripts commit 6197bc623013d7fca82c556f3fb51c15832578b3 Merge: 451669a8 cd86b0ed Author: Kate Friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 10:47:08 2020 -0400 Merge pull request #148 from NOAA-EMC/feature/gfsv16b_updates Updates to optimize wave post jobs commit cd86b0eddd305483007e1381d0d4a7256fa05680 Merge: 9b32bf0c 95bc516a Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 14:16:50 2020 +0000 Merge branch 'feature/gfsv16b_updates' of https://github.com/NOAA-EMC/global-workflow into feature/gfsv16b_updates commit 9b32bf0c83ac9eb38f8d3b1b405b704b26c6592a Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Oct 5 14:16:21 2020 +0000 Issue #1 - adjust error handling in wave rocoto job scripts commit 8048cd0285c8b9c8606673b04d60e8a137fe89b8 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:45:21 2020 +0000 issue #142 generate station i,j grid commit e4e4b84235344b6da44ae732020115581abb9afe Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:45:00 2020 +0000 issue #142 generate station i,j grid commit 68e5fd7279bf1f9c30fa4daa16bf44795f5e91f6 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:44:46 2020 +0000 issue #142 generate station i,j grid commit fcf1f415333d53fe3a97546d4a16de55d6e1d703 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:43:49 2020 +0000 issue #142 add 6 bufr station data commit 026b4e0a2ec1da85a3cc8c73053dd85fd4d56439 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:42:58 2020 +0000 issue #142 add 6 bufr stations for Thailand TMD commit faaf8041faeecbc4c39cb37782bbe291ebd7a011 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:41:09 2020 +0000 issue #145 change dev path to prod for parallel netcdf modules commit e6ba71f58ab5e88957f12fc742fded77a58f75d2 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Sat Oct 3 00:40:34 2020 +0000 issue #145 change dev path to prod for parallel netcdf modules commit 95bc516af61e4aa35997f45ea625773f947c2125 Merge: 28904cdd a4d0e4d7 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Fri Oct 2 15:34:48 2020 -0400 Merge pull request #143 from JessicaMeixner-NOAA/feature/gfsv16b-wave-byhr optimize wave post and EE2 commit 451669a8f8d7778addd7bbd090d2fe71c9a6e3f8 Merge: 340f849f 28904cdd Author: Kate Friedman <kate.friedman@noaa.gov> Date: Fri Oct 2 15:32:41 2020 -0400 Merge pull request #144 from NOAA-EMC/feature/gfsv16b_updates Issue #1 - updates for modules and small fixes commit 28904cddca4d3e432f6b155ae018b6a081aea82e Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Oct 2 19:05:10 2020 +0000 Issue #1 - updates for modules and small fixes - fix to run ens_tracker without tclogg module in modulefiles/module_base.wcoss_dell_p3 - fix to sorc/syndat_qctropcy.fd/qctropcy.f for compile warning - fix to gfswaveawipsbulls dependency in setup scripts - update to bufr/11.3.0 from bufr/11.2.0 in modulefiles - add override ability for POE for prep jobs in env/WCOSS_DELL_P3.env commit a4d0e4d7a063c14f711bee5ef32cd0b183121ea7 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 18:59:22 2020 +0000 reverting changes to configs that were not intented to be committed commit 2e6ba320b39b50030c8097a09700e2eb81cb724a Merge: cb7b27c9 340f849f Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 18:08:59 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-wave-byhr commit cb7b27c96c59388e39283b2c01aff2da92fcedbf Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 18:08:16 2020 +0000 fix resource time estimates commit d51a260adc0fb003730ae4090c528856ac18be93 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 18:04:50 2020 +0000 bug fix in exgfs_wave_post_pnt.sh commit 340f849f1cad6b562a941f15318eaf2d050743f1 Merge: 897286fb d5457ec1 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Fri Oct 2 12:00:00 2020 -0400 Merge pull request #141 from RobertoPadilla-NOAA/feature/gfsv16_wave_prdgen Updates to downstream wave jobs commit 2b2635d441beb988e6c09a329eb80e1d519266ee Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 14:38:06 2020 +0000 update resources and trigger from 192->180 commit 56193a6bf9e8942edd54b7b7078143a3c91bc77f Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 14:10:05 2020 +0000 last of EE2 changes commit ad5dcff885c3690f991936412453506deed543a6 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Oct 2 14:01:25 2020 +0000 updates for EE2 from waves commit d5457ec1e15e670677eea3171e68df20e4d6ca53 Merge: 4c488d30 897286fb Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Thu Oct 1 19:02:34 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16_wave_prdgen Issue #94 Adding error capture in the Jjobs commit 4c488d30947cf556d6cbf05d570fa6c41ae59ffb Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Thu Oct 1 18:45:21 2020 +0000 Issue #94 fix for failing silently commit 897286fbdfea6a8d5765f9d89ab7c586bcadb201 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Oct 1 18:14:37 2020 +0000 Issue #1 - update WAFS tag to gfs_wafs.v6.0.8 commit e133c5d1d509781824140f5ec1d302502394dc89 Merge: a25a7dea 545742c4 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Oct 1 09:13:05 2020 -0400 Merge pull request #140 from lgannoaa/feature/gfsv16b Update ecflow scripts for GFSv16 commit 8f79b61ab8b0c7ed17b707eaae7736a3aedd33ef Merge: cc9e98a6 a25a7dea Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Wed Sep 30 16:09:27 2020 +0000 Issue #94 solving conflicts commit cc9e98a6d03fa422f5080626da02426c174e2b45 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Wed Sep 30 15:23:29 2020 +0000 Issue #94 add native grids as default grids commit 545742c42c635d24c360a8c9b0902483cab66359 Merge: 65ba88e5 a25a7dea Author: Lin.Gan <lin.gan@noaa.gov> Date: Wed Sep 30 14:05:40 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit a25a7deac9053dbb2ce119e3754f32c2d3f225b9 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Tue Sep 29 22:46:35 2020 +0000 Issue #1: update name of ncdiag executable and source code directory to be conistent commit 2eab17ce11be26c7d113e16e3a9159e0e6395cac Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Sep 29 19:05:21 2020 +0000 cleaning up the rearranged scripts commit 65ba88e5ad97a560e4b1c6dd7a3568185e5ccbd9 Author: Lin.Gan <lin.gan@noaa.gov> Date: Tue Sep 29 18:22:29 2020 +0000 Jobs were tested with PDY 20200925, code managers from post, gempak, wave, and post process certified the test run result. This merge included an update from high watermark testing (tested by gfs team using devonprod) results impact the following jobs: jgfs_atmos_analysis.ecf jgfs_forecast.ecf jgdas_atmos_analysis.ecf jgdas_enkf_update.ecf jgdas_enkf_ecen.ecf commit d86cfee7befd1d97c9ff6fd8cb58d2f9c9f9f1d8 Merge: abe24e27 69bdae3e Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Mon Sep 28 18:47:23 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-wave-byhr commit 121bafee1e227119ddcba233da5b59af242128e4 Merge: 0d7ba5fb 69bdae3e Author: Lin.Gan <lin.gan@noaa.gov> Date: Mon Sep 28 18:42:03 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit 95f03be594d2944f14f0f6baa600bae27691e891 Merge: 7278b067 69bdae3e Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Mon Sep 28 17:30:03 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit 69bdae3e7cdb35db28d899b7384daab48e888eb4 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Mon Sep 28 16:58:47 2020 +0000 Issue #1: update parm/config.vrfy to define VSDBJOBSH (used by jobs/rocoto/vrfy.sh) commit abe24e279666ecccb27fb875322373b4920a66d3 Merge: d4ebc2e6 ef6d2c5c Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Sep 25 21:56:05 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-wave-byhr Conflicts: parm/config/config.resources commit 0d7ba5fb286ac280efda5510a23e2dbf625ba19a Author: Lin.Gan <lin.gan@noaa.gov> Date: Fri Sep 25 21:34:42 2020 +0000 Code manager indicated all wafs jobs wall clock is 30 mins. Code manager indicated job card for scripts/gfs/atmos/gempak/jgfs_atmos_pgrb2_spec_gempak.ecf need to be changed commit 998228f94e36f63a0586f431fbcd32fb646d0ee6 Author: Lin.Gan <lin.gan@noaa.gov> Date: Fri Sep 25 21:02:57 2020 +0000 The EMC realtime parallel does not use operational job settings. Ecflow job card roll back the setting from module_used_gfs-16_job google sheet document. commit 0e700ef159835510b3e3d02d27448826cb8dd914 Merge: 9b8e2f3a ef6d2c5c Author: Lin.Gan <lin.gan@noaa.gov> Date: Fri Sep 25 19:49:13 2020 +0000 Bring change from upstream_feature_gfsv16b commit ef6d2c5ca3243c579615ee47bcef494bc42f335e Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 25 16:17:05 2020 +0000 Update GLDAS tag to gldas_gfsv16_release.v1.10.0 commit a9f8cb2616259b5610b9d101b5f9e50ea3013a2e Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 25 16:06:11 2020 +0000 Update gfswafs job to run with loop over fcsthrs commit 8187a31eca915184a43c0649db0170271b4ee6a9 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Fri Sep 25 14:06:43 2020 +0000 Issue #1: update vrfy.sh to submit vsdb processing as separate job (only on WCOSS_DELL_P3) commit 320f33033ac0f6f6919bd933c0a18d2a4088fcd6 Author: Roberto Padilla <Roberto.Padilla@noaa.gov> Date: Thu Sep 24 23:29:10 2020 +0000 Issue #94 add /fakedbn to run DBN_alerts commit 0d2c6280ac80d944ea7e9e2700430f42d24b3867 Merge: f9876550 83655eda Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Sep 24 17:17:17 2020 -0400 Merge pull request #139 from NOAA-EMC/feature/gfsv16b_jobname Update script names to match ecflow convention commit 83655eda76114414f39c5e32a61b93186b42ac3c Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 24 18:30:00 2020 +0000 Update config.awips for newly named JJOB scripts commit 2f5fb01d02516a6fe72664c54cd97a5585f99a3f Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 24 18:20:14 2020 +0000 Update WAFS jobs/rocoto scripts to use new JJOB names commit 9b8e2f3a2b782c9dc602c620ce7efc2f7210d6dd Author: lin.gan <lin.gan@noaa.gov> Date: Thu Sep 24 15:30:45 2020 +0000 Making J-Job naming change accourding to code manager. Remove temp files commit ff50171eea7b99c7e89b0b773824464da5fe949f Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 24 14:24:23 2020 +0000 Update post.sh UPP JJOB script name to submit commit 0eb85537f30b1c89ed160374e2e7f8470d7a20d0 Author: lin.gan <lin.gan@noaa.gov> Date: Wed Sep 23 18:42:52 2020 +0000 Modify each ecflow script with old j-job name for test. Modify the following in each definition file. - ecen family require new extern from previous cycle - Job jgfs_atmos_npoess_pgrb2_0p5deg trigger changed to be (requested from code manager): 1. jgfs_atmos_post_manager:release_post180 - Job jgdas_enkf_select_obs trigger changed to be: 1. previous cycle enkf post complete 2. current cycle jgdas_atmos_analysis_calc complete (new job) Tested as of 9/21/2020 before production switch with following condition: 1. Known issue in wafs gcip. Job failed. Waiting for code manager to fix. 2. obsproc testing still on going. 3. Code manager still updating j-job and ex-script names. Testing in hold until package is ready and WCOSS availability. commit 9fb09168c9aa2057a0c919f66bdf43b8e4e3a545 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 23 15:41:20 2020 +0000 Update config.base.nco.static with config.base.emc.dyn changes commit a1a7ac9495446976b9e9ccae48a39bb4b868c19b Merge: ee4bc2b7 70f5064e Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 23 10:19:52 2020 -0500 Issue #5 - sync merge with feature/gfsv16b_jobname commit 70f5064e8e345e073d9c0dc7da812d0a2a51d91d Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 23 14:00:07 2020 +0000 Script name updates for sfc_prep and tracker commit 4346c03a1aaf1cf1429a59b6a5682065c2c6e51b Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 23 13:51:44 2020 +0000 Name change for tropcy scripts and update WAFS tag commit 0ef9e49d9752643fa3ebdc8fc0ef9768968836d2 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 22 17:50:35 2020 +0000 Fixing spelling mistake in config.gldas commit 9fdb9eef052586c36abf034cd335ec649bf9cf19 Merge: 869dfa35 f9876550 Author: lin.gan <lin.gan@noaa.gov> Date: Tue Sep 22 17:13:20 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit 4b1affe520e0610c14168ccba4ef3439a3b7a966 Author: BoiVuong-NOAA <Boi.Vuong@noaa.gov> Date: Tue Sep 22 16:39:39 2020 +0000 Updated drivers and release notes commit 2ed155ccee58d3cc72d7fdf6577806c7a14e58e9 Author: BoiVuong-NOAA <Boi.Vuong@noaa.gov> Date: Tue Sep 22 15:55:01 2020 +0000 Updated scripts commit 6d171bc82f2c63f146fe1cf760c350b2effc20e6 Author: Wen Meng <wen.meng@noaa.gov> Date: Tue Sep 22 15:26:37 2020 +0000 Update Externals.cfg with new UPP tag upp_gfsv16_release.v1.0.16. commit 4b4069b715c9ebcc5122b79a1508f70ad7c78b46 Author: Wen Meng <wen.meng@noaa.gov> Date: Tue Sep 22 14:59:24 2020 +0000 1)Update sorc/checkout.sh with new UPP tag upp_gfsv16_release.v1.0.16. 2)Update sorc/link_fv3gfs.sh with new file name convention for jjob and ex-script of post processing part. commit c071ac0159cce98ea98ce5fa8dc5337b284ad136 Author: BoiVuong-NOAA <Boi.Vuong@noaa.gov> Date: Tue Sep 22 14:48:45 2020 +0000 Updated jobs name commit ea13d0c9146457aadd65d567fda794beeeef6c7d Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 22 14:27:47 2020 +0000 Update EMC_verif-global tag to verif_global_v1.11.0 commit 92e69985706cf62cdd7b383fd45c4cd50f937053 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 22 14:15:24 2020 +0000 Rename scripts to match ecf script naming convention. Add SENDDBN and DBNROOT. Update GLDAS tag. commit 37ae040a0f21ec344228128e3e79910059c3b734 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 22 04:30:58 2020 +0000 In anticipating changes from the GLDAS repo : renaming JGDAS_GLDAS to JGDAS_ATMOS_GLDAS, and exgdas_gldas.sh to exgdas_atmos_gldas.sh modified: driver/gdas/test_gdas_gldas.sh jobs/rocoto/gldas.sh parm/config/config.gldas sorc/link_fv3gfs.sh commit c58b93a61f77d65f042f8226445163029ebd9f8d Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 22 04:06:06 2020 +0000 renamed: jobs/JGFS_POSTSND -> jobs/JGFS_ATMOS_POSTSND renamed: scripts/exgfs_postsnd.sh -> scripts/exgfs_atmos_postsnd.sh modified: docs/archive/README_bufr driver/product/run_postsnd.sh driver/product/run_postsnd.sh.cray driver/product/run_postsnd.sh.dell driver/product/run_postsnd.sh.hera driver/product/run_postsnd.sh.jet parm/config/config.postsnd commit bec1b83027e162e4c083464d2cdb3fbdbd5168e8 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 22 03:51:02 2020 +0000 renamed: scripts/exglobal_fcst_nemsfv3gfs.sh -> scripts/exglobal_forecast.sh and modified jobs/JGLOBAL_FORECAST parm/config/config.fcst commit d4ebc2e6798d13af1ced8a51899e80e209a13c71 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Mon Sep 21 18:28:15 2020 +0000 updates for optimizing point jobs commit 7278b0677be6168a9695fca6c2e08154d9af0f63 Merge: 928e3e4b f9876550 Author: Guang Ping Lou <guang.ping.lou@noaa.gov> Date: Fri Sep 18 18:35:06 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit f98765509cc7fc0e7b8979abfc73dbc5db035825 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 18 16:58:57 2020 +0000 Issue #1 - update SEND variables and add DBNROOT to base configs and add check to build_enkf_chgres_recenter_nc.sh for GSI build commit e9e8d63db112ab8f5e15de08a1714cfebd386a2a Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 18 15:18:48 2020 +0000 Issue #1 - update to UFS_UTILS ops-gfsv16.0.0 tag commit 3df7625d74012552cf69fcfe7c0b5384b860c999 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 18 13:25:00 2020 +0000 Issue #1 - fix to link_fv3gfs.sh for new GLDAS tag commit 928e3e4b53e969f8ecdd3544c3bf2668b57c66b3 Merge: dd081426 1fc7bde9 Author: Guang Ping Lou <guang.ping.lou@noaa.gov> Date: Thu Sep 17 20:00:17 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit dd08142664e5695e3f27890c0560f0b5e48841a8 Author: Guang Ping Lou <guang.ping.lou@noaa.gov> Date: Thu Sep 17 19:57:20 2020 +0000 Issue #131 Unify dbn_alert path commit 1fc7bde9b7f99da7d0430387ec4a547e73ea641b Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu Sep 17 19:37:41 2020 +0000 Issue #1: update to UPP tag "upp_gfsv16_release.v1.0.15" commit 9eae5a8af39c4a8c5d47c16725ccc62b5d3c60cf Merge: ce1c7825 99c15099 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Thu Sep 17 13:46:58 2020 -0400 Merge pull request #135 from KateFriedman-NOAA/feature/gfsv16b-down Small updates to downstream jobs and tag updates commit 99c1509923399845ba794cb8fad981d12935dd03 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 17 13:13:14 2020 +0000 Fix for running prep on Hera commit 869dfa350a013f66e5fdca66aa9b1f0192c1570c Author: lin.gan <lin.gan@noaa.gov> Date: Wed Sep 16 21:25:10 2020 +0000 ecflow full day cycle included commit 515eeb5c6b188e873b304619c40c9a6efcfd9046 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 16 19:53:26 2020 +0000 Update WAFS tag to gfs_wafs.v6.0.6 commit 89f138af89814c865331b9aefcb8450b5915d1f7 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 16 16:33:21 2020 +0000 Small updates: - new UPP tag - new GLDAS tag - new WAFS tag - new module for WAFS - EE2 updates to awips scripts - added WAFS to archival - break downstream and WAFS archival into separate gfs_downstream tarball - update gfsarch dependencies to wait for all wavepost jobs to complete commit 9930e8770a2940c46e22b243c11d2ac14f95611a Merge: b3433d59 ce1c7825 Author: lin.gan <lin.gan@noaa.gov> Date: Wed Sep 16 13:25:36 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit b100c22b5bfcf455ff3ff15bd71f0ddc15f1d071 Author: Guang Ping Lou <guang.ping.lou@noaa.gov> Date: Tue Sep 15 18:57:21 2020 +0000 Issue #131 reduce scripts output to logfile commit 6866e6cd2ef1e76dd58de27ebb7d68b2bd3fa304 Author: Guang Ping Lou <guang.ping.lou@noaa.gov> Date: Tue Sep 15 18:55:03 2020 +0000 Issue #131 added a path to DBNROOT commit b3433d59d1d5b75f015b0e044a8b4e03d55407f7 Author: Lin.Gan <lin.gan@noaa.gov> Date: Tue Sep 15 17:59:32 2020 +0000 Adding wafs wave and downstream jobs commit 4c7ccd466bc71b3e73194ffc48385225e01e7c0c Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Tue Sep 15 15:29:44 2020 +0000 updates for by hour post commit ce1c78255f4bf8f40c2f116547062c7f1b3832c5 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Tue Sep 15 10:25:37 2020 +0000 Issue #1: add fhrgrp and fhrlst back to gfsawips in setup_workflow.py (bugfix) commit 67b33dd15633345e0fd59dd37728c26b36d4c0b3 Merge: c33869da 586fe6ce Author: Kate Friedman <kate.friedman@noaa.gov> Date: Mon Sep 14 10:34:39 2020 -0400 Merge pull request #130 from JessicaMeixner-NOAA/bugfix/rtofs Bugfix for rtofs commit 586fe6ce19c5fc281dec16be3347d0311f3e99ce Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Mon Sep 14 14:29:01 2020 +0000 adding the line to go back a day for RTOFS for the if not NCO section because RTOFS will not be available until 06 cycle commit 15fcb8a46e2cbc93282d1ad038e6decc5fcdacfb Author: Lin.Gan <lin.gan@noaa.gov> Date: Mon Sep 14 13:30:24 2020 +0000 Restructured ecflow - up to post step commit c33869dab2704396ea6e569dcd202a2b9866827a Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Mon Sep 14 02:34:08 2020 +0000 deleted relocate_mv_nvortex.fd since storm relocation is no longer needed. modified build_tropcy_NEMS.sh to remove references to relocate_mv_nvortex commit 4320bf9fd55757df79b63ed15c2041b1acd0e604 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Sat Sep 12 00:05:38 2020 +0000 Issue #1: correct DA typos in sorc/link_fv3gfs.sh commit 674cd841a7be3a2a9c772cd455ab980195ea9fcc Merge: 46c2404e ad1a9d90 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Fri Sep 11 15:06:36 2020 -0400 Merge pull request #124 from JessicaMeixner-NOAA/feature/gfsv16b-wave Splitting post jobs for waves commit ad1a9d9044e89b75ec82bb201e35005552d3d177 Merge: 986f8f0b fd687727 Author: Jessica Meixner <jessica.meixner@noaa.gov> Date: Fri Sep 11 14:01:35 2020 -0400 Merge pull request #4 from KateFriedman-NOAA/feature/gfsv16b-splitwavepost Sync with feature/gfsv16b and small updates to split wave post changes commit fd687727b2df80f81fabc41b94f808b74e68783c Merge: 986f8f0b fc60e895 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 11 17:52:30 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b-wave' into feature/gfsv16b-splitwavepost commit fc60e895dea1c123a4b8e02b50df0d0cfa43f77f Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 11 17:45:03 2020 +0000 Increase walltime for new wavepost jobs commit e0dd1097de2c335400a546137569886a838c46ba Merge: 0844b004 46c2404e Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Sep 11 14:20:15 2020 +0000 Merge branch 'feature/gfsv16b' into feature/gfsv16b-wave commit 46c2404eba485d08e381ef81ebd5ac10c5ad605f Merge: c5546570 9d9b79c9 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Fri Sep 11 10:15:49 2020 -0400 Merge pull request #128 from RobertoPadilla-NOAA/feature/gfsv16_wave_prdgen Feature/gfsv16 wave prdgen commit c554657023d82ac934b481593e55406c45157932 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Fri Sep 11 13:59:51 2020 +0000 Issue #1: update name of DA jobs and scripts in accordance with WCOSS Implementation Standards commit 9d9b79c911add71065b0999821772d026609ad62 Merge: cb78f7b8 d3946f90 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Fri Sep 11 13:48:19 2020 +0000 Issue #94 solving a conflict commit cb78f7b839a7b5fd5082f39592e3b450ce059e82 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Fri Sep 11 13:21:41 2020 +0000 Issue #94 add waves-prdgen, ICE->ICEC, Sleep in gempak script commit b4a99e3d8b2f6a3837084ddfb08da6a667de81e0 Merge: edb91373 e6148566 Author: Lin.Gan <lin.gan@noaa.gov> Date: Fri Sep 11 13:19:13 2020 +0000 Merge branch 'feature/gfsv16b' of https://github.com/lgannoaa/global-workflow into feature/gfsv16b commit e614856610da39345976823d29bdc32781f38c71 Author: lin.gan <lin.gan@noaa.gov> Date: Thu Sep 10 16:26:11 2020 +0000 add gfs gempak downstream jobs into def file commit 907291d81c512968817241b883a0084b8506f2b2 Merge: 3f9695b4 d3946f90 Author: lin.gan <lin.gan@noaa.gov> Date: Thu Sep 10 15:46:45 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit ee4bc2b7268bf8f23ca7f7b3b631ddd6730c6a8c Merge: 41d146fc d3946f90 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 9 08:54:17 2020 -0500 Issue #5 - sync merge with feature/gfsv16b commit 6b38e648f244afbba9590ea1a4de70d4ce2ed119 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Sep 8 22:14:13 2020 +0000 worked on wcoss commit edb913733023b1025786901aee895d2dbca5edc7 Author: Lin.Gan <lin.gan@noaa.gov> Date: Tue Sep 8 16:09:07 2020 +0000 ecflow script rename after redesign approved - not including all wave jobs commit d3946f9006f433e0a6b2f459aeaa7fd8bf800aff Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Tue Sep 8 14:46:39 2020 +0000 Issue #1: clean up DA sections of link_fv3gfs.sh commit 986f8f0b9858f61d32d337a67efa966a7948aa94 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Sep 4 15:42:25 2020 +0000 fix from Bhavani for having first wave grib file be set as a forecast instead of analysis commit 0844b0043c937925c5ad76b4fad03308483d49b3 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Sep 4 15:42:25 2020 +0000 fix from Bhavani for having first wave grib file be set as a forecast instead of analysis commit c1d5c45c13b46964d9d2479962b8c56307a6ad11 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Fri Sep 4 15:42:25 2020 +0000 fix from Bhavani for having first wave grib file be set as a forecast instead of analysis commit 3f9695b44deef4790ae443f4d0c1844b1385374d Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Sep 3 19:07:35 2020 +0000 ecflow gfs v16 nco review 3 commit 256885283bb42c2309e820ca53b44042b8223617 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Sep 3 17:44:47 2020 +0000 updates to split boundary points plus saving config file updates commit 8a203e5d5afa92a2b925f69efa5237a2c0d3dca6 Merge: 40c689b5 26c84b3c Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Sep 3 17:36:19 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b commit 64409b1e9e976b75afd8a3548e7023dce534c4ae Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 3 15:42:23 2020 +0000 Adding missing space to if-block in env files to resolve runtime failure commit 0485442f5876b82de73c47429d3a70f58f0aa263 Merge: 26c84b3c 2006bbcb Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Sep 3 15:37:50 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b-wave' into feature/gfsv16b-wave * upstream/feature/gfsv16b-wave: adding pnt jobs as seperate jobs for env moving definitions of wavempexec and wave_mpmd from jobs to env lowering the resource requirement for wave prep job update module for cdo updates to resources for wave jobs Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py cleaning up wave point post scripts rename wave post script remove gridded so can rename updates to boundary point Remove extra space from line Fix wavepostbndpnt dependency and increase wavepostbntpnt and wavepostpnt walltimes fix typos updating WCOSS work around for CDO, CDO_ROOT is missing from module file adding module use for cdo module on wcoss dell updates for new weights file and adding cdo module for wave prep Adding new wavepostbndpnt and wavepostpnt jobs updating wave post scripts for restructured format updates to JJOBs for wave post point for new structure changing exit 0 to exit number for FATAL errors in ice prep for waves updating error message and exit if there is no current input file update WAVE_PREP so that currents do not check for previous 24 hour so that parallels will be reproducible also deleted unused variable renaming wave job and scripts update jobs for waves Issue #94 - pull in two fixes for wave job setup in free-forecast mode updates for wave scripts to split them, also added updates from GEFS branch to add extra error checking updates from gefs post workflow: updates for re-run case as well as extra error messages commit 26c84b3ca81dec965ab31d00409b537f61174dc1 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu Sep 3 14:06:29 2020 +0000 Issue #1: remove pgrb2b.0p25 dependency from gfsawips in setup_workflow.py commit 40c689b5d5886d9a4bed92e0c6262bfc5988836d Author: Lin.Gan <lin.gan@noaa.gov> Date: Thu Sep 3 02:00:09 2020 +0000 ecflow gfsv16 redesign 2 commit 609e157c2477b662b55bbf3d53999cdd30856bc8 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 20:35:28 2020 +0000 Issue #1 - update WAFS tag to gfs_wafs.v6.0.4 and remove HOURLY variable from WAFS configs commit b0bebad6258bd81c0b0c89b559a04d9b059c838e Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 20:08:01 2020 +0000 Issue #1 - change wavegempak and waveawipsgridded dependency to match waveawipsbulls and start when wavepostsbs is complete commit 084c89e3d562f8c9977eaa17624646be388f7854 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Wed Sep 2 19:58:37 2020 +0000 Issue #1: set n_sponge=42 in gfs section of config.fcst commit 2006bbcb1e54e3cd5ae0ff2826b6d0b211c1d013 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 19:22:38 2020 +0000 adding pnt jobs as seperate jobs for env commit c61cd59488b64ead77e13b2eb5faeb383d052ea0 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 19:02:21 2020 +0000 moving definitions of wavempexec and wave_mpmd from jobs to env commit 68ed2d670ebe25713554f2165a0bbc7c35fb5030 Merge: 4e7975d2 70abda26 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 17:45:26 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-wave Conflicts: parm/config/config.resources ush/rocoto/setup_workflow.py ush/rocoto/setup_workflow_fcstonly.py commit 70abda260dc9ab47533d25cd570dd055c4644123 Merge: 0a31d568 52e987ac Author: Kate Friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 10:28:22 2020 -0400 Merge pull request #122 from KateFriedman-NOAA/feature/gfsv16b_wavedown Add downstream wave jobs to GFSv16 commit 0a31d568bdacd0fb2d8bc6e1fddb09d2c72d014c Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 14:09:57 2020 +0000 Remove unneeded settings from config.post commit 52e987ac67477932e5b034321cf52f1cc756081c Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 13:05:42 2020 +0000 Added null DBNROOT to wave awips configs commit b3c7b7379a6ebb53b4d4533b894b1bf36df3c2fd Merge: 074f2782 add6ea0b Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Sep 2 13:02:41 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b_wavedown commit 806a57838b2a6fd8a9df993fd6cd8debf9fb659a Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 12:28:43 2020 +0000 add extra script for by hour points for waves commit ab3e0b196bbb147da99da4ef34710e8d5fbb68ea Merge: 054f8c53 4e7975d2 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 11:40:04 2020 +0000 Merge branch 'feature/gfsv16b-wave' of github.com:JessicaMeixner-NOAA/global-workflow into feature/gfsv16b-wave commit 054f8c53608689b00b32d035ce728ed3d8cb3ad9 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Wed Sep 2 11:39:28 2020 +0000 updates for boundary points by hour parallelization commit 4e7975d265857e4e634e0c7352f6ed2de1a99336 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Sep 1 22:45:05 2020 +0000 lowering the resource requirement for wave prep job commit add6ea0bae2c56bba2e3d76460771095b98786b1 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Tue Sep 1 19:40:10 2020 +0000 Issue #1: rename enkf_chgres_recenter executables in accordance with WCOSS Implementation Standards commit 8a7e8d9944b8727da91bfb28bbfe44958f0aeb65 Merge: 4c9978a8 595edcfa Author: Kate Friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 15:00:08 2020 -0400 Merge pull request #121 from KateFriedman-NOAA/feature/gfsv16b-wafs Adding WAFS jobs to GFSv16 commit 4c9978a8b0a98527d7c78a3da0a0a55e39cefed0 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 1 18:48:44 2020 +0000 modified: checkout.sh to use gldas_gfsv16_release.v1.6.0 commit 595edcfaaf1372889c8d569e01ec4dfefb51c469 Merge: 8a593c8d 06bda7de Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 17:30:08 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b-wafs commit ada0fb3155a57bdba074c84e1ab3d73eabb0e2f4 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Sep 1 17:18:27 2020 +0000 update module for cdo commit 074f2782438471740453e356b856a4756e59c858 Merge: a1a3d69b 8a593c8d Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 14:30:56 2020 +0000 Sync with WAFS branch commit a1a3d69ba40564f550053b99b4328ba41c7cc45d Merge: 249b6ef7 06bda7de Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 14:22:20 2020 +0000 Sync merge with feature/gfsv16b commit 8a593c8df03d8a879c5488fbd671fef94f5d867d Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 14:09:49 2020 +0000 Update to WAFS tag and added SENDDBN_NTC to both base configs commit 5270ed831c0b3c428736cbd8a789a4d3cfdcc0fe Merge: 95ec3329 eabda84f Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Sep 1 14:03:53 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b-wafs commit 06bda7dec74831951034b72c83abbb2d994ee539 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 1 14:02:44 2020 +0000 modified: link_fv3gfs.sh to not link or copy 0readme fix_chem fix_fv3 fix_sfc_climo which are not used by GFS.v16 and are of large size commit eabda84f97c11251f672d95bb604ad0c50e8da18 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 1 13:48:11 2020 +0000 modified: link_fv3gfs.sh to remove chgres_cube.fd and chgres_cube.fd in sorc/link_fv3gfs.sh commit 223492bf6c56c0491c0034dc1d4a0a3e6e97a607 Author: fanglin.yang <fanglin.yang@noaa.gov> Date: Tue Sep 1 03:59:53 2020 +0000 modified: link_fv3gfs.sh to allow "fix" directories to be removed before rerunning link_fv3gfs.sh for RUN_ENVIR=nco case commit 95ec3329e72a54b0dabdccdecd467972c4914dcd Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 31 18:57:32 2020 +0000 Added WAFS jobs to free-forecast mode, updates for extending WAFS to fh120, and two bug fixes in link_fv3gfs.sh and hpssarch_gen.sh commit 6f660d9a9a5758f3d74f87f170a95a26ca0c0e6a Merge: 8da41916 3282a899 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 31 17:58:55 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16b-wafs commit 3282a8996ab0510699932a53897b87730b2cc492 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 31 17:47:37 2020 +0000 Renamed global-workflow-owned ex-scripts to remove ecf extension and updated other scripts which call those ex-scripts commit 9cde3a41f34d0c2618e8fb06ff1276cec5378ef5 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 18:46:57 2020 +0000 Remove UFS_UTILS ecf extensions commit f7a92dbc1c3ad822d3b8e567967e91384631288d Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Fri Aug 28 18:09:26 2020 +0000 Issue #1: (1) update earc.sh directory removal to be consistent with arch.sh, (2) update config files to be consistent with EMC real-time GFS v16 parallel commit 249b6ef761fb41b5d102b282fccedeb827192dff Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 16:52:54 2020 +0000 Remove ecf script name extensions from downstream wave scripts commit 004a29f39204314159d2cbd028950cfaba07cf33 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 16:50:03 2020 +0000 Add new downstream wave jobs to workflow commit 8da4191644ff55f46e8f394e4e1d29641d3c117c Merge: 8f97726a 6319bda4 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 16:42:11 2020 +0000 Sync merge with feature/gfsv16b commit 8f97726a4170d56dcaf6732ae141fae9aaebfd8d Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 16:39:50 2020 +0000 Add new downstream WAFS jobs commit 6319bda47548873acb8859d9a47d2ac6a6ef4c67 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 28 15:41:55 2020 +0000 Issue #1 - update GLDAS and UPP workflow files for removal of ecf script extension commit 8f7615c76f76611d748246a80d9286de7c4d3295 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu Aug 27 20:53:25 2020 +0000 Issue #1: remove ".ecf" suffix from DA scripts referenced in sorc/link_fv3gfs.sh commit af754d1fa0aa4a521fcd5b4fc04eaa88d475dbff Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu Aug 27 20:47:14 2020 +0000 Issue #1: remove ".ecf" extension from DA exscripts (as per WCOSS Implementation Standards) referenced from parm/config files commit a6e91b48b7024c83491fd1f93c6d7df8e3301af5 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 27 20:25:45 2020 +0000 updates to resources for wave jobs commit f0b9a98973b7983eadab51c7009723b5d0b4a564 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Wed Aug 26 23:04:02 2020 +0000 Issue #1: update name of DA enkf chgres script in config.echgres commit 01f33c498bf0b5c0d48486cd04dab9c93c721906 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Wed Aug 26 20:58:29 2020 +0000 Issue #1: Rename DA enkf chgres job and script as per EE2 guidance commit 7d3f37819aba17dc794d10f7453061802779b435 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 26 18:35:59 2020 +0000 Workflow changes for wave gempak and awips downstream jobs commit 485632eafe37c1866011af1bd0a601fb1c7adc4c Merge: 2946baad e191fd4b Author: Jessica Meixner <jessica.meixner@noaa.gov> Date: Wed Aug 26 11:49:40 2020 -0400 Merge pull request #3 from KateFriedman-NOAA/feature/gfsv16b-wave Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py commit e191fd4bb87af787feab486bf072fe4dce7f12f4 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 26 15:47:49 2020 +0000 Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py commit 4641a72e1ced493c7ec5d837a3093908e388b5df Merge: a1b08c92 25ae4899 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Wed Aug 26 11:33:23 2020 -0400 Merge pull request #119 from GeorgeGayno-NOAA/feature/gfsv16b enkf_chgres_recenter_nc.fd - Remove hard-coded vertical levels. commit 25ae4899cee3dc3aeff1e36f0ac1d0b0773ca2f9 Author: George Gayno <George.Gayno@noaa.gov> Date: Wed Aug 26 14:25:36 2020 +0000 feature/gfsv16b: Add Cory's updates to build 'enkf_chgres_recenter_nc' on Cray. Issue #102. commit 2946baad88d908b32793f542cab42f0c89adf009 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Wed Aug 26 13:44:06 2020 +0000 cleaning up wave point post scripts commit 3590e9a45e2b13b22ff3c3d4827907ddcf55eebf Merge: 727c3ffd a1b08c92 Author: George Gayno <George.Gayno@noaa.gov> Date: Tue Aug 25 20:20:17 2020 +0000 feature/gfsv16b: Merge updates from authoratative feature/gfsv16b branch. Issue #112. commit a1b08c92892278453f25c2530f8b8fb968af9a34 Merge: 45ad029b ce3816d3 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Tue Aug 25 16:01:57 2020 -0400 Merge pull request #116 from RobertoPadilla-NOAA/feature/gfsv16_wave_prdgen Feature/gfsv16 wave prdgen commit ce3816d3e88b8d2de7472a214e66cb54aceca9a6 Merge: b0c91610 45ad029b Author: wx21rph <Roberto.Padilla@m71a2.ncep.noaa.gov> Date: Tue Aug 25 19:55:53 2020 +0000 Merge remote-tracking branch 'upstream/feature/gfsv16b' into feature/gfsv16_wave_prdgen Issue #94 Adding prdgen for waves commit 90181842fbb7a22479f12d3a67bcdc8fa4b8f669 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Aug 25 19:02:22 2020 +0000 rename wave post script commit 1f15be0a8207d3117200bcc145a5ae66b7445ec3 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Tue Aug 25 19:01:41 2020 +0000 remove gridded so can rename commit 1fc5b368fe0cd438e2202b62de7753b7efed7af6 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Tue Aug 25 19:00:20 2020 +0000 updates to boundary point commit f0e3ae5c2cd441673a4a670618e87f050a12c9e9 Merge: 98d6c163 b74b21e7 Author: Jessica Meixner <jessica.meixner@noaa.gov> Date: Tue Aug 25 14:15:57 2020 -0400 Merge pull request #2 from KateFriedman-NOAA/feature/gfsv16b-wave Feature/gfsv16b wave commit b74b21e71edbb62207ccfcafe4c6ed5b6d301cfe Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Aug 25 18:14:15 2020 +0000 Remove extra space from line commit 25e2cc4596213b39d2a3dc3ee8afda4a86e10d38 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Aug 25 18:12:04 2020 +0000 Fix wavepostbndpnt dependency and increase wavepostbntpnt and wavepostpnt walltimes commit 45ad029bad4367961e5eff987f27226b0ac78d5a Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Tue Aug 25 13:40:45 2020 +0000 Issue #1: several minor changes * Externals.cfg and sorc/checkout.sh: update to tag verif_global_v1.10.1 * jobs/rocoto/arch.sh: update ARCDIR cp to use new path to tracker output * scripts/run_gfsmos_master.sh.dell: remove module purge from mos driver script commit 0a85a36ef0784bebf96d2f97c24dd4c642ac23f1 Merge: d5861551 5190efb1 Author: Kate Friedman <kate.friedman@noaa.gov> Date: Tue Aug 25 09:20:42 2020 -0400 Merge pull request #118 from GuangPingLou-NOAA/feature/gfsv16b Issue #117 Modufy Bufr station Hilo's grid point representation commit 5190efb119c6eec6a7c67d90327dee4666307541 Author: Guang.Ping.Lou <Guang.Ping.Lou@noaa.gov> Date: Tue Aug 25 12:30:45 2020 +0000 Issue #117 Modufy Bufr station Hilo's grid point representation commit 98d6c16336e5b0a3241174c54b7631667a4f919d Merge: 0eacf5e2 32bd57ef Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Mon Aug 24 22:27:39 2020 +0000 Merge branch 'feature/gfsv16b-wave' of github.com:JessicaMeixner-NOAA/global-workflow into feature/gfsv16b-wave commit 0eacf5e21c3149d2d922b4c2495e48fb2355e639 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Mon Aug 24 22:27:28 2020 +0000 fix typos commit b0c9161061302ccf4b890cceabe5b4eaecb67e61 Author: wx21rph <Roberto.Padilla@m71a2.ncep.noaa.gov> Date: Mon Aug 24 22:25:05 2020 +0000 Issue #94 changing native by interpolated grids for gempak commit 8a68d3c6d6996f389609d5961f32f0db116797d1 Author: wx21rph <Roberto.Padilla@m71a2.ncep.noaa.gov> Date: Mon Aug 24 21:47:44 2020 +0000 Issue #94 removing the load of modulefiles and sending set.pdy to j-jobs commit 32bd57ef2b390dbe73a744188a40ca4c42c306fe Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Mon Aug 24 20:35:39 2020 +0000 updating WCOSS work around for CDO, CDO_ROOT is missing from module file commit a2d06bb0bf82ee48899cb26ea9abf2331b543107 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Mon Aug 24 18:55:02 2020 +0000 adding module use for cdo module on wcoss dell commit e5c9f037bd82ed4bc72cf11241d7c053160ff5b9 Author: jessica.meixner <Jessica.Meixner@noaa.gov> Date: Mon Aug 24 18:29:36 2020 +0000 updates for new weights file and adding cdo module for wave prep commit 96655fbe5b5daf130d4a9a458ce47059c047376a Author: wx21rph <Roberto.Padilla@m71a2.ncep.noaa.gov> Date: Mon Aug 24 16:56:37 2020 +0000 Issue #94 removing modulefiles load from j-jobs commit 7f9344f777075ce3220d9a9fccba74c07e4f40e2 Author: wx21rph <Roberto.Padilla@m71a2.ncep.noaa.gov> Date: Mon Aug 24 14:32:26 2020 +0000 Issue #94 Solving reviewers comments commit c9598a3207bb06cbd7d2619d97f723f6511da9a4 Merge: bf97710b 92a2a43d Author: Jessica Meixner <jessica.meixner@noaa.gov> Date: Mon Aug 24 10:12:43 2020 -0400 Merge pull request #1 from KateFriedman-NOAA/feature/gfsv16b-wave Adding new wavepostbndpnt and wavepostpnt jobs commit 92a2a43db190982944b4166b929a791a1b0b0750 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 24 14:06:23 2020 +0000 Adding new wavepostbndpnt and wavepostpnt jobs commit bf97710bece30195679740b0de2b32e0adc6c3c6 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Fri Aug 21 00:20:56 2020 +0000 updating wave post scripts for restructured format commit a914521cec478667191b365e2a2a62e3553e0ff7 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 23:52:47 2020 +0000 updates to JJOBs for wave post point for new structure commit 1f195f8d432072f4e4f66406ea6b09256a185d2b Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 15:20:28 2020 +0000 changing exit 0 to exit number for FATAL errors in ice prep for waves commit f836a7869dbb88badd93fcd9d08314284eee4f96 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 15:17:28 2020 +0000 updating error message and exit if there is no current input file commit 529cc3692f4fc003295584e761279be3c9405b68 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 14:50:50 2020 +0000 update WAVE_PREP so that currents do not check for previous 24 hour so that parallels will be reproducible also deleted unused variable commit 57c4258ba73778fe95118ebfae98c4bbf012ae37 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 14:09:22 2020 +0000 renaming wave job and scripts commit 1626cb2f90bfea5663f198cfc2ac2916a9200e1a Merge: da292216 d5861551 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 14:02:54 2020 +0000 Merge remote-tracking branch 'EMC/feature/gfsv16b' into feature/gfsv16b-splitwavepost commit da2922163922f4b4b14dba78dba36e9eced3a2c5 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Thu Aug 20 13:50:15 2020 +0000 update jobs for waves commit a1c456f267ddf701aa47ad33fd231a2f1ae0bf99 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Wed Aug 19 20:09:47 2020 +0000 Issue #94 renaming the J-jobs commit 41d146fc0fda97a41ef829ecff41b005bbf21740 Merge: c2a4f04e d5861551 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 19 13:54:13 2020 -0500 Issue #5 - sync merge with feature/gfsv16b after COMPONENT update commit 036617c8a9b5da765b82c276f7b087aa4e16d679 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Wed Aug 19 14:24:01 2020 +0000 Issue #94 Updating the modulefiles for waves-prdgen commit d5861551ae5b1fe2c2b00802159a42f7fde06357 Merge: 9b923ac3 0e0699aa Author: Kate Friedman <kate.friedman@noaa.gov> Date: Wed Aug 19 09:49:08 2020 -0400 Merge pull request #109 from NOAA-EMC/feature/gfsv16b-restructure GFSv16 restructure for new $COMPONENT subfolder commit 1e76093c8554c3ccb87a7ed243f738f5763ca5da Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Wed Aug 19 13:47:44 2020 +0000 Issue #94 adding waves-prdgen to gfsv16 commit 0e0699aac7cb00988c999546dcdf3a52b11706e3 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 19 13:47:29 2020 +0000 Issue #94 - fix to messed up shebang in setup_expt_fcstonly.py commit c7a708fd54ffe60c6259f35c4230e6e73ecd6f77 Author: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Date: Tue Aug 18 21:16:19 2020 +0000 Issue #94 adding waves-prdgen for gfsv16 commit 0b2744e53a35c570178b7e6cd7ede72b6255c579 Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Fri Aug 14 17:36:31 2020 +0000 Issue #94 - pull in two fixes for wave job setup in free-forecast mode commit 4888001e76d24277b3a75d1d520945383f49d456 Author: Jessica.Meixner <Jessica.Meixner@noaa.gov> Date: Fri Aug 14 18:55:40 2020 +0000 updates for wave scripts to split them, also added updates from GEFS branch to add extra error checking commit 00dc1973010b68e65e176c90a1eeaef359b7beae Author: Kate.Friedman <Kate.Friedman@noaa.gov> Date: Fri Aug 14 17:36:31 2020 +0000 Issue #94 - pull in two fixes for wave job setup in free-forecast mode commit c2a4f04e50ccb45febf55f7985c64a287973dee0 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 14 08:21:01 2020 -0500 Issue #5 - update for COMINsyn on Orion commit fe849e918b30e6a9ca22ebe1a81e350afc4ed6cf Merge: 0c06cda7 9b923ac3 Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Aug 13 18:49:52 2020 +0000 Issue #94 - Sync merge branch 'feature/gfsv16b' into feature/gfsv16b-restructure commit 9b923ac308841d7accfc6ed2a4ef9733dce2305e Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Aug 13 18:37:51 2020 +0000 Issue #1 - update to prod_util version (1.1.3 -> 1.1.4) on WCOSS-Dell for post P1/P2 removal commit bf0bff444bdd8a02e1c875eadbdc6b60628cff76 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 12 10:00:51 2020 -0500 Issue #5 - update to JGFS_CYCLONE_TRACKER for machine=ORION commit 0c06cda7dd667e936e8aa71fc1c584a4839094ba Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 10 18:50:44 2020 +0000 Issue #94 - update CFP module version on WCOSS-Dell commit b73d25224d8208291048b774a91497928b051713 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 10 17:58:55 2020 +0000 Issue #94 - update WCOSS-Dell module versions to prod_util and EnvVars commit 485ee56c1e772e8efa944ee9a3f350130d49a718 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 10 13:00:42 2020 +0000 Issue #94 - fix AWIPS file dependency commit 5a7e45e398efafb4b5b6cde0a69f799a99406d34 Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 7 09:48:45 2020 -0500 Issue #5 - add missing AND condition for wavepostsbs commit bdaa28fbdc2372ed85320a4b044a33d350e2e7be Author: kate.friedman <kate.friedman@noaa.gov> Date: Fri Aug 7 13:34:22 2020 +0000 Issue #94 - updates for FSU tracker commit e8800078f8d00e9447ed81b83eb49135110deb8f Author: kate.friedman <kate.friedman@noaa.gov> Date: Thu Aug 6 14:31:05 2020 -0500 Issue #5 - change UFS_UTILS checkout back to auth repo release/ops-gfsv16 branch after commit to it commit df20d848de2420eacba296ebdf9c9fe68d697351 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 5 15:46:27 2020 -0500 Issue #5 - fix for errant text in setup_workflow_fcstonly.py for waveinit job settings commit 4cee6f65467c34e171ed3e0bdc72458a875e5e21 Author: kate.friedman <kate.friedman@noaa.gov> Date: Wed Aug 5 17:14:04 2020 +0000 Issue #94 - adding -o flag to checkout.sh for optional GTG checkout with EMC_post commit 563d2931378c3d6276212cc9c4e2a4e9a286589c Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Aug 4 18:19:47 2020 +0000 Issue #94 - small fix to updated UFS_UTILS part of link_fv3gfs.sh commit 7c4f8eab074115323a7812dc498e8ea043916718 Author: kate.friedman <kate.friedman@noaa.gov> Date: Tue Aug 4 08:53:39 2020 -0500 Issue #5 - add new APRUNCFP setting to ORION.env commit 5652485ef0cc42f8814df9d08e8b953b025d08b4 Merge: 5cf8a458 d1751309 Author: kate.friedman <kate.friedman@noaa.gov> Date: Mon Aug 3 13:10:27 2020 -0500 Issue #5 - Sync merge branch '…

* add gfs gempak downstream jobs into def file * Issue #94 add waves-prdgen, ICE->ICEC, Sleep in gempak script * Issue #1: update name of DA jobs and scripts in accordance with WCOSS Implementation Standards * Increase walltime for new wavepost jobs * Issue #1: correct DA typos in sorc/link_fv3gfs.sh * deleted relocate_mv_nvortex.fd since storm relocation is no longer needed. modified build_tropcy_NEMS.sh to remove references to relocate_mv_nvortex * Restructured ecflow - up to post step * adding the line to go back a day for RTOFS for the if not NCO section because RTOFS will not be available until 06 cycle * Issue #1: add fhrgrp and fhrlst back to gfsawips in setup_workflow.py (bugfix) * updates for by hour post * Adding wafs wave and downstream jobs * Issue #131 added a path to DBNROOT * Issue #131 reduce scripts output to logfile * Small updates: - new UPP tag - new GLDAS tag - new WAFS tag - new module for WAFS - EE2 updates to awips scripts - added WAFS to archival - break downstream and WAFS archival into separate gfs_downstream tarball - update gfsarch dependencies to wait for all wavepost jobs to complete * Update WAFS tag to gfs_wafs.v6.0.6 * ecflow full day cycle included * Fix for running prep on Hera * Issue #1: update to UPP tag "upp_gfsv16_release.v1.0.15" * Issue #131 Unify dbn_alert path * Issue #1 - fix to link_fv3gfs.sh for new GLDAS tag * Issue #1 - update to UFS_UTILS ops-gfsv16.0.0 tag * Issue #1 - update SEND variables and add DBNROOT to base configs and add check to build_enkf_chgres_recenter_nc.sh for GSI build * updates for optimizing point jobs * renamed: scripts/exglobal_fcst_nemsfv3gfs.sh -> scripts/exglobal_forecast.sh and modified jobs/JGLOBAL_FORECAST parm/config/config.fcst * renamed: jobs/JGFS_POSTSND -> jobs/JGFS_ATMOS_POSTSND renamed: scripts/exgfs_postsnd.sh -> scripts/exgfs_atmos_postsnd.sh modified: docs/archive/README_bufr driver/product/run_postsnd.sh driver/product/run_postsnd.sh.cray driver/product/run_postsnd.sh.dell driver/product/run_postsnd.sh.hera driver/product/run_postsnd.sh.jet parm/config/config.postsnd * In anticipating changes from the GLDAS repo : renaming JGDAS_GLDAS to JGDAS_ATMOS_GLDAS, and exgdas_gldas.sh to exgdas_atmos_gldas.sh modified: driver/gdas/test_gdas_gldas.sh jobs/rocoto/gldas.sh parm/config/config.gldas sorc/link_fv3gfs.sh * Rename scripts to match ecf script naming convention. Add SENDDBN and DBNROOT. Update GLDAS tag. * Update EMC_verif-global tag to verif_global_v1.11.0 * Updated jobs name * 1)Update sorc/checkout.sh with new UPP tag upp_gfsv16_release.v1.0.16. 2)Update sorc/link_fv3gfs.sh with new file name convention for jjob and ex-script of post processing part. * Update Externals.cfg with new UPP tag upp_gfsv16_release.v1.0.16. * Updated scripts * Updated drivers and release notes * Fixing spelling mistake in config.gldas * Name change for tropcy scripts and update WAFS tag * Script name updates for sfc_prep and tracker * Update config.base.nco.static with config.base.emc.dyn changes * Modify each ecflow script with old j-job name for test. Modify the following in each definition file. - ecen family require new extern from previous cycle - Job jgfs_atmos_npoess_pgrb2_0p5deg trigger changed to be (requested from code manager): 1. jgfs_atmos_post_manager:release_post180 - Job jgdas_enkf_select_obs trigger changed to be: 1. previous cycle enkf post complete 2. current cycle jgdas_atmos_analysis_calc complete (new job) Tested as of 9/21/2020 before production switch with following condition: 1. Known issue in wafs gcip. Job failed. Waiting for code manager to fix. 2. obsproc testing still on going. 3. Code manager still updating j-job and ex-script names. Testing in hold until package is ready and WCOSS availability. * As requested from management, point ufs-weather-model to development: b8c5c22 git submodule f61416fef691d9ba39a40df1ce72aa574f54c390 FMS (2019.01.03) 6bc61df FV3 (heads/develop) 9d05172b711f4ab5d6f978dbe575bd67a681b55a NEMS (heads/develop) 96e3f3a8fa0389a4b110b0fa23e7a414f6d92038 WW3 (6.07.1-50-g96e3f3a8) ffdd19bc6c1df747394b7e9958a76238fcd44242 stochastic_physics (ufs-v1.0.0-70-gffdd19b) Remove aerosol from checkout * Update post.sh UPP JJOB script name to submit * Making J-Job naming change accourding to code manager. Remove temp files * modifications to python scripts remove aeroic task from setup_workflow_fcstonly.py delete setup_workflow_fcstonly_noaeroic.py add setup_workflow_fcstonly_aeroic.py * Update WAFS jobs/rocoto scripts to use new JJOB names * Update config.awips for newly named JJOB scripts * Issue #94 add /fakedbn to run DBN_alerts * Issue #1: update vrfy.sh to submit vsdb processing as separate job (only on WCOSS_DELL_P3) * Update gfswafs job to run with loop over fcsthrs * Update GLDAS tag to gldas_gfsv16_release.v1.10.0 * The EMC realtime parallel does not use operational job settings. Ecflow job card roll back the setting from module_used_gfs-16_job google sheet document. * Code manager indicated all wafs jobs wall clock is 30 mins. Code manager indicated job card for scripts/gfs/atmos/gempak/jgfs_atmos_pgrb2_spec_gempak.ecf need to be changed * Issue #1: update parm/config.vrfy to define VSDBJOBSH (used by jobs/rocoto/vrfy.sh) * Jobs were tested with PDY 20200925, code managers from post, gempak, wave, and post process certified the test run result. This merge included an update from high watermark testing (tested by gfs team using devonprod) results impact the following jobs: jgfs_atmos_analysis.ecf jgfs_forecast.ecf jgdas_atmos_analysis.ecf jgdas_enkf_update.ecf jgdas_enkf_ecen.ecf * cleaning up the rearranged scripts * Issue #1: update name of ncdiag executable and source code directory to be conistent * Issue #94 add native grids as default grids * - updated to use 28Sep develop ufs-weather-model, d021e7b f61416fef691d9ba39a40df1ce72aa574f54c390 FMS (2019.01.03) 9e1ba7c FV3 (heads/develop) 9d05172b711f4ab5d6f978dbe575bd67a681b55a NEMS (heads/develop) 96e3f3a8fa0389a4b110b0fa23e7a414f6d92038 WW3 (6.07.1-50-g96e3f3a8) ffdd19bc6c1df747394b7e9958a76238fcd44242 stochastic_physics (ufs-v1.0.0-70-gffdd19b) - changed compilation options in build_fv3.sh - removed fv3gfs.fd_jkh directory since changes are already in develop branch - updated getic script to retrieve files after 00Z 26Feb20 from mass store with prefix name of 'com' * Issue #1 - update WAFS tag to gfs_wafs.v6.0.8 * Issue #94 fix for failing silently * updates for EE2 from waves * last of EE2 changes * update resources and trigger from 192->180 * bug fix in exgfs_wave_post_pnt.sh * fix resource time estimates * reverting changes to configs that were not intented to be committed * Issue #1 - updates for modules and small fixes - fix to run ens_tracker without tclogg module in modulefiles/module_base.wcoss_dell_p3 - fix to sorc/syndat_qctropcy.fd/qctropcy.f for compile warning - fix to gfswaveawipsbulls dependency in setup scripts - update to bufr/11.3.0 from bufr/11.2.0 in modulefiles - add override ability for POE for prep jobs in env/WCOSS_DELL_P3.env * issue #145 change dev path to prod for parallel netcdf modules * issue #145 change dev path to prod for parallel netcdf modules * issue #142 add 6 bufr stations for Thailand TMD * issue #142 add 6 bufr station data * issue #142 generate station i,j grid * issue #142 generate station i,j grid * issue #142 generate station i,j grid * Issue #1 - adjust error handling in wave rocoto job scripts * Issue #1 - update component tags and modulefiles for nwtest lib updates, remove unneeded module load and modulefile from downstream wave job rocoto scripts * Issue #1 - update GSI tag to gfsda.v16.0.0 * Issue #1 - remove unneeded line in vrfy.sh and update link_fv3gfs.sh for UFS_UTILS execs * Issue #1 - config updates from real-time parallel * Issue #1 - update g2tmpl module load in modulefiles/module_base.wcoss_dell_p3 * Issue #1 - update prep job resources * Issue #1 - update config.fv3 based on real-time parallel * Issue #1 - move ABIBF, AHIBF, and HDOB pointers into RUN_ENVIR=emc block * Issue #1 - remove hardcoded POE and BACK values from config.prep * Issue #1 - return POE=YES and BACK=off setting for prep on WCOSS_DELL_P3 * for rocoto add a dependency to wavepostpnt job on wavepostbndpnt so that both jobs will not run at the same time which will slow both jobs down. This is the reason for the dependency, otherwise there is not a "true" dependency between the jobs * Issue #1 - remove unneeded DMPDIR and ICSDIR from config.base.nco.static * Issue #1 - remove POE/BACK block from config.prep and set POE=YES/BACK=off as defaults in env/WCOSS_DELL_P3.env prep section * Issue #1 - update WAFS tag to gfs_wafs.v6.0.9 * Temporarily peg GSI checkout to hash of release branch * add a dependency for the wavepostpnt on wavepostbndpnt for just gfs as this job does not exist for gdas * Modify module for each job to match implementation package change Modify two wafs jobs trigger Modify wall clock and resource for running jobs in NCO Modify obsproc package location * updates to parm to reduce the number of wave variables changes to the config so that wave models are interpolated to the multi_1 masked files for the regional output grids * Issue #1 - update to fbwndgfs modulefiles for WCOSS-Dell and WCOSS-Cray * Change config.resources for eobs for low resolution cases * Issue #1 - update gfs_util modulefiles * Issue #1 - update config.fv3 and config.resources with v16rt2 values * Issue #1 - update WAFS tag to gfs_wafs.v6.0.10 and change WAFS job dependencies * Modify two wafs jobs trigger as: jgfs_atmos_wafs_grib2 trigger ../../post/jgfs_atmos_post_f000 == complete jgfs_atmos_wafs_grib2_0p25 trigger ../../post/jgfs_atmos_post_f036 == complete * Issue #1 - update link_fv3gfs.sh to point to newly frozen fix_nco_gfsv16 FIX_DIR * Modify gfs/gdas post job to 20 minutes in wall clock. * updates to add glo_30m to the created grib files for waves for awips processing * Issue #94 producing awips files with masks and deleting wmo headers for arctic ocean * Issue #1 - adding release notes for GFSv16 * Issue #1 - adjust WAFS dependencies to wait for f036 post output * Add wave env updates into ORION.env, increase waveinit tasks, and update resources for analysis and efcs walltimes * Update .gitignore for script renaming and removed external files * Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support * Issue #1 - new FV3 tag that builds on Hera/Orion and update for building/running high res system on Hera * Issue #1 - save GFSv16 hand-off resource settings into new static nco configs * Issue #1 - add FDATE to config.base * Issue #1 - add parm mon folder to ignore list and move parm section of ignore list up * Issue #1 - pull in corrected npe_eobs values in config.resources * Add UPP netcdf module library load to HERA.env to resolve runtime netcdf version mismatch * Issue #1 - increase C768 npe_eobs to 200 for Hera nodes with less memory * Issue #1 - resource updates from low res testing - set io_layout to "1,1" for low res gfs in config.fcst - set npe_wav[_gfs] to 140 for all resolutions, same wave grid - increase nth_fv3 to 4 for C192 and C384 - set smaller walltime for gfsfcst when resolutions less than C768 * Issue #1 - fix firstcyc queue bug in workflow_utils.py on WCOSS * Issue #1 - add wtime_fcst_gfs time of 4hrs for C384 * Fix wrong DATE in new if-block in config.anal for cold start checking * Issue #1 - increase wavepostbndpnt and wavepostpnt walltimes to give more time on Hera * Cycled warm start run using develop ufs-weather-model branch and feature/ccpp using merged branch on the 10/13 (4da0f) with feature/gfsv16b (31563). CPP_SUITE="FV3_GFS_v16beta" build_fv3 option: CCPP=Y 32BIT=Y SUITES=FV3_GFS_v15,FV3_GSD_v0,FV3_GSD_noah,FV3_GFS_v16beta wave is turned off for this test because it's for atmospheric physics and comparison. * Issue #1 - update WAFS tag to gfs_wafs.v6.0.12 for removal of in-cloud turbulence per AWC * Rename Release_Notes.gfs.v16.0.0.txt to Release_Notes.gfs.v16.0.0.md * Issue #1 - adjust epos groups for DOIAU/DOIAU_ENKF=NO * Issue #1 - update anal, eobs, and eupd resources for low res * Issue #1 - update WAFS tag to gfs_wafs.v6.0.13 * Revert epos change in setup_workflow.py * modified: jobs/JGFS_ATMOS_POSTSND and jobs/rocoto/postsnd.sh to remove redundant variables in the two scripts and make them work for both EMC and NCO parallels. * Issue #1 - update WAFS tag to gfs_wafs.v6.0.14 and update dumpjb version to 5.1.0 * Reduce C384 nth_fv3 to 1 in config.fv3 * Add FDATE calculation to setup scripts and change FDATE in to parsed value in config.base.emc.dyn * Set nth_fcst to 4 for C384 on Hera to handle less memory * Increase gfsfcst walltime for C192 * Tie DOIAU_ENKF to DOIAU and add DOIAU check for IAU_OFFSET and IAU_FHROT in config.base * Set nth_fcst to 4 for C384 deterministic * Hera updates for OUTPUT_FILETYPES and resources * Change wavepostbndpnt to wait for fcst to end * As of 11/12/2020, this package is tested with a C768 cycled (6 cycle) run on Dell system using FV3_GFS_v16beta (imp_physics=11). The wave components are turned off. Ready to merge back to the development. The expdir and log files are available on HPSS: /NCEPDEV/emc-global/1year/Lin.Gan/WCOSS_DELL_P3/feature_ccpp/FV3_GFS_v16beta/FV3_GFS_v16beta-LOG.tar /NCEPDEV/emc-global/1year/Lin.Gan/WCOSS_DELL_P3/feature_ccpp/FV3_GFS_v16beta/FV3_GFS_v16beta-EXPT.tar File parm/config/config.resources has been modified to fix EUPD job issue in job card resource. File sorc/build_fv3.sh and sorc/link_fv3gfs.sh changed to clear up development remark. Removed a developer directory that is not required for FV3_GFS_v16beta confiruration. * Changes to be committed: modified: jobs/rocoto/fcst.sh deleted: modulefiles/module_base.wcoss_dell_p3_fcst deleted: parm/config/config.aeroic modified: parm/config/config.base.emc.dyn modified: parm/config/config.resources modified: sorc/build_fv3.sh modified: sorc/checkout.sh modified: sorc/link_fv3gfs.sh deleted: ush/load_fv3gfs_modules_fcst.sh deleted: ush/rocoto/setup_workflow_fcstonly_aeroic.py * deleted: jobs/rocoto/aeroic.sh * Remove GSD suite file and aero IC extract util * sync config.base.emc.dyn and config.resources with development * modified: parm/config/config.base.emc.dyn parm/config/config.base.nco.static scripts/exglobal_forecast.sh sorc/build_all.sh sorc/build_fv3.sh sorc/checkout.sh to add the option to check out ufs_weather_model and run with CCPP phsyics * Merge with v16ccpp modified: parm/config/config.base.emc.dyn modified: parm/config/config.resources modified: scripts/exglobal_forecast.sh modified: sorc/build_fv3.sh modified: sorc/checkout.sh * update eupd resource * Remove development configuration from config.nsst * modified: ../scripts/exglobal_forecast.sh modified: build_all.sh build_fv3.sh to automatically detect model version, CCPP vs IPD * Modified build_all.sh checkout.sh partial_build.sh to allow switch turn on/off ccpp option Turn on CCPP usage: checkout.sh -c build_all.sh -c Turn off CCPP usage: checkout.sh build_all.sh * Clean up development code from build_all * modified: build_fv3.sh * modified: exglobal_forecast.sh to add min_lakeice = ${min_lakeice:-"0.15"} min_seaice = ${min_seaice:-"0.15"} * bug fix exglobal_forecast.sh * modified: ../parm/config/config.fcst and exglobal_forecast.sh 1. use iovr for model after NCAR/ccpp-physics#514 and iovr_sw and iovr_lw for older version of the model, controled by RUN_CCPP 2. remove the if block and use atmos_model_nml to turn on/off the CCPP option * modified checkout.sh to check out a hash instead of head of the develop branch * modified: ../scripts/exglobal_forecast.sh * Modify exglobal_forecast.sh to create namelist in runable sequence. * As requested, using 2e25df5 for ufs-weather-model. * scripts/exglobal_forecast.sh Merge with v16ccpp * Modify build_all.sh while getopts "oc" option to while getopts "c" option * Fix missing COMROOT setting on Orion * Adjust efcs walltime and eupd thread value on Orion * gfsv16 physics; script updates * update IC scripts * model configure changes; preserve $DATA in postdet * update /driver; /parm and /ecflow folder to match gfsv16 * Revert "update /driver; /parm and /ecflow folder to match gfsv16" This reverts commit 45341b6. * configuration update * preserve /atmos level COM directory * typo fix * Coupled/devmerge (#203) * update to waves scripts for merging with develop - synced with develop where necessary and left changes in prep and gridded post for coupled-crow updates that should remain * removing ecflow scripts that are not in develop branch * removing files from branch that do not appear in develop branch and were not added for coupling in the coupled-crow branch * updating sorc and ush files to match dev when these are not files changes intentionally in coupled-crow branch and therefore should match develop branch * updating files to match develop that were not matching through merge but should match develop branch * cleaning up evn files after merge with develop * cleaning up differences in jobs/rocoto folder from develop branch as it does not seem that the changes here were made intentionally in feature/coupled-crow so this brings us insync with the develop branch * resolving differences between develop and this branch in terms of wave variables for jobs/JGLOBAL_FORECAST * updating module file to match develop * updates for wave model so that the forecast runs -- atm post still does not work * fix typo * Fixes for issue #202 (FINDDATE) and issue #208 (postsnd.sh permissions) * coupled: updates for merging checkout, build and link with develop branch (#206) * update to waves scripts for merging with develop - synced with develop where necessary and left changes in prep and gridded post for coupled-crow updates that should remain * removing ecflow scripts that are not in develop branch * removing files from branch that do not appear in develop branch and were not added for coupling in the coupled-crow branch * updating sorc and ush files to match dev when these are not files changes intentionally in coupled-crow branch and therefore should match develop branch * updating files to match develop that were not matching through merge but should match develop branch * cleaning up evn files after merge with develop * cleaning up differences in jobs/rocoto folder from develop branch as it does not seem that the changes here were made intentionally in feature/coupled-crow so this brings us insync with the develop branch * resolving differences between develop and this branch in terms of wave variables for jobs/JGLOBAL_FORECAST * updating module file to match develop * updates for wave model so that the forecast runs -- atm post still does not work * fix typo * updating .gitignore to match develop a little better * cleaning up differences between checkout and link with merging to develop * updates for build and checkout scripts to unify with develop and simplify build_all to add an option for coupling * fix typo in build all script * updating .gitignore for linked files missing from list * add fix files for ocean post * changing -p to -c option and adding coupled to the ccpp -c * configuration and minor script update for inline post * bug fix for vrfy job in layout file; missing namelist variable fix * updates that are needed after merging * Issue #201 - workaround for failing post000 job before hpc-stack solution * Issue #189 - update ufs-weather-model hash * Coupled/devmerge 3 (#219) * update for making post work without inline post * add in linking capabilities * updating module file so that atm pos will work (#214) Co-authored-by: JessicaMeixner-NOAA <Jessica.Meixner@noaa.gov> * set inline_post off for default file dependencies for post job triggering updated * add new parameters into /default * clean up excessive logic clause in namelist parsing scripts * match default value of some namelist variables * name list update for CCPP suite "FV3_GFS_v16beta_coupled" update CCPP suite selection in test case file create prototype 5.1 case file with updated CCPP suite Making each CCPP suite a selectable option is beneficial, because this could handle future development when they start to differ from each other. * change CCPP suite back to FV3_GFS_v15p2_coupled in case file * bugfix for iovr variables Co-authored-by: lin.gan <lin.gan@noaa.gov> Co-authored-by: kate.friedman <kate.friedman@noaa.gov> Co-authored-by: wx21rph <Roberto.Padilla@m71a1.ncep.noaa.gov> Co-authored-by: russ.treadon <Russ.Treadon@noaa.gov> Co-authored-by: Jessica Meixner <jessica.meixner@noaa.gov> Co-authored-by: fanglin.yang <fanglin.yang@noaa.gov> Co-authored-by: Guang Ping Lou <guang.ping.lou@noaa.gov> Co-authored-by: BoiVuong-NOAA <Boi.Vuong@noaa.gov> Co-authored-by: Wen Meng <wen.meng@noaa.gov> Co-authored-by: Judy.K.Henderson <Judy.K.Henderson@noaa.gov> Co-authored-by: Roberto Padilla <Roberto.Padilla@noaa.gov> Co-authored-by: CoryMartin-NOAA <cory.r.martin@noaa.gov> Co-authored-by: wx21rph <Roberto.Padilla@m71a3.ncep.noaa.gov> Co-authored-by: lgannoaa <37596169+lgannoaa@users.noreply.github.com>

Merge remote-tracking branch 'origin/release/gfsv16.0.0' into release/gfsv16.0.0_to_ops * origin/release/gfsv16.0.0: (1073 commits) Reverting transfer parm file changes committed at 39bab45 Component tag updates for nwprod/gfsv16.0.7 Updated transfer parm files for gdas, enkf, and gfs dissemination Add config.resources.nco.static ecflow forecast job resource updates from NCO v16.0.7 install Add missing symlinks for WAFS source code folders Update EMC_gfs_wafs tag to gfs_wafs.v6.0.19 Remove KEEPDATA from config.base.nco.static Pull in config changes from NCO v16.0.7 install Pull in workflow changes from NCO v16.0.7 install Update EMC_verif-global tag to verif_global_v1.13.4 ecFlow resource adjustments from NCO for forecast and post jobs issue #257 shorten run time on Mars Dell1 file system Update Fit2Obs tag to newm.1.3 for bugfix Update EMC_verif-global tag for Hera bug Pull in nwpara/gfsv16.0.6 updates for parse-storm-type.pl Issue #1 and issue #238 - update Externals.cfg to match checkout.sh updates for v16.0.6 move errchk definition from script to job for wave prdgen and gempak adding definition of errchk which was undefined in these scripts Issue #1 and issue #233 - update GLDAS tag to gldas_gfsv16_release.v1.13.0 Issue #1 and issue #241 - update EMC_verif-global tag Issue #1 and issue #238 - remove ak_10m grid from config.wave and update checkout.sh tags for ufs-weather-model and EMC_gfs_wafs Issue #1 and issue #226 - update UPP tag to upp_gfsv16_release.v1.1.3 in Externals.cfg Issue #1 and issue #226 - update UPP tag to upp_gfsv16_release.v1.1.3 Issue #1 and issue #226 - update exgfs_atmos_grib2_special_npoess.sh for dbn_alert issue #227 reducing output bufr files to 64 levels per NCO request issue #227 reducing output bufr files to 64 levels per NCO request Issue #1: update ecflow to be consistent with NCO's gfs.v16.0.4 and update checkout to bring in new UPP tag (see issue #226) Upaded ush script scale_dec.sh Updated scripts gfs_v16.0 Issue #1 - add grib_util module load to several analysis ecflow scripts Issue #1 - update WAFS tag to gfs_wafs.v6.0.17 for dbn_alert change Issue #1 - correct gridded wave parm files for v16.0.3 Issue #1 - changes from NCO for GFSv16.0.3 Issue #1 - update Externals.cfg with final tags for GFSv16.0.2 Issue #1 - correct permissions on jobs/rocoto/postsnd.sh Issue #1 - update gempak version to 7.3.3 in the ecflow gfs.ver file Issue #1 - update gempak and dumpjb versions to 7.3.3 and 5.1.0 respectively Script alert updates from NCO for wave downstream Add override for COMIN_WAV_RTOFS in emc mode for waveprep job Issue #197: place CDATE specific sections of config.anal and config.prep inside RUN_ENVIR=emc blocks. These sections are use for retrospective parallels and therefore do not need to be executed in operations (NCO). modified: JGLOBAL_FORECAST modified: JGLOBAL_FORECAST to make it work for both emc and nco running environments. modified: JGLOBAL_FORECAST A test showed that jobid is not defined in JGLOBAL_FORECAST running in the Rocoto environment. jobid is defined in ./env files. Defining DATA without sourcing ./env/$nachine.env caused the script to fail. Move the definitin of DATA after sourcing env parameters modified: checkout.sh to use WAFS tag gfs_wafs.v6.0.16 modified: checkout.sh to update UPP to upp_gfsv16_release.v1.1.1, a minor syntax bug fix modified: link_fv3gfs.sh to 1) use hard copies of external fix fields and executable for NCO installation 2) use soft links for all other files and directories for both NCO and EMC installations Compared local files in NCO implementation directory with release/gfs.v16.0.0 branch, changes made by NCO(Jen Yang) in the following files are either accepted or rejected. create a new branch release/gfsv16.0.0.nco to merge changes made by NCO in /gpfs/dell1/nco/ops/nwpara/gfs-v16/gfs.v16.0.1 back to EMC's repository update for the wave parm so that the wave model will look for the correct restart for when gfs is not run every cycle updates for checking if RTOFS files exist and only processing RTOFS files for needed fhr Issue #1 - update WAFS tag to gfs_wafs.v6.0.14 and update dumpjb version to 5.1.0 modified: jobs/JGFS_ATMOS_POSTSND and jobs/rocoto/postsnd.sh to remove redundant variables in the two scripts and make them work for both EMC and NCO parallels. Issue #1 - update WAFS tag to gfs_wafs.v6.0.13 Rename Release_Notes.gfs.v16.0.0.txt to Release_Notes.gfs.v16.0.0.md Issue #1 - update WAFS tag to gfs_wafs.v6.0.12 for removal of in-cloud turbulence per AWC Issue #1 - pull in corrected npe_eobs values in config.resources Issue #1 - update FV3 tag to GFS.v16.0.14 for Hera/Orion build support Issue #1 - adjust WAFS dependencies to wait for f036 post output Issue #1 - adding release notes for GFSv16 Issue #94 producing awips files with masks and deleting wmo headers for arctic ocean updates to add glo_30m to the created grib files for waves for awips processing Modify gfs/gdas post job to 20 minutes in wall clock. Issue #1 - update link_fv3gfs.sh to point to newly frozen fix_nco_gfsv16 FIX_DIR Modify two wafs jobs trigger as: jgfs_atmos_wafs_grib2 trigger ../../post/jgfs_atmos_post_f000 == complete jgfs_atmos_wafs_grib2_0p25 trigger ../../post/jgfs_atmos_post_f036 == complete Issue #1 - update WAFS tag to gfs_wafs.v6.0.10 and change WAFS job dependencies Issue #1 - update config.fv3 and config.resources with v16rt2 values Issue #1 - update gfs_util modulefiles Change config.resources for eobs for low resolution cases Issue #1 - update to fbwndgfs modulefiles for WCOSS-Dell and WCOSS-Cray updates to parm to reduce the number of wave variables changes to the config so that wave models are interpolated to the multi_1 masked files for the regional output grids Modify module for each job to match implementation package change Modify two wafs jobs trigger Modify wall clock and resource for running jobs in NCO Modify obsproc package location add a dependency for the wavepostpnt on wavepostbndpnt for just gfs as this job does not exist for gdas Issue #1 - update WAFS tag to gfs_wafs.v6.0.9 Issue #1 - remove POE/BACK block from config.prep and set POE=YES/BACK=off as defaults in env/WCOSS_DELL_P3.env prep section Issue #1 - remove unneeded DMPDIR and ICSDIR from config.base.nco.static for rocoto add a dependency to wavepostpnt job on wavepostbndpnt so that both jobs will not run at the same time which will slow both jobs down. This is the reason for the dependency, otherwise there is not a "true" dependency between the jobs Issue #1 - return POE=YES and BACK=off setting for prep on WCOSS_DELL_P3 Issue #1 - remove hardcoded POE and BACK values from config.prep Issue #1 - move ABIBF, AHIBF, and HDOB pointers into RUN_ENVIR=emc block Issue #1 - update config.fv3 based on real-time parallel Issue #1 - update prep job resources Issue #1 - update g2tmpl module load in modulefiles/module_base.wcoss_dell_p3 Issue #1 - config updates from real-time parallel Issue #1 - remove unneeded line in vrfy.sh and update link_fv3gfs.sh for UFS_UTILS execs Issue #1 - update GSI tag to gfsda.v16.0.0 Issue #1 - update component tags and modulefiles for nwtest lib updates, remove unneeded module load and modulefile from downstream wave job rocoto scripts Issue #1 - adjust error handling in wave rocoto job scripts issue #142 generate station i,j grid issue #142 generate station i,j grid issue #142 generate station i,j grid issue #142 add 6 bufr station data issue #142 add 6 bufr stations for Thailand TMD issue #145 change dev path to prod for parallel netcdf modules issue #145 change dev path to prod for parallel netcdf modules Issue #1 - updates for modules and small fixes reverting changes to configs that were not intented to be committed fix resource time estimates bug fix in exgfs_wave_post_pnt.sh update resources and trigger from 192->180 last of EE2 changes updates for EE2 from waves Issue #94 fix for failing silently Issue #1 - update WAFS tag to gfs_wafs.v6.0.8 Issue #94 add native grids as default grids Issue #1: update name of ncdiag executable and source code directory to be conistent cleaning up the rearranged scripts Jobs were tested with PDY 20200925, code managers from post, gempak, wave, and post process certified the test run result. Issue #1: update parm/config.vrfy to define VSDBJOBSH (used by jobs/rocoto/vrfy.sh) Code manager indicated all wafs jobs wall clock is 30 mins. Code manager indicated job card for scripts/gfs/atmos/gempak/jgfs_atmos_pgrb2_spec_gempak.ecf need to be changed The EMC realtime parallel does not use operational job settings. Ecflow job card roll back the setting from module_used_gfs-16_job google sheet document. Update GLDAS tag to gldas_gfsv16_release.v1.10.0 Update gfswafs job to run with loop over fcsthrs Issue #1: update vrfy.sh to submit vsdb processing as separate job (only on WCOSS_DELL_P3) Issue #94 add /fakedbn to run DBN_alerts Update config.awips for newly named JJOB scripts Update WAFS jobs/rocoto scripts to use new JJOB names Making J-Job naming change accourding to code manager. Remove temp files Update post.sh UPP JJOB script name to submit Modify each ecflow script with old j-job name for test. Update config.base.nco.static with config.base.emc.dyn changes Script name updates for sfc_prep and tracker Name change for tropcy scripts and update WAFS tag Fixing spelling mistake in config.gldas Updated drivers and release notes Updated scripts Update Externals.cfg with new UPP tag upp_gfsv16_release.v1.0.16. 1)Update sorc/checkout.sh with new UPP tag upp_gfsv16_release.v1.0.16. 2)Update sorc/link_fv3gfs.sh with new file name convention for jjob and ex-script of post processing part. Updated jobs name Update EMC_verif-global tag to verif_global_v1.11.0 Rename scripts to match ecf script naming convention. Add SENDDBN and DBNROOT. Update GLDAS tag. In anticipating changes from the GLDAS repo : renaming JGDAS_GLDAS to JGDAS_ATMOS_GLDAS, and exgdas_gldas.sh to exgdas_atmos_gldas.sh renamed: jobs/JGFS_POSTSND -> jobs/JGFS_ATMOS_POSTSND renamed: scripts/exgfs_postsnd.sh -> scripts/exgfs_atmos_postsnd.sh modified: docs/archive/README_bufr driver/product/run_postsnd.sh driver/product/run_postsnd.sh.cray driver/product/run_postsnd.sh.dell driver/product/run_postsnd.sh.hera driver/product/run_postsnd.sh.jet parm/config/config.postsnd renamed: scripts/exglobal_fcst_nemsfv3gfs.sh -> scripts/exglobal_forecast.sh and modified jobs/JGLOBAL_FORECAST parm/config/config.fcst updates for optimizing point jobs Issue #1 - update SEND variables and add DBNROOT to base configs and add check to build_enkf_chgres_recenter_nc.sh for GSI build Issue #1 - update to UFS_UTILS ops-gfsv16.0.0 tag Issue #1 - fix to link_fv3gfs.sh for new GLDAS tag Issue #131 Unify dbn_alert path Issue #1: update to UPP tag "upp_gfsv16_release.v1.0.15" Fix for running prep on Hera ecflow full day cycle included Update WAFS tag to gfs_wafs.v6.0.6 Small updates: - new UPP tag - new GLDAS tag - new WAFS tag - new module for WAFS - EE2 updates to awips scripts - added WAFS to archival - break downstream and WAFS archival into separate gfs_downstream tarball - update gfsarch dependencies to wait for all wavepost jobs to complete Issue #131 reduce scripts output to logfile Issue #131 added a path to DBNROOT Adding wafs wave and downstream jobs updates for by hour post Issue #1: add fhrgrp and fhrlst back to gfsawips in setup_workflow.py (bugfix) adding the line to go back a day for RTOFS for the if not NCO section because RTOFS will not be available until 06 cycle Restructured ecflow - up to post step deleted relocate_mv_nvortex.fd since storm relocation is no longer needed. modified build_tropcy_NEMS.sh to remove references to relocate_mv_nvortex Issue #1: correct DA typos in sorc/link_fv3gfs.sh Increase walltime for new wavepost jobs Issue #1: update name of DA jobs and scripts in accordance with WCOSS Implementation Standards Issue #94 add waves-prdgen, ICE->ICEC, Sleep in gempak script add gfs gempak downstream jobs into def file worked on wcoss ecflow script rename after redesign approved - not including all wave jobs Issue #1: clean up DA sections of link_fv3gfs.sh fix from Bhavani for having first wave grib file be set as a forecast instead of analysis fix from Bhavani for having first wave grib file be set as a forecast instead of analysis fix from Bhavani for having first wave grib file be set as a forecast instead of analysis ecflow gfs v16 nco review 3 updates to split boundary points plus saving config file updates Adding missing space to if-block in env files to resolve runtime failure Issue #1: remove pgrb2b.0p25 dependency from gfsawips in setup_workflow.py ecflow gfsv16 redesign 2 Issue #1 - update WAFS tag to gfs_wafs.v6.0.4 and remove HOURLY variable from WAFS configs Issue #1 - change wavegempak and waveawipsgridded dependency to match waveawipsbulls and start when wavepostsbs is complete Issue #1: set n_sponge=42 in gfs section of config.fcst adding pnt jobs as seperate jobs for env moving definitions of wavempexec and wave_mpmd from jobs to env Remove unneeded settings from config.post Added null DBNROOT to wave awips configs add extra script for by hour points for waves updates for boundary points by hour parallelization lowering the resource requirement for wave prep job Issue #1: rename enkf_chgres_recenter executables in accordance with WCOSS Implementation Standards modified: checkout.sh to use gldas_gfsv16_release.v1.6.0 update module for cdo Update to WAFS tag and added SENDDBN_NTC to both base configs modified: link_fv3gfs.sh to not link or copy 0readme fix_chem fix_fv3 fix_sfc_climo which are not used by GFS.v16 and are of large size modified: link_fv3gfs.sh to remove chgres_cube.fd and chgres_cube.fd in sorc/link_fv3gfs.sh modified: link_fv3gfs.sh to allow "fix" directories to be removed before rerunning link_fv3gfs.sh for RUN_ENVIR=nco case Added WAFS jobs to free-forecast mode, updates for extending WAFS to fh120, and two bug fixes in link_fv3gfs.sh and hpssarch_gen.sh Renamed global-workflow-owned ex-scripts to remove ecf extension and updated other scripts which call those ex-scripts Remove UFS_UTILS ecf extensions Issue #1: (1) update earc.sh directory removal to be consistent with arch.sh, (2) update config files to be consistent with EMC real-time GFS v16 parallel Remove ecf script name extensions from downstream wave scripts Add new downstream wave jobs to workflow Add new downstream WAFS jobs Issue #1 - update GLDAS and UPP workflow files for removal of ecf script extension Issue #1: remove ".ecf" suffix from DA scripts referenced in sorc/link_fv3gfs.sh Issue #1: remove ".ecf" extension from DA exscripts (as per WCOSS Implementation Standards) referenced from parm/config files updates to resources for wave jobs Issue #1: update name of DA enkf chgres script in config.echgres Issue #1: Rename DA enkf chgres job and script as per EE2 guidance Workflow changes for wave gempak and awips downstream jobs Fixing wavepostbndpnt dependency in setup_workflow_fcstonly.py ... * conflicts resolved Refs: #1

* Initialize 'recname' array to blank-fill array and avoid GNU compiling errors * DTC Sync: Add gtg stub routines to community makefile * DTC Sync: Use 'INCLUDE mpif.h' instead of 'use mpi' for community portability * DTC Sync: Declare 'recname' array with blanks to avoid compiling errors with GNU for community * Temporary hack for community testing until EMC provides fix * DTC Sync: Add and update initialization routines for NMM binary read. These have not been used operationally for a while. This commit is merely to sync the community and emc code bases * Link data files in run_unipost scripts for updated CRTM * First stage in removing WRF dependency: if you copy in the frame/, main/, and external/ directories from a successful WRF build, this version compiles and runs successfully * Second stage in removing WRF dependency: Now contains a new directory "wrf_io/" with its own makefile for building the relevant WRF code. Now you no longer have to pre-build WRF, only run the configure script to create a configure.wrf file. To build this version: - Copy in the external/, frame/, inc/, main/, Registry/, and tools/ directories from the RAW UNBUILT WRF source code into the new wrf_io/ directory - Copy in a configure.wrf file created with that same WRF source code Should be able to pare down the above list soon, many of them are only needed for one or two files (or perhaps ultimately none) This version was tested with the WRF V4.0 Friendly Release NOAA-EMC#3 (git hash e96ef955), but it should work for a wide range of WRF code * Adding a basic .gitignore file * AR should not be defined with flags, this can be different for some platforms * Third stage in removing WRF dependency: configure.wrf file no longer included in wrf_io makefile * Adding some makefiles to track their changes * Updating clean rules to fully clean wrf_io stuff * Fourth stage in removing WRF dependency: configure.wrf no longer required! - Added "wrf_makerules" file to be included in a couple makefiles - Contains configure.wrf preamble and postamble, but no platform-specific stuff! - Still need to copy over WRF directories, *and* properly check out the versioned files - Modified frame Makefile to remove an unnecessary compilation - Hopefully a lot more of this in the future! * Versioning WRF files in frame/ directory. No longer need to copy this directory in from WRF. * Fifth stage in removing WRF dependency: frame/ and main/ no longer need to be copied in to wrf_io/ directory - Versioned the necessary files in frame/ from the WRF build. - Moved depend.common from main/ to frame/, and versioned it - Build libwrflib.a in the wrf_io/ directory instead of wrf_io/main/ * Fix hard-coding of netCDF path. Don't think it was causing problems but hard-coding is bad, mmkay * Finally started testing other platforms/options. This commit fixes serial compile. Tests now work for options 7 and 8 (gfortran serial and parallel) - Link in already existing UPP stub mpi library files for WRF serial build - Use already existing "sw_dmparallelflag" switch from configure to pass -DSTUBMPI flag for serial builds - Remove clog.o file which is only needed for log file buffering, which is rarely used in WRF and certainly not supported for UPP. - While removing log file buffering, also remove a lot of other unsupported CPP ifdefs * Properly add serial flags. Not sure why the previous version was working... * Clean out the remnants of the platform-specific wrf_makerules. * More wrf_makerules cleanup * Even more wrf_makerules cleanup * Continuing wrf_makerules cleanup, adding to-do list under version control * Removing a lot more unnecessary make rules.; * Remove registry requirement, and version necessary tools/ files * Adding a bunch of external io source code * Remove inc/ dependency...very close to removing all WRF dependency! Move inc files to frame * Added rest of external libraries, now just testing to go! * Delete todo * Get rid of diffwrf, stub-ify wrf_debug * Remove wrf_debug completely. There, one WRF routine down, seventeen thousand to go... * Remove ESMF dependence. Lots of line savings here! * Remove WRF grib1 stuff, really making progress now! * Remove rest of WRF grib stuff, references to UPP libs from WRF * Removing fftpack * Get rid of some "undefined reference" warnings * Move module_internal_header_util and intio_tags to io_int directory * Remove module_wrf_error, add some stub routines to compensate * Remove module_machine * Remove module_driver_constants and wrf_shutdown * Tools directory removed! * Removing ioapi_share directory, redistributing necessary include files * libwrf no longer necessary * Remove a whole bunch more residual WRF crap. Mostly unnecessary and/or unused variables and CPP flags. * Remove module_wrfsi_static * Remove WRF links from unipost run script; include necessary lookup tables in parm/ directory * Remove unnecessary subroutines from pack_utils * Delete a whole bunch more unneeded flags and variables * Remove unnecessary netCDF code * Remove frame directory, final step before consolidating everything in its final location - Remove some old WRF mpi stub stuff - Move pack_utils to io_int directory and build it there - Remove a couple more unnecessary makefile items - Remove now-defunct frame directory and associated make/clean rules * Remove a test routine and an unnecessary variable * A bunch more stuff stripped out. - Remove unused variable from io_int.F90 - Remove unused module module_io_int_read - Remove old logic involving 4DVAR - Remove a bunch more unneeded/unused makefile variables * Start moving code to final location: move io_int code to wrf_io top directory * Continue moving WRF code to its final location: move io_netcdf code to wrf_io top directory * Move WRF remnants to their final location: src/lib/wrf_io * Deprecate capability to read WRF binary I/O files * Remove rest of WRF binary I/O code - Remove binary I/O code and makefiles - Add a stub "wrf_message" routine to wrf_io.F90 (the netCDF I/O routine) * Some final touch-ups to this code before rigorous testing. - Condense wrf_makerules and roll it into the main wrf_io makefile - Remove some unipost source files which are unnecessary without wrf binary IO - Remove old "Makefile_nowrf" which was from an old partial attempt to remove WRF depepndency * Remove old changes inadvertantly included in removal of WRF dependency * Update ip libraries to v3.0.0 * Update g2 libraries to v3.1.0 * Update sigio libraries to v2.1.0 * Update g2tmpl libraries to v1.5.0 * update version info/log * Updating UPP run scripts and Adding V4 Users Guide * Add GFS config files and update run scripts * Update V4 UG * Adding "-w" flag to wrf_io makefile to suppress "Unrecognized directive" warnings * Update V4.0 UG required libraries section * Bug fix for nemsiompiio format for FV3GFS processing * Edit version info for updated nemsio library to v2.2.2 and bug fix uppv4.0.1 * Nemosio fix for serial built from Laurie. * modifying scripts to use binarynemsiompiio format for FV3 * Modify error message to reflect binarynemsiompiio * Jira NOAA-EMC#121 Fix typo in Wind Energy Calculation (UPP ID 411) in MDL2AGL.f * Jira NOAA-EMC#122 Fix error that grabs incorrect EL level for TAUX/TAUY calculation in CALTAU.f * Jira NOAA-EMC#131 Fix error in pname for updraft helicity in post_avblflds.xml * Jira NOAA-EMC#132 Fix incorrect grib codes in RQSTFLD.f for wind shear variables * Jira NOAA-EMC#135 Fix allocation issue for PSFC in Block 2 of SURFCE.f * Jira NOAA-EMC#136 Fix typo in CALRAD_WCLOUD_newcrtm.f of incorrect iget ID for INSAT 3D select_channels_L call * Jira NOAA-EMC#139 Remove 10 m POT/SPFH from wrf params - not available for wrf output * Fix mods for selecting satellite channels in CALRAD_WCLOUD_newcrtm.f and SELECT_CHANNELS.f * modify makefile to conditionally add mpi stubs for serial builds, instead of always including by default * Modified GRIB1 Table lyx doc for available satellite channels/levels * Fix allocation issue for PSFC in Block 2 * Fix mods for selecting satellite channels in CALRAD_WCLOUD_newcrtm * Fix grib codes in RQSTFLD.f for wind shear variables * Fix incorrect EL level for TAUX/TAUY calculation * Fix typo in Wind Energy Calculation (UPP ID 411) * Fix index for SEVIRI * Fix index for SEVIRI * Manual sync of EMC mods to comupp * Add new routines to makefile * Update crtm submodule to v2.2.3.1_subset tag to include GOES-R/abi* fix files * Add abi* coefficient files to run scripts for GOES16 products * Remove extraneous great than sign * Comment out #if for testing. PGI and GNU fail with this syntax * Remove extraneous greater than sign * Revert MXLVL back to 70. Comment out #if 0 lines. * Remove nmm-binary read file. No longer supported * Add community contorl filse and update others * Chain make commands with "&&" instead of ";", this prevents infinite loop when you call clean script under certain circumstances (like when you forget to check out the crtm submodule) * Initial progress in new build system: - add NCEPLIBS_DIR environment variable into configure.upp - use NCEPLIBS_DIR to point to external build of wrfio libraries - Remove our build of wrf_io in favor of external build Compile tested only on Cheyenne, gnu compilers for now * Missed one change to properly build with external WRF libs * Removing netCDF discovery dialogue. We should not try to be cute or clever. If the user wants NETCDF they should be able to set a variable or make some links. * Revamping how we check for JASPER libraries/include files. Old code incorrectly and unexpectedly defaulted to a (typically) non-existant location for JASPERLIB and JASPERINC. In keeping with the 'Let the configure script fail'(TM) philosophy I'm trying to instill here, if the user does not set JASPER or JASPERLIB and JASPERINC variables, unless one of the old default locations exists, the configure script will fail with an error message. Users can overwrite this message by setting NOGRIB2 environment variable, but support for GRIB1 will be going away in the not-so-distant future! * Deleting old deprecated makefiles clogging up src/unipost * Use consistent JASPER variables between UPP and NCEPlibs. Allow old JASPER variables for back-compatibility * Use external GRIB2 (g2 and g2tmpl) library builds. Tested on Cheyenne for gnu compilers so far. * Got unipost to build with all (possible) external libraries * ndate and copygb also build with external libraries (cheyenne, gnu) * Since we no longer have a native copy of "params_grib2_tbl_new" file from g2tmpl libraries, we need to link it in from NCEPlibs in the run scripts * The big merge is here! Moved all the comupp framework to the top level. This includes the following moves/renames: comupp/c* --> configure|compile|clean comupp/makefile --> makefile comupp/arch/ --> sorc/arch comupp/src/lib --> sorc/comlibs (this includes crtm submodule!) comupp/src/unipost/makefile --> sorc/ncep_post.fd/makefile_dtc Modifications had to be made to clean/configure/compile scripts, as well as the community makefiles and Config.pl, to accomodate the new directory structure and naming schemes. Additionally, there was one divergence point between the community source code and the ncep source code: GFSPOST was split into GFSPOST and GFSPOSTSIG. This version compiles successfully, but the merge is not really finished. Lots more work before this is considered a complete merge. * Remove top-level makefile to simplify things * Removing the last of the external libraries * Under comupp, moving contents of docs/ parm/ and scripts/ to corresponding top-level directories. A few files in comupp/parm/ remain since they have files in the top-level parm/ that have differences; Tracy is sorting those out. * Modify clean and compile scripts for proper directory navigation; this was causing the clean script to fail to remove the old configure.upp file * In clean script, only try to find custom make command if configure.upp exists and is not empty * Overhaul ncep_post build script: use bash instead of sh, machine name is now a command-line argument * Using feedback from Tracy, removing or renaming the rest of the files in comupp/parm. Now everything should be in the top-level parm/ directory * Add top-level .gitignore file so git will not track compilation files such as configuration files, .exe, .o, and .mod * Updating community runscripts - Copy compiled executable to exec/ directory instead of bin/, mirroring ncep build - Update runscripts - Replacing references to ndate with `date` utility (thanks to Ka Yee Wong) - Removing references to copygb - Reference new location of executable in exec/ rather than bin/ - Reference post_avblflds_comm.xml rather than post_avblflds.xml Did not update global runscript as this appears to be unsupported anyway * Should not try to set NETCDF environment variable; if it was not already taken care of in the configure step something has already broken anyway * Convert clean and compile scripts to bash to match other scripts (and avoid using the non-recommended csh varieties). Also a bit of cleanup of my sloppy handling of directory switching in these scripts * One more csh->bash change: need to use !-s test instead of -z * A few more tidying changes for clean: restore use of printf to get newlines, echo all the clean -a remove statements * Allow ncep_post compilation from ./compile script by providing argument * Removing the last of the comupp remnants * Fix dumb mistake: need to actually create the exec directory we want to use! * Add Darwin, gnu stanza to configure.defaults * Accidentally removed last NULL stanza from configure.defaults; this could cause weird failures * Prepping configure architecture to allow individual locations of NCEP libs to be specified - Rather than just setting NCEPLIB_DIR in configure.upp, now use that environment variable to set the library and include files in configure.upp - Remove old, obsolete definition of WRF_DIR in configure.upp * One last overhaul of configure system - Add framework (but not functionality) for NCEP libraries to be linked individually - Handle the inclusion of NCEPLIBLIB and NCEPLIBINC in configure script rather than Config.pl - This will allow easier handling of multiple library and include paths once the full functionality is added - Gracefully handle unsupported platforms; if OS/MACH combo is not available don't even use Config.pl * Forgot to remove some debug prints from configure script * Continuing overhaul of configure system to allow linking of libraries individually - Set up array of required directories, and remove directories as they are detected. If all required directories are found with the appropriate files, NCEPLIBS is not required - This is only completed for library files, not other required files - Fix sed issues that wouldn't substitute properly for strings with spaces in them - Add in an echo line that somehow got removed * One final intermediate commit on new config system before the big finale - Forgot to add exit statements to failure conditions when library files are missing - Accidentally left some important lines commented - Fix some indentation * Configure system now fully mix-and-match configurable for NCEP libraries - All include files now included as well. I'm kind of shocked at how few include files are actually necessary... - Use an array for directories where multiple files from the same library are needed - Remove some old comments and echo statements * A few miscellaneous improvements to configure script - Explicitly reference bash rather than sh in shebang - A few more detailed comments - Remove unnecessary assignment of input argument * More portable solution for GRIB2 table: use already existing params_grib2_tbl_new in top-level parm directory * Fix locations of params_grib2_tbl_new and crtm coefficient files * Adding version numbers and precision info to library names Since UPP specifically needs 4-byte reals in its libraries we should specify this in the library names rather than leaving it ambiguous This also follows standard EMC naming conventions so ideally we can use libraries from any source Furthermore, if a different library version is desired, it can be specified using an environment variable at configure time * Remove jasper requirement; this is obsolete since it is only needed for compiling GRIB2 libraries * Add mods from develop * Update dtc makefile to compile new routines * Add check to configure script to ensure CRTM submodule has been checked out * fix for filling a handful of 2d variables currently causing a divide-by-zero error when run in debug mode. Currently filled with 'k' which fills with zeros Needs to fill with 'll' which is what's being filled within the larger loop and different index value than 'k' * Fix ID index in WRF-CHEM SMOKE block, which currently causes failed build in debug mode * Modification to makefile for compiling new routines added from develop * Remove blank line from params_grib2_tbl_new that causes memory fault for certain cases ran with GNU * Add the flat file name (postxconfig-NT.txt) to fix the itag bug for GFS case. * Change MXLVL back to 70 for COMMCODE in RQSTFLD.F * Add if-statement for imp_physics when calling GSD VIS (dependency is that imp_physics=28) * Fix the way that the parameter 'rg' is read in, should be read in from params.F * Temporarily restoring the ability to run build_ncep_post.sh without an argument. * Turn off 2 fields not available for ARW, which were causing seg faults during run time * Initialize n_clouds=0 and print msg, when not defined for certain mp_physics * 1) Initialize variables as zero that were not initialized for ARW, causing failures in debug mode 2) Comment out 2 lines in INITPOST.F that were causing failures in debug mode * Add v4.1-beta UG * Add new HWRF routine * Allocate/deallocate HWRF variables * Add HWRF variables * Add cd10 and ch10 code for HWRF * Add new HWRF vars to rqstflds * Add new HWRF routine to community makefile * Add NMM model for HWRF * WRF-NMM has no data for certain fields at the boundary. Add code to mask out the outermost rows and columns if maptype==203 * Correct typo made when adding support for advected Ferrier-Aligo microphysics * Add Himawari sensors * Removing serial option for this release * Better solution to avoid changing option numbering: if users select a serial option, output an error message * Updated submodule to new tag v2.2.3.2_subset to include Himawari files * Add Himwari sensors to list * Fix typo in grib tables * Change name of UPPV4.1 users guide * Add link to Himawari fix files in run scripts * Switch to updated Himawari fix files for testing * Updates to v4.1 UG * Fix Out of Bound Exception in GFSPOST.F (NOAA-EMC#100) * Fix out-of-bound error in tpause routine in GFSPOST.F * Fix use of undefined variables. * Updating CRTM submodule tag to include Himawari fix file * Added the FV3 netcdf option and updated the netcdf format check for FV3 option. * Update run_unipost * Update run_unipostandgempak * Update run_unipostandgrads * Update parameter files and remove some duplicate parameter files * Update scripts with bug fix for FV3GFS data and minor file link corrections * Minor updates to fields file info * Add GOES 16/17 to GRIB2 table, update release tag in UG * remove redundant line * Add extra space character to obslist to fit himarwari * Add Himawari-8 for grib2 * Link Himawari-8 coefficient files in run_unipost script * Add new HWRF routine to EMC makefile * Changed HWRF's CD/CH exchange coeff UPP IDs to 922 and 923 to avoid conflict with Himawari number set * Set n_clouds to zero to avoid crashes. This got removed in merge somehow * Remove old lyx doc files * Remove old run scripts * Initialize aerosol coeffs and remove mp check to avoid failures * Add Himawari coefficients to list of crtm files to link * Modify UPP IDs for Himawari fields to avoid conflict with other model output * Increase MXFLDS to accommodate new Himawari IDs * Fix index for Himwarai channel 7 * Add Orion and Odin back into build script * Change lowercase o to uppercase O for orion * Add Orion and Odin to list of machines * Save DTC grib2 table and restore develop branch version to be default Co-authored-by: Kate.Fossell <Kate.Fossell@noaa.gov> Co-authored-by: Wen Meng <wen.meng@noaa.gov> Co-authored-by: Tracy <tracy.hertneky@noaa.gov> Co-authored-by: Michael Kavulich, Jr <michael.kavulich@noaa.gov> Co-authored-by: kayee <kayee.wong@noaa.gov> Co-authored-by: Michael Kavulich, Jr <kavulich@ucar.edu> Co-authored-by: Tracy <hertneky@ucar.edu> Co-authored-by: Kate Fossell <you@example.com> Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>

This was referenced Sep 15, 2020

Issue #131 EE2 compliance changes to Feature/gfsv16b bufr sounding #133

Closed

Issue # 131 EE2 compliance for postsnd in Feature/gfsv16b #134

Closed

GuangPingLou-NOAA closed this as completed Sep 18, 2020

kayeekayee pushed a commit to kayeekayee/global-workflow that referenced this issue May 30, 2024

Update for GFDL_atmos_cubed_sphere (dycore GNU bugfix) (NOAA-EMC#131)

ea71b79

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

EE2 compliance, dbn_alert issues and err_chk #131

EE2 compliance, dbn_alert issues and err_chk #131

GuangPingLou-NOAA commented Sep 15, 2020

KateFriedman-NOAA commented Sep 17, 2020

GuangPingLou-NOAA commented Sep 17, 2020

GuangPingLou-NOAA commented Sep 18, 2020

EE2 compliance, dbn_alert issues and err_chk #131

EE2 compliance, dbn_alert issues and err_chk #131

Comments

GuangPingLou-NOAA commented Sep 15, 2020

KateFriedman-NOAA commented Sep 17, 2020

GuangPingLou-NOAA commented Sep 17, 2020

GuangPingLou-NOAA commented Sep 18, 2020