-
Notifications
You must be signed in to change notification settings - Fork 8
/
Copy pathRelease_Notes.txt
392 lines (319 loc) · 13.6 KB
/
Release_Notes.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
prepobs v1.1.0 RELEASED AUG ??, 2023
v1.1.? IMPLEMENTED ??? ??, 2023
PRELUDE
This update supports obsproc.v1.2.0 and bufr-dump.v1.2.0 releases.
obsproc.v1.2.0 and bufr-dump.v1.2.0 introduce two new dump files:
*satwhr* - satellite AMVs tailored for hurricates, developed at UW/CIMSS, use tank b005/xx099
- CONUS domain AMVs at time resolution of 15-20 minutes, NESDIS prouct, use tanks b005/xx052..xx056
*uprair* - BUFR formated high-res rawinsondes(radiosondes),part of worldwide TAC2BUFR migration, use tanks b002/xx101..xx105
- *uprair* data is added to prepbufr files,to the prepbufr's ADPUPA component
prepobs.v1.1.0 adds *uprair* to prepbufr's ADPUPA component
The prepobs post step adds capability to unrestrict aircraft data (on demand, by default PROCESS_REMOREST_dm2=NO)
FILE CHANGES
M CMakeLists.txt
D README.md
D VERSION
D build.sh
A docs
A docs/README.md
A docs/Release_Notes.txt
A fix/prepobs_landc
M fix/prepobs_prep.bufrtable
A fix/syndat_syndata.slmask.t126.gaussian
A modulefiles/prepobs_jet.lua
M scripts/exprep_post.sh
M sorc/prepobs_cqcbufr.fd/CMakeLists.txt
M sorc/prepobs_mpcopybufr.fd/CMakeLists.txt
M sorc/prepobs_prepdata.fd/CMakeLists.txt
M sorc/syndat_syndata.fd/CMakeLists.txt
M sorc/prepobs_cqcbufr.fd/cqcbufr.f
M sorc/prepobs_cqcbufr.fd/radcor.f
M sorc/prepobs_mpcopybufr.fd/CMakeLists.txt
M sorc/prepobs_mpcopybufr.fd/mpcopybufr.f90
M sorc/prepobs_oiqcbufr.fd/oiqcbufr.f
M sorc/prepobs_prepdata.fd/CMakeLists.txt
M sorc/prepobs_prepdata.fd/iw3unpbf.f
M sorc/prepobs_prepdata.fd/prepdata.f
M sorc/syndat_syndata.fd/CMakeLists.txt
M sorc/syndat_syndata.fd/syndata.f
A ush/build.sh
M ush/gdas_counts.sh
M ush/gdas_summary.sh
M ush/prepobs_makeprepbufr.sh
D versions/README
A versions/VERSION
(M-modified; A-added; D-deleted)
NOTE:
fix/prepobs_landc and
fix/syndat_syndata.slmask.t126.gaussian
were not released from EMC to NCO during the transition to WCOSS2. However they appear in $PACKAGEROOT
Thus, for consistency, they were added to this release
ROOT LEVEL CHANGES
CMakeLists.txt
Reflect moving file VERSION from root level to directory /versions
README.md
Moved to directory /docs
VERSION
Moved to to directory /versions
build.sh
Reflect changes to support functionality on Jet
DOCS CHANGES
docs
Introduce directory for all documents
docs/README.md
Move REDME.md from root level to /docs
docs/Release_Notes.txt
Updated for this release.
FIX CHANGES
fix/prepobs_landc
fix/syndat_syndata.slmask.t126.gaussian
These files were not released from EMC to NCO during the transition to WCOSS2. However they appear in $PACKAGEROOT
Thus, for consistency, they were added to this release
fix/prepobs_prep.bufrtable
Introduce UPRAIR (from *uprair* dumps) to prepbufr's bufrtable
MODULEFILES
modulefiles/bufrdump_jet.lua
Support obsproc functionality to jet
SCRIPTS CHANGES
scripts/exprep_post.sh
Add functionality to unrestrict aircraft data, this feature is meant to be used in development environmet
SOURCE CHANGES
sorc/prepobs_cqcbufr.fd/CMakeLists.txt
Replace obsolete bufr_4_DA library with bufr_4 which uses Dynamic Allocation by default (in bufr/v11.6 and later)
sorc/prepobs_cqcbufr.fd/cqcbufr.f
Increase array sizes to accomodate upper air data (MXMSGL,MAXSS,MAXOUT,NST,MAXOBS)
sorc/prepobs_cqcbufr.fd/radcor.f
Increase NST to match sorc/prepobs_cqcbufr.fd/cqcbufr.f
sorc/prepobs_mpcopybufr.fd/CMakeLists.txt
Replace obsolete bufr_4_DA library with bufr_4 which uses Dynamic Allocation by default (in bufr/v11.6 and later)
sorc/prepobs_mpcopybufr.fd/mpcopybufr.f90
Increase array sizes to accomodate upper air data (MXMSGL,MAXSS)
Introduce functionality for adding upper air data (*uprair*) to prepbufr's ADPUPA
sorc/prepobs_oiqcbufr.fd/oiqcbufr.f
Increase MAXOUT
sorc/prepobs_prepdata.fd/CMakeLists.txt
Replace obsolete bufr_4_DA library with bufr_4 which uses Dynamic Allocation by default (in bufr/v11.6 and later)
sorc/prepobs_prepdata.fd/iw3unpbf.f
Introduce functionality for adding upper air data (*uprair*) to prepbufr's ADPUPA
Introduce functionality to use GNSS-measured drift info from *uprair* dumps and add to prepbufr file
sorc/prepobs_prepdata.fd/prepdata.f
Introduce functionality for adding upper air data (*uprair*) to prepbufr's ADPUPA
Introduce functionality to use GNSS-measured drift info from *uprair* dumps and add to prepbufr file
sorc/syndat_syndata.fd/CMakeLists.txt
Replace obsolete bufr_4_DA library with bufr_4 which uses Dynamic Allocation by default (in bufr/v11.6 and later)
sorc/syndat_syndata.fd/syndata.f
Increase MXMSGL, MAXSS, MAXOUT to accomodate the additional BUFR formated upper air data
USH CHANGES
ush/build.sh
Move from root level to ush, to accomodate coding standards
ush/gdas_counts.sh
Minor INFILE path correction for consistent path structue
ush/gdas_summary.sh
Minor correction for consistency with NCO
ush/prepobs_makeprepbufr.sh
Introduce functionality to add upper air dump data (*uprair*) to prepbufr's ADPUPA
VERSIONS CHANGES
versions/README
Delete/clean up old notes
versions/VERSION
Update to this release's versione
versions/build.ver
Start using bufr v11.7 to match the calls to bufr_4 libraries (instead of bufr_4_DA which required v11.5)
CHANGES TO OUTPUT AND FILE SIZES
obsproc.v1.2.0 generates new dumps: *satwhr*, *uprair*
prepobs.v1.1.0 incorporates *uprair* into prepbufr's ADPUPA
(this release must be synced with obsproc.v1.2.0 and bufr-dump.v1.2.0)
The updated *prepbur* files are up to ~20% larger in size
For examples, see: /lfs/h2/emc/stmp/iliana.genkova/CRON/R12/com
PRE-IMPLEMENTATION TESTING REQUIREMENTS
obsproc needs modules bufr-dump and prepobs in order to run
See docs/README.md for build instructions
See versions/build.ver and versions/run.ver for libaries
Run jobs/JOBSPROC_networkname_DUMP, jobs/JOBSPROC_networkname_DUMP_POST
jobs/JOBSPROC_networkname_PREP1, jobs/JOBSPROC_networkname_PREP1_POST
jobs/JOBSPROC_networkname_PREP2, jobs/JOBSPROC_networkname_PREP2_POST
for the following networkname values: GLOBAL, RAP
*uprair* is only added to GLOBAL and RAP's prepbufr files
DISSEMINATION INFORMATION
No changes to dissemination on WCOSS2
For NOMAD proposed changes, a SCN will be issued/submitted to Data Flow
SPECIAL INSTRUCTIONS
1.Implement release/obsproc.v1.2.0, release/bufr-dump.v1.2.0, and release/prepobs.v1.1.0 at the same time
2.Implement release/obsproc.v1.2.0, release/bufr-dump.v1.2.0, and release/prepobs.v1.1.0 after confirming GFS global-workflow is ready for the new versions (first 2 digits)
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
prepobs v1.0.0 RELEASED MAR 01, 2022
v1.0.1 IMPLEMENTED JUN 28, 2022
Transition from WCOSS Cray and Phase3 to WCOSS2
===============================================
Usage
module use /apps/ops/test/nco/modulefiles/compiler/intel/19.1.3.304
module load prepobs/1.0.1
Where is the release tag on subversion/git/vlab?
git clone https://github.com/NOAA-EMC/prepobs
git checkout release/prepobs.v1.0.0
List of external software used (anything outside of your vertical structure), including compilers and version numbers for everything
Software used must be a minimal list of modules/versions specified per job
bacio_ver=2.4.1
w3emc_ver=2.9.1
bufr_ver=11.5.0
List of all code/scripts modified with this release
---------------------------------------------------
A CMakeLists.txt
A README.md
A VERSION
A build.sh
A cmake/FindMKL.cmake
A cmake/FindNetCDF.cmake
A fix/CMakeLists.txt
fix/gdascounts_avg.awk
fix/gdascounts_base.shtml
fix/gdascounts_html
fix/gdascounts_types
fix/glerldict.lmd
fix/prepobs_cqc_statbge
fix/prepobs_errtable.cdas
fix/prepobs_errtable.nam
fix/prepobs_oiqc.oberrs
fix/prepobs_oiqc.oberrs.cdas
fix/prepobs_prep.bufrtable
fix/satellite_counts.tbl
fix/syndat_weight
A modulefiles/CMakeLists.txt
A modulefiles/prepobs.lua.tmpl
A modulefiles/prepobs_common.lua
A modulefiles/prepobs_hera.lua
A modulefiles/prepobs_orion.lua
A modulefiles/prepobs_wcoss2.lua
A scripts/CMakeLists.txt
M scripts/exprep_post.sh
A sorc/CMakeLists.txt
A sorc/gblevents.fd/CMakeLists.txt
sorc/gblevents.fd/gblevents.f
A sorc/gdascounts_ave.fd/CMakeLists.txt
sorc/gdascounts_ave.fd/build_new.f
A sorc/global_postevents.fd/CMakeLists.txt
sorc/global_postevents.fd/postevents.f
A sorc/prepobs_cqcbufr.fd/CMakeLists.txt
sorc/prepobs_cqcbufr.fd/cqcbufr.f
sorc/prepobs_cqcbufr.fd/radcor.f
A sorc/prepobs_cqcvad.fd/CMakeLists.txt
sorc/prepobs_cqcvad.fd/cqcvad.f
A sorc/prepobs_glerladj.fd/CMakeLists.txt
sorc/prepobs_glerladj.fd/glerldictmod.f90
sorc/prepobs_glerladj.fd/glerlmain.f90
sorc/prepobs_glerladj.fd/indict.f90
sorc/prepobs_glerladj.fd/landtowater.f90
sorc/prepobs_glerladj.fd/spd_to_dir.f90
sorc/prepobs_glerladj.fd/td_to_q.f90
sorc/prepobs_glerladj.fd/uv_to_sd.f90
sorc/prepobs_glerladj.fd/uz.f
sorc/prepobs_glerladj.fd/uzl.f
sorc/prepobs_glerladj.fd/watertoland.f90
A sorc/prepobs_listheaders.fd/CMakeLists.txt
sorc/prepobs_listheaders.fd/listheaders.f90
A sorc/prepobs_monoprepbufr.fd/CMakeLists.txt
sorc/prepobs_monoprepbufr.fd/monoprepbufr.f90
A sorc/prepobs_mpcopybufr.fd/CMakeLists.txt
sorc/prepobs_mpcopybufr.fd/mpcopybufr.f90
A sorc/prepobs_oiqcbufr.fd/CMakeLists.txt
sorc/prepobs_oiqcbufr.fd/oiqcbufr.f
A sorc/prepobs_prepacpf.fd/CMakeLists.txt
sorc/prepobs_prepacpf.fd/prepacpf.f
A sorc/prepobs_prepacqc.fd/CMakeLists.txt
sorc/prepobs_prepacqc.fd/acftobs_qc.f
sorc/prepobs_prepacqc.fd/indexc40.f
sorc/prepobs_prepacqc.fd/input_acqc.f
sorc/prepobs_prepacqc.fd/output_acqc_noprof.f
sorc/prepobs_prepacqc.fd/output_acqc_prof.f
sorc/prepobs_prepacqc.fd/pietc.f90
sorc/prepobs_prepacqc.fd/pkind.f90
sorc/prepobs_prepacqc.fd/pmat.f90
sorc/prepobs_prepacqc.fd/pmat2.f90
sorc/prepobs_prepacqc.fd/pmat3.f90
sorc/prepobs_prepacqc.fd/prepacqc.f
sorc/prepobs_prepacqc.fd/pspl.f90
sorc/prepobs_prepacqc.fd/sub2mem_mer.f
sorc/prepobs_prepacqc.fd/sub2mem_um.f
sorc/prepobs_prepacqc.fd/tranQCflags.f
A sorc/prepobs_prepdata.fd/CMakeLists.txt
sorc/prepobs_prepdata.fd/inc_w3unpkb7.inc
sorc/prepobs_prepdata.fd/iw3unpbf.f
sorc/prepobs_prepdata.fd/prepdata.f
sorc/prepobs_prepdata.fd/w3atovsunp.f
sorc/prepobs_prepdata.fd/w3cnvxtovs.f
sorc/prepobs_prepdata.fd/w3rtovsunp.f
sorc/prepobs_prepdata.fd/w3unpkb7.f
sorc/prepobs_prepdata.fd/w3xtovseds.f
sorc/prepobs_prepdata.fd/w3xtovsmnd.f
sorc/prepobs_prepdata.fd/wordlength.f
A sorc/prepobs_prevents.fd/CMakeLists.txt
sorc/prepobs_prevents.fd/gblevents_cdas.f
sorc/prepobs_prevents.fd/prevents.f
A sorc/prepobs_profcqc.fd/CMakeLists.txt
sorc/prepobs_profcqc.fd/profcqc.f
A sorc/syndat_syndata.fd/CMakeLists.txt
sorc/syndat_syndata.fd/syndata.f
A sorc/timetwin.fd/CMakeLists.txt
sorc/timetwin.fd/timetwin.f
A ush/CMakeLists.txt
ush/build_mainpage.sh
ush/download_fix.sh
M ush/gdas_counts.sh
ush/gdas_countstat.sh
ush/gdas_summary.sh
ush/gdascounts_combine.sh
ush/getges.sh
ush/getges_driver.sh
ush/getges_nc.sh
ush/getges_sig.sh
ush/global_postevents.sh
ush/mstr_shp_stn_lst_update.sh
ush/mstr_shp_stn_lst_update2.sh
ush/prepobs_cqcbufr.sh
ush/prepobs_cqcvad.sh
ush/prepobs_glerladj.sh
M ush/prepobs_makeprepbufr.sh
ush/prepobs_oiqcbufr.sh
ush/prepobs_prepacqc.sh
ush/prepobs_prevents.sh
ush/prepobs_profcqc.sh
ush/prepobs_syndata.sh
ush/satellite_daily.pl
ush/satellite_html.pl
ush/satellite_summary.sh
A versions/README
A versions/build.ver
------------------------------
M-modified; A-added; D-deleted
What changes were made to the above code/scripts to support the new architecture?
prep and prep_post have been removed from the obsproc software package to be a standalone application, installed on WCOSS2 as a module.
prepobs has been moved to github as its own repository. https://github.com/NOAA-EMC/prepobs
prepobs utilizes cmake to build and install the code. build prepobs repo with cmake
Were any other changes made that aren’t directly related to the transition?
No
Are there any changes to incoming data needs or outgoing products?
No
If output filenames are changing, list the current and new filename
N/A
Compute resource information, for every job:
Please see https://github.com/NOAA-EMC/obsproc release branch release/obsproc.v1.0.0/triggers for various network j*dump.wc2.pbs trigger settings
Total tasks
Tasks per node
Serial or parallel or mpmd
Memory requirements (exclusive or shared)
List any other PBS resource information requirements or MPI tunables
*** Providing PBS and/or ecFlow submission scripts as part of release tag is preferred; if they are provided then resource information is not needed in the release notes.
Runtime changes compared to current production (/gpfs/dell1/nco/ops/com/logs/runtime/daily/* for current stats)
Optimization for network dump jobs was not performed prior to release because of the team reshuffling and resultant tight deadline.
Obsproc developers will work with assigned SPA to meet optimization goals for network dump jobs.
Disk space required per day or per cycle; data retention on disk will remain the same unless otherwise requested.
Same as WCOSS1
Dissemination will remain the same unless otherwise communicated to NCO and a PNS/SCN issued
HPSS archive retention will remain the same unless approval granted by HPCRAC
What are your up and downstream dependencies?
Upstream: decoders, satingest ($DCOMROOT)
Provide a pointer to your COMOUT, temp directory and pbspro output file that was used during testing:
see obsproc.v1.0.0 Release Notes
===========================================================================
WCOSS1 RN:https://github.com/ShelleyMelchior-NOAA/smelchior/tree/main/RNs
END