-
Notifications
You must be signed in to change notification settings - Fork 151
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add use of high resolution Raob data #126
Comments
FYI @CatherineThomas-NOAA and I are co-hosting a NOAA Hollings student this summer to help tackle a similar issue with AI/ML (more intelligent thinning of the profiles) |
Yes. Daryl mentioned about the Hollings student. This work should assist the student in getting going with the work. I was not going to spend much time on optimally specifying the error (or the combination of the observations into superobs) and will leave this for the student. |
First difficulty was to get the BUFR Library to read the new soundings. There were many (10000) levels in some of the soundings and the standard BUFR library would run out of memory. Jeff Ator suggested using the Dynamic Allocation (DA) version of the BUFR library and setting a couple of parameters before calling the first openbf. Russ helped with this and verified that the DA version reproduced the standard BUFR library. Use of this data allowed the reading of the data. A new routine (read_hdraob) was defined to read the new data file and put them into the standard output file types produced by the other read routines. The new data was put under data types 119, 219 and a few under 218. The type 119 was use for temperature, q and ps. 219 was used for winds when pressure was available. 218 was used for a few profiles that only had height for a vertical location. These profiles appeared to be just pibals put into the new format. The code was tested by producing a record for certain radiosondes, find the corresponding prepbufr radiosonde record and looking to see if the results were similar. They were not identical because the input values are not identical (e.g., Td rather than q, speed and direction rather than u,v), more accurate values in the input file and in some cases certain values were not available from the new file (e.g., quality marks, etc.) Default values were put in place of the missing values (e.g., qm = 0). Comparisons are below. |
For PS, the output record for each observation includes:
For a single observation ps record for one radiosonde (station 94170) 0.110000002384186 For same station from prepbufr file 0.110000000000000 606.525333333333 |
Note that elements 9,10,19 are expected to be different. 9 -- is the location on convinfo file of observation type. These ps are given obs type 119 for the new data and typ 120 for prepbufr data. |
Most other numbers are close. Some small differences in the numbers are expected since reporting precision, reporting quantities and other details are different. |
For q observations, the output record contains,
For a single record at level 5 for station chosen so that the levels for the station are similar (the same number of level) (station 91815) 0.221079645071228 prepbufr 0.220387185134036 The lat,lon,and time (2,3,7,15,16) are expected to be a little different because of the observed balloon drift that has been included. The qob (5) in the new file is converted from dew point temperature. Because of the balloon drift the surface information (14,15,16,17,19) differs. As with the surface pressure data, the convinfo type (8), the quality mark(11) and the subprovider name ('HDRAOB'). Cat also comes from the prepbufr file so it is set to 2. In general the numbers are close and the code appears to be working properly. |
temperature observation
(Single record for station 91815) 0.994858376465778 Prepbufr 1.10193592567018 Similar comments to those for q. Note for temperature, the sensible temperature is reported. |
UV
Again, one sample record at level 5 for station 71815 1.65809733803421 Prepbufr 1.68636172351236 Similar comments as for t and q. Note that the height of the observation is missing in the prepbufr data. |
As another test, we will look at the fits to obs for types 120, 220, 221 versus the new data types 119, 218 and 219. ps t
|
As mentioned before, the quality marks are not set in new data set. Thus, the default quality mark is set to 0. The following conditions result in the quality mark being changed. uvob: Set to 1. Height not from direct measurement. uvob,tob,qob,psob: Set to 2. Change in time missing. uvob,tob,qob,psob: Set to 2. Change in lat/long missing. tob: Set to 12 (don't use). Temperature < 100. or Temperature > 400. uvob: Set to 12(don't use). Direction > 360. or < 0. .or. Speed < 0. or Speed > 300. |
The next step was to ensure that profiles are not used twice since many are in both the uprair file and the prepbufr file. To do this, a list of station numbers was saved for each observation type for those profiles that are used. These lists are then transferred to all processors. In setup(t),(q),(ps),and (w), the list is search for a matching station number for observation types 120, 220 and 221 If the new uprair station matches that from the prepbufr file, the profile from the prepbufr file is moved to being monitored. This assumes that the uprair profile is as good or better than that from the prepbufr file. With these changes, the output for the appropriate removal of the prepbufr profiles to the monitored category. At this point the preliminary version seems to be working and the branch (hdraob) is saved. |
Some stats concerning the contents of the contents of the input . ps data 3/359 profiles with invalid station IDs. q data t data 4/359 with invalid station number uv |
Note by using the new bufrlib, there is a message printed everytime a bufr file is closed when it is not open. This was happening many times. Modification of the code was made to remove the messages. Also, closes were added to the files after the the closbf. This appears to have released some memory and it uses a bit less. |
Updated to head of trunk. Contains restart changes (which were partly in this branch). So now regression test can be properly performed. |
Did regression test. Passed. |
WCOSS_D test Check out and install NOAA-EMC/GSI master at 39ed5fa and jderber-NOAA:master at 5d76654 on Venus. Run 2021041300 gdas case using two global_gsi.x executables. 5d76654 global_gsi.x generates b4b results with respect from 39ed5fa global_gsi.x. Wall times from two runs are comparable. 5d76654 ran about 69 seconds longer than 39ed5fa. Another run of 5d76654 might yield a wall time closer to 39ed5fa. |
Daryl asked me to look at using the RAOB descent data. It turns out this data was also in the same data file. In fact the descent data was being misused as high resolution radiosonde data as ascent data. There was no real issue with using the data this way except it was not separated the data was not given a different type. Two new types for the descent data 118 (for temp, and q) and 217 for uv. No surface pressure data was created from the descent data. Note that it is assumed that there are no uv descent observations with only height (not pressure) reported. Usually the descent data has a GTS bulletin header of IUD or IUX. However it was found that it was more reliable to use the change in time as a better measure of whether it is ascent or descent data. For ascent data, the time starts at the launch of the radiosonde. For descent data, the time starts when the balloon bursts. The data for both is ordered from higher pressure to lower pressure. Thus, if the time of the first observation is greater than the last observation, it is a descent observation. A message is printed if the header is not consistent with a descent or ascent observation. If no change in time is available it is assumed to be a ascent profile. Changes to allow the use of this data were incorporated and tested. The code which separates out this data into types 118 and 217. Appears to be working properly. |
A presentation with revised figures including descent data and with a few errors fixed are found in the attached presentation |
GitHub Issue #126. Add use of high resolution Raob data.
…obal for high resolution Raob data.
commit 67705a1 Merge: 5e53aaf 18afa96 Author: AndrewEichmann-NOAA <58948505+AndrewEichmann-NOAA@users.noreply.github.com> Date: Fri Jun 11 10:55:08 2021 -0400 Merge branch 'NOAA-EMC:master' into master commit 18afa96 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Thu Jun 10 11:57:29 2021 +0000 master: Updated fix/rev2 use flags for CrIS NPP due to LW band anomalies (global_satinfo.txt and added gfsv16_historical/global_satinfo.txt.2021052118 commit 51a6564 Merge: 820ee80 d199ed5 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Thu Jun 10 07:48:55 2021 -0400 Merge pull request NOAA-EMC#169 from RussTreadon-NOAA/master GitHub Issue NOAA-EMC#120. Merge GFS v16.1.1 DA changes into master commit d199ed5 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu May 27 19:08:39 2021 +0000 GitHub Issue NOAA-EMC#120. merge GFS v16.1.1 DA changes into master commit 820ee80 Merge: 6585234 86d4071 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 28 11:34:46 2021 -0400 Merge pull request NOAA-EMC#155 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_util_EFSOI_src GitHub Issue NOAA-EMC#118. EFSOI additions to util/EFSOI-Utilities/src directory. commit 86d4071 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Fri May 28 15:31:10 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI-specific util source code. commit 6585234 Merge: 6cec754 efaa7cf Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 28 11:20:54 2021 -0400 Merge pull request NOAA-EMC#166 from comgsi/prMaster GitHub Issue NOAA-EMC#167. Change GSIWRFIO_LIB to WRF_IO_LIB and update build.comgsi accordingly. commit efaa7cf Author: Guoqing.Ge <guoqing.ge@noaa.gov> Date: Wed May 26 15:51:51 2021 -0600 change GSIWRFIO_LIB to WRF_IO_LIB and update build.comgsi accordingly commit 5e53aaf Merge: e54683c 6cec754 Author: AndrewEichmann-NOAA <58948505+AndrewEichmann-NOAA@users.noreply.github.com> Date: Mon May 24 14:34:33 2021 -0400 Merge branch 'NOAA-EMC:master' into master commit 6cec754 Merge: 6a6ac4e 3cc26ec Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 21 13:48:26 2021 -0400 Merge pull request NOAA-EMC#147 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_util_EFSOI_scripts GitHub Issue NOAA-EMC#118. EFSOI additions to util/EFSOI-Utilities/scripts directory. commit 6a6ac4e Merge: 1162d92 62c884c Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Thu May 20 11:03:36 2021 -0400 Merge pull request NOAA-EMC#146 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_jobs GitHub Issue NOAA-EMC#118. EFSOI additions to jobs directory for issue. commit 1162d92 Merge: 6e38b98 77a729e Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Wed May 19 11:02:40 2021 -0400 Merge pull request NOAA-EMC#157 from comgsi/tmpdtc GitHub Issue NOAA-EMC#158. Updates for community users to adopt the NOAA hpc-stack structure. commit 6e38b98 Merge: b511ba0 00eb5da Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Wed May 19 07:27:08 2021 -0400 Merge pull request NOAA-EMC#164 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#160. Correct data file location problem. commit 00eb5da Author: Edward.Safford <edward.safford@noaa.gov> Date: Tue May 18 16:31:34 2021 +0000 GitHub Issue NOAA-EMC#160. Correct data file location problem. commit b511ba0 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Tue May 18 14:38:15 2021 +0000 GitHub Issue NOAA-EMC#126. Update global_convinfo.txt and prepobs_errtable.global for high resolution Raob data. commit 66db434 Merge: dcb735a 23ec8ef Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Tue May 18 10:06:16 2021 -0400 Merge pull request NOAA-EMC#149 from jderber-NOAA/master GitHub Issue NOAA-EMC#126. Add use of high resolution Raob data. commit 77a729e Author: Guoqing.Ge <guoqing.ge@noaa.gov> Date: Fri May 14 11:15:32 2021 -0600 GitHub Issue NOAA-EMC#158. Updates for community users to adopt the NOAA hpc-stack structure. commit e54683c Merge: f69c3c8 b31b851 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:39:23 2021 +0000 Merge branch 'master' of github.com:AndrewEichmann-NOAA/GSI commit f69c3c8 Merge: 1dc5f83 dcb735a Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:37:10 2021 +0000 Merge branch 'master' of github.com:NOAA-EMC/GSI commit 3cc26ec Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:28:03 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI additions to util/EFSOI-Utilities/scripts directory. commit 62c884c Author: Michael Lueken <michael.lueken@noaa.gov> Date: Tue May 11 14:31:14 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI-specific additions to jobs. commit 23ec8ef Author: john.derber <John.Derber@noaa.gov> Date: Mon Apr 26 19:29:18 2021 +0000 GitHub Issue NOAA-EMC#126. Add use of high resolution Raob data. commit dcb735a Merge: c502c92 7939d47 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Mon May 3 12:57:43 2021 -0400 Merge pull request NOAA-EMC#153 from lbi2018/master GitHub Issue NOAA-EMC#152. commit b31b851 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Fri Apr 30 15:34:59 2021 +0000 Should not have gone into master Revert "EFSOI-specific fortran source from branch EXP-efso_fv3 - GSI issue NOAA-EMC#118" This reverts commit c9b8221. commit c9b8221 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Fri Apr 30 15:30:59 2021 +0000 EFSOI-specific fortran source from branch EXP-efso_fv3 - GSI issue NOAA-EMC#118 commit 7939d47 Author: Li.Bi@noaa.gov <Li.Bi@noaa.gov> Date: Wed Apr 28 13:15:30 2021 +0000 GitHub Issue NOAA-EMC#152. Update of modulefile.ProdGSI.wcoss_c and get_gefs_for_regional.f90 bug fixes. commit c502c92 Merge: 39ed5fa 5d77565 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Mon Apr 26 10:22:12 2021 -0400 Merge pull request NOAA-EMC#151 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#150. Correct OznMon read diag issue. commit 5d77565 Author: edward.safford <edward.safford@noaa.gov> Date: Fri Apr 23 19:42:54 2021 +0000 GitHub Issue NOAA-EMC#150. Correct OznMon read diag issue. commit 39ed5fa Merge: 02d5ce6 1e6fd61 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Tue Apr 13 09:37:05 2021 -0400 Merge pull request NOAA-EMC#144 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#123. OznMon update and bugzilla fixes. commit 1e6fd61 Author: Edward.Safford <edward.safford@noaa.gov> Date: Fri Apr 9 14:40:01 2021 +0000 GitHub Issue NOAA-EMC#123. OznMon update and bugzilla fixes. commit 1dc5f83 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu Apr 8 21:15:51 2021 +0000 removing EFSOI source files until they are merged into GSI master upstream
commit 67705a1 Merge: 5e53aaf 18afa96 Author: AndrewEichmann-NOAA <58948505+AndrewEichmann-NOAA@users.noreply.github.com> Date: Fri Jun 11 10:55:08 2021 -0400 Merge branch 'NOAA-EMC:master' into master commit 18afa96 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Thu Jun 10 11:57:29 2021 +0000 master: Updated fix/rev2 use flags for CrIS NPP due to LW band anomalies (global_satinfo.txt and added gfsv16_historical/global_satinfo.txt.2021052118 commit 51a6564 Merge: 820ee80 d199ed5 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Thu Jun 10 07:48:55 2021 -0400 Merge pull request NOAA-EMC#169 from RussTreadon-NOAA/master GitHub Issue NOAA-EMC#120. Merge GFS v16.1.1 DA changes into master commit d199ed5 Author: russ.treadon <Russ.Treadon@noaa.gov> Date: Thu May 27 19:08:39 2021 +0000 GitHub Issue NOAA-EMC#120. merge GFS v16.1.1 DA changes into master commit 820ee80 Merge: 6585234 86d4071 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 28 11:34:46 2021 -0400 Merge pull request NOAA-EMC#155 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_util_EFSOI_src GitHub Issue NOAA-EMC#118. EFSOI additions to util/EFSOI-Utilities/src directory. commit 86d4071 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Fri May 28 15:31:10 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI-specific util source code. commit 6585234 Merge: 6cec754 efaa7cf Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 28 11:20:54 2021 -0400 Merge pull request NOAA-EMC#166 from comgsi/prMaster GitHub Issue NOAA-EMC#167. Change GSIWRFIO_LIB to WRF_IO_LIB and update build.comgsi accordingly. commit efaa7cf Author: Guoqing.Ge <guoqing.ge@noaa.gov> Date: Wed May 26 15:51:51 2021 -0600 change GSIWRFIO_LIB to WRF_IO_LIB and update build.comgsi accordingly commit 5e53aaf Merge: e54683c 6cec754 Author: AndrewEichmann-NOAA <58948505+AndrewEichmann-NOAA@users.noreply.github.com> Date: Mon May 24 14:34:33 2021 -0400 Merge branch 'NOAA-EMC:master' into master commit 6cec754 Merge: 6a6ac4e 3cc26ec Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Fri May 21 13:48:26 2021 -0400 Merge pull request NOAA-EMC#147 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_util_EFSOI_scripts GitHub Issue NOAA-EMC#118. EFSOI additions to util/EFSOI-Utilities/scripts directory. commit 6a6ac4e Merge: 1162d92 62c884c Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Thu May 20 11:03:36 2021 -0400 Merge pull request NOAA-EMC#146 from AndrewEichmann-NOAA/EXP-efso_fv3_PR_jobs GitHub Issue NOAA-EMC#118. EFSOI additions to jobs directory for issue. commit 1162d92 Merge: 6e38b98 77a729e Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Wed May 19 11:02:40 2021 -0400 Merge pull request NOAA-EMC#157 from comgsi/tmpdtc GitHub Issue NOAA-EMC#158. Updates for community users to adopt the NOAA hpc-stack structure. commit 6e38b98 Merge: b511ba0 00eb5da Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Wed May 19 07:27:08 2021 -0400 Merge pull request NOAA-EMC#164 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#160. Correct data file location problem. commit 00eb5da Author: Edward.Safford <edward.safford@noaa.gov> Date: Tue May 18 16:31:34 2021 +0000 GitHub Issue NOAA-EMC#160. Correct data file location problem. commit b511ba0 Author: michael.lueken <Michael.Lueken@noaa.gov> Date: Tue May 18 14:38:15 2021 +0000 GitHub Issue NOAA-EMC#126. Update global_convinfo.txt and prepobs_errtable.global for high resolution Raob data. commit 66db434 Merge: dcb735a 23ec8ef Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Tue May 18 10:06:16 2021 -0400 Merge pull request NOAA-EMC#149 from jderber-NOAA/master GitHub Issue NOAA-EMC#126. Add use of high resolution Raob data. commit 77a729e Author: Guoqing.Ge <guoqing.ge@noaa.gov> Date: Fri May 14 11:15:32 2021 -0600 GitHub Issue NOAA-EMC#158. Updates for community users to adopt the NOAA hpc-stack structure. commit e54683c Merge: f69c3c8 b31b851 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:39:23 2021 +0000 Merge branch 'master' of github.com:AndrewEichmann-NOAA/GSI commit f69c3c8 Merge: 1dc5f83 dcb735a Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:37:10 2021 +0000 Merge branch 'master' of github.com:NOAA-EMC/GSI commit 3cc26ec Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu May 13 14:28:03 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI additions to util/EFSOI-Utilities/scripts directory. commit 62c884c Author: Michael Lueken <michael.lueken@noaa.gov> Date: Tue May 11 14:31:14 2021 +0000 GitHub Issue NOAA-EMC#118. Implement EFSOI process in FV3 GFS workflow - EFSOI-specific additions to jobs. commit 23ec8ef Author: john.derber <John.Derber@noaa.gov> Date: Mon Apr 26 19:29:18 2021 +0000 GitHub Issue NOAA-EMC#126. Add use of high resolution Raob data. commit dcb735a Merge: c502c92 7939d47 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Mon May 3 12:57:43 2021 -0400 Merge pull request NOAA-EMC#153 from lbi2018/master GitHub Issue NOAA-EMC#152. commit b31b851 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Fri Apr 30 15:34:59 2021 +0000 Should not have gone into master Revert "EFSOI-specific fortran source from branch EXP-efso_fv3 - GSI issue NOAA-EMC#118" This reverts commit c9b8221. commit c9b8221 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Fri Apr 30 15:30:59 2021 +0000 EFSOI-specific fortran source from branch EXP-efso_fv3 - GSI issue NOAA-EMC#118 commit 7939d47 Author: Li.Bi@noaa.gov <Li.Bi@noaa.gov> Date: Wed Apr 28 13:15:30 2021 +0000 GitHub Issue NOAA-EMC#152. Update of modulefile.ProdGSI.wcoss_c and get_gefs_for_regional.f90 bug fixes. commit c502c92 Merge: 39ed5fa 5d77565 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Mon Apr 26 10:22:12 2021 -0400 Merge pull request NOAA-EMC#151 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#150. Correct OznMon read diag issue. commit 5d77565 Author: edward.safford <edward.safford@noaa.gov> Date: Fri Apr 23 19:42:54 2021 +0000 GitHub Issue NOAA-EMC#150. Correct OznMon read diag issue. commit 39ed5fa Merge: 02d5ce6 1e6fd61 Author: MichaelLueken-NOAA <63728921+MichaelLueken-NOAA@users.noreply.github.com> Date: Tue Apr 13 09:37:05 2021 -0400 Merge pull request NOAA-EMC#144 from EdwardSafford-NOAA/master GitHub Issue NOAA-EMC#123. OznMon update and bugzilla fixes. commit 1e6fd61 Author: Edward.Safford <edward.safford@noaa.gov> Date: Fri Apr 9 14:40:01 2021 +0000 GitHub Issue NOAA-EMC#123. OznMon update and bugzilla fixes. commit 1dc5f83 Author: andrew.eichmann <andrew.eichmann@noaa.gov> Date: Thu Apr 8 21:15:51 2021 +0000 removing EFSOI source files until they are merged into GSI master upstream
The WMO has created a new standard for the reporting of raob data. This allows for the more precise encoding of the data and the reporting of many more levels. Initially we are bypassing the prepbufr file to use this data and using file uprair.
The contents of the uprair file were given to me by Chris Hill and repeated below.
SINGULAR FIELDS
BUFR FIELD UNITS DESCRIPTION
001001 WMOB NUMERIC WMO BLOCK NUMBER
001002 WMOS NUMERIC WMO STATION NUMBER
001006 ACID ( 8)CCITT IA5 AIRCRAFT FLIGHT NUMBER
001011 SMID ( 9)CCITT IA5 SHIP OR MOBILE LAND STATION IDENTIFIER
001081 RSERL (20)CCITT IA5 RADIOSONDE SERIAL NUMBER
001082 RASCN NUMERIC RADIOSONDE ASCENSION NUMBER
001083 RRLSE NUMERIC Radiosonde release number
001125 WGOSIDS NUMERIC WIGOS IDENTIFIER SERIES
001126 WGOSISID NUMERIC WIGOS ISSUER OF IDENTIFIER
001127 WGOSISNM NUMERIC WIGOS ISSUE NUMBER
001128 WGOSLID (16)CCITT IA5 WIGOS LOCAL IDENTIFIER (CHARACTER)
001198 RPID ( 8)CCITT IA5 REPORT IDENTIFIER
002003 A4ME CODE TABLE TYPE OF MEASURING EQUIPMENT USED
002011 RATP CODE TABLE RADIOSONDE TYPE
002013 SIRC CODE TABLE SOLAR AND INFRARED RADIATION CORRECTION
002014 TTSS CODE TABLE TRACKING TECHNIQUE/STATUS OF SYSTEM USED
002015 RACP CODE TABLE Radiosonde completeness
002016 RCONF FLAG TABLE Radiosonde configuration
002017 CAHM CODE TABLE Correction algorithms for humidity measurements
002066 RGRSY CODE TABLE Radiosonde ground receiving system
002067 RFREQ HZ RADIOSONDE OPERATING FREQUENCY
002080 BMFGR CODE TABLE Balloon manufacturer
002081 BTYPE CODE TABLE Type of balloon
002082 BWGHT KG Weight of balloon
002083 BSHEL CODE TABLE Type of balloon shelter
002084 BGTYP CODE TABLE Type of gas used in balloon
002085 BGAMT KG Amount of gas used in balloon
002086 BFTLN M Balloon flight train length
002095 PSENS CODE TABLE TYPE OF PRESSURE SENSOR
002096 TSENS CODE TABLE TYPE OF TEMPERATURE SENSOR
002097 RHSENS CODE TABLE TYPE OF HUMIDITY SENSOR
002191 GHTC CODE TABLE Geopotential height calculation
004001 YEAR YEAR YEAR
004002 MNTH MONTH MONTH
004003 DAYS DAY DAY
004004 HOUR HOUR HOUR
004005 MINU MINUTE MINUTE
004006 SECO SECOND SECOND
004200 RCYR YEAR YEAR - TIME OF RECEIPT
004201 RCMO MONTH MONTH - TIME OF RECEIPT
004202 RCDY DAY DAY - TIME OF RECEIPT
004203 RCHR HOUR HOUR - TIME OF RECEIPT
004204 RCMI MINUTE MINUTE - TIME OF RECEIPT
005001 CLATH DEGREE(N+,S-) LATITUDE (HIGH ACCURACY)
006001 CLONH DEGREE(E+,W-) LONGITUDE (HIGH ACCURACY)
007007 HEIT METERS HEIGHT
007030 HSMSL M HEIGHT OF STATION GROUND ABOVE MEAN SEA LEVEL
007031 HBMSL M HEIGHT OF BAROMETER ABOVE MEAN SEA LEVEL
008002 VSSO CODE TABLE VERTICAL SIGNIFICANCE (SURFACE OBSERVATIONS)
008021 TSIG CODE TABLE TIME SIGNIFICANCE
008202 RCTS CODE TABLE RECEIPT TIME SIGNIFICANCE
011061 AWSB METERS/SECOND ABSOLUTE WIND SHEAR IN 1 KM LAYER BELOW
011062 AWSA METERS/SECOND ABSOLUTE WIND SHEAR IN 1 KM LAYER ABOVE
020011 CLAM CODE TABLE CLOUD AMOUNT
020012 CLTP CODE TABLE CLOUD TYPE
020013 HOCB M HEIGHT OF BASE OF CLOUD
022043 SST1 DEGREES KELVIN SEA/WATER TEMPERATURE
025061 SOFTV (12)CCITT IA5 Software identification and version number
033215 CORN CODE TABLE CORRECTED REPORT INDICATOR
035021 BUHD ( 6)CCITT IA5 BULLETIN BEING MONITORED (TTAAii)
035022 BULTIM ( 6)CCITT IA5 BULLETIN BEING MONITORED (YYGGgg)
035023 BORG ( 4)CCITT IA5 BULLETIN BEING MONITORED (CCCC)
035035 RTERM CODE TABLE Reason for termination
035194 BBB ( 6)CCITT IA5 BULLETIN BEING MONITORED (BBB)
035195 SEQNUM ( 4)CCITT IA5 CHANNEL SEQUENCE NUMBER
REPLICATED FIELDS
BUFR FIELD UNITS DESCRIPTION
004086 LTDS SECOND LONG TIME PERIOD OR DISPLACEMENT
005015 LATDH DEGREE LATITUDE DISPLACEMENT (HIGH ACCURACY)
006015 LONDH DEGREE LONGITUDE DISPLACEMENT (HIGH ACCURACY)
007004 PRLC PASCALS PRESSURE
007008 GP07 (METERS/SECOND)**2 GEOPOTENTIAL
008042 VSIGX FLAG TABLE EXTENDED VERTICAL SOUNDING SIGNIFICANCE
010008 GP10 (METERS/SECOND)**2 GEOPOTENTIAL
011001 WDIR DEGREES TRUE WIND DIRECTION
011002 WSPD METERS/SECOND WIND SPEED
012101 TMDB DEGREES KELVIN TEMPERATURE/DRY BULB TEMPERATURE
012103 TMDP DEGREES KELVIN DEW POINT TEMPERATURE
uprair_field_list_single-vs-replicate.txt
The main issues with doing this is the large number of levels that are reported for some sondes and the irregular quality of some of the profiles. Note some profiles are full, reporting all expected values, others are just repeats of what is in an old radiosonde or rawinsonde report and many parameters are missing. So there has to be a lot of checking for special cases. Another difficulty with this data is that we have to check to ensure that a particular observation is not used twice once through the prepbufr file and once through the uprair file.
The text was updated successfully, but these errors were encountered: