Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[End-to-End Test Code Sprint] Bufr to Ioda converter for SEVIRI METEOSAT-8 and to METEOSAT-11 #765

Open
azadeh-gh opened this issue Nov 22, 2023 · 8 comments
Open

[End-to-End Test Code Sprint] Bufr to Ioda converter for SEVIRI METEOSAT-8 and to METEOSAT-11 #765

azadeh-gh opened this issue Nov 22, 2023 · 8 comments
Assignees
@azadeh-gh

Comments

@azadeh-gh
Copy link
Collaborator

azadeh-gh commented Nov 22, 2023 •
edited
Loading

(Issue #99)
Spinning Enhanced Visible and InfraRed Imager (SEVIRI) from METEOSAT-8 and to METEOSAT-11 GDASApp end-to-end testing.

new files include:
parm/ioda/bufr2ioda//bufr2ioda_sevcsr.json : JSON containing data format, sensor/bufr2ioda_sevcsr.json, and satellite information
ush/ioda/bufr2ioda/bufr2ioda_sevcsr.py: bufr2ioda code for extracting SEVIRI METEOSAT-8 and METEOSAT-11 from BUFR
@azadeh-gh azadeh-gh self-assigned this Nov 22, 2023
azadeh-gh pushed a commit that referenced this issue Nov 22, 2023
[End- to End Test code sprint] Add SEVIRI METEOSAT-8 and METEOSAT-11 (#…
c56d20c 
…765)

Spinning Enhanced Visible and InfraRed Imager (SEVIRI) from METEOSAT-8 and to METEOSAT-11 GDASApp end-to-end testing.

new files include:
parm/ioda/bufr2ioda//bufr2ioda_sevcsr.json : JSON containing data format, sensor/bufr2ioda_sevcsr.json, and satellite information
ush/ioda/bufr2ioda/bufr2ioda_sevcsr.py: bufr2ioda code for extracting SEVIRI METEOSAT-8 and METEOSAT-11 from BUFR
azadeh-gh pushed a commit that referenced this issue Nov 22, 2023
[End- to End Test code sprint] Add SEVIRI METEOSAT-8 and METEOSAT-11 (#…
99bc425 
…765)

End-to-end testing for Spinning Enhanced Visible and InfraRed Imager (SEVIRI) from METEOSAT-8 and to METEOSAT-11
new files include:
parm/ioda/bufr2ioda//bufr2ioda_sevcsr.json : JSON containing data format, sensor/bufr2ioda_sevcsr.json, and satellite information
ush/ioda/bufr2ioda/bufr2ioda_sevcsr.py: bufr2ioda code for extracting SEVIRI METEOSAT-8 and METEOSAT-11 from BUFR
@azadeh-gh azadeh-gh mentioned this issue Nov 22, 2023
Merged
@azadeh-gh
Copy link
Collaborator Author

Updated SEVIRI YAMLs in the config to add two filters: 1) Gaussian Thinning 2) Bound check filter to reject obs when sensorZenithAngle is more than 65

@azadeh-gh
Copy link
Collaborator Author

azadeh-gh commented Jan 9, 2024 •
edited
Loading

Evaluation plots:

BUFR to IODA SEVIRI M08 Ch5 No thinning No QC observations

1_JEDI_OmF_Seviri08_ch5_UnThinNoqC

@azadeh-gh
Copy link
Collaborator Author

azadeh-gh commented Jan 9, 2024 •
edited
Loading

BUFR to IODA SEVIRI M08 Ch5 Gaussian thinning No QC observations

Data Thining

  • filter: Gaussian Thinning
    filter variables:
    • name: brightnessTemperature
      channels: 4-11
      horizontal_mesh: 145
      use_reduced_horizontal_grid: true
      distance_norm: geodesic
      priority_variable: MetaData/cloudFree
      action:
      name: reject
      2_JEDI_OmF_Seviri08_ch5_ThinNoQC

@azadeh-gh
Copy link
Collaborator Author

azadeh-gh commented Jan 9, 2024 •
edited
Loading

BUFR to IODA SEVIRI M08 Ch5 Gaussian thinning and Reject when sensorZenithAngle is more than 65

  • filter: Bounds Check
    filter variables:
    • name: brightnessTemperature
      channels: 4-11
      test variables:
    • name: MetaData/sensorZenithAngle
      maxvalue: 65.
      action:
      name: reject
      JEDI_OmF_Seviri08_ch5_Thin{_Sensor

@azadeh-gh
Copy link
Collaborator Author

azadeh-gh commented Jan 9, 2024 •
edited
Loading

GSI O-F No QC

UnthinGSI_OmF_Seviri08_ch5_NoQC

@azadeh-gh
Copy link
Collaborator Author

azadeh-gh commented Jan 9, 2024 •
edited
Loading

JEDI Quality control for SEVIRI

JEDI_OmF_Seviri08_ch5_QC

@azadeh-gh
Copy link
Collaborator Author

GSI Quality control for SEVIRI

GSI_OmF_Seviri08_ch5_QC

@azadeh-gh
Copy link
Collaborator Author

GSI_JEDIQCdiff_Seviri08_ch5

CoryMartin-NOAA added a commit that referenced this issue Mar 27, 2024
@azadeh-gh @RussTreadon-NOAA
@emilyhcliu @CoryMartin-NOAA @BrettHoover-NOAA @XuanliLi-NOAA
[End- to End Test code sprint] Add SEVIRI METEOSAT-8 and METEOSAT-11 …
3ffc340 
…to end-to-end testing (#766)

(#765)

End-to-end testing for Spinning Enhanced Visible and InfraRed Imager
(**SEVIRI**) from METEOSAT-8 and to METEOSAT-11

**New files include:**
- `parm/ioda/bufr2ioda//bufr2ioda_sevcsr.json` : JSON containing data
format, sensor/bufr2ioda_sevcsr.json, and satellite information
- `ush/ioda/bufr2ioda/bufr2ioda_sevcsr.py` : bufr2ioda python code for
converting SEVIRI METEOSAT-8 and METEOSAT-11 from BUFR to IODA
- `parm/atm/obs/config/seviri_m08.yaml.j2`
- `parm/atm/obs/config/seviri_m11.yaml.j2`
- `parm/atm/obs/lists/gdas_prototype_3d.yaml.j2`

---------

Co-authored-by: RussTreadon-NOAA <russ.treadon@noaa.gov>
Co-authored-by: Emily Liu <emily.liu@noaa.gov>
Co-authored-by: Cory Martin <cory.r.martin@noaa.gov>
Co-authored-by: emilyhcliu <36091766+emilyhcliu@users.noreply.github.com>
Co-authored-by: BrettHoover-NOAA <98188219+BrettHoover-NOAA@users.noreply.github.com>
Co-authored-by: Brett Hoover <bhoover@Orion-login-1.HPC.MsState.Edu>
Co-authored-by: Xuanli Li <101414760+XuanliLi-NOAA@users.noreply.github.com>
Co-authored-by: Azadeh Gholoubi <gholoubi@Orion-login-2.HPC.MsState.Edu>
Co-authored-by: Azadeh Gholoubi <gholoubi@Orion-login-4.HPC.MsState.Edu>
Co-authored-by: RussTreadon-NOAA <26926959+RussTreadon-NOAA@users.noreply.github.com>
Co-authored-by: Azadeh Gholoubi <gholoubi@Orion-login-3.HPC.MsState.Edu>
@azadeh-gh azadeh-gh mentioned this issue Nov 1, 2024
Merged
CoryMartin-NOAA pushed a commit to NOAA-EMC/jcb-gdas that referenced this issue Nov 6, 2024
@azadeh-gh
Add YAML configuration files for SEVIRI M08 and M11 with Thinning and…
15acb78 
… Quality Control (#40)

**Description:**
This PR adds YAML configuration files for `seviri_m08` and `seviri_m11`
into JEDI, along with thinning and observation quality control.
The the bufr2ioda python converter for these observations has also been
added to the GDASApp repository.

**Related Issue:**
[Evaluation of SEVIRI YAMLs
#756](NOAA-EMC/GDASApp#765)

**New files include:**
- `observation_chronicle/atmosphere/seviri_m08.yaml` 
- `observation_chronicle/atmosphere/seviri_m11.yaml` 
-  `observations/atmosphere/seviri_m08.yaml.j2` 
- `observations/atmosphere/seviri_m11.yaml.j2`

---------

Co-authored-by: Azadeh Gholoubi <gholoubi@hercules-login-2.hpc.msstate.edu>
Co-authored-by: Azadeh Gholoubi <gholoubi@hercules-login-4.hpc.msstate.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@azadeh-gh azadeh-gh

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@azadeh-gh