Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancements for AHI radiance DA #1774

Merged
merged 16 commits into from
Dec 8, 2022
Merged

Conversation

weather4evr
Copy link
Contributor

@weather4evr weather4evr commented Oct 3, 2022

TYPE: Enhancement

KEYWORDS: WRFDA, AHI, Himawari-8

SOURCE: Craig Schwartz (NCAR/MMM)

DESCRIPTION OF CHANGES:
This PR makes several enhancements for assimilating Himawari-8 radiance data, including
(1) Introduction of an all-sky obs error model (Harnisch et al., 2016) for all-sky AHI DA;
(2) Optional read and use of AHI level-2 product (e.g., cloud mask);
(3) More efficient read of a sub-area of the full disk data;
(4) Allow the use of offline statistics of constant bias correction values;
(5) More diagnostic output (peak of weighting functions, cloud ice water path, cloud flag) in omb/oma files.

LIST OF MODIFIED FILES:
var/da/da_radiance/module_radiance.f90 Registry/registry.var
var/da/da_define_structures/da_define_structures.f90
var/da/da_monitor/da_rad_diags.f90
var/da/da_radiance/da_allocate_rad_iv.inc
var/da/da_radiance/da_deallocate_radiance.inc
var/da/da_radiance/da_get_innov_vector_crtm.inc
var/da/da_radiance/da_initialize_rad_iv.inc
var/da/da_radiance/da_qc_ahi.inc
var/da/da_radiance/da_radiance.f90
var/da/da_radiance/da_radiance1.f90
var/da/da_radiance/da_radiance_init.inc
var/da/da_radiance/da_read_obs_netcdf4ahi_jaxa.inc
var/da/da_radiance/da_write_iv_rad_ascii.inc
var/da/da_radiance/module_radiance.f90
var/run/ahi_info
var/run/radiance_info/himawari-8-ahi.info

TESTING:
(1) WRFDA regression test passed;
(2) AHI all-sky DA runs also Ok.

Release Note: Enhancements for AHI radiance DA, including all-sky observation error model, Level-2 AHI product read, and more diagnostic output.
Xu, D. M., Z. Q. Liu, S. Y. Fan, M. Chen, and F. F. Shen, 2021: Assimilating all-sky infrared radiances from Himawari-8 using the 3DVar method for the prediction of a severe storm over North China. Adv. Atmos. Sci., 38(4), 661-676.

@weather4evr weather4evr requested a review from a team as a code owner October 3, 2022 15:39
@weather4evr weather4evr changed the title Add 2 new namelist entries for AHI assimilation in WRFDA Several changes for AHI assimilation in WRFDA Oct 3, 2022
@liujake liujake requested review from liujake and junmeiban and removed request for a team October 4, 2022 15:30
@weather4evr weather4evr closed this Oct 4, 2022
@weather4evr weather4evr reopened this Oct 4, 2022
@weather4evr weather4evr closed this Oct 4, 2022
@weather4evr weather4evr reopened this Oct 4, 2022
Copy link

@Plantain Plantain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this will mess up VarBC, but I'm not sure; not tested for that.

This should be tested then...

var/da/da_radiance/da_qc_ahi.inc Outdated Show resolved Hide resolved
var/da/da_radiance/da_qc_ahi.inc Show resolved Hide resolved
var/da/da_radiance/da_qc_ahi.inc Outdated Show resolved Hide resolved
var/da/da_radiance/da_qc_ahi.inc Outdated Show resolved Hide resolved
@liujake liujake changed the title Several changes for AHI assimilation in WRFDA Enhancements for AHI radiance DA Dec 6, 2022
@liujake
Copy link
Contributor

liujake commented Dec 6, 2022

@weather4evr Craig, the code changes looks good to me. A few minor suggestions. I have also edited the PR message. Please check if it is Ok.

@weather4evr
Copy link
Contributor Author

@liujake Thank you for reviewing. I pushed a new commit with your minor suggestions addressed. But, I kind of messed it up, so you can ignore 0f74466, which is unnecessary.

There is a question about whether 79a4d9 should be included. Let me know if you want me to change back the channel numbers

@weather4evr weather4evr requested review from liujake and removed request for junmeiban and xdmjolly December 7, 2022 00:11
Copy link
Contributor

@liujake liujake left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WRFDA regression test passed. Ready to merge.

@liujake liujake merged commit 05a00cf into wrf-model:develop Dec 8, 2022
liujake added a commit that referenced this pull request Jan 17, 2024
TYPE: new feature

KEYWORDS: ABI, cloud detection, all-sky obs error model

SOURCE: JJ Guerrette (NCAR/MMM, now at tomorrow.io), Deqin Li (Liaoning Meteorological Bureau of CMA), Jake Liu (NCAR/MMM)

DESCRIPTION OF CHANGES:
This PR addes the assimilation of GOES-16/17 ABI's 3 water vapor channels' radiance data. This includes reading of ABI's full-disk, CONUS, and meso1&2 data files, superobbing and thinning of ABI data, IR-based cloud detection scheme as part of quality control, and all-sky obs error model. Cloud detection scheme should be the same as for AHI in principle, but the actual code implementation is not the same. No attempt made to make ABI's cloud detection code consistent with AHI's when bringing the code originally developed back in 2019-2020 into the latest develop branch. Some technical information is provided below for the use of this new capability.

1. Read ABI files:
Raw netcdf ABI data files (one file for one channel) need to be listed in 4 list files:
'file_list_GOES-16-ABI_C' for CONUS scan files
'file_list_GOES-16-ABI_F'  for full-disk scan files (e.g., OR_ABI-L1b-RadF-M6C08_G16_s20191211200263_e20191211209571_c20191211210021.nc)
'file_list_GOES-16-ABI_M1' for meso1 scan files
'file_list_GOES-16-ABI_M2' for meso2 scan files

ABI data reading code will automatically determine which file(s) to read in matching ABI file's time and analysis time.

2. Cloud detection scheme needs to read in a terrain file OR_ABI-TERR_G16.nc or OR_ABI-TERR_G17.nc for GOES-16 ABI or GOES-17 ABI.

3. Related namelist settings:
```
&wrfvar4
 use_goesabiobs  = true, ! read goes-16 and goes-17 ABI data
/
```
```
&wrfvar14
 rtminit_nsensor= 1,
 rtminit_platform=  4, ! goes
 rtminit_satid=  16,      ! goes-16
 rtminit_sensor=  44,  ! abi
 thinning= true,
 thinning_mesh= 30.0,
 qc_rad=true,
 write_iv_rad_ascii=true,
 write_oa_rad_ascii=true,
 rtm_option= 2,
 crtm_cloud= false,
 only_sea_rad=false,
 use_varbc=true,
 varbc_nobsmin=500,
 crtm_irland_coef= "IGBP.IRland.EmisCoeff.bin",
 use_clddet_zz=true, ! IR-based cloud detection
 abi_superob_halfwidth=3, ! this will do supperobbing with 7x7 pixels
 /
```

See also AHI DA related PRs:
#1139
#1173
#1774

LIST OF MODIFIED FILES: 41
M       Registry/registry.var
M       var/build/depend.txt
M       var/da/da_define_structures/da_define_structures.f90
M       var/da/da_monitor/da_rad_diags.f90
M       var/da/da_radiance/da_allocate_rad_iv.inc
M       var/da/da_radiance/da_deallocate_radiance.inc
M       var/da/da_radiance/da_get_innov_vector_crtm.inc
M       var/da/da_radiance/da_get_innov_vector_rttov.inc
A       var/da/da_radiance/da_get_sat_angles.inc
A       var/da/da_radiance/da_get_sat_angles_1d.inc
A       var/da/da_radiance/da_get_solar_angles.inc
A       var/da/da_radiance/da_get_solar_angles_1d.inc
M       var/da/da_radiance/da_initialize_rad_iv.inc
A       var/da/da_radiance/da_qc_goesabi.inc
M       var/da/da_radiance/da_qc_rad.inc
M       var/da/da_radiance/da_radiance.f90
M       var/da/da_radiance/da_radiance1.f90
M       var/da/da_radiance/da_radiance_init.inc
A       var/da/da_radiance/da_read_obs_ncgoesabi.inc
M       var/da/da_radiance/da_rttov.f90
M       var/da/da_radiance/da_setup_radiance_structures.inc
M       var/da/da_radiance/da_write_iv_rad_ascii.inc
M       var/da/da_radiance/da_write_oa_rad_ascii.inc
M       var/da/da_radiance/module_radiance.f90
M       var/da/da_setup_structures/da_setup_obs_structures.inc
M       var/da/da_setup_structures/da_setup_structures.f90
A       var/da/da_tools/da_llxy_1d.inc
A       var/da/da_tools/da_llxy_default_1d.inc
A       var/da/da_tools/da_llxy_global_1d.inc
A       var/da/da_tools/da_llxy_kma_global_1d.inc
A       var/da/da_tools/da_llxy_latlon_1d.inc
A       var/da/da_tools/da_llxy_lc_1d.inc
A       var/da/da_tools/da_llxy_merc_1d.inc
A       var/da/da_tools/da_llxy_ps_1d.inc
A       var/da/da_tools/da_llxy_rotated_latlon_1d.inc
A       var/da/da_tools/da_llxy_wrf_1d.inc
A       var/da/da_tools/da_togrid_1d.inc
M       var/da/da_tools/da_tools.f90
M       var/run/VARBC.in
A       var/run/radiance_info/goes-16-abi.info
A       var/run/radiance_info/goes-17-abi.info

TESTS CONDUCTED: 
1. WRFDA regression test passed on Derecho.
2. Clear-sky ABI DA is tested with a full-disk data file. 
3. the Jenkins tests all passing.

RELEASE NOTE: Add the capability for assimilating GOES-ABI radiance data
vlakshmanan-scala pushed a commit to scala-computing/WRF that referenced this pull request Apr 4, 2024
TYPE: Enhancement 

KEYWORDS: WRFDA, AHI, Himawari-8

SOURCE: Craig Schwartz (NCAR/MMM)

DESCRIPTION OF CHANGES:
This PR makes several enhancements for assimilating Himawari-8 radiance data, including
(1) Introduction of an all-sky obs error model (Harnisch et al., 2016) for all-sky AHI DA;
(2) Optional read and use of AHI level-2 product (e.g., cloud mask); 
(3) More efficient read of a sub-area of the full disk data;
(4) Allow the use of offline statistics of constant bias correction values;
(5) More diagnostic output (peak of weighting functions, cloud ice water path, cloud flag) in omb/oma files.

LIST OF MODIFIED FILES:
var/da/da_radiance/module_radiance.f90 Registry/registry.var
var/da/da_define_structures/da_define_structures.f90
var/da/da_monitor/da_rad_diags.f90
var/da/da_radiance/da_allocate_rad_iv.inc
var/da/da_radiance/da_deallocate_radiance.inc
var/da/da_radiance/da_get_innov_vector_crtm.inc
var/da/da_radiance/da_initialize_rad_iv.inc
var/da/da_radiance/da_qc_ahi.inc
var/da/da_radiance/da_radiance.f90
var/da/da_radiance/da_radiance1.f90
var/da/da_radiance/da_radiance_init.inc
var/da/da_radiance/da_read_obs_netcdf4ahi_jaxa.inc
var/da/da_radiance/da_write_iv_rad_ascii.inc
var/da/da_radiance/module_radiance.f90
var/run/ahi_info
var/run/radiance_info/himawari-8-ahi.info

TESTING:
(1) WRFDA regression test passed;
(2) AHI all-sky DA runs also Ok.

Release Note: Enhancements for AHI radiance DA, including all-sky observation error model, Level-2 AHI product read, and more diagnostic output.
Xu, D. M., Z. Q. Liu, S. Y. Fan, M. Chen, and F. F. Shen, 2021: Assimilating all-sky infrared radiances from Himawari-8 using the 3DVar method for the prediction of a severe storm over North China. Adv. Atmos. Sci., 38(4), 661-676.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants