Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cads for andrew #616

Merged
merged 80 commits into from
Dec 4, 2023
Merged

Commits on Jun 21, 2022

  1. Added co2_slicing technique as a subroutine to qc_irsnd. Needed to ad…

    …d sensor flags (iasi, hirs, airs, etc.) to the qc_irsnd subroutine.
    wx20jjung committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    b83d543 View commit details
    Browse the repository at this point in the history
  2. Added instrument flags to qc_irsnd subroutine for the new co2_slicing…

    … cloud detection routine.
    wx20jjung committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    8c47ad4 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2022

  1. Added comments and documentation for the two new subroutines CO2_clou…

    …d_detect and statistical_cloud_detect
    wx20jjung committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    24db10c View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. Configuration menu
    Copy the full SHA
    096aeb4 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2022

  1. Configuration menu
    Copy the full SHA
    066d95b View commit details
    Browse the repository at this point in the history
  2. Added quality control procedures to read_cris for the new CO2_slicing…

    … subroutine.
    
    If a channel used by the CO2_slicing routine has a missing value, reject the profile.
    wx20jjung committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    1f4415a View commit details
    Browse the repository at this point in the history
  3. Added quality control procedures to read_iasi for the new CO2_slicing…

    … subroutine.
    
    If a channel used by the CO2_slicing routine is bad/missing, reject the profile.
    wx20jjung committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    1ae6050 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2022

  1. Configuration menu
    Copy the full SHA
    b224b43 View commit details
    Browse the repository at this point in the history
  2. added flags to namelist obsqc to use co2_cloud_detect instead of defa…

    …ult. These flags include airs_co2, cris_co2, iasi_co2, hirs_co2 and goessndr_co2. When the flag is true the subroutine co2_cloud_detect will be used to determine cloud layer.
    wx20jjung committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    ab3424b View commit details
    Browse the repository at this point in the history
  3. Minor tuning to the cloud thresholds for iasi and cris based on the V…

    …IIRS cloud information within the CrIS bufr. Added namelist flags to determine which cloud detection routine to use. If cris_co2, airs_co2, iasi_co2, hirs_co2 and/or goessnder_co2 are true, use the co2_cloud_detect subroutine. The original cloud detection subroutine (statistical_cloud_detect) is the default if any flags are missing or set to false.
    wx20jjung committed Sep 2, 2022
    Configuration menu
    Copy the full SHA
    2d317a8 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Modified to look for channels used by CO2_cloud_detect in any CrIS su…

    …bset. Also added logic if CO2_cloud_detect is used,specific channels must be available and pass minimum quality control.
    wx20jjung committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0e7986e View commit details
    Browse the repository at this point in the history
  2. Added logic to check for required CO2_cloud_detect channels in any IA…

    …SI subset. CO2 required channels must also pass minimal quality control or profile will be rejected.
    wx20jjung committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    caedef8 View commit details
    Browse the repository at this point in the history
  3. Modified to look for channels used by CO2_cloud_detect in any AIRS s…

    …ubset. Also added logic if CO2_cloud_detect is used,specific channels must be available and pass minimum quality control. AIRS is no longer an operational data set so these changes were never properly tested.
    wx20jjung committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    9506020 View commit details
    Browse the repository at this point in the history
  4. Added logic so that specific channels used by CO2_cloud_detect must b…

    …e available and pass minimum quality control. These are channels 3 - 7 which are the basic CO2 sounding channels of this instrument.
    wx20jjung committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    f2beb83 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. This commit contains a bug fix to the CO2_cloud_detect subroutine. Ea…

    …ch channel pair only tested a specific layer. All channel pairs should test from the tropopause to their pre determined level. Starting from the tropopause with each channel pair finds considerably more cirrus. A CrIS channel was changed in the 3rd pair, cloud thresholds were adjusted lower. There were other cosmetic changes like the radiative transfer integration, changed the subroutine name of the emc_legacy cloud test, etc.
    wx20jjung committed Oct 13, 2022
    Configuration menu
    Copy the full SHA
    d6a702f View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. Configuration menu
    Copy the full SHA
    fd3bf06 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2022

  1. Changes were added to derive channel height assignments for the new c…

    …loud_and_aerosol_detection software. Specifically you will see the variable chan_level. Other variables were added (radiance_overcast, radiance_ratio) to compute chan_level.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    ecbfc2e View commit details
    Browse the repository at this point in the history
  2. Namelist variables were added to call the cloud_and_Aerosol_Detection…

    … software. These include cris_cads, iasi_cads, and airs_cads. These variables need to be added to the script exglobal_atmos_analysis.sh to call this routine.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    f95f2ce View commit details
    Browse the repository at this point in the history
  3. The addition of chan_level in crtm_interface.f90 (the call_crtm() sub…

    …routine) requires chan_level to be added in this routine. chan_level is NOT used in this routine and should NOT change the value of any variable going out of this subroutine.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    acc615b View commit details
    Browse the repository at this point in the history
  4. chan_level is a pass-through variable in setuprad and is sent to subr…

    …outine qc_irsnd. This variable is used in qc_irsnd when determining the clear/cloudy channels for the IR sensors AIRS, IASI, and CrIS.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    11d92fa View commit details
    Browse the repository at this point in the history
  5. A new module was added containing the cloud_and_aerosol_detection sof…

    …tware. This module contains the code (subroutines) developed by ECMWF and available on the NWP SAF.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    ea25e3d View commit details
    Browse the repository at this point in the history
  6. Extensive changes were made to the subroutine qc_irsnd. This version …

    …contains the setup and call routines for the cloud_and_aerosol_detection software. There are several code additions, deletions, and reorganizations in this push.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    967e656 View commit details
    Browse the repository at this point in the history
  7. This is a new module containing the subroutines for the new cloud_and…

    …_aerosol_detection software. This code is available from the NWP SAF and is specifically version 3. The only code changes made to these subroutines are to be compatible with the GSI. Logic changes were kept to a minimum.
    wx20jjung committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    e38a3f0 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. Reorganized various subroutines for CADS. Moved CADS setup to gsimod.…

    …F90. Added an 11 - 12 micron test to qcmod to remove potential low level clouds.
    wx20jjung committed May 2, 2023
    Configuration menu
    Copy the full SHA
    8ca9a66 View commit details
    Browse the repository at this point in the history
  2. Added code to read the AVHRR cluster (IASI) and the VIIRS cluser (CrI…

    …S) for use in CADS. These are NOT complete yet.
    wx20jjung committed May 2, 2023
    Configuration menu
    Copy the full SHA
    de56c94 View commit details
    Browse the repository at this point in the history
  3. Added the CADS namelist files to this script. They should be located …

    …in the fix_gsi directory.
    
    In this case the IASI_CLDDET.NL was modified to NOT use the AVHRR cluster information as it is not ready yet.
    AIRS_CLDDET.NL
    CRIS_CLDDET.NL
    IASI_CLDDET.NL
    IASING_CLDDET.NL
    IRS_CLDDET.NL
    wx20jjung committed May 2, 2023
    Configuration menu
    Copy the full SHA
    7ebf0fe View commit details
    Browse the repository at this point in the history
  4. Merge remote-tracking branch 'emc/develop' into jung_cloud_tests_dr

    Fixed conflict in gsimod.f90 and removed exglobal_atmos_analysis.sh
    
    Conflicts:
    	scripts/exglobal_atmos_analysis.sh
    	src/gsi/gsimod.F90
    wx20jjung committed May 2, 2023
    Configuration menu
    Copy the full SHA
    21b7dcd View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3d20ace View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. Configuration menu
    Copy the full SHA
    aa7024d View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Configuration menu
    Copy the full SHA
    9d8a7f7 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. Cleaned up setuprad code and changed some variable names to include i…

    …mager instead of viirs or avhrr. Other minor format changes.
    wx20jjung committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    ef37d7a View commit details
    Browse the repository at this point in the history
  2. Added some quality control steps for when the imager (viirs, avhrr) c…

    …luster information is missing.
    wx20jjung committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    a274631 View commit details
    Browse the repository at this point in the history
  3. modified read_prepbufr with Russ' change to use bufr library v12.0

    Adding this new bufr library resolves some data overflow problems that cause the GSI to crash.
    wx20jjung committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    f4e119c View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Configuration menu
    Copy the full SHA
    de3e664 View commit details
    Browse the repository at this point in the history
  2. merge commit

    Merge remote-tracking branch 'emc/develop' into CADS_for_Andrew
    
    Conflicts:
    	fix
    	src/gsi/qcmod.f90
    	src/gsi/read_iasi.f90
    wx20jjung committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2fb0a00 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Configuration menu
    Copy the full SHA
    5938dd0 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    97e3fc0 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Added test for the existence of the imager (VIIRS or AVHRR) spectral …

    …coefficient file exists. If the file does not exist, disable the imager calculations and the imager test within the Cloud and Aerosol Detection Software (CADS).
    
    Removed some excess write statements in the CADS read namelist files.
    wx20jjung committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    084eafc View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. Configuration menu
    Copy the full SHA
    4717c1e View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Potential bug fix

    wx20jjung committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    b405117 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4492129 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    567c511 View commit details
    Browse the repository at this point in the history
  4. Updating to latest develop

    Merge remote-tracking branch 'emc/develop' into CADS_for_Andrew
    wx20jjung committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    af86c2f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    cb94211 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    ad6c011 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Configuration menu
    Copy the full SHA
    d8bf8c9 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Configuration menu
    Copy the full SHA
    9d436fa View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2023

  1. removed various comments

    wx20jjung committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    e6d5e34 View commit details
    Browse the repository at this point in the history
  2. removed various comments

    wx20jjung committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    fd99173 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e712434 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Configuration menu
    Copy the full SHA
    93d68b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Configuration menu
    Copy the full SHA
    1196943 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d9284b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Configuration menu
    Copy the full SHA
    ebd2989 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Two bug fixes both are array out of bounds issues. One with CADS in t…

    …he cloud height array. The other with abi2km bias correction array.
    wx20jjung committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    b3b02f7 View commit details
    Browse the repository at this point in the history
  2. Merge remote-tracking branch 'emc/develop' into CADS_for_Andrew

    Conflicts:
    	src/gsi/read_iasi.f90
    	src/gsi/setuprad.f90
    wx20jjung committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    f07a4e9 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Fixed openmp

    wx20jjung committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    06f953f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6df65e7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    67014cf View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c88c1c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Configuration menu
    Copy the full SHA
    dd24102 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5e774ea View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2383ead View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d3fbfe7 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. rearranged the cads - legacy cloud detection section to be more effic…

    …ient in qcmod.f90
    
    added logic to look for CRTM files for j1/n20 and j2/n21, fixed reviewer comments in read_cris.f90
    fixed reviewer comments in read_iasi.f90
    major changes to the CADS if blocks.  Moved initialization of most variables outside of the nobs loop, added if test for the existance of the imager data.
    wx20jjung committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    c2e5652 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7ec4619 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b04d004 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Returned abi2km to original coding. There are indexing problems and a…

    …rray out of bounds from abi2km with this commit
    wx20jjung committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    099b90f View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. Configuration menu
    Copy the full SHA
    a436130 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8ba50c8 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ed9cad7 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Configuration menu
    Copy the full SHA
    e4646fd View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Configuration menu
    Copy the full SHA
    1d1715b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3858863 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. CADS for CrIS instruments requires band 1 ( channels 1 -713 ) to exis…

    …t. CrIS band 1 on NPP has failed. The band 1 failure creates a lot of I/O statements from the CADS cloud test quality control. These changes reject CrIS profiles when cris_cads = .true. and band 1 is missing. If cris_cads = .false., nothing changes. The verbose flag was also added to the CADS output.
    wx20jjung committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    ac16db4 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Moved the subroutine cads_imager_calc from setuprad.f90 to cads.f90 (…

    …from Russ) and removed the redundant zero declarations. In crtm_interface.f90, removed the if (iasi .and. iasi_cads and etc. statements to break the compiler circular dependencies (from Russ). Added cloudp to subroutine qc_geocsr in qcmod.f90 (From Russ).
    wx20jjung committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    3968508 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7e250a6 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. Code review changes from Dave Huber. In qcmod.f90, definition of tsim…

    … is changed and cenlon is removed from the qc_irsnd argument list. In setuprad.f90, cenlon is removed from the qc_irsnd argument list. In read_cris.f90, 714 is replaced with the parameter band_2_start and some TODO comments were added.
    wx20jjung committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    9c0a736 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    af80355 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. Configuration menu
    Copy the full SHA
    88bf2ec View commit details
    Browse the repository at this point in the history