Skip to content

ACCESS-NRI/ESMValTool-workflow

Repository files navigation

ACCESS-NRI ESMValTool-workflow

DOI

ACCESS-NRI maintenance of ESMValTool for the Australian Community.

What is ESMValTool?

The Earth System Model Evaluation Tool (ESMValTool) is a tool developed for evaluation of Earth System Models in CMIP (Climate Model Intercomparison Projects). It allows for routine comparison of single or multiple models, either against predecessor versions or against observations. ESMValTool is a community-developed climate model diagnostics and evaluation software package, driven both by computational performance and scientific accuracy and reproducibility. It is open to both users and developers, encouraging open exchange of diagnostic source code and evaluation results from the Coupled Model Intercomparison Project CMIP ensemble.

What are we releasing?

ACCESS-NRI is releasing an NCI configuration of ESMValTool under the name ESMValTool-workflow.

ESMValTool-workflow is the ACCESS-NRI software and data infrastructure that enables the ESMValTool evaluation framework on NCI Gadi. It includes the ESMValTool/ESMValCore Python packages, the ESMValTool collection of recipes and diagnostics and some observational datasets. ESMValTool-workflow is configured to use the existing NCI supported CMIP data collections.

Using ESMValTool on Gadi

ESMValTool is provided through the xp65 project on Gadi.

Pre-requisites

To enable the ESMValTool-workflow, you need to be a member of the xp65 NCI projects:

Depending on your needs, you may want to also joined the following supported data collections:

  • CMIP6: fs38, oi10
  • CMIP5: rr3, al33
  • ERA5 and ERA5-Land: rt52, zz93
  • obs4MIPs: qv56

Loading the ESMValTool-workflow modules

To load the the esmvaltool module, execute the following commands:

    module use /g/data/xp65/public/modules
    module load esmvaltool

ESMValTool is pre-configured to access CMIP and observation datasets available on Gadi. By default, ESMValTool looks for the config_user.yml file in the home directory, inside the .esmvaltool folder. You can get a copy by running:

esmvaltool config get_config_user --path=dest

To list which ESMValTool recipes are available on Gadi, run:

esmvaltool recipes list

To find out details of a specific recipe_name.yml, execute:

esmvaltool recipes show recipe_name.yml

To retrieve a recipe (and modify it), execute:

esmvaltool recipes get recipe_name.yml

To execute recipe_name.yml and automatically download the required climate data to the default directory, run:

esmvaltool run examples/recipe_python.yml --search_esgf=when_missing

The --search_esgf=when_missing option tells ESMValTool to search for and download the necessary climate data files from Earth System Grid Federation (ESGF), if they cannot be found locally.

Observation and reanalyses data products available

You can request access to the ACCESS-NRI collection. Data is stored in /g/data/ct11 on GADI.

We welcome contributions and feedback through the ACCESS-Hive forum. You can also request help through support.

long_name datasets name
0 Total Alkalinity GLODAP, OceanSODA-ETHZ talk
1 Surface pH OceanSODA-ETHZ phos
2 Surface Downward Mass Flux of Carbon as CO2 [kgC m-2 s-1] GCP2018, GCP2020, Landschuetzer2016, OceanSODA-ETHZ fgco2
3 Total Column Ozone ESACCI-OZONE toz
4 TOA Outgoing Longwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH, JRA-25, JRA-55, NCEP-NCAR-R1, NOAA-CIRES-20CR rlut
5 Surface Dissolved Inorganic Carbon Concentration OceanSODA-ETHZ dissicos
6 Surface Upwelling Shortwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH rsus
7 Primary Organic Carbon Production by All Types of Phytoplankton Eppley-VGPM-MODIS intpp
8 Grid-Cell Area for Ocean Variables OceanSODA-ETHZ areacello
9 Air Temperature AIRS, AIRS-2-1, BerkeleyEarth, CFSR, CRU, CowtanWay, E-OBS, GHCN-CAMS, GISTEMP, GLODAP, HadCRUT3, HadCRUT4, HadCRUT5, ISCCP-FH, Kadow2020, NCEP-DOE-R2, NCEP-NCAR-R1, NOAAGlobalTemp, OceanSODA-ETHZ, PHC, WFDE5, WOA ta
10 Convective Cloud Area Percentage CALIOP, CALIPSO-GOCCP clc
11 Near-Surface Air Temperature BerkeleyEarth, CFSR, CRU, CowtanWay, E-OBS, GHCN-CAMS, GISTEMP, HadCRUT3, HadCRUT4, HadCRUT5, ISCCP-FH, Kadow2020, NCEP-NCAR-R1, NOAAGlobalTemp, WFDE5 tas
12 Specific Humidity AIRS, AIRS-2-1, HALOE, JRA-25, NCEP-NCAR-R1, NOAA-CIRES-20CR hus
13 Daily Maximum Near-Surface Air Temperature E-OBS, NCEP-NCAR-R1 tasmax
14 Percentage of the Grid Cell Occupied by Land (Including Lakes) BerkeleyEarth sftlf
15 Total Cloud Cover Percentage CALIOP, CloudSat, ESACCI-CLOUD, ISCCP, JRA-25, JRA-55, MODIS, MODIS-1-0, NCEP-DOE-R2, NCEP-NCAR-R1, NOAA-CIRES-20CR, PATMOS-x clt
16 Sea Surface Salinity ESACCI-SEA-SURFACE-SALINITY, WOA sos
17 Surface Downwelling Longwave Radiation CERES-EBAF, ISCCP-FH, JRA-55 rlds
18 Mole Fraction of CH4 ESACCI-GHG, TCOM-CH4 ch4
19 Liquid Water Path ESACCI-CLOUD, MODIS lwp
20 Atmosphere CO2 CT2019, ESRL, Scripps-CO2-KUM co2s
21 Surface Downwelling Shortwave Radiation CERES-EBAF, ISCCP-FH rsds
22 Ambient Aerosol Absorption Optical Thickness at 550nm ESACCI-AEROSOL abs550aer
23 Northward Near-Surface Wind CFSR vas
24 Near-Surface Relative Humidity NCEP-NCAR-R1 hurs
25 Sea Surface Temperature ATSR, HadISST, WOA tos
26 Sea Water Potential Temperature PHC, WOA thetao
27 Ambient Aerosol Optical Thickness at 550nm ESACCI-AEROSOL, MODIS od550aer
28 Ambient Aerosol Optical Depth at 870nm ESACCI-AEROSOL od870aer
29 Northward Wind CFSR, NCEP-NCAR-R1 va
30 Sea Water Salinity CALIPSO-GOCCP, ESACCI-LANDCOVER, ESACCI-SEA-SURFACE-SALINITY, PHC, WOA so
31 Tree Cover Percentage ESACCI-LANDCOVER treeFrac
32 Ice Water Path ESACCI-CLOUD clivi
33 Precipitation CRU, E-OBS, ESACCI-OZONE, GHCN, GPCC, GPCP-SG, ISCCP-FH, JRA-25, JRA-55, NCEP-DOE-R2, NCEP-NCAR-R1, NOAA-CIRES-20CR, PERSIANN-CDR, REGEN, SSMI, SSMI-MERIS, TRMM-L3, WFDE5 pr
34 Surface Downwelling Clear-Sky Longwave Radiation CERES-EBAF, JRA-55 rldscs
35 Surface Downwelling Clear-Sky Shortwave Radiation CERES-EBAF rsdscs
36 Delta CO2 Partial Pressure Landschuetzer2016 dpco2
37 TOA Outgoing Clear-Sky Shortwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH, JRA-25, JRA-55, NCEP-NCAR-R1 rsutcs
38 Sea Level Pressure E-OBS, JRA-55, NCEP-NCAR-R1 psl
39 CALIPSO Percentage Cloud Cover CALIPSO-GOCCP clcalipso
40 Surface Aqueous Partial Pressure of CO2 Landschuetzer2016, Landschuetzer2020, OceanSODA-ETHZ spco2
41 Surface Upwelling Clear-Sky Shortwave Radiation CERES-EBAF, ESACCI-CLOUD rsuscs
42 Dissolved Inorganic Carbon Concentration GLODAP, MOBO-DIC_MPIM, OceanSODA-ETHZ dissic
43 Mole Fraction of N2O TCOM-N2O n2o
44 Percentage Cloud Cover CALIOP, CALIPSO-GOCCP, CloudSat, ESACCI-CLOUD, ISCCP, JRA-25, JRA-55, MODIS, MODIS-1-0, NCEP-DOE-R2, NCEP-NCAR-R1, NOAA-CIRES-20CR, PATMOS-x cl
45 Surface Upwelling Longwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH rlus
46 Carbon Mass Flux out of Atmosphere Due to Net Biospheric Production on Land [kgC m-2 s-1] GCP2018, GCP2020 nbp
47 Total Dissolved Inorganic Phosphorus Concentration WOA po4
48 TOA Incident Shortwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH rsdt
49 Omega (=dp/dt) NCEP-NCAR-R1 wap
50 Dissolved Oxygen Concentration CT2019, ESACCI-GHG, ESRL, GCP2018, GCP2020, Landschuetzer2016, Landschuetzer2020, OceanSODA-ETHZ, Scripps-CO2-KUM, WOA o2
51 Percentage Crop Cover ESACCI-LANDCOVER cropFrac
52 Water Vapor Path ISCCP-FH, JRA-25, NCEP-DOE-R2, NCEP-NCAR-R1, NOAA-CIRES-20CR, SSMI, SSMI-MERIS prw
53 Geopotential Height CFSR, NCEP-NCAR-R1 zg
54 Ambient Fine Aerosol Optical Depth at 550nm ESACCI-AEROSOL od550lt1aer
55 Eastward Wind CFSR, NCEP-NCAR-R1 ua
56 Total Dissolved Inorganic Silicon Concentration CFSR, GLODAP, HadISST, MOBO-DIC_MPIM, OSI-450-nh, OSI-450-sh, OceanSODA-ETHZ, PIOMAS, WOA si
57 Mass Concentration of Total Phytoplankton Expressed as Chlorophyll in Sea Water ESACCI-OC chl
58 Natural Grass Area Percentage ESACCI-LANDCOVER grassFrac
59 Daily Minimum Near-Surface Air Temperature E-OBS, NCEP-NCAR-R1 tasmin
60 Condensed Water Path MODIS, NOAA-CIRES-20CR clwvi
61 TOA Outgoing Clear-Sky Longwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH, JRA-25, JRA-55, NCEP-NCAR-R1 rlutcs
62 Bare Soil Percentage Area Coverage ESACCI-LANDCOVER baresoilFrac
63 pH GLODAP, OceanSODA-ETHZ ph
64 Surface Carbonate Ion Concentration OceanSODA-ETHZ co3os
65 Surface Air Pressure CALIPSO-GOCCP, E-OBS, ISCCP-FH, JRA-55, NCEP-NCAR-R1 ps
66 Relative Humidity AIRS-2-0, AIRS-2-1, NCEP-DOE-R2, NCEP-NCAR-R1 hur
67 Surface Temperature CFSR, ESACCI-LST, ESACCI-SST, HadISST, ISCCP-FH, NCEP-NCAR-R1 ts
68 Eastward Near-Surface Wind CFSR uas
69 TOA Outgoing Shortwave Radiation CERES-EBAF, ESACCI-CLOUD, ISCCP-FH, JRA-25, JRA-55, NCEP-NCAR-R1, NOAA-CIRES-20CR rsut
70 Daily-Mean Near-Surface Wind Speed CFSR, NCEP-NCAR-R1 sfcWind
71 Surface Total Alkalinity OceanSODA-ETHZ talkos
72 Percentage Cover by Shrub ESACCI-LANDCOVER shrubFrac