Create new single-point input forcing data for the NorESM land sites platform

This repository harmonizes the different steps necessary to create a CTSM input data tarball used within the Legacy version v0.2.0 of the NorESM land sites platform. It extracts single-point forcing data from global or regional datasets. Broadly, it is a wrapper for executing tools from the CTSM and CIME libraries:

https://github.com/ESCOMP/CTSM

https://github.com/ESMCI/cime

Parts of the code are heavily inspired by CTSM's subset_data.py tool and other resources provided by NCAR and the CESM hive mind.

The scripts contained in ./external_scripts are modified versions of work created by @huitang-earth, accessible under https://github.com/huitang-earth/NLP_prep.

Refer to the complete instructions for adding a new site under docs/howto-add-new-sites.md.

1 Instructions

1.1 First time installation on SAGA

Log into SAGA and Run the following commands:

cd
git clone https://github.com/lasseke/noresm-lsp-input.git
cd noresm-lsp-input/install
chmod +x ./install_dependencies.sh
./install_dependencies.sh

2 Adding a new site

To print additional help, run python3 create_forcing_classic.py --help.

⚠️ You need to load the Python dependencies before you can create a new site! Run (note the dots!):

cd [INSTALLATION_DIR]/noresm-lsp-input
. ./load_dependencies.sh

2.1 Add a single new site

Adapt the site_instructions_template.yaml file or use it as a template to create a new one. Make sure it contains all the correct information concerning naming, input data paths, etc. For example using vi:

vi site_input_instructions.yaml
...adapt content (press 'i' to edit and 'escape' when finished)...
:wq

Use the file as a recipe to create new compressed input via:

python3 create_forcing_classic.py -f [name_of_file].yml [-m [name_of_machine]]

2.2 Add multiple new sites

Create a directory that will contain multiple .yaml recipes, for example:

mkdir mysites

Add as many instruction files using the site_input_instructions.yaml template as you like into mysites/ (following step 1.2.1). Subsequently, run:

python3 create_forcing_classic.py -d ./mysites/

3 Sending jobs to the SAGA queue

Check out the make_input_jobscripts/ directory for template scripts that will send the input data creation as jobs to the SAGA queue. Refer to the SIGMA2 docs for additional information. Once you adapted a script according to your needs and credentials, run the following command:

cd [INSTALLATION_DIR]/noresm-lsp-input/make_input_jobscripts
sbatch [my_script_name].sh