Pipeline template

Pipeline template for the Orchestration.

Install

The only requirement is to have miniconda or anaconda previously installed:

git clone https://github.com/linea-it/pipeline_template && cd pipeline_template
cp env.template.sh env.sh

Edit env.sh setting the path to this repo in $PIPELINES_DIR and execute:

source env.sh

Run a pipeline

Create config:

pip install pydantic
cd $PIPELINES_DIR/hello_world
python config.py

To execute, simply:

# execute Hello World
cd $PIPELINES_DIR/hello_world
mkdir process001
./run.sh config.yaml process001