Skip to content

v3.5.3

Compare
Choose a tag to compare
@ptitzler ptitzler released this 14 Feb 17:16

New feature highlights

Support GitLab as DAG repository for Apache Airflow

Elyra now supports GitLab as DAG repository for Apache Airflow runtime configuration. This new feature is only enabled if the optional gitlab dependency is installed.

Configure GitLab as DAG repository

Resources:

Attach pipeline node comments to generated pipelines

Comment nodes provide you with the ability to add embedded documentation to pipelines. Starting with this release these comments are passed through to the target runtime environment.

Kubeflow Pipelines

For Kubeflow Pipelines node comments are attached to the Kubernetes pods as elyra/node-user-doc annotations:

Pipeline node comments are embedded in the generated

Pipeline descriptions are rendered in the Airflow GUI

Tip: If your pipeline includes a description, it is rendered in the Kubeflow Pipelines Dashboard when you open the pipeline:

Pipeline descriptions are rendered in the Kubeflow Pipelines GUI

Apache Airflow

For Apache Airflow node comments are attached to the task instance and can be accessed in the task details view:

Pipeline node comments are embedded in the generated DAG

Tip: If your pipeline includes a description, it is rendered in the Apache Airflow GUI when you open the DAG:

Pipeline descriptions are rendered in the Airflow GUI