v3.9.0
Quick links
New feature highlights
Access sensitive information in generic pipeline nodes
Jupyter notebooks, Python scripts or R scripts might require access to resources that are protected using sensitive information, such as an API key or a user id and password. If you are running pipelines on Kubeflow Pipelines or Apache Airflow you can take advantage of Kubernetes secrets that are defined in your cluster. Starting with version 3.9 you can configure pipelines to expose these secrets as environment variables, which notebooks or scripts can access.
Pipeline CLI: identify pipeline dependencies
The elyra-pipeline describe CLI command output now includes information about the following dependencies for nodes that utilize generic components: container images, data volumes, and Kubernetes secrets. The machine readable output (produced when the --json option is specified) is most commonly used to automate processes, such as impact analysis and dependency checking. In the example below the output of the command is piped to the jq command-line processor, which extracts information about the container images that the pipeline's notebooks or script are executed in:
$ elyra-pipeline describe --json my.pipeline | jq '.dependencies.container_images[]'
"tensorflow/tensorflow:2.8.0"
This information could be used to identify pipelines that use a specific container image version or to verify that the container images are available in a specific container registry.
Create code snippets from notebook cells
Create a code snippet by selecting one or more cells in a Jupyter notebook.
Documentation: Running Elyra in an air gapped environment
The new documentation topic covers considerations for running Elyra in an air gapped environment.
What's Changed
New Features
- Add backend support for Kubernetes secrets environment variables by @kiersten-stokes in #2715
- Elyra pipeline describe enhancements by @binayakdutta in #2722
- Add 'Running Elyra in an air gapped environment' topic to documentation by @ptitzler in #2744
- Update 'elyra-pipeline describe' command by @ptitzler in #2742
- Create code snippet from whole cells (#1199) by @xlegs in #2726
Bug Fixes
- Simplify R and Python icon svgs by @ajbozarth in #2705
- Prepend baseUrl to icon source by @ajbozarth in #2728
- Fix pipeline submit button reload bug by @karlaspuldaro in #2734
- Fix metadata dropdown style in dark mode by @karlaspuldaro in #2743
- Fix incorrect string replacement in release script by @akchinSTC in #2748
- Fix save as code snippet by @marthacryan in #2756
- Fix release script updates to schemas docs and package desc by @akchinSTC in #2752
- Fix tag bug by @marthacryan in #2761
- Fix metadata editor being able to open in multiple tabs by @marthacryan in #2762
- Fix missing placeholder text in metadata editor by @marthacryan in #2764
- Trim whitespace to prevent invalid tags in metadata editor by @marthacryan in #2768
Other
- Add link to new blog post to "published resources" documentation by @kiersten-stokes in #2707
- Update elyra individual extension package descriptions by @akchinSTC in #2708
- Remove dependency on ipython_genutils by @kevin-bates in #2710
- Update changelog header by @ptitzler in #2714
- Metadata tag whitespace proposed solution by @JoshuaAlter in #2538
- Improve github action workflow by @ptitzler in #2720
- Update node packages to fix security vulnerabilities by @akchinSTC in #2575
- Remove tensorflow 1.x sample runtime images by @akchinSTC in #2729
- Develop Elyra against the Jupyterlab source repo by @ajbozarth in #2709
- Validate runtime image environments in CI testing by @kevin-bates in #2721
- Bump NodeJS version requirement to v16 or higher by @akchinSTC in #2732
- Add elyra documentation link in elyra-metadata help by @sgonsal in #2731
- Update generic component operator to support python 3.7 by @akchinSTC in #2727
- Improve pipeline validation by @ajbozarth in #2698
- Fix processing of node properties for pipeline app commands by @kiersten-stokes in #2740
- Update installation topic in the 'getting started' documentation by @ptitzler in #2746
- Update metadata editor to use JupyterLab's new form editor by @marthacryan in #2464
- Fix scroll bug by @marthacryan in #2766
New Contributors
- @JoshuaAlter made their first contribution in #2538
- @sgonsal made their first contribution in #2731
- @binayakdutta made their first contribution in #2722
- @xlegs made their first contribution in #2726
Full Changelog: v3.8.1...v3.9.0
