Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposal: Make IngestPipeline tag be able to reference other data_streams/packages pipelines #580

Open
marc-gr opened this issue May 10, 2021 · 1 comment
Labels
discuss Issue needs discussion enhancement New feature or request Team:Security-External Integrations Label for the Security External Integrations team

Comments

@marc-gr
Copy link
Contributor

marc-gr commented May 10, 2021

We have some data streams that have duplicated pipelines because currently it is not possible to reference pipelines outside of the current data stream using the IngestPipeline tag.

Would be nice to extend it so it could be used in a similar way to:

  • {{ IngestPipeline nameOfPipeline }} for pipelines in the same data stream
  • {{ IngestPipeline nameOfDatastream/nameOfPipeline }} for pipelines in other data streams of the same package

Additionally, even though maybe not as big of a need right now, something like {{ IngestPipeline nameOfPackage/versionOfPackage/nameOfDatastream/nameOfPipeline }} could be used to be able to reference any pipeline from any package. The version must be specified if we want to reference pipelines across packages to avoid breaking changes.

Another consideration is that if we include a pipeline from another data stream or package, we need to not only install it but also any other pipelines that it references, and manage the life cycle of these dependencies accordingly.

@marc-gr marc-gr added enhancement New feature or request discuss Issue needs discussion labels May 10, 2021
@marc-gr marc-gr added the Team:Security-External Integrations Label for the Security External Integrations team label May 10, 2021
@leehinman
Copy link
Contributor

This might be related if we need to track dependencies between packages.
#145

@jsoriano jsoriano transferred this issue from elastic/elastic-package Aug 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discuss Issue needs discussion enhancement New feature or request Team:Security-External Integrations Label for the Security External Integrations team
Projects
None yet
Development

No branches or pull requests

2 participants