Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace required pipeline with final pipeline #49470

Merged
merged 6 commits into from
Nov 22, 2019

Conversation

jasontedor
Copy link
Member

@jasontedor jasontedor commented Nov 21, 2019

This commit enhances the required pipeline functionality by changing it so that default/request pipelines can also be executed, but the required pipeline is always executed last. This gives users the flexibility to execute their own indexing pipelines, but also ensure that any required pipelines are also executed. Since such pipelines are executed last, we change the name of required pipelines to final pipelines.

Closes #49247

This commit enhances the required pipeline functionality by changing it
so that default/request pipelines can also be executed, but the required
pipeline is always executed last. This gives users the flexibility to
execute their own indexing pipelines, but also ensure that any required
pipelines are also executed. Since such pipelines are executed last, we
change the name of required pipelines to final pipelines.
@jasontedor jasontedor added >enhancement blocker :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP v8.0.0 v7.5.0 v7.6.0 labels Nov 21, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features (:Core/Features/Ingest)

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good (besides the test failures). I left two comment.

qa/a.txt Outdated Show resolved Hide resolved
@jasontedor jasontedor requested a review from martijnvg November 22, 2019 12:28
@jasontedor
Copy link
Member Author

@elasticmachine update branch

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jasontedor jasontedor merged commit da20957 into elastic:master Nov 22, 2019
jasontedor added a commit that referenced this pull request Nov 22, 2019
This commit enhances the required pipeline functionality by changing it
so that default/request pipelines can also be executed, but the required
pipeline is always executed last. This gives users the flexibility to
execute their own indexing pipelines, but also ensure that any required
pipelines are also executed. Since such pipelines are executed last, we
change the name of required pipelines to final pipelines.
jasontedor added a commit that referenced this pull request Nov 22, 2019
This commit enhances the required pipeline functionality by changing it
so that default/request pipelines can also be executed, but the required
pipeline is always executed last. This gives users the flexibility to
execute their own indexing pipelines, but also ensure that any required
pipelines are also executed. Since such pipelines are executed last, we
change the name of required pipelines to final pipelines.
@jasontedor jasontedor deleted the final-pipeline branch November 22, 2019 19:58
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Feb 13, 2020
Relates: #4341, elastic/elasticsearch#49470

This commit adds final pipeline to index settings and deprecates
required pipeline.
Mpdreamz pushed a commit to elastic/elasticsearch-net that referenced this pull request Feb 21, 2020
Relates: #4341, elastic/elasticsearch#49470

This commit adds final pipeline to index settings and deprecates
required pipeline.
github-actions bot pushed a commit to elastic/elasticsearch-net that referenced this pull request Feb 21, 2020
Relates: #4341, elastic/elasticsearch#49470

This commit adds final pipeline to index settings and deprecates
required pipeline.
Mpdreamz pushed a commit to elastic/elasticsearch-net that referenced this pull request Feb 21, 2020
Relates: #4341, elastic/elasticsearch#49470

This commit adds final pipeline to index settings and deprecates
required pipeline.

Co-authored-by: Russ Cam <russ.cam@elastic.co>
russcam added a commit to elastic/elasticsearch-net that referenced this pull request Feb 23, 2020
Relates: #4341, elastic/elasticsearch#49470

This commit adds final pipeline to index settings and deprecates
required pipeline.

(cherry picked from commit bfd4221)
joegallo added a commit to joegallo/elasticsearch that referenced this pull request Dec 19, 2022
It's about *final* pipelines (not *required* pipelines) -- see elastic#46847
and elastic#49470 for the history here, 'required' pipelines were renamed to
'final' pipelines.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve flexibility over index.required_pipeline
4 participants