[ML] Reject data frame analytics using runtime fields if not all node… #69331
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…s support it When a data frame anylytics job config contains runtime mappings, when the task starts the destination index will be created with a `runtime` section in its mappings. If the cluster contains nodes that are on a version prior to the addition of runtime fields, the index creation will fail. Thus, this commit adds a check to prevent such jobs from being created and it informs the user on the preconditions for using runtime fields in data frame analytics.
Collaborator
|
Pinging @elastic/ml-core (Team:ML) |
dimitris-athanasiou
deleted the
reject-dfa-jobs-that-use-runtime-fields-if-cluster-lacks-support
branch
dimitris-athanasiou
added a commit
that referenced
this pull request
Feb 25, 2021
) As we make use of the field caps API `runtime_mappings` feature we should prevent data frame analytics jobs from being created in a cluster that contains nodes prior to 7.12. Relates #69331
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
…s support it
When a data frame anylytics job config contains runtime mappings, when the task
starts the destination index will be created with a
runtimesection in its mappings.If the cluster contains nodes that are on a version prior to the addition of runtime
fields, the index creation will fail. Thus, this commit adds a check to prevent such
jobs from being created and it informs the user on the preconditions for using
runtime fields in data frame analytics.