Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Allow for injection of job parameters upon module setup #42409

Closed
weltenwort opened this issue Jul 31, 2019 · 1 comment · Fixed by #42946
Closed

[ML] Allow for injection of job parameters upon module setup #42409

weltenwort opened this issue Jul 31, 2019 · 1 comment · Fixed by #42946
Assignees
Labels
enhancement New value added to drive a business result Feature:Anomaly Detection ML anomaly detection :ml v7.4.0

Comments

@weltenwort
Copy link
Member

Summary

This proposes to enhance the module setup route at /api/ml/modules/setup/:moduleId such that it is possible to directly specify parameters such as the indices (in the usual Elasticsearch syntax including wildcards) and field names (e.g. the timestamp and other fields used in detectors).

Rationale

Two limitations currently make it hard or impossible for solutions to integrate with Machine Learning via this API:

  • The Elasticsearch indices are either specified via hard-coded index names or via Kibana index patterns which are then resolved to index names. (Side-note: The resolution currently seems to use the Kibana index pattern id as the index name, which doesn't match Kibana's index pattern semantics: the id is an opaque uuid while the title attribute holds the index name(s).)

  • Other job parameters such as the timestamp field and detector fields can only be hard-coded in the module specification.

Solutions such as the Infra and Logs UIs neither use Kibana index patterns nor are they limited to static field semantics. As a consequence, jobs created by such solutions as part of an integration with Machine Learning would have to be dynamically parameterized at setup time.

Acceptance criteria

  • The module setup API allows for any parameter of the job definitions to be specified when invoked.
  • The indices can be specified directly via the usual Elasticsearch index name syntax (wildcards, comma-separated list) without the need for a Kibana index pattern.
@weltenwort weltenwort added enhancement New value added to drive a business result :ml Feature:Anomaly Detection ML anomaly detection labels Jul 31, 2019
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Feature:Anomaly Detection ML anomaly detection :ml v7.4.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants