Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENHANCEMENT] Integrate with template query and ext improvements in ML commons #548

Open
ohltyler opened this issue Dec 26, 2024 · 1 comment
Labels
enhancement New feature or request v3.0.0 Issues targeting release v3.0.0

Comments

@ohltyler
Copy link
Member

There are few enhancements made in core OpenSearch and in ML commons that can help smooth the search experience. Updates in the presets and general UI should be done to leverage these backend updates. Some ideas:

  1. For template query, this can eliminate the query overriding required in the ML processors in the default use cases. Rather than having a separate preset query defined in the ML processors, that query can be defined directly within the template clause. The ML processor preset can then be updated to just parse out what fields to parse as input, and where to store in the output (e.g., parsing some input field to generate embeddings for, and store the generated embeddings in some query field)
  2. For ext improvements, the RAG use case can be updated to store the ML search response processors LLM response under the ext field. And, explore some enhancements in the search response UI to easily show the ext response.
@ohltyler ohltyler added v2.19.0 enhancement New feature or request labels Dec 26, 2024
@ohltyler ohltyler added v3.0.0 Issues targeting release v3.0.0 and removed v2.19.0 labels Jan 27, 2025
@ohltyler
Copy link
Member Author

Relevant PRs:
opensearch-project/OpenSearch#16818
opensearch-project/ml-commons#3284

Template query may not be backported to 2.x, so integrating with this feature for 2.x is on hold.
ext improvement is still not merged, with only one day remaining until code freeze, so integrating with this feature for 2.x is also on hold.

Updated label to 3.0 due to the delays.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request v3.0.0 Issues targeting release v3.0.0
Projects
None yet
Development

No branches or pull requests

1 participant