Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Observability AI Assistant] Boost user prompts in recall #180995

Closed
dgieselaar opened this issue Apr 17, 2024 · 0 comments · Fixed by #184933
Closed

[Observability AI Assistant] Boost user prompts in recall #180995

dgieselaar opened this issue Apr 17, 2024 · 0 comments · Fixed by #184933
Assignees
@sorenlouv
Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant Observability AI Assistant
Milestone
8.15

Comments

@dgieselaar
Copy link
Member

We've had reports of where the screen description pollutes results from the knowledge base, resulting in too much noise. We send over both the user prompt and the screen description, we should boost the user prompt to make sure it contributes more to scoring, in order to get more relevant results. Something like x3 would be a good starting point to evaluate.
@dgieselaar dgieselaar added the Team:Obs AI Assistant Observability AI Assistant label Apr 17, 2024
@emma-raffenne emma-raffenne added this to the 8.14 milestone Apr 23, 2024
@emma-raffenne emma-raffenne added the bug Fixes for quality problems that affect the customer experience label Apr 23, 2024
@emma-raffenne emma-raffenne modified the milestones: 8.14, 8.15 May 31, 2024
@sorenlouv sorenlouv self-assigned this Jun 4, 2024
@sorenlouv sorenlouv mentioned this issue Jun 6, 2024
Merged
sorenlouv added a commit that referenced this issue Jun 8, 2024
@sorenlouv @dgieselaar
[Obs AI Assistant] Boost user prompt in recall (#184933)
baa22bb 
Closes: #180995

---------

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
eokoneyo pushed a commit to eokoneyo/kibana that referenced this issue Jun 13, 2024
@sorenlouv @dgieselaar @eokoneyo
[Obs AI Assistant] Boost user prompt in recall (elastic#184933)
60aa207 
Closes: elastic#180995

---------

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
sorenlouv added a commit to sorenlouv/kibana that referenced this issue Jul 1, 2024
@sorenlouv
[Obs AI Assistant] Boost user prompt in recall (elastic#184933)
39e83df 
Closes: elastic#180995

---------

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
(cherry picked from commit baa22bb)

# Conflicts:
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/get_context_function_request_if_needed.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/index.test.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/index.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant_app/public/components/chat/chat_body.test.tsx
sorenlouv referenced this issue Jul 2, 2024
@sorenlouv
[8.14] [Obs AI Assistant] Boost user prompt in recall (#184933) (#187313
80f454d 
)

# Backport

This will backport the following commits from `main` to `8.14`:
- [[Obs AI Assistant] Boost user prompt in recall
(#184933)](#184933)

<!--- Backport version: 9.5.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Søren
Louv-Jansen","email":"soren.louv@elastic.co"},"sourceCommit":{"committedDate":"2024-06-08T20:32:49Z","message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<dario.gieselaar@elastic.co>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746","branchLabelMapping":{"^v8.15.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","auto-backport","Team:Obs
AI
Assistant","ci:project-deploy-observability","v8.15.0","v8.14.2"],"title":"[Obs
AI Assistant] Boost user prompt in
recall","number":184933,"url":"https://github.com/elastic/kibana/pull/184933","mergeCommit":{"message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<dario.gieselaar@elastic.co>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746"}},"sourceBranch":"main","suggestedTargetBranches":["8.14"],"targetPullRequestStates":[{"branch":"main","label":"v8.15.0","branchLabelMappingKey":"^v8.15.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/184933","number":184933,"mergeCommit":{"message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<dario.gieselaar@elastic.co>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746"}},{"branch":"8.14","label":"v8.14.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
sorenlouv added a commit to sorenlouv/kibana that referenced this issue Dec 10, 2024
@sorenlouv
[Obs AI Assistant] Boost user prompt in recall (elastic#184933)
164dc34 
Closes: elastic#180995

---------

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
(cherry picked from commit baa22bb)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@sorenlouv sorenlouv

Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant Observability AI Assistant
Projects
None yet
Milestone
8.15
Development

Successfully merging a pull request may close this issue.

[Obs AI Assistant] Boost user prompt in recall sorenlouv/kibana
3 participants
@sorenlouv @dgieselaar @emma-raffenne