Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] [Draft] AI Performance Matrix Update #5950

Closed
Charelzard opened this issue Oct 16, 2024 · 4 comments · Fixed by #6268
Closed

[Request] [Draft] AI Performance Matrix Update #5950

Charelzard opened this issue Oct 16, 2024 · 4 comments · Fixed by #6268
Assignees
Labels
blocked An issue that's currently blocked because it’s pending info or action from stakeholders.

Comments

@Charelzard
Copy link

Description

We are updating the model matrix testing and need the main page updated here to reflect performance tests: https://www.elastic.co/guide/en/security/current/llm-performance-matrix.html

Background & resources

  • PRs:
  • Issues/metas:
  • Point of contact:
  • Test environments:

Which documentation set does this change impact?

ESS and serverless

ESS release

N/A

Serverless release

N/A

Feature differences

N/A

API docs impact

N/A

Prerequisites, privileges, feature flags

N/A

@Charelzard
Copy link
Author

FYI @jamesspi

@Charelzard
Copy link
Author

Link will be provided once testing is complete.

@benironside benironside added the blocked An issue that's currently blocked because it’s pending info or action from stakeholders. label Nov 11, 2024
@dhru42
Copy link
Collaborator

dhru42 commented Dec 2, 2024

Image
Please update the AI Matrix to reflect the changes in this image.

@jamesspi
Copy link
Collaborator

jamesspi commented Dec 3, 2024

@dhru42 I believe Sonnet 3.5 v2 should also have ES|QL generation down as excellent.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked An issue that's currently blocked because it’s pending info or action from stakeholders.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants