Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Update k-NN plugin documentation to reflect AVX512_spr SIMD optimization update #9108

Open
1 of 4 tasks
naveentatikonda opened this issue Jan 23, 2025 · 0 comments
Open
1 of 4 tasks
Assignees
Labels
1 - Backlog - DEV Developer assigned to issue is responsible for creating PR. v2.19.0

Comments

@naveentatikonda
Copy link
Member

What do you want to do?

  • Request a change to existing documentation
  • Add new documentation
  • Report a technical problem with the documentation
  • Other

Tell us about your request. Provide a summary of the request.
FAISS recently added a new build mode, avx512_spr, which enables the use of advanced AVX512 instructions available since Intel® Sapphire Rapids. These instructions include avx512_fp16, avx512_bf16, avx512_vpopcntdq, and many others. Some optimizations leveraging these instructions, such as speeding up Hamming distance evaluation for binary vectors, have already been implemented and merged. Additional optimizations are also in the pipeline. This PR enables K-NN to utilize this new avx512_spr build mode.

If the underlying system is an Intel® Sapphire Rapids or a newer-generation processor, avx512_spr binaries are generated. Otherwise, depending on the features available in the system and consistent with the existing implementation, avx512, avx2, or generic binaries may be generated.

Version: List the OpenSearch version to which this issue applies, e.g. 2.14, 2.12--2.14, or all.
2.19

What other resources are available? Provide links to related issues, POCs, steps for testing, etc.
opensearch-project/k-NN#2404

@Naarcha-AWS Naarcha-AWS added 1 - Backlog - DEV Developer assigned to issue is responsible for creating PR. and removed untriaged labels Jan 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
1 - Backlog - DEV Developer assigned to issue is responsible for creating PR. v2.19.0
Projects
None yet
Development

No branches or pull requests

2 participants