Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Makes sure KNNVectorValues aren't recreated unnecessarily when #2133

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

shatejas
Copy link
Contributor

@shatejas shatejas commented Sep 20, 2024

quantization isn't needed

Description

This is an attempt to address the regression seen in force-merge time for cohere-10m dataset.

The perf for force merge showed improvements in 1m dataset

  number of index segments force merge time (minutes) force merge segments
2.17 code 75 15.68263 3
Current PR 92 12.51252 3

Related Issues

#2134

Check List

  • New functionality includes testing.
  • New functionality has been documented.
  • API changes companion pull request created.
  • Commits are signed per the DCO using --signoff.
  • Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

quantization isn't needed

Signed-off-by: Tejas Shah <shatejas@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant