Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError when indexing with FAISS #232

Open
kalinduaet opened this issue Jul 16, 2024 · 4 comments
Open

RuntimeError when indexing with FAISS #232

kalinduaet opened this issue Jul 16, 2024 · 4 comments

Comments

@kalinduaet
Copy link

I'm getting this error when I try to index document with FAISS. Is there way change number or cluster?
RuntimeError: Error in void faiss::Clustering::train_encoded(faiss::idx_t, const uint8_t*, const faiss::Index*, faiss::Index&, const float*) at /project/faiss/faiss/Clustering.cpp:261: Error: 'nx >= k' failed: Number of training points (109) should be at least as large as number of clusters (128)

@alpborcek
Copy link

same for me?

@mr-shitij
Copy link

I am getting below error. any solution ?

assert classname.endswith('Vector')
       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

AssertionError

@bclavie
Copy link
Collaborator

bclavie commented Aug 17, 2024

Hey,

  • @mr-shitij, not sure what this error is, but it's an odd that is more likely to be related to your faiss install.
  • @alpborcek and @kalinduaet, this should only occur when trying to create extremely small indexes. Is this what you are currently doing? Next version of RAGatouille will ship with a version that bypasses this process entirely for indexes that are small-sized, so the error will go away.

@mr-shitij
Copy link

Hey,

  • @mr-shitij, not sure what this error is, but it's an odd that is more likely to be related to your faiss install.
  • @alpborcek and @kalinduaet, this should only occur when trying to create extremely small indexes. Is this what you are currently doing? Next version of RAGatouille will ship with a version that bypasses this process entirely for indexes that are small-sized, so the error will go away.

Thanks for reply; It got solved there is problem in my end ..!!
Thank You.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants