Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

inatNLS improvements #138

Open
alexshepard opened this issue Oct 31, 2024 · 0 comments
Open

inatNLS improvements #138

alexshepard opened this issue Oct 31, 2024 · 0 comments
Assignees
@alexshepard

Comments

@alexshepard
Copy link
Contributor

alexshepard commented Oct 31, 2024 •
edited
Loading

our research collaborators have requested a few improvements to our NLS demo:

  1. add more images to the index,
  2. switch from clip-ViT-B-32 model to google/siglip-so400m-patch14-384

siglip-so400m-patch14-384 has a 1152 element embedding dimension, so it'll be more data to store per image than the clip model. it's also noticeably slower than clip-ViT-B-32 so it'll take longer to generate the index.
@alexshepard alexshepard self-assigned this Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@alexshepard alexshepard

Labels
None yet
Projects
iNat ML
Status: No status
Milestone
No milestone
Development

No branches or pull requests
1 participant
@alexshepard