Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NLP] Add model compatibility check mode to eland_import_hub_model.py #599

Open
davidkyle opened this issue Sep 12, 2023 · 0 comments
Open
Labels
enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model

Comments

@davidkyle
Copy link
Member

The best way to check if a model is compatible with Elasticsearch is to run the eland_import_hub_model.py script but this requires the user to configure the Elasticsearch connection settings and possibly even spin up an Elasticsearch cluster in order to get past the connection test.

Add a command option to the script that will download the model and check it is compatible with Elastic without uploading the model to Elasticsearch. This is a convenience to quickly check if a model is compatible with minimal configuration.

Invoking the script might look like:

    eland_import_hub_model \
      --is-compatible
      --hub-model-id 'sentence-transformers/msmarco-MiniLM-L-12-v3 \
      --task-type text_embedding
@davidkyle davidkyle added the enhancement New feature or request label Sep 12, 2023
@pquentin pquentin added the topic:NLP Issue or PR about NLP model support and eland_import_hub_model label Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request topic:NLP Issue or PR about NLP model support and eland_import_hub_model
Projects
None yet
Development

No branches or pull requests

2 participants