-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
community[minor] HuggingFaceTransformersEmbeddings enhancements #6059
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice! Thanks for pushing this up, looks like a good improvement to add.
Additionally, it would be great if you could add a small section in the docs showing off the new options/an example showing why people might want to use them, but not required.
Granted CI passes, I'll land this EOD today.
Thank you! |
Thanks for landing. Yes sure, i'll submit a follow-up with docs |
HuggingFaceTransformersEmbeddings
uses afeature-extraction
pipeline from@xenova/transformers
.This change adds support for providing arguments (
pretrainedOptions
) to the creation of the pipeline and when executing the pipeline (pipelineOptions
). Also bumps@xenova/transformers
to the latest.^2.5.4
->^2.17.2
pretrainedOptions
to constructor args objectHuggingFaceTransformersEmbeddingsParams
. This is passed to @xenova/transformers when creating a pipeline.pipelineOptions
to constructor args objectHuggingFaceTransformersEmbeddingsParams
. This is passed to the pipeline when executing it. There prev. arguments which where hardcoded remain the default for backwards compatibility.