This repository has been archived by the owner on Sep 18, 2024. It is now read-only.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Draft release note:
Release Note Finetuner 0.7.9
This release covers Finetuner version 0.7.9, including dependencies finetuner-core 0.13.9.
This release contains 1 new features and 1 refactoring.
🆕 Features
Add jina embeddings suite. (#757)
We have made contributions to the open source community by releasing three pre-trained embedding models:
jima-embedding-s-en-v1
: 35 million parameter compat embedding model.jina-embedding-b-en-v1
: 110 million parameter standard sized embedding model.jina-embedding-l-en-v1
: 330 million parameter large embeddding model.All three embedding models have been trained using Jina AI's Linnaeus-Clean dataset. This dataset consists of 380 million pairs of sentences, which include both query-document pairs. These pairs were obtained from various domains and were carefully selected through a thorough cleaning process. The Linnaeus-Full dataset, from which the Linnaeus-Clean dataset is derived, originally contained 1.6 billion sentence pairs.
If you wish to utilize these embeddings with Finetuner (Apache 2.0), please follow the instructions below:
⚙ Refactoring
Change installation behavior. (#757)
With the launch of Finetuner 0.7.9, installing it using
pip install finetuner
will automatically include the necessary torch-related dependencies. This enables Finetuner to function as an optimal provider of embedding models. If you intend to fine-tune an embedding model, please ensure that you install Finetuner with the additional dependencies by using the commandpip install "finetuner[full]"
.🤟 Contributors
We would like to thank all contributors to this release: