Skip to content

Commit

Permalink
Add links to W&B Reports
Browse files Browse the repository at this point in the history
  • Loading branch information
tomaarsen committed Jan 15, 2025
1 parent ab36da9 commit 002a5ff
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion static-embeddings.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,8 @@ We apply this recipe to train two extremely efficient embedding models: [sentenc
Today, we are releasing:
- The two models (for English retrieval and for multilingual similarity) mentioned above.
- The detailed training strategy we followed, from ideation to dataset selection to implementation and evaluation.
- The two training scripts, based on the open-source sentence transformers library.
- Two training scripts, based on the open-source sentence transformers library.
- Two Weights and Biases reports with training and evaluation metrics collected during training.
- The detailed list of datasets we used: 30 for training and 13 for evaluation.

We also discuss potential enhancements, and encourage the community to explore them and build on this work!
Expand Down Expand Up @@ -732,6 +733,8 @@ if __name__ == "__main__":

This script produced [sentence-transformers/static-retrieval-mrl-en-v1](https://huggingface.co/sentence-transformers/static-retrieval-mrl-en-v1) after 17.8 hours of training. In total, it consumed 2.6 kWh of energy and emitted 1kg of CO2. That is roughly equivalent to the amount of CO2 an average person exhales per day.

See our [Weights and Biases report](https://api.wandb.ai/links/tomaarsen/b399d6ol) for the training and evaluation metrics collected during training.

#### Multilingual Similarity

<details><summary>Click to expand</summary>
Expand Down Expand Up @@ -1018,6 +1021,8 @@ if __name__ == "__main__":

This script produced [sentence-transformers/static-similarity-mrl-multilingual-v1](https://huggingface.co/sentence-transformers/static-similarity-mrl-multilingual-v1) after 3.1 hours of training. In total, it consumed 0.5 kWh of energy and emitted 0.2kg of CO2. That is roughly 20% of the CO2 that an average person exhales per day.

See our [Weights and Biases report](https://api.wandb.ai/links/tomaarsen/9it77pl0) for the training and evaluation losses collected during training.

## Usage

The usage of these models is very straightforward, identical to the normal Sentence Transformers flow:
Expand Down

0 comments on commit 002a5ff

Please sign in to comment.