Skip to content

Latest commit

 

History

History
1990 lines (990 loc) · 120 KB

CHANGELOG.md

File metadata and controls

1990 lines (990 loc) · 120 KB
Raw

CHANGELOG

v0.13.8 (2024-12-26)

Ci

  • ci: update docs ci for UV (f69313f)

  • ci: update docs ci for UV (0c99b3b)

  • ci: fix remaining ci (6459ea1)

  • ci: Update ci to work with uv (46c4af6)

  • ci: Update ci to use UV (b59f6e9)

Fix

Unknown

  • Merge pull request #189 from KennethEnevoldsen/add-jina

fix: re-add jina and add arctic (61d3255)

fix: Historical task (17e35a0)

with the exception of LCC which have been overwritten with new scores (369fb76)

v0.13.7 (2024-11-14)

Fix

  • fix: Add Jina

  • fix: Add Jina

I am still running the model

  • Add results for Jina

  • Add results for Jina

  • format fixes

  • Update mkdocs to legacy python

Co-authored-by: Your Name <you@example.com> (84c2f91)

  • fix: Add Jina

I am still running the model (702ba9d)

Unknown

  • Update mkdocs to legacy python (a04774d)

  • format fixes (6419b28)

  • Add results for Jina (85ed45e)

  • Add results for Jina (67818c2)

  • Moved historical task to experimental_tasks (e915f78)

  • Added results on the historical task (74b589b)

  • Added MiMe_Memo results (c494605)

  • Fixed historical clustering (979a282)

  • Fixed ruff version (b3c78cc)

  • Added Memo-bert-03 model (5c60d65)

  • Added instruction for new task on instruct models (6eb88ec)

  • Added new task to registry (1677dda)

  • Added historical danish clustering task (5e9a0b5)

v0.13.6 (2024-07-23)

Documentation

  • docs: fix sizes of tables (07a7ec3)

Fix

  • fix: Added language to KFST (c89856a)

Unknown

  • Merge pull request #182 from KennethEnevoldsen/add_kfst_model

fix: Added language to KFST (324dde4)

  • Merge pull request #180 from KennethEnevoldsen/add_kfst_model

docs: fix sizes of tables (e8848e2)

  • Merge pull request #179 from KennethEnevoldsen/add_kfst_model

Added kfst model (542511d)

v0.13.5 (2024-07-19)

Ci

  • ci: remove macos due to it being slow (452bfe2)

Documentation

  • docs: Added license for twitterhjerne (6d03507)

  • docs: Added licenses (c76535c)

Fix

  • fix: Added results from bge-m3 (3703bac)

  • fix: type checking ignore voyage (cd1da36)

  • fix: format (b77caf9)

  • fix: Added models results for voyage (fc19796)

  • fix: Added models results for newly added models (2b0cba5)

  • fix: Added new models (ea830fd)

Unknown

  • Merge pull request #178 from KennethEnevoldsen/add-models-and-muni-code

fix: Added bge, voyage, cmlm-multilingual and mxbai models (3e600a3)

docs: Added licenses (c8376f9)

v0.13.4 (2024-04-08)

Documentation

  • docs: minor updates to tables (9f7da4b)

Fix

  • fix: updated ruff dependency (7e7a7ae)

  • fix: Fixed broken HF links to scandeval (b99e300)

Unknown

  • Merge pull request #174 from KennethEnevoldsen/minor-fixes

fix: Fixing links for prs (5dc4ca3)

v0.13.3 (2024-02-23)

Documentation

  • docs: Updated tables to include task subtypes (e119c58)

Fix

  • fix: Added task subtypes to tasks

This follows the denotion in the paper. A task can have multiple task subtypes but only one task type. (7fc9ed5)

Unknown

  • Merge pull request #162 from KennethEnevoldsen/add-task-subtypes

Added task subtypes (363ab09)

v0.13.2 (2024-02-19)

Fix

  • fix: Pass the task for encode_queries, and encode_corpus

This yield notable performance improvements for the instruct models for retrieval tasks (9992e80)

Unknown

  • Merge pull request #156 from KennethEnevoldsen/fix_instruct_tuned_embed

fix: Pass the task for encode_queries, and encode_corpus (13786fe)

v0.13.1 (2024-02-19)

Chore

  • chore: remove test file (14f9935)

Documentation

  • docs: Updte docs script to handle new name format (aa171dd)

Fix

  • fix: fix incorrect emb. size for e5 large instruct (7865ad7)

  • fix: Added final for mult. e5 instruct, including speed test of ref. system (08e1779)

  • fix: added multilingual-e5-large-instruct (56bfc16)

  • fix: rename model_architecture to architecture to not take up protected attribute for pydantic (f845a49)

Unknown

  • Merge pull request #155 from KennethEnevoldsen/add-multilingual-instruct

Add multilingual e5 instruct (c2cca49)

v0.13.0 (2024-02-19)

Feature

  • feat: Ensure that all model names are consistent

i.e. that they have the same name as they would have on the benchmark (c2299cd)

Fix

  • fix: made the to method optional on the encoder (157a91c)

  • fix: Add to method to lazyloadencoder (0b6d0be)

  • fix: Ensure return type is always np.ndarray (e8d3994)

  • fix: Ensure return type is always np.ndarray (06c5cd8)

Unknown

  • Merge pull request #153 from KennethEnevoldsen/ensure-consistent-names

Ensure consistent names (83fd962)

v0.12.2 (2024-02-17)

Ci

  • ci: Added not planned as valid no stale label (a2dd834)

Fix

  • fix: Removed translate-embed integration test (adb9cd6)

  • fix: removing smaller translate then embed models (fbb9e97)

  • fix: removing smaller translate then embed models (91f6b79)

  • fix: Add missing scores (3b92090)

  • fix: Added e5 mistral scores (7515e79)

Style

Unknown

  • Merge pull request #143 from KennethEnevoldsen/run-e5

Updated e5-mistral model (0026c9c)

v0.12.1 (2024-02-15)

Documentation

  • docs: Added dataset disclaimer (#145) (6b3e71b)

Fix

  • fix: Updated tests (63d33c3)

  • fix: Applied linter and static type checks (b1baee9)

  • fix: Added get_documents to task interface (c4fb354)

  • fix: updated e5 model

fixed passing of batch size, ensure it can run on DanFEVER and avoid collecting to gradient (which lead to OOM errors) (189751d)

Unknown

v0.12.0 (2024-02-12)

Unknown

  • Merge pull request #137 from KennethEnevoldsen/update-sonar-models

Update and rerun sonar models (28ff5e5)

v0.11.4 (2024-02-12)

Feature

  • feat: Updated sonar models (f5f7374)

Fix

  • fix: Applied linter (702f804)

  • fix: Added model type and releae date to model meta

This is to allow the tracking of improvement on SEB over time (49c9f1a)

  • fix: Added results of the sonar models (d0988b6)

  • fix: ensure that sonar model are proberly moved to device (746934a)

  • fix: updated sonar requirement to handle >512 token sequences (792eb80)

  • fix: removed cache of sonar models, due to new update (c140b9f)

Unknown

  • Merge pull request #140 from KennethEnevoldsen/adding-architecture

fix: Added model type and releae date to model meta (245e881)

  • Merge pull request #131 from KennethEnevoldsen/mistral-instructions

Added instructions for all tasks in Mistral E5 (006c253)

  • Added instructions for all tasks in Mistral E5 (07c4c95)

v0.11.3 (2024-02-06)

Documentation

  • docs: Updated table w. dataset descriptions (f955379)

  • docs: Added across column for coverage

added swapped formalization and task columns (31d9d76)

Fix

  • fix: Updated dataset description metadata and script (0e63eb4)

  • fix: Update calc. descriptive stats (bdbd552)

Unknown

  • Merge pull request #130 from KennethEnevoldsen/docs-update

Update task/dataset descriptions (144f025)

v0.11.2 (2024-02-05)

Fix

  • fix: Updated table generation of the benchmark (c87aed4)

Style

Unknown

  • Merge pull request #127 from KennethEnevoldsen/run-models

Ran most of the models (db1868e)

v0.11.1 (2024-02-04)

Documentation

  • docs: sort model on new tables (d4d9e56)

  • docs: Minor grammatical fixes (633b47d)

  • docs: Added speed x performance tab to documentation (b3011a3)

  • docs: renamed run_benchmark to update_benchmark tables

Also disabled it actually running the model. Models are now run using seb run (da562b7)

  • docs: restructured dataset overview (30440f0)

Fix

  • fix: correctly check if model have a to() method (e2a1f44)

  • fix: ensure that the correct sentence transformer wrapper in using the CLI (03fff7f)

  • fix: removed GPU test from speed test

at least for the moment (a7600bd)

  • fix: Updated cache for models (ec07680)

  • fix: lower default batch size for e5 mistral model (3cdd55e)

  • fix: added e5 mistral cache (ecc85c4)

  • fix: Added cache for all smaller models on all tasks (789c8b7)

  • fix: added WPS to speed tasks and benchmark (7ebaca4)

  • fix: Updated scores for all API models (f10c01a)

  • fix: remove duplicate e5 mistral model (2de6ee2)

  • fix: Updated tables (d30284c)

Style

Unknown

Updated docs (02b5993)

Added LazyLoadEncoder, added SebModel and removed EmbeddingModel (4e1cd36)

v0.11.0 (2024-01-29)

Fix

  • fix: Added cache for speed benchmark (f3cd21e)

Unknown

  • Merge pull request #120 from KennethEnevoldsen/ran-speed-bench

fix: Added cache for speed benchmark (b4596c3)

  • Merge pull request #109 from KennethEnevoldsen/add-sts-retrieval-dataset

Add SNL Clustering task (9d1dae4)

  • Merge pull request #110 from KennethEnevoldsen/sts-retrieval

Add SNL retrieval (9412d71)

  • Merge branch 'add-sts-retrieval-dataset' into sts-retrieval (a1216bf)

v0.10.0 (2024-01-29)

Unknown

  • Merge pull request #113 from KennethEnevoldsen/twitterhjerne

Added twitterhjerne (a32dea2)

  • Merge pull request #117 from KennethEnevoldsen/nordjylland-retrieval

Added tv2nord retrieval dataset (1721983)

  • Merge pull request #118 from KennethEnevoldsen/norquad

Added NorQuad (0cf610d)

  • Merge pull request #119 from KennethEnevoldsen/updated-coverage-tables

Updated coverage tables (94f72d5)

  • Merge pull request #108 from KennethEnevoldsen/add-sts-retrieval

Restructured MTEB (115acef)

v0.9.4 (2024-01-28)

Documentation

  • docs: Updated coverage tables (3f848bd)

  • docs: allow error for now in docs (4617983)

Feature

  • feat: Added NorQuad (b1ab34d)

  • feat: Added tv2nord retrieval dataset (c315d94)

  • feat: Added twitterhjerne (8509c37)

  • feat: Added SNL Retrieval (b1169ff)

  • feat: Added SNL clustering (c380519)

  • feat: removed swedn sts to experimental tasks (6d22966)

Fix

  • fix: speed benchmark actually runs the speed tasks (7ae3ef0)

  • fix: Update wrong language tag. (6a143e7)

  • fix: remove ingress from the SNL corpus as they almost always contain the headline (617d616)

  • fix: restructure mteb tasks to its own folder (d88864d)

v0.9.3 (2024-01-28)

Fix

  • fix: Added new OpenAI Models (e096ef5)

v0.9.2 (2024-01-26)

Ci

  • ci: Updated lint workflow to actually fail when not linted (d1c177c)

Fix

  • fix: Added relevant type ignores (27b8dd3)

Unknown

  • Merge pull request #104 from KennethEnevoldsen/ci-lint

Ci lint (ade460b)

  • fixing linting error (1b75a4f)

  • introduce intentional lint error (d861935)

v0.9.1 (2024-01-26)

Fix

  • fix: ran swednsts and reduced dataset size (6c0a030)

  • fix: ensure that metrics is correctly formatted from MTEB (b5873b8)

Unknown

  • Merge pull request #100 from KennethEnevoldsen/sts_vs_retrieval

Reduce size of SwednSTS (c2c32b7)

Added integration test for four model types (f427a6d)

  • Merge pull request #92 from KennethEnevoldsen/custom_embeddings

Custom embeddings for E5 and Cohere + Interface changes to accomodate this (aeb32ce)

v0.9.0 (2024-01-26)

Feature

  • feat: Added performance metrics for danfever (22eb72b)

Fix

  • fix: limit the size of STS (0d1b659)

Unknown

  • Merge pull request #97 from KennethEnevoldsen/add-danfever

Add danFEVER (801753f)

v0.8.0 (2024-01-25)

Ci

  • ci: fix mispecified yaml syntax (ca5567c)

Documentation

  • docs: formatting code blocks (cee41f3)

  • docs: update docs to not run all models (90cef3d)

Feature

  • feat: Added danfever (ccec57c)

  • feat: Added VG clustering dataset (49e75d5)

  • feat: Add swedn clustering (0786ec5)

Fix

  • fix: Update indexes to strings (37d165f)

  • fix: fixed error arised from merge (11e28d6)

  • fix: updated based on static type checks (4752f07)

  • fix: move description to the end as to make printing of task object prettier (f8ec70d)

  • fix: reduced size of SwednClustering and ensure that clusters match with document size (0b70730)

Style

Test

  • test: Performance using 5x2048 examples is 8.13 (ed5cb5d)

  • test: Performance using 5x10000 examples is 13.80 (ed36b82)

  • test: Performance using 2x10000 examples is 8.70 (6fe30b7)

  • test: Performance using 10000 examples is 8.46 (630769c)

  • test: Performance using 1000 examples is 8.12 (7732c32)

  • test: Performance using 100 examples is 21.07 (82f7b3f)

Unknown

  • Merge pull request #96 from KennethEnevoldsen/add-swedn-clustering

Add Swedn and VG clustering datasets (8537e12)

Moved task types to task interface and deleted types module (7c3b582)

  • Added English to Language type (221bdd8)

  • Added pybind install to makefile (31d2a35)

  • Removed faulty import in E5 models (601002c)

  • Added fasttext to testing dependencies (045de9f)

  • Renamed test function (3c50f4f)

  • Moved integration test to new file (6d3ba6d)

  • Merge pull request #91 from KennethEnevoldsen/new_models

Added Jina base (95c515e)

  • Fixed import error in speed task (cfccbdf)

  • Added Jina base (6d1ec69)

  • Changed DKHate to LCC (8c004af)

  • Moved task types to task interface and deleted types module (2f1adf1)

v0.7.1 (2024-01-23)

Fix

  • fix: added task argument to TranslateE5 encoding (71dcd09)

Unknown

  • Merge pull request #87 from KennethEnevoldsen/new_models

Added XLM-Roberta large and LaBSE (74fcf43)

  • Merge pull request #85 from x-tabdeveloping/main

Added FastText and Translate-E5 models (2d9043e)

  • Removed commented-out lines (373b937)

  • Removed duplicate model (476d679)

  • Fixed duplicate model names (7275686)

  • Added XLM-Roberta large and LaBSE (858db1b)

  • Added integration test for four model types (61ff3bb)

  • Merging upstream into the branch so that it contains the fixed E5 models, that pass along the task. (f6f71db)

  • TranslateE5 now uses E5Wrapper to ensure task-correct embeddings and prefixes. (5eff1fc)

  • Translate now returns a single string instead of a list (e1cefd9)

v0.7.0 (2024-01-23)

Feature

  • feat: Added SwednRetrieval task

The idea is that it can be compared with SwednSTS to which one makes the most sense. (7fe3371)

Unknown

  • Merge pull request #82 from KennethEnevoldsen/add-retrieval-swedn

feat: Added SwednRetrieval task (d5f959d)

  • No longer imports ..types because of an error (c75629a)

  • Fasttext now loads on initialization instead of the first encode() call (e6b1fda)

  • Added Translate E5 models (33835af)

  • Added fasttext models to cache (fbc9482)

  • Fixed model names (d28f259)

  • Changed model fasttext names (7871ab5)

v0.6.0 (2024-01-22)

Fix

  • fix: Allow models to batch inputs (09c3527)

Unknown

  • Merge pull request #70 from KennethEnevoldsen/add-speed-task

Added speed task (d192e44)

v0.5.5 (2024-01-22)

Fix

  • fix: Add toggle for verbosity on the cli and remove duplicate entries in table (4d26fce)

Unknown

  • Merge pull request #74 from KennethEnevoldsen/verbosity_for_cli

Fix verbosity toggle on CLI and remove duplicate entries in table (99ef0f2)

v0.5.4 (2024-01-22)

Fix

  • fix: ScaLA now correctly wraps models to allow for task argument to be passed (3b07a4d)

Unknown

v0.5.3 (2024-01-22)

Feature

  • feat: Added speed task for estimating the speed of the embedding models (25caacc)

Fix

  • fix: ScaLA now correctly wraps models to allow for task argument to be passed Renamed scala cache (a70c950)

  • fix: fixed a type hint in tests (da32c0e)

Unknown

  • Merge pull request #73 from KennethEnevoldsen/bug-scala-missing-task-encode-wrapper

Wraps ScaLA models in MTEBTaskModel (e2eee05)

  • Merging with current status of Upstream (9c1fdf3)

  • Added Fasttext models for nb, nn, sv and da (4249333)

v0.5.2 (2024-01-19)

Documentation

  • docs: Added norwegian courts to table (4f31602)

Unknown

  • Merge pull request #66 from KennethEnevoldsen/allow-custom-embeddings

Allow custom embeddings (698453a)

v0.5.1 (2024-01-19)

Ci

  • ci: rename pre-commit to lint (1f3c743)

Documentation

  • docs: Updated CLI docs for run (8ff59b3)

  • docs: make sure that tutorials are tested on prs (e4ef73a)

  • docs: Updated tutorial with the CLI (525eaf2)

Fix

  • fix: Run command now print table for target models (b7d444b)

  • fix: Benchmark result now save in the same format as the cache (896c3bf)

  • fix: updated according to static type checks (f3c77aa)

  • fix: Added missing init file to make sure that docs build (8d44640)

  • fix: require positional argument for encoder (a7040a5)

  • fix: restructure repo (64bace6)

Unknown

  • Merge pull request #65 from x-tabdeveloping/main

Added Norwegian bitext mining task (2e8bb07)

  • Merge pull request #68 from KennethEnevoldsen/cli_updates

Added table to CLI (2457782)

  • Merge pull request #69 from KennethEnevoldsen/KennethEnevoldsen-patch-1

Update paper.md (1676c66)

Make sure that tutorials are tested on prs (ebf1640)

v0.5.0 (2024-01-15)

Fix

  • fix: Fixed errors derived from merge conflicts (5f086cc)

Unknown

  • Merge pull request #60 from KennethEnevoldsen/add-summarization

Add summarization (065b0e6)

v0.4.0 (2024-01-15)

Feature

  • feat: Allow tasks to be passed to benchmark instead of just strings (57a9b19)

Fix

  • fix: remove commented out code (04187b3)

  • fix: remove DKHate from tests (3192fff)

  • fix: Renamed Scala -> ScaLA to ensure cache hit on non osx system (d9f7b05)

  • fix: Added intfloat/e5-mistral-7b results to cache (93b0086)

Unknown

fix: Added new and more comprehensive CLI (2b0a47a)

This old one is no longer udated. (034b428)

  • Updated cookiecutter reference (71b7ead)

v0.3.1 (2024-01-15)

Documentation

  • docs: added execute flag (ea0e9ca)

Fix

  • fix: Added new and more comprehensive CLI

Including documentation and tests (14ca469)

  • fix: SebModel -> EmbeddingModel (d2f9efa)

  • fix: Allow embedding size to be None when using CLI (c621a8b)

Unknown

  • Merge pull request #58 from KennethEnevoldsen/update-cruft

Update cruft (870e442)

  • clean: removed pre-commit as it is no longer used (f1b5804)

  • updated from cruft template (bd7b11a)

v0.3.0 (2024-01-14)

Ci

  • ci: Updated some names in the workflow (b7c3012)

Documentation

  • docs: Added "government" domain to LCC (232dfee)

  • docs: Added documentation of dataset coverage to datasets (e4f9468)

  • docs: Added avg rank to benchmark table (15a821e)

Feature

  • feat: Added e5 mistral model (56c0971)

  • feat: Added option to not run a model (55cd023)

Fix

  • fix: Added Swedn dataset (ac6e744)

  • fix: refactor utils script out into its subcomponents (f36be90)

  • fix: Allow optional embedding size in ModelMeta

This makes the possible to create a on the fly models using the CLI (b0b4793)

  • fix: Updated CLI to now use models which is a part of the benchmark before wrapping it in sentence transformers (2b60c28)

  • fix: Added embedding size of models (2937099)

  • fix: Added mistral current scores (748d8a9)

  • fix: Added prettier prints when running benchmark (012bcd9)

  • fix: Added option to ignore cache (8f36080)

  • fix: removed typer dependency (e519917)

  • fix: removed duplicate on update bnehcmark (ef6270c)

  • fix: Added cache dir to all entry points (3fb4280)

Unknown

Add embedding size to benchmark (d40a633)

  • Merge pull request #50 from KennethEnevoldsen/run-using-cache

Add public cache to benchmark (67e571c)

Added command for running on ucloud (396f79b)

  • clean: remove test file from cache (89bb78f)

  • clean: removed test models from cache (10413e1)

  • clean: remove tests from cache (af1f52d)

  • Added test for checking if benchmark is up to date (8fa2545)

  • Moved cache dir to package (94d6468)

  • Added command for running on ucloud (c48b32e)

  • Merge pull request #45 from KennethEnevoldsen/updated_norwegian_parl

Updated desc. for norwegian parl. (985dd5d)

  • Updated desc. for norwegian parl. (c7f1e74)

  • Merge pull request #43 from KennethEnevoldsen/add-mistral

Added mistral dependencies (a4decba)

  • Added mistral dependencies (1d39008)

  • Merge pull request #40 from x-tabdeveloping/main

Added E5 Mistral (c317ad8)

v0.2.10 (2023-12-07)

Ci

  • ci: ensure full install in test ci (6144791)

  • ci: updated docs ci (4e3b89f)

  • ci: fix python version (dec0de6)

  • ci: remove cache from docs (b53fa67)

  • ci: lock python version (f00d8e8)

  • ci: Update pip and invalidate cache for doc ci (7c507a4)

Documentation

  • docs: fixed size of tables (f889199)

Fix

  • fix: ran ruff formatter (1d2341c)

  • fix: change to relative import for tests (3ec0673)

  • fix: Update from cruft template (5e055da)

Unknown

Update cruft and fix cruft template (c2bf0cf)

  • ignore type error (eb0b647)

  • add missing updated to the makefile (ec857ab)

  • Update cruft (8016bd5)

  • Merge pull request #38 from HLasse/patch-3

Update citation.cff (0b099be)

  • Update citation.cff (b7fad4e)

  • Merge pull request #36 from KennethEnevoldsen/KennethEnevoldsen-patch-1

Update README.md (8f3f9f9)

v0.2.9 (2023-11-18)

Build

  • build: Updated dependencies for mteb (f300ac5)

Ci

Fix

  • fix: added type ignore to optional imports (febfffb)

Unknown

v0.2.8 (2023-11-17)

Documentation

Fix

  • fix: ran pyrigt (e470a71)

  • fix: remove openai and cohere out of main dependencies (b023a88)

Unknown

  • Add cohere library and update task domains (ca4f8b8)

  • adding desc stats script (197c0d5)

v0.2.7 (2023-10-24)

Fix

Unknown

  • Merge pull request #27 from timpal0l/patch-1

Update hf_models.py (a72ac2f)

  • Update hf_models.py

Added sentence-transformers/paraphrase-multilingual-mpnet-base-v2 (c4d5886)

  • Merge pull request #25 from x-tabdeveloping/main

Language selection in CLI (4cb3f7e)

  • Merge branch 'KennethEnevoldsen:main' into main (9054c0a)

  • Corrected pre-commit errors (33c71ab)

  • CLI now accepts a list of languages as its input if none are passed the benchmark will be run on all languages (975418e)

  • Merge pull request #24 from x-tabdeveloping/main

CLI is error tolerant now. (0bcfa98)

  • Fixed issue with mean calculation in DaLAJ. (b5d2f6b)

  • CLI made error tolerant prints NA for unobtainable benchmark results (69be78a)

v0.2.6 (2023-10-19)

Fix

  • fix: ran pyright (fed9f84)

  • fix: ran pyright and pre-commit (04dacf5)

Unknown

  • Merge pull request #23 from KennethEnevoldsen/marton_changes

Fixes for #22 (0905a51)

v0.2.5 (2023-10-19)

Fix

  • fix: update ci based on cruft template (32ea08d)

Unknown

v0.2.4 (2023-09-25)

Fix

  • fix: Converted e5 embedding to the one specified by the docs (796a8dc)

  • fix: ran ruff (172ad9a)

Style

Unknown

  • Merge pull request #21 from KennethEnevoldsen/KennethEnevoldsen/issue-Allow-custom-embeddings-based-on-the-task

Fix e5 models (af8cb17)

v0.2.3 (2023-09-25)

Ci

Fix

  • fix: type hint (abeb2a7)

  • fix: Added handling of long text for openai (20b087c)

Unknown

v0.2.2 (2023-09-25)

Fix

Style

Unknown

Add OpenAI embeddings (0ef4b34)

v0.2.1 (2023-09-13)

Fix

  • fix: Updated benchmark to handle errors (bdceba6)

  • fix: Updated names and table sizes (7257d82)

Unknown

v0.2.0 (2023-09-04)

Build

  • build: only import fairseq models if fairseq2 is installed (07dc22e)

  • build: move fairseq and sonar to optional dependencies (0969f57)

  • build: change to pypi version of fairseq2 (58a62c9)

  • build: add sonar and fairseq2 dependencies (03d3971)

Documentation

  • docs: human translated != machine translated (0d8f86a)

  • docs: Updated docs (423fd4e)

  • docs: removed requirements for social card (fb37b26)

Feature

Fix

  • fix: Overwriting task creator (5da1aed)

  • fix: Updated such that sonar model will get registrered, but not run (28d151f)

  • fix: Updated pyright (6fe494f)

  • fix: Updated task name (f81266a)

  • fix: make sonar return numpy.ndarray (b1db630)

  • fix: unique names for sonar models (d7f353d)

  • fix: add model imports to init (267fb0b)

  • fix: change folder structure, add sonar model per language (94a293c)

  • fix: add languages to sonar model (f1d81a1)

  • fix: Added beir requirement for retrieval tasks (2a614ba)

  • fix: Updated metadata for SweFAQ (cc2d6c3)

  • fix: Updated dataset name (48db87e)

Style

Unknown

feat: add sonar model (082c157)

  • Merge pull request #15 from KennethEnevoldsen/dependabot/pip/pyright-1.1.324

deps:(deps-dev): bump pyright from 1.1.323 to 1.1.324 (7cfd512)

  • deps:(deps-dev): bump pyright from 1.1.323 to 1.1.324

Bumps pyright from 1.1.323 to 1.1.324.

updated-dependencies:

  • dependency-name: pyright dependency-type: direct:production update-type: version-update:semver-patch ...

Signed-off-by: dependabot[bot] <support@github.com> (7774c60)

  • Merge pull request #13 from KennethEnevoldsen/dependabot/pip/pyright-1.1.323

deps:(deps-dev): bump pyright from 1.1.322 to 1.1.323 (48142d3)

  • deps:(deps-dev): bump pyright from 1.1.322 to 1.1.323

Bumps pyright from 1.1.322 to 1.1.323.

updated-dependencies:

  • dependency-name: pyright dependency-type: direct:production update-type: version-update:semver-patch ...

Signed-off-by: dependabot[bot] <support@github.com> (99e112d)

  • Merge pull request #12 from KennethEnevoldsen/dependabot/pip/pyright-1.1.322

deps:(deps-dev): bump pyright from 1.1.320 to 1.1.322 (8086b5a)

  • deps:(deps-dev): bump pyright from 1.1.320 to 1.1.322

Bumps pyright from 1.1.320 to 1.1.322.

updated-dependencies:

  • dependency-name: pyright dependency-type: direct:production update-type: version-update:semver-patch ...

Signed-off-by: dependabot[bot] <support@github.com> (2bd7736)

  • Merge pull request #11 from KennethEnevoldsen/dependabot/pip/pyright-1.1.320

deps:(deps-dev): bump pyright from 1.1.318 to 1.1.320 (be26f91)

  • deps:(deps-dev): bump pyright from 1.1.318 to 1.1.320

Bumps pyright from 1.1.318 to 1.1.320.

updated-dependencies:

  • dependency-name: pyright dependency-type: direct:production update-type: version-update:semver-patch ...

Signed-off-by: dependabot[bot] <support@github.com> (2032c84)

v0.1.5 (2023-08-01)

Ci

  • ci: fixed version pointer (4af85d1)

Documentation

Fix

  • fix: pyproject.toml version reference (5968bd7)

Unknown

v0.1.4 (2023-08-01)

Documentation

  • docs: Updated links in badge (8e3ab16)

Fix

  • fix: ci: removed outdated variables from pyproject.toml (b43edd8)

Unknown

v0.1.3 (2023-08-01)

Ci

Fix

Unknown

v0.1.2 (2023-08-01)

Ci

  • ci: re-added gh token (a280ee6)

  • ci: Updated release ci to use pypi trusted publishing (e5cec02)

Fix

Unknown

v0.1.1 (2023-08-01)

Fix

  • fix: Added documentation to all outward facing functions (ac96fc1)

Unknown

v0.1.0 (2023-08-01)

Build

  • build: Added python 3.11 (2084983)

  • build: Added missing requirement for docs (c9d9090)

Ci

  • ci: updated to latest version of release (bc6394f)

  • ci: fix release action (419dc23)

  • ci: Fix inv script to avoid issues with pyright (63de866)

  • ci: fix url (669b258)

  • ci: Updated docs build to mkdocs (9cae854)

  • ci: Removed windows from CI (4d037c2)

  • ci: Added macOS and windows OS (e4084eb)

Documentation

  • docs: Added missing dependencies for docs (ba4fc76)

  • docs: retrying to get the social card to work (6403f7d)

  • docs: Minor adjustment (4fc6881)

  • docs: Added social card (1b692f6)

  • docs: Updated references when sharing table (7e45a7a)

  • docs: Updated table with new models (7083239)

  • docs: minor updates to index page (8a883c4)

  • docs: testing iframes (d415cb8)

  • docs: Updated page tile (ce6ed9a)

  • docs: Updated tables (dcceccb)

  • docs: fixed heights (6750010)

  • docs: Updated tables (f62e506)

  • docs: added notice regarding tests (b356e62)

  • docs: Updated description (67f0200)

  • docs: Updated tables (aa9d7d0)

  • docs: Minor changes to headings (5fda1ff)

  • docs: added logo (56d26f8)

  • docs: Added logo (79d1a17)

  • docs: Updated readme (fe57c81)

  • docs: Updated the documentation (4875b62)

  • docs: Added link and removed nav. on main page (1f284db)

  • docs: Updated docs workflow to use mkdocs (2b7a6b4)

Feature

  • feat: add multilingual sentence transformer (6e4ae7a)

  • feat: Bumped version

Still awaiting PR: embeddings-benchmark/mteb#128 (5240256)

Fix

  • fix: removed hotfix for MTEB (c2e08b3)

  • fix: Added language codes for English models (8615d3d)

  • fix: Added ignore for static type check (caca3d7)

  • fix: temporary hotfix while waiting for mteb merge

waiting for embeddings-benchmark/mteb#128 (932b847)

  • fix: Updated string handling for model references (39a1060)

  • fix: Correctly sorted values in tables (e69b4bb)

  • fix: Added full benchmark (e3d179c)

  • fix: Updated type hint (963b099)

  • fix: Updated language codes to exclude "no" (c2c14ed)

  • fix: filtered logging and added progress bar (ada3dae)

  • fix: Added time to task errors as well (4c79425)

  • fix: Updated task versioning (2bc628f)

  • fix: Added all models (8b69593)

  • fix: Added cache and error handling (e400cfa)

  • fix: Test loads and fail (d66b1a6)

  • fix: removed cli for now (ab03b7b)

Style

  • style: Only enforce pyright on src folder (0692145)

Unknown

feat: add multilingual sentence transformer (15b8045)

  • Merge pull request #4 from HLasse/patch-1

docs: minor updates to index page (c3d7b69)

deps:(deps-dev): bump pyright from 1.1.305 to 1.1.318 (d5f448e)

  • Merge pull request #1 from KennethEnevoldsen/dependabot/pip/invoke-2.2.0

deps:(deps-dev): bump invoke from 2.1.1 to 2.2.0 (c463449)

  • deps:(deps-dev): bump pyright from 1.1.305 to 1.1.318

Bumps pyright from 1.1.305 to 1.1.318.

updated-dependencies:

  • dependency-name: pyright dependency-type: direct:production update-type: version-update:semver-patch ...

Signed-off-by: dependabot[bot] <support@github.com> (3b28588)

  • deps:(deps-dev): bump invoke from 2.1.1 to 2.2.0

Bumps invoke from 2.1.1 to 2.2.0.

updated-dependencies:

  • dependency-name: invoke dependency-type: direct:production update-type: version-update:semver-minor ...

Signed-off-by: dependabot[bot] <support@github.com> (c114c6b)