1.36.20

1.36.20 (2025-03-12)

Fix

• fix: Add WebFAQ bitext mining tasks (#2326)

• Add WebFAQ bitext mining tasks

Signed-off-by: Michael Dinzinger <michael.dinzinger@uni-passau.de>

• Lower number of language pairs in WebFAQBitextMining

Signed-off-by: Michael Dinzinger <michael.dinzinger@uni-passau.de>

---

Signed-off-by: Michael Dinzinger <michael.dinzinger@uni-passau.de> (04cfe4d)

Unknown

• Update tasks table (d716408)

1.36.19

1.36.19 (2025-03-11)

Documentation

• docs: fix typos (849efbb)

Fix

• fix: Add ModelMeta rubert-mini-frida, BERTA (#2330)

• Add rubert-mini-frida model meta

• Add BERTA model meta (ae83b5f)

1.36.18

1.36.18 (2025-03-11)

Fix

• fix: add annotation models for stella zh (#2277)

• fix: add annotation models for stella zh

Additionally fixed a few annotation errors

• format

• Update mteb/models/stella_models.py

Co-authored-by: Isaac Chung <chungisaac1217@gmail.com>

---

Co-authored-by: Isaac Chung <chungisaac1217@gmail.com> (034da4d)

1.36.17

1.36.17 (2025-03-11)

Fix

• fix: remove SyntaxWarnings in py312 (#2325)

• fix: Resolve conflicting dependencies

These errors where discovered when trying to install the package using uv.

We have a problem with salesforce-lavis, which is not compatible with the current set of dependencies.

• fix: Remove syntax warnings occuring in python 3.12

Python 3.12.0 (main, Oct  2 2023, 20:56:14) [Clang 16.0.3 ] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import mteb # no syntax warnings
>>>
``` ([`fc176ad`](https://github.com/embeddings-benchmark/mteb/commit/fc176ad3df466ccb4a31a0f9b90aad1de96ca87a))

1.36.16

1.36.16 (2025-03-11)

Fix

• fix: Resolve conflicting dependencies (#2323)

These errors where discovered when trying to install the package using uv.

We have a problem with salesforce-lavis, which is not compatible with the current set of dependencies. (8f6bf45)

Unknown

• Added VDR Model (#2290)

• Added VDR Model

• change custom wrapper to SentenceTransformer Wrapper

• remove kwargs and add TODO for Image Modality

• Update mteb/models/vdr_models.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

---

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (7965aad)

1.36.15

1.36.15 (2025-03-11)

Fix

• fix: Update voyage name to include Org. (#2322) (746b411)

1.36.14

1.36.14 (2025-03-10)

Ci

• ci: Add pre-commit hook (#2194)

• make dev life nicer - pre-commit hooks

• add pre-commit to install

• update precommit

• update ruff pre-commit

• lint

• lint

---

Co-authored-by: sam021313 <40773225+sam021313@users.noreply.github.com> (5b30d84)

Fix

• fix: bug in voyage implementation (#2304)

• fix: Fix bug in voyage implementation

"passage" is not a valid input for the voyage API. Remapped to "document".

• Update mteb/models/voyage_models.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

---

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com> (6193db1)

Unknown

• Update tasks table (5e3915e)

1.36.13

1.36.13 (2025-03-09)

Fix

• fix: Add ModelMeta license & custom validations (#2293)

• license validation

• move licenses

• update imports

---

Co-authored-by: Isaac Chung <chungisaac1217@gmail.com> (5dce601)

1.36.12

1.36.12 (2025-03-09)

Fix

• fix: Added Filter Modality (#2262)

• Added Filter Modality

• resolve suggestions

• make lint

• make sure test pass

• make lint

• added exclusive_modality_filter and unit tests

• Integrate tests on overview.py

• Update tests/test_overview.py

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>

• added task related to image modality

• Update mteb/abstasks/AbsTask.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• Update mteb/abstasks/AbsTask.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• update overview..py

• make lint

• update documentation

---

Co-authored-by: Roman Solomatin <samoed.roman@gmail.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (f840f7d)

1.36.11

1.36.11 (2025-03-08)

Ci

• ci: run test_dataset_on_hf separately (#2201)

• dont run test_dataset_on_hf in every pr

• lint

• Update call pytest test_datasets

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• Update tests/test_tasks/test_all_abstasks.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• not datasets for test

• run dataset loading test for push or pull_request

• apply feedback

---

Co-authored-by: sam021313 <40773225+sam021313@users.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (55b9a0e)

Fix

• fix: Run remaining MIEB desc stats (#2288)

• run Vidore

• GLDv2

• run the rest

---

Co-authored-by: Isaac Chung <isaac@hn496lf4f9.lan> (e628bce)

Unknown

• Update tasks table (dd7008d)

• update link (#2281) (9513f15)

• add gemini-embedding-exp-03-07 (#2279)

• add gemini-embedding-exp-03-07

• remove space for lint

• lint fix (fb1b04c)