Skip to content

Issues: embeddings-benchmark/mteb

Merge v2.0.0: Overview issue
#1791 opened Jan 13, 2025 by KennethEnevoldsen
Open 2
Overview: Leaderboard release
#1867 opened Jan 24, 2025 by x-tabdeveloping
Open 26
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

184 Open 597 Closed
184 Open 597 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add modalities to models meta
#2075 opened Feb 16, 2025 by Samoed
MAEB Overview Issue maeb Audio extension
#2072 opened Feb 16, 2025 by isaac-chung
17 tasks
Define an encoder interface for audio maeb Audio extension
#2071 opened Feb 16, 2025 by isaac-chung
Create multilabel audio classification AbsTask and Evaluator maeb Audio extension
#2070 opened Feb 16, 2025 by isaac-chung
Create zeroshot audio classification AbsTask and Evaluator maeb Audio extension
#2069 opened Feb 16, 2025 by isaac-chung
Create audio-text retrieval AbsTask and evaluator maeb Audio extension
#2068 opened Feb 16, 2025 by isaac-chung
Add MAEB contribution guide/README maeb Audio extension
#2067 opened Feb 16, 2025 by isaac-chung
Create audio classification AbsTask and Evaluator maeb Audio extension
#2066 opened Feb 16, 2025 by isaac-chung
Question about the CMTEB ( e.g. MTEB(cmn, v1) ) leaderboard
#2064 opened Feb 15, 2025 by DunZhang
1
column_width interferes with pinned_columns in gradio leaderboard issues related to the leaderboard
#2060 opened Feb 13, 2025 by shikhar1729
Add FSD50K maeb Audio extension new dataset Issues related to adding a new task or dataset
#2056 opened Feb 13, 2025 by Muennighoff
1
Add Audio Caption maeb Audio extension new dataset Issues related to adding a new task or dataset
#2055 opened Feb 13, 2025 by Muennighoff
Add AudioCaps maeb Audio extension new dataset Issues related to adding a new task or dataset
#2054 opened Feb 13, 2025 by Muennighoff
1
Add Clotho maeb Audio extension new dataset Issues related to adding a new task or dataset
#2053 opened Feb 13, 2025 by Muennighoff
Add ESC50 maeb Audio extension new dataset Issues related to adding a new task or dataset
#2052 opened Feb 13, 2025 by Muennighoff
VGGSound maeb Audio extension new dataset Issues related to adding a new task or dataset
#2051 opened Feb 13, 2025 by Muennighoff
Add CommonVoice maeb Audio extension new dataset Issues related to adding a new task or dataset
#2050 opened Feb 13, 2025 by Muennighoff
1
Add AudioSet maeb Audio extension new dataset Issues related to adding a new task or dataset
#2049 opened Feb 13, 2025 by Muennighoff
Add MARBLE maeb Audio extension new dataset Issues related to adding a new task or dataset
#2048 opened Feb 13, 2025 by Muennighoff
Add SoundDescs maeb Audio extension new dataset Issues related to adding a new task or dataset
#2047 opened Feb 13, 2025 by Muennighoff
2
Allow benchmark to select custom metrics enhancement New feature or request
#2046 opened Feb 13, 2025 by KennethEnevoldsen
Add HEAR benchmark maeb Audio extension new benchmark Issues related to adding a new benchmark
#2043 opened Feb 12, 2025 by Muennighoff
1
Add an overview benchmark enhancement New feature or request leaderboard issues related to the leaderboard new benchmark Issues related to adding a new benchmark
#2038 opened Feb 12, 2025 by KennethEnevoldsen
2
Add leaderboard unit tests leaderboard issues related to the leaderboard
#2034 opened Feb 11, 2025 by Muennighoff
Freeze columns for better leaderboard UI good first issue Good for newcomers leaderboard issues related to the leaderboard
#2033 opened Feb 11, 2025 by Muennighoff
@shikhar1729
4
ProTip! Find all open issues with in progress development work with linked:pr.