Skip to content

Commit

Permalink
Switch table columns in README.md beir table (#1887)
Browse files Browse the repository at this point in the history 
1. Switch flat-wp and multifield columns in the README table for beir
2. Fix few possible doc link bugs and typos.
  • Loading branch information
@amyxie361
amyxie361 authored May 26, 2022
1 parent 30c9974 commit dceae06
Showing 1 changed file with 32 additions and 32 deletions.
64 changes: 32 additions & 32 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -117,40 +117,40 @@ See individual pages for details!
### Regressions for BEIR (v1.0.0)

+ F = "flat" baseline
+ MF = "multfield" baseline
+ MF = "multifield" baseline
+ SPLADE = SPLADE-distill CoCodenser-medium

| Corpus | flat | multifield | flat-wp | SPLADE |
|--------|:----:|:----------:|:-------:|:------:|
| TREC-COVID | [+](docs/regressions-beir-v1.0.0-trec-covid-flat.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-multifield.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md) |
| BioASQ | [+](docs/regressions-beir-v1.0.0-bioasq-flat.md) | [+](docs/regressions-beir-v1.0.0-bioasq-multifield.md) | [+](docs/regressions-beir-v1.0.0-bioasq-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md) |
| NFCorpus | [+](docs/regressions-beir-v1.0.0-nfcorpus-flat.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-multifield.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md) |
| NQ | [+](docs/regressions-beir-v1.0.0-nq-flat.md) | [+](docs/regressions-beir-v1.0.0-nq-multifield.md) | [+](docs/regressions-beir-v1.0.0-nq-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md) |
| HotpotQA | [+](docs/regressions-beir-v1.0.0-hotpotqa-flat.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-multifield.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md) |
| FiQA-2018 | [+](docs/regressions-beir-v1.0.0-fiqa-flat.md) | [+](docs/regressions-beir-v1.0.0-fiqa-multifield.md) | [+](docs/regressions-beir-v1.0.0-fiqa-flat-wp.md) |[+](docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md) |
| Signal-1M(RT) | [+](docs/regressions-beir-v1.0.0-signal1m-flat.md) | [+](docs/regressions-beir-v1.0.0-signal1m-multifield.md) | [+](docs/regressions-beir-v1.0.0-signal1m-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md) |
| TREC-NEWS | [+](docs/regressions-beir-v1.0.0-trec-news-flat.md) | [+](docs/regressions-beir-v1.0.0-trec-news-multifield.md) | [+](docs/regressions-beir-v1.0.0-trec-news-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md) |
| Robust04 | [+](docs/regressions-beir-v1.0.0-robust04-flat.md) | [+](docs/regressions-beir-v1.0.0-robust04-multifield.md) | [+](docs/regressions-beir-v1.0.0-robust04-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md) |
| ArguAna | [+](docs/regressions-beir-v1.0.0-arguana-flat.md) | [+](docs/regressions-beir-v1.0.0-arguana-multifield.md) | [+](docs/regressions-beir-v1.0.0-arguana-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md) |
| Touche2020 | [+](docs/regressions-beir-v1.0.0-webis-touche2020-flat.md) | [+](docs/regressions-beir-v1.0.0-arguana-multifield.md) | [+](docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md) |
| CQADupStack-Android | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md) |
| CQADupStack-English | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md) |
| CQADupStack-Gaming | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md) |
| CQADupStack-Gis | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md) |
| CQADupStack-Mathematica | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md) |
| CQADupStack-Physics | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md) |
| CQADupStack-Programmers | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md) |
| CQADupStack-Stats | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md) |
| CQADupStack-Tex | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md) |
| CQADupStack-Unix | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md) |
| CQADupStack-Webmasters | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md) |
| CQADupStack-Wordpress | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md) |
| Quora | [+](docs/regressions-beir-v1.0.0-quora-flat.md) | [+](docs/regressions-beir-v1.0.0-quora-multifield.md) | [+](docs/regressions-beir-v1.0.0-quora-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md) |
| DBPedia | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md) |
| SCIDOCS | [+](docs/regressions-beir-v1.0.0-scidocs-flat.md) | [+](docs/regressions-beir-v1.0.0-multifield-flat.md) | [+](docs/regressions-beir-v1.0.0-scidocs-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md) |
| FEVER | [+](docs/regressions-beir-v1.0.0-fever-flat.md) | [+](docs/regressions-beir-v1.0.0-fever-multifield.md) | [+](docs/regressions-beir-v1.0.0-fever-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md) |
| Climate-FEVER | [+](docs/regressions-beir-v1.0.0-climate-fever-flat.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-multifield.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md) |
| SciFact | [+](docs/regressions-beir-v1.0.0-scifact-flat.md) | [+](docs/regressions-beir-v1.0.0-scifact-multifield.md) | [+](docs/regressions-beir-v1.0.0-scifact-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md) |
| Corpus | flat | flat-wp | multifield | SPLADE |
|--------|:----:|:-------:|:----------:|:------:|
| TREC-COVID | [+](docs/regressions-beir-v1.0.0-trec-covid-flat.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-multifield.md) | [+](docs/regressions-beir-v1.0.0-trec-covid-splade-distil-cocodenser-medium.md) |
| BioASQ | [+](docs/regressions-beir-v1.0.0-bioasq-flat.md) | [+](docs/regressions-beir-v1.0.0-bioasq-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-bioasq-multifield.md) | [+](docs/regressions-beir-v1.0.0-bioasq-splade-distil-cocodenser-medium.md) |
| NFCorpus | [+](docs/regressions-beir-v1.0.0-nfcorpus-flat.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-multifield.md) | [+](docs/regressions-beir-v1.0.0-nfcorpus-splade-distil-cocodenser-medium.md) |
| NQ | [+](docs/regressions-beir-v1.0.0-nq-flat.md) | [+](docs/regressions-beir-v1.0.0-nq-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-nq-multifield.md) | [+](docs/regressions-beir-v1.0.0-nq-splade-distil-cocodenser-medium.md) |
| HotpotQA | [+](docs/regressions-beir-v1.0.0-hotpotqa-flat.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-multifield.md) | [+](docs/regressions-beir-v1.0.0-hotpotqa-splade-distil-cocodenser-medium.md) |
| FiQA-2018 | [+](docs/regressions-beir-v1.0.0-fiqa-flat.md) | [+](docs/regressions-beir-v1.0.0-fiqa-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-fiqa-multifield.md) | [+](docs/regressions-beir-v1.0.0-fiqa-splade-distil-cocodenser-medium.md) |
| Signal-1M(RT) | [+](docs/regressions-beir-v1.0.0-signal1m-flat.md) | [+](docs/regressions-beir-v1.0.0-signal1m-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-signal1m-multifield.md) | [+](docs/regressions-beir-v1.0.0-signal1m-splade-distil-cocodenser-medium.md) |
| TREC-NEWS | [+](docs/regressions-beir-v1.0.0-trec-news-flat.md) | [+](docs/regressions-beir-v1.0.0-trec-news-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-trec-news-multifield.md) | [+](docs/regressions-beir-v1.0.0-trec-news-splade-distil-cocodenser-medium.md) |
| Robust04 | [+](docs/regressions-beir-v1.0.0-robust04-flat.md) | [+](docs/regressions-beir-v1.0.0-robust04-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-robust04-multifield.md) | [+](docs/regressions-beir-v1.0.0-robust04-splade-distil-cocodenser-medium.md) |
| ArguAna | [+](docs/regressions-beir-v1.0.0-arguana-flat.md) | [+](docs/regressions-beir-v1.0.0-arguana-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-arguana-multifield.md) | [+](docs/regressions-beir-v1.0.0-arguana-splade-distil-cocodenser-medium.md) |
| Touche2020 | [+](docs/regressions-beir-v1.0.0-webis-touche2020-flat.md) | [+](docs/regressions-beir-v1.0.0-webis-touche2020-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-webis-touche2020-multifield.md) | [+](docs/regressions-beir-v1.0.0-webis-touche2020-splade-distil-cocodenser-medium.md) |
| CQADupStack-Android | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-android-splade-distil-cocodenser-medium.md) |
| CQADupStack-English | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-english-splade-distil-cocodenser-medium.md) |
| CQADupStack-Gaming | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gaming-splade-distil-cocodenser-medium.md) |
| CQADupStack-Gis | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-gis-splade-distil-cocodenser-medium.md) |
| CQADupStack-Mathematica | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-mathematica-splade-distil-cocodenser-medium.md) |
| CQADupStack-Physics | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-physics-splade-distil-cocodenser-medium.md) |
| CQADupStack-Programmers | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-programmers-splade-distil-cocodenser-medium.md) |
| CQADupStack-Stats | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-stats-splade-distil-cocodenser-medium.md) |
| CQADupStack-Tex | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-tex-splade-distil-cocodenser-medium.md) |
| CQADupStack-Unix | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-unix-splade-distil-cocodenser-medium.md) |
| CQADupStack-Webmasters | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-webmasters-splade-distil-cocodenser-medium.md) |
| CQADupStack-Wordpress | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-multifield.md) | [+](docs/regressions-beir-v1.0.0-cqadupstack-wordpress-splade-distil-cocodenser-medium.md) |
| Quora | [+](docs/regressions-beir-v1.0.0-quora-flat.md) | [+](docs/regressions-beir-v1.0.0-quora-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-quora-multifield.md) | [+](docs/regressions-beir-v1.0.0-quora-splade-distil-cocodenser-medium.md) |
| DBPedia | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-flat.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-multifield.md) | [+](docs/regressions-beir-v1.0.0-dbpedia-entity-splade-distil-cocodenser-medium.md) |
| SCIDOCS | [+](docs/regressions-beir-v1.0.0-scidocs-flat.md) | [+](docs/regressions-beir-v1.0.0-scidocs-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-scidocs-multifield.md) | [+](docs/regressions-beir-v1.0.0-scidocs-splade-distil-cocodenser-medium.md) |
| FEVER | [+](docs/regressions-beir-v1.0.0-fever-flat.md) | [+](docs/regressions-beir-v1.0.0-fever-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-fever-multifield.md) | [+](docs/regressions-beir-v1.0.0-fever-splade-distil-cocodenser-medium.md) |
| Climate-FEVER | [+](docs/regressions-beir-v1.0.0-climate-fever-flat.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-multifield.md) | [+](docs/regressions-beir-v1.0.0-climate-fever-splade-distil-cocodenser-medium.md) |
| SciFact | [+](docs/regressions-beir-v1.0.0-scifact-flat.md) | [+](docs/regressions-beir-v1.0.0-scifact-flat-wp.md) | [+](docs/regressions-beir-v1.0.0-scifact-multifield.md) | [+](docs/regressions-beir-v1.0.0-scifact-splade-distil-cocodenser-medium.md) |

### Other Regressions

Expand Down

0 comments on commit dceae06

Please sign in to comment.