Skip to content

Commit

Permalink
leaderboard update (#285)
Browse files Browse the repository at this point in the history
  • Loading branch information
@ingberam
ingberam authored Mar 5, 2024
1 parent 9537af2 commit d1ab374
Showing 1 changed file with 62 additions and 26 deletions.
88 changes: 62 additions & 26 deletions neurips23.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,8 +32,7 @@
<nav>
<ul>
<li><a href="#tracks">Tracks</a></li>
<li><a href="#winners">Winners</a></li>
<li><a href="#participate">Participate</a></li>
<li><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md">Participate</a></li>
<li><a href="#organizers">Organizers</a></li>
<li><a href="neurips21.html">NeurIPS'21: Billion-Scale ANN Challenge</a></li>
</ul>
Expand Down Expand Up @@ -73,7 +72,7 @@ <h1>

<div class="table-container">
<p class="hero-text">
<b>New: the latest ongoing leaderboard has been released (Feb 1st, 2024). <br> Top entries:</b>
<b>New: the latest ongoing leaderboard has been released (March 1st, 2024). <br> Top entries:</b>
</p>

<table>
Expand All @@ -98,38 +97,75 @@ <h1>
<td class="group-border">85,491</td>
<td>1</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/pinecone-ood">Pinecone-ood</a></td>
<td class="group-border">31,643</td>
<td class="group-border">38,088</td>
<td>1</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/zilliz ">Zilliz</a></td>
<td>9,933</td>
<td>10,749</td>
</tr>
<tr>
<td>2</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/zilliz ">Zilliz</a></td>
<td class="group-border">84,596</td>
<td>2</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/zilliz ">Zilliz</a></td>
<td class="group-border">27,585</td>
<td class="group-border">33,241</td>
<td>2</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">PyANNS</a></td>
<td>8,732</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pinecone_smips">Pinecone_smips</a></td>
<td>10,440</td>
</tr>
<tr>
<tr>
<td>3</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/parlayivf">ParlayANN IVF<sup>2</sup></a></td>
<td class="group-border">37,902</td>
<td>3</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/mysteryann">RoarANN</a></td>
<td class="group-border">22,555</td>
<td>3</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pinecone_smips">Pinecone_smips</a></td>
<td>8,078</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">PyANNS</a></td>
<td>8,732</td>
</tr>
<tr>
<td>4</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/puck">Puck</a></td>
<td class="group-border">19,193</td>
<td>4</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/pyanns">PyANNS</a></td>
<td class="group-border">22,296</td>
<td>4</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/shnsw">shnsw</a></td>
<td>7,137</td>
</tr>
<tr >
<td style="padding: 0;"> ...</td>
<td style="padding: 0;"> ...</td>
<td style="padding: 0;" class="group-border"> ...</td>
<td style="padding: 0;"> ...</td>
<td style="padding: 0;"> ...</td>
<td style="padding: 0;" class="group-border"> ...</td>
<td style="padding: 0;"> ...</td>
<td style="padding: 0;"> ...</td>
<td style="padding: 0;"> ...</td>
</tr>
<tr>
<td>Baseline</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/filter/faiss">FAISS</a></td>
<td class="group-border">3,032</td>
<td>Baseline</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/ood/diskann">Diskann</a></td>
<td class="group-border">4,133</td>
<td>Baseline</td>
<td><a href="https://github.com/harsha-simhadri/big-ann-benchmarks/tree/main/neurips23/sparse/pyanns">Linscan</a></td>
<td>93</td>
</tr>

</table>
<p class="hero-text">
See here for the <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/ongoing_leaderboard/leaderboard.md">full ongoing leaderboard and rules</a>. Next update: March 1st, 2024.
<br>
Note: entries by pinecone and zilliz are not open source.
<br>
<div class="buttons">
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/ongoing_leaderboard/leaderboard.md"
class="button button-alpha">Full Leaderboard, Plots, and Rules</a>
</div>
</p>
</div>

Expand All @@ -148,19 +184,19 @@ <h1>
by limiting the scale of the datasets to about 10 million points.
</p>

<div class="buttons">
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md"
class="button button-white">Get Started</a>
<a href="https://neurips.cc/virtual/2023/competition/66587" class="button button-alpha">
NeurIPS'23 Session
</a>
<a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/leaderboard.md" class="button button-white">
NeurIPS'23 Leaderboard
</a>
<a href="#winners" class="button button-alpha">
Track Winners and presentations
</a>
</div>
<!-- <div class="buttons">-->
<!-- <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md"-->
<!-- class="button button-white">Get Started</a>-->
<!-- <a href="https://neurips.cc/virtual/2023/competition/66587" class="button button-alpha">-->
<!-- NeurIPS'23 Session-->
<!-- </a>-->
<!-- <a href="https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/leaderboard.md" class="button button-white">-->
<!-- NeurIPS'23 Leaderboard-->
<!-- </a>-->
<!-- <a href="#winners" class="button button-alpha">-->
<!-- Track Winners and presentations-->
<!-- </a>-->
<!-- </div>-->
</div>
</section>

Expand Down

0 comments on commit d1ab374

Please sign in to comment.