Skip to content

Commit

Permalink
Merge pull request #2480 from itlackey/benchmark/ollama-qwen2.5-14b
Browse files Browse the repository at this point in the history
  • Loading branch information
paul-gauthier authored Nov 28, 2024
2 parents d54fbd6 + f714e42 commit 62109f4
Showing 1 changed file with 23 additions and 1 deletion.
24 changes: 23 additions & 1 deletion aider/website/_data/edit_leaderboard.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1945,4 +1945,26 @@
command: aider --model gemini/gemini-exp-1114
date: 2024-11-15
versions: 0.63.2.dev
seconds_per_case: 38.6
seconds_per_case: 38.6
- dirname: 2024-11-27-07-41-51--qwen2.5-coder-14b-whole-1
test_cases: 133
model: ollama/qwen2.5-coder:14b
edit_format: whole
commit_hash: 200295e
pass_rate_1: 53.4
pass_rate_2: 61.7
percent_cases_well_formed: 98.5
error_outputs: 4
num_malformed_responses: 4
num_with_malformed_responses: 2
user_asks: 48
lazy_comments: 0
syntax_errors: 2
indentation_errors: 2
exhausted_context_windows: 0
test_timeouts: 2
command: aider --model ollama/qwen2.5-coder:14b
date: 2024-11-27
versions: 0.65.2.dev
seconds_per_case: 58.0
total_cost: 0.0000

0 comments on commit 62109f4

Please sign in to comment.