Skip to content

Commit 9686e7c

Browse files
committed
Nightly evals: lower concurrency, switch to base & base-lite-grok-4-fast
1 parent d68ecc4 commit 9686e7c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

evals/buffbench/main-nightly.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ async function main() {
1313

1414
const results = await runBuffBench({
1515
evalDataPath: path.join(__dirname, 'eval-codebuff.json'),
16-
agents: ['base', 'base2'],
17-
taskConcurrency: 20,
16+
agents: ['base', 'base-lite-grok-4-fast'],
17+
taskConcurrency: 5,
1818
})
1919

2020
console.log('\nNightly buffbench evaluation completed successfully!')

0 commit comments

Comments
 (0)