Skip to content

Commit

Permalink
Remove cohere command (non-r) from tests. Change default test_options…
Browse files Browse the repository at this point in the history
… to be more conservative to prevent long repetition and have better compatibility for testing.
  • Loading branch information
LeonRuggiero committed Nov 5, 2024
1 parent 59ea337 commit 258f462
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions drivers/test/all-models.test.ts
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@ if (process.env.BEDROCK_REGION) {
models: [
"anthropic.claude-3-sonnet-20240229-v1:0",
"anthropic.claude-v2:1",
"cohere.command-text-v14",
//"cohere.command-text-v14", EOL
"mistral.mixtral-8x7b-instruct-v0:1",
"cohere.command-r-plus-v1:0",
"meta.llama3-1-70b-instruct-v1:0"
Expand Down Expand Up @@ -169,12 +169,12 @@ describe.concurrent.each(drivers)("Driver $name", ({ name, driver, models }) =>

let test_options: ExecutionOptions = {
model: "",
max_tokens: 64,
temperature: 0.5,
max_tokens: 128,
temperature: 0.3,
top_k: 40,
top_p: 1.0,
top_p: 0.7, //Some models do not support top_p = 1.0, set to 0.99 or lower.
top_logprobs: 5, //Currently not supported, option will be ignored
presence_penalty: 0.0,
presence_penalty: 0.1, //Cohere Command R does not support using presence & frequency penalty at the same time
frequency_penalty: 0.0,
};

Expand Down

0 comments on commit 258f462

Please sign in to comment.