Skip to content

Commit d0c063a

Browse files
Merge pull request #5041 from ferenci84/reasoning_params_to_schemas
Add reasoning and reasoningBudgetTokens parameters to config schemas and docs
2 parents b0dd432 + ff204ef commit d0c063a

File tree

3 files changed

+14
-0
lines changed

3 files changed

+14
-0
lines changed

docs/docs/json-reference.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -159,6 +159,8 @@ Parameters that control the behavior of text generation and completion settings.
159159
- `numThreads`: The number of threads used during the generation process. Available only for Ollama as `num_thread`.
160160
- `keepAlive`: For Ollama, this parameter sets the number of seconds to keep the model loaded after the last request, unloading it from memory if inactive (default: `1800` seconds, or 30 minutes).
161161
- `useMmap`: For Ollama, this parameter allows the model to be mapped into memory. If disabled can enhance response time on low end devices but will slow down the stream.
162+
- `reasoning`: Enables thinking/reasoning for Anthropic Claude 3.7+ models.
163+
- `reasoningBudgetTokens`: Sets budget tokens for thinking/reasoning in Anthropic Claude 3.7+ models.
162164

163165
Example
164166

docs/docs/reference.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -181,6 +181,8 @@ The `models` section defines the language models used in your configuration. Mod
181181
- `topK`: Maximum number of tokens considered at each step.
182182
- `stop`: An array of stop tokens that will terminate the completion.
183183
- `n`: Number of completions to generate.
184+
- `reasoning`: Boolean to enable thinking/reasoning for Anthropic Claude 3.7+ models.
185+
- `reasoningBudgetTokens`: Budget tokens for thinking/reasoning in Anthropic Claude 3.7+ models.
184186
- `requestOptions`: HTTP request options specific to the model.
185187
- `timeout`: Timeout for each request to the language model.
186188
- `verifySsl`: Whether to verify SSL certificates for requests.

extensions/vscode/config_schema.json

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,16 @@
7171
"title": "Ollama keep_alive",
7272
"description": "The number of seconds after no requests are made to unload the model from memory. Defaults to 60*30 = 30min",
7373
"type": "integer"
74+
},
75+
"reasoning": {
76+
"title": "Reasoning",
77+
"description": "Enable thinking/reasoning for Anthropic Claude 3.7+ models",
78+
"type": "boolean"
79+
},
80+
"reasoningBudgetTokens": {
81+
"title": "Reasoning Budget Tokens",
82+
"description": "Set budget tokens for thinking/reasoning in Anthropic Claude 3.7+ models",
83+
"type": "integer"
7484
}
7585
}
7686
},

0 commit comments

Comments
 (0)