You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Interactive mode (default): Guides you through selecting a provider type (text completion or chat completion) and then shows available providers for that type
107
108
- List mode (`--list`): Simply lists all available providers without interactive selection
108
109
@@ -126,7 +127,7 @@ models:
126
127
engine: deepseek
127
128
model: deepseek-reasoner
128
129
reasoning_config:
129
-
remove_thinking_traces: True
130
+
remove_reasoning_traces: True
130
131
start_token: "<think>"
131
132
end_token: "</think>"
132
133
```
@@ -136,7 +137,7 @@ By removing the traces, the guardrails runtime processes only the actual respons
136
137
137
138
You can specify the following parameters for a reasoning model:
138
139
139
-
-`remove_thinking_traces`: if the reasoning traces should be ignored (default `True`).
140
+
-`remove_reasoning_traces`: if the reasoning traces should be ignored (default `True`).
140
141
-`start_token`: the start token for the reasoning process (default `<think>`).
141
142
-`end_token`: the end token for the reasoning process (default `</think>`).
Copy file name to clipboardExpand all lines: nemoguardrails/rails/llm/config.py
+25-6Lines changed: 25 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -71,9 +71,13 @@
71
71
classReasoningModelConfig(BaseModel):
72
72
"""Configuration for reasoning models/LLMs, including start and end tokens for reasoning traces."""
73
73
74
-
remove_thinking_traces: Optional[bool] =Field(
74
+
remove_reasoning_traces: Optional[bool] =Field(
75
75
default=True,
76
-
description="For reasoning models (e.g. DeepSeek-r1), if the output parser should remove thinking traces.",
76
+
description="For reasoning models (e.g. DeepSeek-r1), if the output parser should remove reasoning traces.",
77
+
)
78
+
remove_thinking_traces: Optional[bool] =Field(
79
+
default=None,
80
+
description="[DEPRECATED] Use remove_reasoning_traces instead. For reasoning models (e.g. DeepSeek-r1), if the output parser should remove thinking traces.",
77
81
)
78
82
start_token: Optional[str] =Field(
79
83
default="<think>",
@@ -84,6 +88,21 @@ class ReasoningModelConfig(BaseModel):
84
88
description="The end token used for reasoning traces.",
0 commit comments