Skip to content

Commit c4dc1a8

Browse files
committed
update
1 parent 34e926f commit c4dc1a8

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

site-src/guides/serve-multiple-genai-models.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -180,14 +180,16 @@ kubectl get httproute llm-phi4-route -o yaml
180180
-H "Content-Type: application/json" \
181181
-d '{
182182
"model": "meta-llama/Llama-3.1-8B-Instruct",
183+
"max_tokens": 100,
184+
"temperature": 0,
183185
"messages": [
184186
{
185187
"role": "developer",
186188
"content": "You are a helpful assistant."
187189
},
188190
{
189191
"role": "user",
190-
"content": "Hello!"
192+
"content": "Linux is said to be an open source kernel because "
191193
}
192194
]
193195
}'
@@ -199,6 +201,8 @@ kubectl get httproute llm-phi4-route -o yaml
199201
-H "Content-Type: application/json" \
200202
-d '{
201203
"model": "microsoft/Phi-4-mini-instruct",
204+
"max_tokens": 100,
205+
"temperature": 0,
202206
"messages": [
203207
{
204208
"role": "developer",

0 commit comments

Comments
 (0)