-
-
Notifications
You must be signed in to change notification settings - Fork 855
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
pixtral-12b-2409 使用 openai 渠道,Stream 工具调用结果为空 #540
Labels
bug
Something isn't working
Comments
可以更新看看再回來測試 |
这个也是我更新到最新版本的结果 |
在playgroud裡面試試看呢 |
有一個可能就是mistral沒那麼兼容openai格式 |
可能是格式的问题,下面这个是官方的返回结果: data: {
"id": "f7831ba1240a4a26a0f9292a65668945",
"object": "chat.completion.chunk",
"created": 1731295728,
"model": "pixtral-12b-2409",
"choices": [
{
"index": 0,
"delta": {
"role": "assistant",
"content": ""
},
"finish_reason": null
}
]
}
data: {
"id": "f7831ba1240a4a26a0f9292a65668945",
"object": "chat.completion.chunk",
"created": 1731295728,
"model": "pixtral-12b-2409",
"choices": [
{
"index": 0,
"delta": {
"content": null,
"tool_calls": [
{
"id": "Mu9OidbCQ",
"function": {
"name": "get_current_weather",
"arguments": "{\"city\": \"Toronto\"}"
}
}
]
},
"finish_reason": "tool_calls"
}
],
"usage": {
"prompt_tokens": 83,
"total_tokens": 104,
"completion_tokens": 21
}
} |
應該是 我今天嘗試了一下 |
也许可以在新渠道Mistral下优化代码,就不使用OpenAI渠道了。 |
確實是 目前沒啥問題 比較神奇的是pixtral沒有像他說的可以讀很多圖片 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
例行检查
问题描述
在 v0.3.0.1-alpha.2 版本上使用 OpenAI 渠道设置好 pixtral-12b-2409, 发送 Stream 工具调用结果为空,直接调用官方是正常的。
复现步骤
使用OpenAI 渠道设置pixtral-12b-2409, 发送 Stream 工具调用请求。
预期结果
返回正常结果。
相关截图
官方截图:
new-api 截图:
The text was updated successfully, but these errors were encountered: