llm：调用vllm部署的大模型openai接口时报错

[mengxianglong123]

Initial Checks

• I have searched GitHub for a duplicate issue and I'm sure this is something new
• I have read and followed the docs & demos and still think this is a bug
• I am confident that the issue is with modelscope-agent (not my code, or another library in the ecosystem)

What happened + What you expected to happen

调用基于vllm部署的大模型openai接口时报错

openai.BadRequestError: Error code: 400 - {'object': 'error', 'message': "[{'type': 'extra_forbidden', 'loc': ('body', 'stream_options'), 'msg': 'Extra inputs are not permitted', 'input': {}}]", 'type': 'BadRequestError', 'param': None, 'code': 400}

大致原因是多了一个参数stream_options，在源代码中注释掉该参数便可以正常请求

Versions / Dependencies

v0.6.1

Reproduction script

直接使用最新版vllm部署模型，并以openai接口启动

Issue Severity

None

[zzhangpurdue]

好的，这里我们看一下。

[zzhangpurdue]

solved in 0.6.2