Skip to content

[Bug]: tp4 DeepSeek-V2-Lite, accuracy is error,"text":"....................................................................................................." #894

@david6666666

Description

@david6666666

Your current environment

The output of `python collect_env.py`
Your output of above commands here

🐛 Describe the bug

910B1,DeepSeek-V2-Lite
image: vllm-ascend:v0.8.5rc1-openeuler
Code:
vllm main 20250519
vllm-ascend main 20250519

[root@devserver-bms-7f4183be home]# curl -X POST "http://127.0.0.1:8000/v1/completions" -H "Content-Type: application/json" -H "Authorization: Bearer YOUR_API_KEY" -d '{
"model": "/home/dsv3/models/DeepSeek-V2-Lite",
"prompt": "Alice is ",
"max_tokens": 50,
"temperature": 0
}'
{"id":"cmpl-e2c22a363e004bb98a1a8a23b7b47bb9","object":"text_completion","created":1747622321,"model":"/home/dsv3/models/DeepSeek-V2-Lite","choices":[{"index":0,"text":".....................................................................................................","logprobs":null,"finish_reason":"length","stop_reason":null,"prompt_logprobs":null}],"usage":{"prompt_tokens":4,"total_tokens":54,"completion_tokens":50,"prompt_tokens_details":null}}[root@devserver-bms-7f4183be home]#

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions