Skip to content

Commit 32a4dfa

Browse files
committed
[Misc] Fix the benchmark's README and improve the error messages for the benchmark's argument checks
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
1 parent 1bf5e1f commit 32a4dfa

File tree

2 files changed

+6
-2
lines changed

2 files changed

+6
-2
lines changed

benchmarks/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -177,6 +177,7 @@ vllm serve Qwen/Qwen2-VL-7B-Instruct
177177
```bash
178178
vllm bench serve \
179179
--backend openai-chat \
180+
--endpoint-type openai-chat \
180181
--model Qwen/Qwen2-VL-7B-Instruct \
181182
--endpoint /v1/chat/completions \
182183
--dataset-name hf \
@@ -213,6 +214,7 @@ vllm serve Qwen/Qwen2-VL-7B-Instruct
213214
```bash
214215
vllm bench serve \
215216
--backend openai-chat \
217+
--endpoint-type openai-chat \
216218
--model Qwen/Qwen2-VL-7B-Instruct \
217219
--endpoint /v1/chat/completions \
218220
--dataset-name hf \
@@ -227,6 +229,7 @@ vllm bench serve \
227229
```bash
228230
vllm bench serve \
229231
--backend openai-chat \
232+
--endpoint-type openai-chat \
230233
--model Qwen/Qwen2-VL-7B-Instruct \
231234
--endpoint /v1/chat/completions \
232235
--dataset-name hf \

vllm/benchmarks/datasets.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -673,10 +673,11 @@ def get_samples(args, tokenizer) -> list[SampleRequest]:
673673
"openai-chat",
674674
"openai-audio",
675675
]:
676-
# multi-modal benchmark is only available on OpenAI Chat backend.
676+
# multi-modal benchmark is only available on OpenAI Chat
677+
# endpoint-type.
677678
raise ValueError(
678679
"Multi-modal content is only supported on 'openai-chat' and "
679-
"'openai-audio' backend.")
680+
"'openai-audio' endpoint-type.")
680681
input_requests = dataset_class(
681682
dataset_path=args.dataset_path,
682683
dataset_subset=args.hf_subset,

0 commit comments

Comments
 (0)