Skip to content

Commit 6696bb5

Browse files
russellbxuebwang-amd
authored andcommitted
[Benchmark] Fix regression in structured output benchmark (vllm-project#25500)
Signed-off-by: Russell Bryant <rbryant@redhat.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
1 parent 2e0b5fc commit 6696bb5

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

benchmarks/benchmark_serving_structured_output.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -449,7 +449,8 @@ async def benchmark(
449449
def prepare_extra_body(request) -> dict:
450450
extra_body = {}
451451
# Add the schema to the extra_body
452-
extra_body[request.structure_type] = request.schema
452+
extra_body["structured_outputs"] = {}
453+
extra_body["structured_outputs"][request.structure_type] = request.schema
453454
return extra_body
454455

455456
print("Starting initial single prompt test run...")

0 commit comments

Comments
 (0)