[Bugfix]Fix index out of range error in api server log (vllm-project#16787)

WangErXiao · Mu Huai · commit 27668723b8c6 · 2025-05-12T19:19:20.000+08:00
Signed-off-by: WangErXiao &lt;863579016@qq.com&gt;
Signed-off-by: Mu Huai &lt;tianbowen.tbw@antgroup.com&gt;
diff --git a/vllm/entrypoints/openai/api_server.py b/vllm/entrypoints/openai/api_server.py
@@ -881,7 +881,8 @@ async def log_response(request: Request, call_next):
                 section async for section in response.body_iterator
             ]
             response.body_iterator = iterate_in_threadpool(iter(response_body))
-            logger.info("response_body={%s}", response_body[0].decode())
+            logger.info("response_body={%s}",
+                        response_body[0].decode() if response_body else None)
             return response
 
     for middleware in args.middleware:

Original file line number	Diff line number	Diff line change
`@@ -881,7 +881,8 @@ async def log_response(request: Request, call_next):`
`881`	`881`	`section async for section in response.body_iterator`
`882`	`882`	`]`
`883`	`883`	`response.body_iterator = iterate_in_threadpool(iter(response_body))`
`884`		`- logger.info("response_body={%s}", response_body[0].decode())`
	`884`	`+ logger.info("response_body={%s}",`
	`885`	`+ response_body[0].decode() if response_body else None)`
`885`	`886`	`return response`
`886`	`887`
`887`	`888`	`for middleware in args.middleware:`