Skip to content

Commit 106cdfb

Browse files
committed
bugfix for waiting request
Signed-off-by: Abatom <abzhonghua@gmail.com>
1 parent ce75efe commit 106cdfb

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/v1/core/kv_cache_manager.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -367,6 +367,7 @@ def take_events(self) -> list[KVCacheEvent]:
367367

368368
def get_block_ids(self, request_id: str) -> list[list[int]]:
369369
"""Get the block ids of a request."""
370-
assert request_id in self.single_type_manager.req_to_blocks
370+
if request_id not in self.single_type_manager.req_to_blocks:
371+
return [[]]
371372
return KVCacheBlocks(self.single_type_manager.req_to_blocks[request_id]
372373
).get_block_ids()

0 commit comments

Comments
 (0)