Skip to content

Commit 12a2c06

Browse files
committed
new block_ids logic
Signed-off-by: nicklucche <nlucches@redhat.com>
1 parent 7cb6c47 commit 12a2c06

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/v1/core/sched/scheduler.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -991,9 +991,10 @@ def _connector_finished(
991991
request.request_id not in
992992
self.kv_cache_manager.single_type_manager.req_to_blocks):
993993
# Ensure empty blocks ids are passed to respect connector interface
994-
block_ids = KVCacheBlocks.create_empty().get_block_ids()
994+
block_ids = KVCacheBlocks.create_empty().get_block_ids()[0]
995995
else:
996-
block_ids = self.kv_cache_manager.get_block_ids(request.request_id)[0]
996+
block_ids = self.kv_cache_manager.get_block_ids(
997+
request.request_id)[0]
997998
return self.connector.request_finished(request, block_ids)
998999

9991000
def _update_waiting_for_remote_kv(self, request: Request) -> bool:

0 commit comments

Comments
 (0)