Skip to content

Commit c8c7d56

Browse files
committed
[Bugfix][Core]remove preempted_req in req_to_new_blocks and num_scheduled_tokens
Signed-off-by: quanliu <18646313696@163.com>
1 parent 9bb3813 commit c8c7d56

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

vllm/v1/core/sched/scheduler.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -273,6 +273,9 @@ def schedule(self) -> SchedulerOutput:
273273
self.running.remove(preempted_req)
274274
if preempted_req in scheduled_running_reqs:
275275
scheduled_running_reqs.remove(preempted_req)
276+
token_budget += num_scheduled_tokens[preempted_req.request_id]
277+
req_to_new_blocks.pop(preempted_req.request_id)
278+
num_scheduled_tokens.pop(preempted_req.request_id)
276279
else:
277280
preempted_req = self.running.pop()
278281

0 commit comments

Comments
 (0)