Skip to content

Commit d75c407

Browse files
authored
[Fix] Keep scheduler.running as deque (#2523)
1 parent 5b23c3f commit d75c407

File tree

1 file changed

+2
-4
lines changed

1 file changed

+2
-4
lines changed

vllm/core/scheduler.py

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -332,10 +332,8 @@ def free_seq(self, seq: Sequence) -> None:
332332
self.block_manager.free(seq)
333333

334334
def free_finished_seq_groups(self) -> None:
335-
self.running = [
336-
seq_group for seq_group in self.running
337-
if not seq_group.is_finished()
338-
]
335+
self.running = deque(seq_group for seq_group in self.running
336+
if not seq_group.is_finished())
339337

340338
def _allocate(self, seq_group: SequenceGroup) -> None:
341339
self.block_manager.allocate(seq_group)

0 commit comments

Comments
 (0)