Skip to content

Commit 4c0d93f

Browse files
authored
[V1][Bugfix] Copy encoder input ids to fix set iteration issue during VLM abort (#13173)
Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com>
1 parent 14b7899 commit 4c0d93f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/core/encoder_cache_manager.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ def free_encoder_input(self, request: Request, input_id: int) -> None:
5454

5555
def free(self, request: Request) -> None:
5656
"""Free all cached input ids for the request."""
57-
input_ids = self.get_cached_input_ids(request)
57+
input_ids = self.get_cached_input_ids(request).copy()
5858
for input_id in input_ids:
5959
self.free_encoder_input(request, input_id)
6060

0 commit comments

Comments
 (0)