Skip to content
This repository was archived by the owner on Sep 4, 2025. It is now read-only.

Commit ccd9ac6

Browse files
aws-patlangeprashantgupta24
authored andcommitted
[Bugfix] Fix assertion in NeuronExecutor (vllm-project#5841)
1 parent 81a1c46 commit ccd9ac6

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

vllm/executor/neuron_executor.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -48,9 +48,9 @@ def initialize_cache(self, num_gpu_blocks: int,
4848
def execute_model(
4949
self,
5050
execute_model_req: ExecuteModelRequest) -> List[SamplerOutput]:
51-
assert (execute_model_req.blocks_to_swap_in == {}
52-
and execute_model_req.blocks_to_swap_out == {}
53-
and execute_model_req.blocks_to_copy == {}), (
51+
assert (not execute_model_req.blocks_to_swap_in
52+
and not execute_model_req.blocks_to_swap_out
53+
and not execute_model_req.blocks_to_copy), (
5454
"Cache operations are not supported for Neuron backend.")
5555
assert execute_model_req.num_lookahead_slots == 0, (
5656
"lookahead not supported for Neuron backend.")

0 commit comments

Comments
 (0)