Skip to content

Commit cea2b71

Browse files
updated vllm custom op default behaviour so that non is appened if and only if backend is inductor
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
1 parent 2c967ba commit cea2b71

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

vllm/config/vllm.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -330,10 +330,7 @@ def __post_init__(self):
330330
+ self.compilation_config.custom_ops.count("all")
331331
== 0
332332
):
333-
if (
334-
self.compilation_config.level > 0
335-
and self.compilation_config.backend != "eager"
336-
):
333+
if self.compilation_config.backend == "inductor":
337334
self.compilation_config.custom_ops.append("none")
338335
else:
339336
self.compilation_config.custom_ops.append("all")

0 commit comments

Comments
 (0)