Skip to content

Commit 8c2b722

Browse files
committed
Enable use_inductor_graph_partition by default in >=2.9
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
1 parent 6e914d9 commit 8c2b722

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/config/compilation.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -366,7 +366,7 @@ class CompilationConfig:
366366
FULL_AND_PIECEWISE instead.
367367
"""
368368

369-
use_inductor_graph_partition: bool = False
369+
use_inductor_graph_partition: bool = is_torch_equal_or_newer("2.9.0")
370370
"""Use inductor graph partition to split the graph at cudagraph_unsafe ops.
371371
This partition happens at inductor codegen time after all passes and fusions
372372
are finished. It generates a single `call` function which wraps

0 commit comments

Comments
 (0)