Skip to content

Commit de11286

Browse files
Akashcodes732nikhil-arm
authored andcommitted
ARM: Update vllm/engine/arg_utils.py
Co-authored-by: Nikhil Gupta <nikhil.gupta2@arm.com> Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
1 parent d63183c commit de11286

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/engine/arg_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1089,7 +1089,7 @@ def create_engine_config(
10891089
# Disable chunked prefill for POWER (ppc64le) CPUs in V1
10901090
if current_platform.is_cpu(
10911091
) and current_platform.get_cpu_architecture(
1092-
) == CpuArchEnum.POWERPC:
1092+
) in (CpuArchEnum.POWERPC, CpuArchEnum.ARM):
10931093
logger.info("Chunked prefill is not supported for POWER CPUs; "
10941094
"disabling it for V1 backend.")
10951095
self.enable_chunked_prefill = False

0 commit comments

Comments
 (0)