Skip to content

Commit a97f222

Browse files
committed
Handle triton kernel import exception (#25319)
Summary: Signed-off-by: Ming Yang <minos.future@gmail.com> Pull Request resolved: #25319 Handle triton kernel import exception in cases it is not available. Test Plan: AMD DeepSeek test Reviewed By: houseroad Differential Revision: D82899108 Privacy Context Container: L1370295 Signed-off-by: Ming Yang <minos.future@gmail.com>
1 parent bef180f commit a97f222

File tree

1 file changed

+8
-3
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+8
-3
lines changed

vllm/model_executor/layers/fused_moe/config.py

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -14,11 +14,16 @@
1414
from vllm.utils import cdiv, has_triton_kernels
1515
from vllm.utils.flashinfer import has_flashinfer_cutlass_fused_moe
1616

17-
if has_triton_kernels():
18-
from triton_kernels.matmul_ogs import PrecisionConfig
19-
2017
logger = init_logger(__name__)
2118

19+
if has_triton_kernels():
20+
try:
21+
from triton_kernels.matmul_ogs import PrecisionConfig
22+
except ImportError:
23+
logger.error(
24+
"Failed to import Triton kernels. Please make sure your triton "
25+
"version is compatible.")
26+
2227

2328
def _get_config_dtype_str(
2429
dtype: torch.dtype,

0 commit comments

Comments
 (0)