Skip to content

Commit 213b644

Browse files
authored
[Bugfix] Convert untraceable GroupShape to list for AMD impl (#26535)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
1 parent 784c231 commit 213b644

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/model_executor/layers/quantization/utils/fp8_utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -360,7 +360,7 @@ def _run_aiter(
360360
weight,
361361
input_scale,
362362
weight_scale,
363-
self.weight_group_shape,
363+
list(self.weight_group_shape),
364364
input_2d.dtype,
365365
)
366366

@@ -377,7 +377,7 @@ def _run_triton(
377377
weight,
378378
input_scale,
379379
weight_scale,
380-
self.weight_group_shape,
380+
list(self.weight_group_shape),
381381
input_2d.dtype,
382382
)
383383

0 commit comments

Comments
 (0)