Skip to content

Commit 847150a

Browse files
author
varun sundar rabindranath
committed
fix plumbing
Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
1 parent 5ab56cb commit 847150a

File tree

1 file changed

+2
-1
lines changed
  • vllm/model_executor/layers/fused_moe

1 file changed

+2
-1
lines changed

vllm/model_executor/layers/fused_moe/layer.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -437,9 +437,9 @@ def apply(
437437
custom_routing_function: Optional[Callable] = None,
438438
scoring_func: str = "softmax",
439439
e_score_correction_bias: Optional[torch.Tensor] = None,
440+
apply_router_weight_on_input: bool = False,
440441
activation: str = "silu",
441442
) -> torch.Tensor:
442-
443443
assert activation == "silu"
444444
assert global_num_experts == layer.w13_weight.shape[0]
445445
assert expert_map is None
@@ -466,6 +466,7 @@ def apply(
466466
self.c_strides1,
467467
self.ab_strides2,
468468
self.c_strides2,
469+
apply_router_weight_on_input=apply_router_weight_on_input,
469470
)
470471

471472

0 commit comments

Comments
 (0)