Skip to content

Commit 938772a

Browse files
authored
[Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123)
1 parent e4ee658 commit 938772a

File tree

16 files changed

+271
-311
lines changed

16 files changed

+271
-311
lines changed

vllm/distributed/device_communicators/base_device_communicator.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -266,14 +266,14 @@ def prepare_communication_buffer_for_model(self, model: torch.nn.Module) -> None
266266
module
267267
for module in model.modules()
268268
# TODO(bnell): Should use isinstance but can't. Maybe search for
269-
# presence of quant_method.init_prepare_finalize?
269+
# presence of quant_method.maybe_init_modular_kernel?
270270
if (
271271
module.__class__.__name__ == "FusedMoE"
272272
or module.__class__.__name__ == "SharedFusedMoE"
273273
)
274274
]
275275
for module in moe_modules:
276-
module.quant_method.init_prepare_finalize(module)
276+
module.maybe_init_modular_kernel()
277277

278278
def dispatch(
279279
self,

0 commit comments

Comments
 (0)