Skip to content

Commit a6f8814

Browse files
committed
fix CI
Signed-off-by: zzhx1 <zzh_201018@outlook.com>
1 parent c582024 commit a6f8814

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_ascend/torchair/models/torchair_deepseek_mtp.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -150,8 +150,9 @@ def forward(
150150
inputs_embeds: Optional[torch.Tensor] = None,
151151
spec_step_idx: int = 0,
152152
) -> torch.Tensor:
153-
if inputs_embeds is None:
153+
if inputs_embeds is None and self.embed_tokens is not None:
154154
inputs_embeds = self.embed_tokens(input_ids)
155+
155156
current_step_idx = (spec_step_idx % self.num_mtp_layers)
156157
step_kv_cache = kv_caches[
157158
current_step_idx] if kv_caches is not None else None

0 commit comments

Comments
 (0)