Skip to content

Commit fdeb3da

Browse files
authored
[Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640)
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
1 parent d52358c commit fdeb3da

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/models/deepseek_v2.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,7 @@ def __init__(
126126
prefix=f"{prefix}.gate")
127127
if config.topk_method == "noaux_tc":
128128
self.gate.e_score_correction_bias = nn.Parameter(
129-
torch.empty(config.n_routed_experts))
129+
torch.empty(config.n_routed_experts, dtype=torch.float32))
130130
else:
131131
self.gate.e_score_correction_bias = None
132132

0 commit comments

Comments
 (0)