Skip to content

Commit

Permalink
Fix: Change embeddings to embedding (#2738)
Browse files Browse the repository at this point in the history
fix: change embeddings to embedding

Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-135.us-west-2.compute.internal>
  • Loading branch information
mokeddembillel and Ubuntu authored Nov 15, 2024
1 parent f9ee46f commit 4f4857a
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -212,7 +212,7 @@ def __init__(self, config, weights):
try:
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embeddings", weights)
except RuntimeError:
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embeddings", weights)
self.lm_head = SpeculativeHead.load(config, f"{prefix}.embedding", weights)
self.config = config

def forward(
Expand Down

0 comments on commit 4f4857a

Please sign in to comment.