Skip to content

Commit

Permalink
convert : fix style
Browse files Browse the repository at this point in the history
  • Loading branch information
slaren committed Dec 11, 2023
1 parent 7dc75e3 commit f1cbfab
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion convert.py
Original file line number Diff line number Diff line change
Expand Up @@ -284,7 +284,6 @@ def loadOriginalParamsJson(model: LazyModel, config_path: Path) -> Params:
n_experts_used = config["moe"]["num_experts_per_tok"]
f_rope_freq_base = 1e6


return Params(
n_vocab = model["tok_embeddings.weight"].shape[0],
n_embd = config["dim"],
Expand Down

0 comments on commit f1cbfab

Please sign in to comment.