Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
  • Loading branch information
akoumpa committed Jul 3, 2024
1 parent 7d06fc9 commit 427ab4c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/nlp/language_modeling/megatron_gpt_eval.py
Original file line number Diff line number Diff line change
Expand Up @@ -345,7 +345,7 @@ def main(cfg) -> None:

fp8_enabled = hasattr(model.cfg, "fp8") and (model.cfg.fp8 == True)
if fp8_enabled and len(prompts) > 0:
padded_len = round_to_mult((len(prompts), 8)
padded_len = round_to_mult(len(prompts), 8)
nb_paddings = padded_len - len(prompts)
if nb_paddings > 0:
nb_paddings += [''] * nb_paddings
Expand Down

0 comments on commit 427ab4c

Please sign in to comment.