Skip to content

Commit

Permalink
nit: add comment
Browse files Browse the repository at this point in the history
  • Loading branch information
baberabb committed Aug 29, 2024
1 parent f2f7fa8 commit 1c2def6
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions lm_eval/models/vllm_causallms.py
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,7 @@ def loglikelihood_rolling(
get_rolling_token_windows(
token_list=self.tok_encode(string),
prefix_token=self.prefix_token_id,
# max_seq_len - (1 for context)
max_seq_len=self.max_length - 1,
context_len=1,
),
Expand Down

0 comments on commit 1c2def6

Please sign in to comment.