Skip to content

Commit

Permalink
Merge branch 'patch-7' of https://github.com/jklj077/transformers int…
Browse files Browse the repository at this point in the history
…o patch-7
  • Loading branch information
renxuancheng.rxc committed Jan 15, 2024
2 parents 304f0dc + e0c7750 commit 8b144e1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/transformers/models/qwen2/tokenization_qwen2.py
Original file line number Diff line number Diff line change
Expand Up @@ -214,7 +214,7 @@ def __init__(
)

@property
# copied from transformers.models.gpt2.tokenization_gpt2.GPT2Tokenizer.vocab_size
# Copied from transformers.models.gpt2.tokenization_gpt2.GPT2Tokenizer.vocab_size
def vocab_size(self) -> int:
return len(self.encoder)

Expand Down

0 comments on commit 8b144e1

Please sign in to comment.