Skip to content

Commit

Permalink
Apply isort and black reformatting
Browse files Browse the repository at this point in the history
Signed-off-by: huvunvidia <huvunvidia@users.noreply.github.com>
  • Loading branch information
huvunvidia committed Oct 21, 2024
1 parent 020a2f4 commit 492c3a3
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,7 @@ def __init__(
new_tokens_in_vocab.append(token)
for token in additional_special_tokens:
if token is not None and token not in self.tokenizer.get_vocab():
new_tokens_in_vocab.append(token)
new_tokens_in_vocab.append(token)

if len(new_tokens_in_vocab) > 0:
"""
Expand Down

0 comments on commit 492c3a3

Please sign in to comment.