Skip to content

Commit

Permalink
Fix one char super tiny typo (#1137)
Browse files Browse the repository at this point in the history
* Update pipeline.mdx

* Update pipeline.rst
  • Loading branch information
fzyzcjy authored and Narsil committed Jan 16, 2023
1 parent 041c0f0 commit cff8ff5
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docs/source-doc-builder/pipeline.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -558,7 +558,7 @@ If you used a model that added special characters to represent subtokens
of a given "word" (like the `"##"` in
WordPiece) you will need to customize the `decoder` to treat
them properly. If we take our previous `bert_tokenizer` for instance the
default decoing will give:
default decoding will give:

<tokenizerslangcontent>
<python>
Expand Down
2 changes: 1 addition & 1 deletion docs/source/pipeline.rst
Original file line number Diff line number Diff line change
Expand Up @@ -497,7 +497,7 @@ remove all special tokens, then join those tokens with spaces:

If you used a model that added special characters to represent subtokens of a given "word" (like
the :obj:`"##"` in WordPiece) you will need to customize the `decoder` to treat them properly. If we
take our previous :entity:`bert_tokenizer` for instance the default decoing will give:
take our previous :entity:`bert_tokenizer` for instance the default decoding will give:

.. only:: python

Expand Down

0 comments on commit cff8ff5

Please sign in to comment.