Skip to content

Commit

Permalink
Replace DeBERTa with ELECTRA in docs
Browse files Browse the repository at this point in the history
As DeBERTa doesn't support attention mask matrices
  • Loading branch information
tomaarsen committed Jul 4, 2023
1 parent 5c56569 commit 41fdda8
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ SpanMarker for Named Entity Recognition
[πŸ“„ Documentation](https://tomaarsen.github.io/SpanMarkerNER) | πŸ“Š [Thesis](https://raw.githubusercontent.com/tomaarsen/SpanMarkerNER/main/thesis.pdf)
</div>

SpanMarker is a framework for training powerful Named Entity Recognition models using familiar encoders such as BERT, RoBERTa and DeBERTa.
SpanMarker is a framework for training powerful Named Entity Recognition models using familiar encoders such as BERT, RoBERTa and ELECTRA.
Built on top of the familiar [πŸ€— Transformers](https://github.com/huggingface/transformers) library, SpanMarker inherits a wide range of powerful functionalities, such as easily loading and saving models, hyperparameter optimization, automatic logging in various tools, checkpointing, callbacks, mixed precision training, 8-bit inference, and more.

<!--Tightly implemented on top of the [πŸ€— Transformers](https://github.com/huggingface/transformers/) library, SpanMarker can take advantage of its valuable functionality.-->
Expand Down
2 changes: 1 addition & 1 deletion docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ SpanMarker for Named Entity Recognition
#######################################

SpanMarker is a framework for training powerful Named Entity Recognition models using familiar encoders such as BERT,
RoBERTa and DeBERTa. Tightly implemented on top of the `πŸ€— Transformers <https://github.com/huggingface/transformers>`_
RoBERTa and ELECTRA. Tightly implemented on top of the `πŸ€— Transformers <https://github.com/huggingface/transformers>`_
library, SpanMarker can take advantage of its valuable functionality.

Based on the `PL-Marker <https://arxiv.org/pdf/2109.06067.pdf>`_ paper, SpanMarker breaks the mold through its
Expand Down

0 comments on commit 41fdda8

Please sign in to comment.