Skip to content

v2.2.1

Latest
Latest
Compare
Choose a tag to compare
@retarfi retarfi released this 28 Apr 11:28
· 4 commits to main since this release
v2.2.1
571ecf8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
  • Able to select sentencepiece algorithm
  • Able to use multiprocessing in create_datasets.py
  • Move ELECTRA model file into models directory
  • Add DeBERTaV3 (alpha) implementation
    • This implementation does back propagation of generator and discriminator at the same time
    • In my experiment, models from this implementation perform worse than the models with my DeBERTaV2 implementation
    • So the implementation needs to be improved, however, I don't have time to put effort into this.
Assets 2
Loading