Skip to content

v4.27.4: Patch release
Compare
Choose a tag to compare
@sgugger sgugger released this 29 Mar 17:08
· 5546 commits to main since this release
v4.27.4
4e9f6fc
This commit was signed with the committer’s verified signature.
sgugger Sylvain Gugger
GPG key ID: 4198F83D867EFC2E
Learn about vigilant mode.

This patch fixes a regression with FlauBERT and XLM models.

  • Revert "Error (also in original) model, scaling only q matrix not qk.T dot product (qk.T/sqrt(dim_per_head)) (#21627) in #22444 by @sgugger

Contributors

sgugger
Assets 2
Loading