Skip to content

b1545

  • b1545
  • 40a34fe

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
    GPG key ID: 4AEE18F83AFDEB23
    Expired
    Verified
    Learn about vigilant mode
  • Compare
    Choose a tag to compare
b1545: speculative : fix prompt tokenization in speculative example (#4025)
  • b1545
  • 40a34fe
  • Compare
    Choose a tag to compare

  • Verified

    This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
    GPG key ID: 4AEE18F83AFDEB23
    Expired
    Verified
    Learn about vigilant mode
@AutonomicPerfectionist AutonomicPerfectionist tagged this 20 Nov 09:50 
* Support special tokens and not adding BOS to prompt in speculative

* Adapt to new should_add_bos function

* Ensure tgt and dft have same add_bos setting
Assets 2
Loading