Skip to content

0.1.1
Compare
Choose a tag to compare
@feifeibear feifeibear released this 21 Sep 03:53
· 19 commits to main since this release
0.1.1
1da8d0a
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Add serving logic. You can launch bloom-based LLM speculative sampling as a server.

Assets 2
Loading