Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: speculative decoding #509

Merged
merged 32 commits into from
Oct 20, 2023

Conversation

UranusSeven
Copy link
Contributor

No description provided.

@XprobeBot XprobeBot added this to the v0.5.2 milestone Oct 7, 2023
@UranusSeven UranusSeven force-pushed the feat/speculative_decoding branch 4 times, most recently from fd3eed9 to 4bbf21c Compare October 13, 2023 09:15
@UranusSeven UranusSeven marked this pull request as ready for review October 13, 2023 09:22
@UranusSeven UranusSeven force-pushed the feat/speculative_decoding branch from efaa2da to b123263 Compare October 16, 2023 02:27
@XprobeBot XprobeBot modified the milestones: v0.5.2, v0.6.0 Oct 16, 2023
@UranusSeven UranusSeven force-pushed the feat/speculative_decoding branch from 3332b4a to 6c22ce5 Compare October 20, 2023 03:14
@UranusSeven UranusSeven merged commit 14fc29c into xorbitsai:main Oct 20, 2023
8 of 10 checks passed
Minamiyama pushed a commit to Minamiyama/inference that referenced this pull request Oct 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants