Skip to content

[Speculative decoding 1/9] Optimized rejection sampler#2336

Merged
LiuXiaoxuanPKU merged 10 commits intovllm-project:mainfrom cadedaniel:rejection-samplerJan 9, 2024

Commits

Commits on Jan 5, 2024

Commits on Jan 6, 2024

Commits on Jan 9, 2024