[Speculative decoding][Re-take] Enable TP>1 speculative decoding#4840
Merged
cadedaniel merged 20 commits intovllm-project:mainfrom comaniac:cody/tp_gt_1May 16, 2024
+297-182
Commits
Commits on May 9, 2024
- committed
Commits on May 14, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on May 16, 2024
- authored
- committed