[Bugfix] Better error message for MLPSpeculator when `num_speculative_tokens` is set too high#5894

Merged

njhill merged 2 commits intovllm-project:mainfrom tdoublep:mlp-error-msg

Jun 28, 2024

+3-3

Commits on Jun 27, 2024

MLPSpeculator: Better error message when num_speculative_tokens is set too high
tdoublep
committed

Commits on Jun 28, 2024

Merge branch 'main' into mlp-error-msg
tdoublep
committed