Skip to content

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding #16195

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding

[Core][Bugfix] Support prompt_logprobs returned with speculative decoding #16195

Annotations

2 warnings

ruff (3.12)

succeeded Sep 23, 2024 in 32s