Skip to content

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling #25639

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling #25639

Annotations

1 warning

mypy (3.10)

succeeded Dec 27, 2024 in 33s