Skip to content
Back to pull request #5414

[Speculative Decoding] Support draft model on different tensor-parallel size than target model #12676

Sign in to view logs

[Speculative Decoding] Support draft model on different tensor-parallel size than target model

[Speculative Decoding] Support draft model on different tensor-parallel size than target model #12676

Run time

Learn about OS pricing on GitHub Actions
Job Run time
yapf (3.8)
1m 9s
yapf (3.9)
1m 21s
yapf (3.10)
1m 11s
yapf (3.11)
56s
4m 37s