Merged
Update default max_num_batch_tokens for chunked prefill to 2048#10544youkaichao merged 2 commits intomainfrom default-chunked-prefill-2048
youkaichao merged 2 commits intomainfrom default-chunked-prefill-2048
Update default max_num_batch_tokens for chunked prefill to 2048#10544
Merged
youkaichao merged 2 commits intomainfrom default-chunked-prefill-2048Nov 23, 2024
+3-3
Commits cannot be loaded
The page is unavailable due to a system error.
Try reloading the page, or if the problem persists, contact support.