Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: fix fp8 for MLA and support bmm fp8 for DeepSeek V2 #1285

Merged
merged 2 commits into from
Sep 1, 2024

feat: use bmm fp8

0624f69
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

feat: fix fp8 for MLA and support bmm fp8 for DeepSeek V2 #1285

feat: use bmm fp8
0624f69
Select commit
Loading
Failed to load commit list.