Skip to content

fuse fp8 quant in kv copying and add flashinfer decode mla operator in the attention module #737

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
hiworldwzj merged 4 commits into from
Feb 26, 2025

fix

461eec9
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

fuse fp8 quant in kv copying and add flashinfer decode mla operator in the attention module #737

fix
461eec9
Select commit
Loading
Failed to load commit list.

Annotations

1 error

The logs for this run have expired and are no longer available.