fuse fp8 quant in kv copying and add flashinfer decode mla operator in the attention module#737
Merged
hiworldwzj merged 4 commits intoModelTC:mainfrom Feb 26, 2025
Merged
Commits
Commits on Feb 26, 2025
- committed
niushengxiao - authored andcommitted
- authored
- authored
