Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]Support flashMLA decoding via flashAttn2 #1

Open
zhangjinnan opened this issue Feb 25, 2025 · 0 comments
Open

[Feature]Support flashMLA decoding via flashAttn2 #1

zhangjinnan opened this issue Feb 25, 2025 · 0 comments
Assignees
@zhangjinnan

Comments

@zhangjinnan
Copy link

As titled, please add support for MACA Platform via flashAttn2

deepseek-ai#29
zhangjinnan added a commit to zhangjinnan/FlashMLA that referenced this issue Feb 25, 2025
@zhangjinnan
Feature：Support flashMLA decoding via flashAttn2(MetaX-MACA#1)
569544b 
Changes:
1. Implement flashMLA with matrix absorption algorithm via flashAttn2
2. Add golden test on MXMACA platform
@zhangjinnan zhangjinnan mentioned this issue Feb 25, 2025
Merged
@zhangjinnan zhangjinnan self-assigned this Feb 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhangjinnan zhangjinnan

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@zhangjinnan