本实现是在 https://github.com/66RING/tiny-flash-attention.git 基础上做了一些是实现上的代码简化，如去掉了一些不必要的冗余定义、简化shared memory cute layout 定义等
对应的 blog：https://zhuanlan.zhihu.com/p/708867810
-
Notifications
You must be signed in to change notification settings - Fork 1
weishengying/tiny-flash-attention
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
使用 cutlass 实现 flash-attention 精简版，具有教学意义
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published