[ROCm][AMD][Model]Adding alibi slopes support in ROCm triton flash attention and naive flash attention#6043

Merged

WoosukKwon merged 6 commits intovllm-project:mainfrom gshtras:rocm_flash_attn_alibi

Jul 4, 2024

+51-2

Commits on Jun 28, 2024

Adding alibi slopes support. In case of naive attention, fall back to the old implementation when there is alibi
gshtras
committed

Commits on Jul 1, 2024

Merge remote-tracking branch 'upstream/main' into rocm_flash_attn_alibi
gshtras
committed
Fixed naive attention implementation and removed dead code
gshtras
committed

Commits on Jul 2, 2024

Commits on Jul 3, 2024

Update vllm/attention/backends/rocm_flash_attn.py

gshtras
and
hongxiayang
authored