Code

NKI flash-attention backend#1

Code

Open

liangfu wants to merge 2 commits intoAoyuQC:tpu-compileAoyuQC/vllm:tpu-compilefrom liangfu:tpu-compileliangfu/vllm:tpu-compileCopy head branch name to clipboard

+1,257-40

Commits

Commits on Dec 19, 2024

• NKI-based flash-attention kernel with paged KV cache

  Show description for e216c65
  liangfu

  committed
  e216c65

  Copy full SHA for e216c65

Commits on Dec 21, 2024

• trying to integrate NKI flash-attention as attention backend

  liangfu

  committed
  2bc9bcf

  Copy full SHA for 2bc9bcf