Code

Ck tile/kvcache#74

Code

Merged

rocking5566 merged 19 commits intock_improve_v0.1.1ROCm/flash-attention:ck_improve_v0.1.1from ck_tile/kvcacheROCm/flash-attention:ck_tile/kvcacheCopy head branch name to clipboardAug 28, 2024

+950-33

Commits

Commits on Aug 13, 2024

• Update CK for changing of fmha_fwd_args

  rocking5566

  committed
  909d66f

Commits on Aug 17, 2024

• Add kvcache tmp

  rocking5566

  committed
  6928524

Commits on Aug 19, 2024

• Add kvcache

  rocking5566

  committed
  23000f7

Commits on Aug 20, 2024

• Merge remote-tracking branch 'origin/ck_improve_v0.1.1' into ck_tile/kvcache

  rocking5566

  committed
  a37da96

• Add kvcache test

  rocking5566

  committed
  d8de7a6

• Fix page_block_size in arg

  rocking5566

  committed
  a84d12d

• Minor fix

  rocking5566

  committed
  5b4546c

• Fix stride error

  rocking5566

  committed
  d6aac9e

Commits on Aug 21, 2024

• Update seqlen of kvcache before splitkv

  rocking5566

  committed
  ae24800

• Fix compile error

  rocking5566

  committed
  e2d3f5b

• Fix bug of hdim is not 8x

  rocking5566

  committed
  bb7a439

Commits on Aug 23, 2024

• Fit ck arg

  rocking5566

  committed
  7b18b87

Commits on Aug 26, 2024

• support adaptive num_splits

  rocking5566

  committed
  94e054f

• add more tests

  rocking5566

  committed
  9316aa6

• Refine test tolerance

  rocking5566

  committed
  7815e3b

• update CK

  rocking5566

  committed
  27095f2

• Move override_num_splits_if_necessary into cpp

  rocking5566

  committed
  4a25f60

Commits on Aug 27, 2024

• update ck

  rocking5566

  committed
  22eee22

Commits on Aug 28, 2024

• Update ck

  rocking5566

  committed
  007ae03