Code

Separate attention backends#3005

Code

Merged

WoosukKwon merged 44 commits intomainvllm-project/vllm:mainfrom refactor-attnvllm-project/vllm:refactor-attnCopy head branch name to clipboardMar 7, 2024

+558-268

Commits

Commits on Feb 23, 2024

• Add attention_backends

  WoosukKwon

  committed
  a40b2c9

  Copy full SHA for a40b2c9

• Move

  WoosukKwon

  committed
  6b6f7c7

  Copy full SHA for 6b6f7c7

• Remove if

  WoosukKwon

  committed
  f2b888c

  Copy full SHA for f2b888c

• Remove if

  WoosukKwon

  committed
  7f4422c

  Copy full SHA for 7f4422c

• Attention

  WoosukKwon

  committed
  1d9dc99

  Copy full SHA for 1d9dc99

• Minor

  WoosukKwon

  committed
  534d0f8

  Copy full SHA for 534d0f8

• Minor

  WoosukKwon

  committed
  404022a

  Copy full SHA for 404022a

• Rename

  WoosukKwon

  committed
  194df2f

  Copy full SHA for 194df2f

• Add flash-attn

  WoosukKwon

  committed
  a6910ea

  Copy full SHA for a6910ea

Commits on Feb 27, 2024

• Address review

  WoosukKwon

  committed
  346b1b7

  Copy full SHA for 346b1b7

Commits on Feb 28, 2024

• Merge branch 'main' into refactor-attn

  WoosukKwon

  committed
  05579fa

  Copy full SHA for 05579fa

Commits on Feb 29, 2024

• Move

  WoosukKwon

  committed
  da115dd

  Copy full SHA for da115dd

• Move

  WoosukKwon

  committed
  19ecd4d

  Copy full SHA for 19ecd4d

• Minor

  WoosukKwon

  committed
  5b8e8c7

  Copy full SHA for 5b8e8c7

• Rename

  WoosukKwon

  committed
  ef8ace1

  Copy full SHA for ef8ace1

• Fix attention

  WoosukKwon

  committed
  6490fb4

  Copy full SHA for 6490fb4

• Minor

  WoosukKwon

  committed
  3baebac

  Copy full SHA for 3baebac

• Minor

  WoosukKwon

  committed
  6a81692

  Copy full SHA for 6a81692

• Minor

  WoosukKwon

  committed
  963a2c7

  Copy full SHA for 963a2c7

• Add comment

  WoosukKwon

  committed
  38baed7

  Copy full SHA for 38baed7

Commits on Mar 5, 2024

• Merge branch 'main' into refactor-attn

  WoosukKwon

  committed
  f97fc52

  Copy full SHA for f97fc52

• Attention backends -> Attention

  WoosukKwon

  committed
  89069b8

  Copy full SHA for 89069b8

• Move

  WoosukKwon

  committed
  9ba068a

  Copy full SHA for 9ba068a

• Move

  WoosukKwon

  committed
  677ad69

  Copy full SHA for 677ad69

• Minor

  WoosukKwon

  committed
  f5c7b07

  Copy full SHA for f5c7b07

• Ops

  WoosukKwon

  committed
  4a80dd0

  Copy full SHA for 4a80dd0

• Minor

  WoosukKwon

  committed
  1319fc9

  Copy full SHA for 1319fc9

• Import Attention

  WoosukKwon

  committed
  281c5d5

  Copy full SHA for 281c5d5

• Minor

  WoosukKwon

  committed
  2f32381

  Copy full SHA for 2f32381

• Update models

  WoosukKwon

  committed
  c68fe7e

  Copy full SHA for c68fe7e

• forward -> forward_decode

  WoosukKwon

  committed
  f65f65d

  Copy full SHA for f65f65d

• Add packaging to requirements

  WoosukKwon

  committed
  45d02a1

  Copy full SHA for 45d02a1

Commits on Mar 6, 2024

• Merge branch 'main' into refactor-attn

  WoosukKwon

  committed
  8e5ca7e

  Copy full SHA for 8e5ca7e

• Remove FlashAttention from requirements

  WoosukKwon

  committed
  8333223

  Copy full SHA for 8333223

• Add FlashInfer wheels to vLLM

  WoosukKwon

  committed
  ed1ab56

  Copy full SHA for ed1ab56

• Minor

  WoosukKwon

  committed
  73aedbd

  Copy full SHA for 73aedbd

• maybe fix packaging

  WoosukKwon

  committed
  0214afd

  Copy full SHA for 0214afd

• Add gitignore

  WoosukKwon

  committed
  12ea60d

  Copy full SHA for 12ea60d

Commits on Mar 7, 2024

• Revert

  WoosukKwon

  committed
  b460c21

  Copy full SHA for b460c21

• revert

  WoosukKwon

  committed
  4ffa89f

  Copy full SHA for 4ffa89f

• Copy after build

  WoosukKwon

  committed
  6ba0e70

  Copy full SHA for 6ba0e70

• Binary distribution

  WoosukKwon

  committed
  974db99

  Copy full SHA for 974db99

• yapf

  WoosukKwon

  committed
  f72560c

  Copy full SHA for f72560c

• Fix a bug for FP32

  WoosukKwon

  committed
  0b8ac9e

  Copy full SHA for 0b8ac9e