Code

Add exllama q4 kernel#219

Code

Merged

PanQiWei merged 20 commits intoAutoGPTQ:mainAutoGPTQ/AutoGPTQ:mainfrom fxmarty:exllama-q4-kernelfxmarty/AutoGPTQ:exllama-q4-kernelCopy head branch name to clipboardAug 6, 2023

+2,068-41

Commits

Commits on Jul 31, 2023

• exllama kernel

  fxmarty

  committed
  179776b

• cleaning

  fxmarty

  committed
  760667d

• fix fused attn

  fxmarty

  committed
  3844726

• add test

  fxmarty

  committed
  7c72b72

• fix bug quantization config loading

  fxmarty

  committed
  5660b22

• add test act-order wip (not passing)

  fxmarty

  committed
  d595b0b

• fix test

  fxmarty

  committed
  208bbfb

• act-order now works fine

  fxmarty

  committed
  129fa4b

• fix

  fxmarty

  committed
  339c57a

• fix atol

  fxmarty

  committed
  7ce1828

Commits on Aug 1, 2023

• add pack fun

  qwopqwop200

  authored
  a60c9a8

• if training disable exllama

  qwopqwop200

  authored
  a1fd81c

• change pcak func support only 4 bit

  qwopqwop200

  authored
  3fc097d

Commits on Aug 3, 2023

• support group query attention

  qwopqwop200

  authored
  7a7df56

• exllama support flash attention

  qwopqwop200

  authored
  068210d

Commits on Aug 4, 2023

• revert fused_llama_attn.py

  qwopqwop200

  authored
  79ab507

• Merge branch 'main' into exllama-q4-kernel

  fxmarty

  committed
  4fb3e20

• rocm support

  fxmarty

  committed
  d0608b0

• fix

  fxmarty

  committed
  c203a85

• Merge pull request #1 from qwopqwop200/exllama-q4-kernel

  Show description for 71f2326
  fxmarty

  authored
  71f2326