Code

[FA2] Add flash attention for opt#26414

Code

Merged

amyeroberts merged 16 commits intohuggingface:mainhuggingface/transformers:mainfrom susnato:flash_attn_optsusnato/transformers:flash_attn_optCopy head branch name to clipboardNov 23, 2023

+323-30

Commits

Commits on Sep 26, 2023

• added flash attention for opt

  susnato

  committed
  626276f

  Copy full SHA for 626276f

• added to list

  susnato

  committed
  7800457

  Copy full SHA for 7800457

• fix use cache (#3)

  younesbelkada

  authored
  689f599

  Copy full SHA for 689f599

• style fix

  susnato

  committed
  74e9687

  Copy full SHA for 74e9687

• fix text

  susnato

  committed
  cf923e8

  Copy full SHA for cf923e8

• test fix2

  susnato

  committed
  db8cf07

  Copy full SHA for db8cf07

Commits on Sep 28, 2023

• reverted until 689f599

  susnato

  committed
  af67e0f

  Copy full SHA for af67e0f

• torch fx tests are working now!

  susnato

  committed
  edf1610

  Copy full SHA for edf1610

• small fix

  susnato

  committed
  f34b680

  Copy full SHA for f34b680

• Merge branch 'main' into flash_attn_opt

  susnato

  committed
  90be210

  Copy full SHA for 90be210

• added TODO docstring

  susnato

  committed
  5cec2ad

  Copy full SHA for 5cec2ad

• Merge branch 'main' into flash_attn_opt

  susnato

  committed
  2bde7cf

  Copy full SHA for 2bde7cf

Commits on Oct 30, 2023

• Merge branch 'main' into flash_attn_opt

  susnato

  authored
  db18d65

  Copy full SHA for db18d65

• changes

  susnato

  committed
  adfbb69

  Copy full SHA for adfbb69

Commits on Nov 16, 2023

• Merge branch 'main' into flash_attn_opt

  susnato

  committed
  10ab9b3

  Copy full SHA for 10ab9b3

• comments and .md file modification

  susnato

  committed
  7d4c688

  Copy full SHA for 7d4c688