Code

Enable BNB multi-backend support#31098

Code

Merged

Titus-von-Koeller merged 66 commits intohuggingface:mainhuggingface/transformers:mainfrom jiqing-feng:bnb_cpujiqing-feng/transformers:bnb_cpuCopy head branch name to clipboardSep 24, 2024

+436-100

Commits

Commits on Aug 27, 2024

• enable cpu bnb path

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  846f853

• fix style

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  6c56703

• fix code style

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  3f02c9b

• fix 4 bit path

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  9ccbf10

• Update src/transformers/utils/import_utils.py

  Show description for 89fa5ef
  

  2 peopleauthored and

  Titus-von-Koeller

  committed
  89fa5ef

• add multi backend refactor tests

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  a52d7af

• fix style

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  6f67862

• tweak 4bit quantizer + fix corresponding tests

  Titus-von-Koeller

  committed
  ee23eb0

• tweak 8bit quantizer + *try* fixing corresponding tests

  Titus-von-Koeller

  committed
  678e673

• fix dequant bnb 8bit

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  0858b3e

• account for Intel CPU in variability of expected outputs

  Titus-von-Koeller

  committed
  c76d243

• enable cpu and xpu device map

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  5843f28

• further tweaks to account for Intel CPU

  Titus-von-Koeller

  committed
  1a864a8

• fix autocast to work with both cpu + cuda

  Titus-von-Koeller

  committed
  f3753fc

• fix comments

  Titus-von-Koeller

  committed
  0cc1b7e

• fix comments

  Titus-von-Koeller

  committed
  b611812

• switch to testing_utils.torch_device

  Titus-von-Koeller

  committed
  ab4836e

• allow for xpu in multi-gpu tests

  Titus-von-Koeller

  committed
  7399500

• fix tests 4bit for CPU NF4

  

  jiqing-feng

  authored and

  Titus-von-Koeller

  committed
  b41059c

• fix bug with is_torch_xpu_available needing to be called as func

  Titus-von-Koeller

  committed
  1a7a6fe

• avoid issue where test reports attr err due to other failure

  Titus-von-Koeller

  committed
  87983df

• fix formatting

  Titus-von-Koeller

  committed
  7f17188

• fix typo from resolving of merge conflict

  Titus-von-Koeller

  committed
  bb3ba4a

• polish based on last PR review

  Show description for 463c211
  

  Titus-von-Koeller

  and

  SunMarc

  committed
  463c211

Commits on Aug 28, 2024

• fix CI

  jiqing-feng

  committed
  6d89ee4

Commits on Aug 29, 2024

• Update src/transformers/integrations/integration_utils.py

  Show description for 7e01cfb
  

  jiqing-feng

  and

  ArthurZucker

  authored
  7e01cfb

• Update src/transformers/integrations/integration_utils.py

  Show description for 9bffc93
  

  jiqing-feng

  and

  ArthurZucker

  authored
  9bffc93

• fix error log

  jiqing-feng

  committed
  01b7587

• fix error msg

  jiqing-feng

  committed
  171b130

• add \n in error log

  jiqing-feng

  committed
  5e9bf9a

• make quality

  jiqing-feng

  committed
  496c046

Commits on Aug 30, 2024

• rm bnb cuda restriction in doc

  jiqing-feng

  committed
  86d0016

Commits on Sep 3, 2024

• cpu model don't need dispatch

  jiqing-feng

  committed
  1c96ae9

• Merge branch 'main' into bnb_cpu

  jiqing-feng

  authored
  495354e

• fix doc

  jiqing-feng

  committed
  3aec626

• fix style

  jiqing-feng

  committed
  daa1e27

Commits on Sep 5, 2024

• check cuda avaliable in testing

  jiqing-feng

  committed
  d55db0e

• fix tests

  jiqing-feng

  committed
  a21a916

Commits on Sep 11, 2024

• Update docs/source/en/model_doc/chameleon.md

  Show description for 8ad17e8
  

  jiqing-feng

  and

  SunMarc

  authored
  8ad17e8

• Update docs/source/en/model_doc/llava_next.md

  Show description for 107e02b
  

  jiqing-feng

  and

  akx

  authored
  107e02b

• Update tests/quantization/bnb/test_4bit.py

  Show description for 20f6b5e
  

  jiqing-feng

  and

  akx

  authored
  20f6b5e

• Update tests/quantization/bnb/test_4bit.py

  Show description for 9ac038e
  

  jiqing-feng

  and

  akx

  authored
  9ac038e

• fix doc

  jiqing-feng

  committed
  3bab7d7

• Merge branch 'huggingface:main' into bnb_cpu

  jiqing-feng

  authored
  968d9c5

• fix check multibackends

  jiqing-feng

  committed
  08f31f8

• fix import sort

  jiqing-feng

  committed
  9eb0970

• remove check torch in bnb

  jiqing-feng

  committed
  b506b98

• docs: update bitsandbytes references with multi-backend info

  Titus-von-Koeller

  committed
  2be4169

• docs: fix small mistakes in bnb paragraph

  Titus-von-Koeller

  committed
  e607b7c

• run formatting

  Titus-von-Koeller

  committed
  ac108c6

• Merge remote-tracking branch 'origin/main' into bnb_cpu

  Titus-von-Koeller

  committed
  82dcb0d

Commits on Sep 12, 2024

• reveret bnb check

  jiqing-feng

  committed
  c66e7e7

Commits on Sep 13, 2024

• move bnb multi-backend check to import_utils

  jiqing-feng

  committed
  8f25ee2

Commits on Sep 14, 2024

• Update src/transformers/utils/import_utils.py

  Show description for a4333cb
  

  jiqing-feng

  and

  akx

  authored
  a4333cb

• fix bnb check

  jiqing-feng

  committed
  32cbb8d

• minor fix for bnb

  jiqing-feng

  committed
  4ce4b55

• check lib first

  jiqing-feng

  committed
  937ed3b

• fix code style

  jiqing-feng

  committed
  e40f284

• Merge branch 'huggingface:main' into bnb_cpu

  jiqing-feng

  authored
  03dd03b

• Revert "run formatting"

  Show description for b8093ce
  jiqing-feng

  committed
  b8093ce

• fix format

  jiqing-feng

  committed
  0551d23

Commits on Sep 18, 2024

• give warning when bnb version is low and no cuda found]

  jiqing-feng

  committed
  e33e43b

• Merge branch 'huggingface:main' into bnb_cpu

  jiqing-feng

  authored
  ced3c28

Commits on Sep 22, 2024

• fix device assignment check to be multi-device capable

  Titus-von-Koeller

  committed
  170dd58

Commits on Sep 23, 2024

• address akx feedback on get_avlbl_dev fn

  Titus-von-Koeller

  committed
  9ba4a5e

Commits on Sep 24, 2024

• we don't want the function tat publicc, as docs would be too much

  Titus-von-Koeller

  committed
  594f6f8