Code

Safetensors offload#20321

Code

Merged

sgugger merged 6 commits intomainhuggingface/transformers:mainfrom safetensors_offloadhuggingface/transformers:safetensors_offloadCopy head branch name to clipboardNov 28, 2022

+83-17

Commits

Commits on Nov 18, 2022

• INtegrate safetensos in weight offloading

  sgugger

  committed
  c99b308

  Copy full SHA for c99b308

• Use safetensors checkpoint for offload when available

  sgugger

  committed
  b7b6b99

  Copy full SHA for b7b6b99

Commits on Nov 21, 2022

• Make naming consistent

  sgugger

  committed
  9ca0301

  Copy full SHA for 9ca0301

• Make load faster

  sgugger

  committed
  ffa9b24

  Copy full SHA for ffa9b24

• Quality

  sgugger

  committed
  dae2816

  Copy full SHA for dae2816

• Add default

  sgugger

  committed
  c1a6d4b

  Copy full SHA for c1a6d4b