Code

HF FSDP wrap BLOOM and OPT as well#83

Code

Merged

abhi-mosaic merged 12 commits intomosaicml:mainmosaicml/examples:mainfrom samhavens:hf-fsdpsamhavens/benchmarks:hf-fsdpCopy head branch name to clipboardJan 27, 2023

+295-59

Commits

Commits on Jan 24, 2023

• HF FSDP wrap BLOOM and OPT as well

  samhavens

  committed
  910560b

  Copy full SHA for 910560b

• remove unused import

  samhavens

  committed
  b26f91c

  Copy full SHA for b26f91c

Commits on Jan 26, 2023

• Merge remote-tracking branch 'upstream/main' into hf-fsdp

  samhavens

  committed
  93da478

  Copy full SHA for 93da478

• don't keep data in git

  samhavens

  committed
  c27df6e

  Copy full SHA for c27df6e

• add OPT and add params to gpt demos

  samhavens

  committed
  68d788e

  Copy full SHA for 68d788e

• use ComposerHFCausalLM, allow pretrained, add types

  samhavens

  committed
  1bb5fa6

  Copy full SHA for 1bb5fa6

• try to fix linter errors

  samhavens

  committed
  0544356

  Copy full SHA for 0544356

• I need to get linting locally

  samhavens

  committed
  36d723d

  Copy full SHA for 36d723d

• linter fixes

  samhavens

  committed
  794d020

  Copy full SHA for 794d020

Commits on Jan 27, 2023

• Merge remote-tracking branch 'upstream/main' into hf-fsdp

  samhavens

  committed
  ac3e6d1

  Copy full SHA for ac3e6d1

• pyright is satisfied

  samhavens

  committed
  059725d

  Copy full SHA for 059725d

• yapf changes

  samhavens

  committed
  4300513

  Copy full SHA for 4300513