Code

deepspeed#288

Code

Merged

haqishen merged 67 commits intomainh2oai/h2o-llmstudio:mainfrom deepspeedh2oai/h2o-llmstudio:deepspeedCopy head branch name to clipboardOct 24, 2023

+814-494

Commits

Commits on Jul 18, 2023

• deepspeed

  haqishen

  committed
  d1ea793

  Copy full SHA for d1ea793

Commits on Jul 19, 2023

• shard

  haqishen

  committed
  5ef4792

  Copy full SHA for 5ef4792

Commits on Jul 25, 2023

• full param deepspeed works by this commit

  haqishen

  committed
  b5fac57

  Copy full SHA for b5fac57

Commits on Jul 26, 2023

• offload optimizer & documentation

  haqishen

  committed
  0f7086b

  Copy full SHA for 0f7086b

Commits on Aug 2, 2023

• format & fix save deepspeed weight

  haqishen

  committed
  687c456

  Copy full SHA for 687c456

Commits on Aug 3, 2023

• format & update save_checkpoint

  haqishen

  committed
  3b7ff0d

  Copy full SHA for 3b7ff0d

Commits on Aug 4, 2023

• update pipfile

  haqishen

  committed
  105a849

  Copy full SHA for 105a849

Commits on Aug 5, 2023

• update pipfile

  haqishen

  committed
  f583395

  Copy full SHA for f583395

Commits on Aug 9, 2023

• zero init for transformers

  haqishen

  committed
  cbc50fb

  Copy full SHA for cbc50fb

• add some new config

  haqishen

  committed
  ffee1c0

  Copy full SHA for ffee1c0

• fix bug

  haqishen

  committed
  f40ef52

  Copy full SHA for f40ef52

Commits on Aug 10, 2023

• min 1e6

  haqishen

  committed
  9cd37ab

  Copy full SHA for 9cd37ab

Commits on Aug 17, 2023

• update deepspeed config

  haqishen

  committed
  69e9eb1

  Copy full SHA for 69e9eb1

• Merge main to deepspeed

  haqishen

  committed
  1415cdc

  Copy full SHA for 1415cdc

• Merge branch 'main' into deepspeed

  haqishen

  authored
  9db3fbd

  Copy full SHA for 9db3fbd

• Update requirements.txt

  

  haqishen

  authored and

  github-actions[bot]

  committed
  b0df016

  Copy full SHA for b0df016

Commits on Aug 18, 2023

• remove duplicate code

  haqishen

  committed
  d30b51c

  Copy full SHA for d30b51c

• Merge branch 'deepspeed' of github.com:h2oai/h2o-llmstudio into deepspeed

  haqishen

  committed
  a4b76c3

  Copy full SHA for a4b76c3

• throw warning when compile w/ deepspeed

  haqishen

  committed
  67629ee

  Copy full SHA for 67629ee

• black

  haqishen

  committed
  48d7f71

  Copy full SHA for 48d7f71

• integrate deepspeed into wrap_model_distributed

  haqishen

  committed
  d1efef5

  Copy full SHA for d1efef5

• remove unuse code

  haqishen

  committed
  d6b0748

  Copy full SHA for d6b0748

• style

  haqishen

  committed
  3f89359

  Copy full SHA for 3f89359

• fix bug

  haqishen

  committed
  5c253f2

  Copy full SHA for 5c253f2

• fix bug

  haqishen

  committed
  9ff717f

  Copy full SHA for 9ff717f

• Merge branch 'main' into deepspeed

  haqishen

  authored
  405b207

  Copy full SHA for 405b207

• max token len to 16k

  haqishen

  committed
  b3495d4

  Copy full SHA for b3495d4

Commits on Aug 21, 2023

• deepspeed save lora

  haqishen

  committed
  7b78538

  Copy full SHA for 7b78538

• update get optimizer

  haqishen

  committed
  892f47c

  Copy full SHA for 892f47c

• fix check disk

  haqishen

  committed
  f2dfb89

  Copy full SHA for f2dfb89

Commits on Aug 23, 2023

• Merge branch 'main' into deepspeed

  haqishen

  authored
  efe77bb

  Copy full SHA for efe77bb

Commits on Aug 28, 2023

• comment out offload CPU

  haqishen

  committed
  d297ec9

  Copy full SHA for d297ec9

• Merge branch 'deepspeed' of github.com:h2oai/h2o-llmstudio into deepspeed

  haqishen

  committed
  a6781f1

  Copy full SHA for a6781f1

• Merge branch 'main' into deepspeed

  haqishen

  authored
  e6e46dc

  Copy full SHA for e6e46dc

• Pipfile.lock

  haqishen

  committed
  e16cab8

  Copy full SHA for e16cab8

• Merge branch 'main' into deepspeed

  haqishen

  committed
  65a1b2d

  Copy full SHA for 65a1b2d

• Update requirements.txt

  

  haqishen

  authored and

  github-actions[bot]

  committed
  32b16a5

  Copy full SHA for 32b16a5

• Merge branch 'main' into deepspeed

  haqishen

  authored
  eb4c990

  Copy full SHA for eb4c990

Commits on Aug 29, 2023

• make black

  haqishen

  committed
  e36fada

  Copy full SHA for e36fada

• Merge branch 'deepspeed' of github.com:h2oai/h2o-llmstudio into deepspeed

  haqishen

  committed
  bc4c239

  Copy full SHA for bc4c239

• add default

  haqishen

  committed
  b5e59e9

  Copy full SHA for b5e59e9

Commits on Sep 4, 2023

• minor fix

  haqishen

  committed
  24eeb16

  Copy full SHA for 24eeb16

• minor fix

  haqishen

  committed
  b9e5934

  Copy full SHA for b9e5934

• minor fix

  haqishen

  committed
  a296cca

  Copy full SHA for a296cca

Commits on Sep 5, 2023

• fix val loader

  haqishen

  committed
  11a4b8d

  Copy full SHA for 11a4b8d

Commits on Sep 7, 2023

• potential val loader fix

  psinger

  committed
  3efa2c9

  Copy full SHA for 3efa2c9

Commits on Sep 8, 2023

• update

  psinger

  committed
  14bc17e

  Copy full SHA for 14bc17e

• merge

  psinger

  committed
  0f40322

  Copy full SHA for 0f40322

• lock

  psinger

  committed
  bd1e134

  Copy full SHA for bd1e134

• Update requirements.txt

  

  psinger

  authored and

  github-actions[bot]

  committed
  6f81182

  Copy full SHA for 6f81182

Commits on Sep 26, 2023

• improve model saving for deepspeed

  haqishen

  committed
  62fc9c5

  Copy full SHA for 62fc9c5

• solved INFLIGHT problem

  haqishen

  committed
  dbbbcdf

  Copy full SHA for dbbbcdf

• update doc

  haqishen

  committed
  c023d19

  Copy full SHA for c023d19

Commits on Sep 28, 2023

• deepspeed default push to hub by cpu

  haqishen

  committed
  2785f9f

  Copy full SHA for 2785f9f

Commits on Oct 5, 2023

• Revert "improve model saving for deepspeed"

  Show description for aa17c0b
  haqishen

  committed
  aa17c0b

  Copy full SHA for aa17c0b

• remove unuse code

  haqishen

  committed
  4491c16

  Copy full SHA for 4491c16

Commits on Oct 10, 2023

• Merge branch 'main' into deepspeed

  haqishen

  committed
  fa031f2

  Copy full SHA for fa031f2

• Update requirements.txt

  

  haqishen

  authored and

  github-actions[bot]

  committed
  9337741

  Copy full SHA for 9337741

Commits on Oct 19, 2023

• deepspeed==0.11.1

  haqishen

  committed
  263f48a

  Copy full SHA for 263f48a

• Merge branch 'main' into deepspeed

  haqishen

  authored
  83429b6

  Copy full SHA for 83429b6

• Update requirements.txt

  

  haqishen

  authored and

  github-actions[bot]

  committed
  882631a

  Copy full SHA for 882631a

Commits on Oct 20, 2023

• temp fix for deepspeed slow gen

  haqishen

  committed
  368f0af

  Copy full SHA for 368f0af

• Merge branch 'deepspeed' of github.com:h2oai/h2o-llmstudio into deepspeed

  haqishen

  committed
  011e269

  Copy full SHA for 011e269

• style

  haqishen

  committed
  d5dbbfb

  Copy full SHA for d5dbbfb

• style

  haqishen

  committed
  5b8499c

  Copy full SHA for 5b8499c

Commits on Oct 24, 2023

• fix

  psinger

  committed
  07bb4b2

  Copy full SHA for 07bb4b2

• Merge branch 'main' into deepspeed

  haqishen

  committed
  91562e9

  Copy full SHA for 91562e9