Code

Refactor residual add kernels#2333

Code

Merged

jeffra merged 4 commits intomastermicrosoft/DeepSpeed:masterfrom arashb/refact-res-add-biasmicrosoft/DeepSpeed:arashb/refact-res-add-biasCopy head branch name to clipboardSep 21, 2022

+70-73

Commits

Commits on Sep 20, 2022

• Refactor residual add to expose fp16/fp32 kernels at python level

  arashb

  committed
  f024542

  Copy full SHA for f024542

• Refactor the in-place tensor update/return

  arashb

  committed
  27d2e7b

  Copy full SHA for 27d2e7b

• Fix function input args order

  arashb

  committed
  0a68127

  Copy full SHA for 0a68127

Commits on Sep 21, 2022

• Merge branch 'master' into arashb/refact-res-add-bias

  awan-10

  authored
  8a89926

  Copy full SHA for 8a89926