Code

MP overlap for 1f1b#57446

Code

Merged

From00 merged 14 commits intoPaddlePaddle:developPaddlePaddle/Paddle:developfrom From00:mp-overlap-for-1f1bFrom00/Paddle:mp-overlap-for-1f1bCopy head branch name to clipboardSep 19, 2023

+664-112

Commits

Commits on Aug 28, 2023

• B-F overlap

  From00

  committed
  dedd69b

  Copy full SHA for dedd69b

Commits on Aug 29, 2023

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into backward-forward-overlap-for-1f1b

  From00

  committed
  3c252c1

  Copy full SHA for 3c252c1

Commits on Sep 1, 2023

• Add column_parallel_linear_backward_overlapping

  From00

  committed
  ac49ea7

  Copy full SHA for ac49ea7

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into backward-forward-overlap-for-1f1b

  From00

  committed
  3389eea

  Copy full SHA for 3389eea

Commits on Sep 5, 2023

• Add cost model

  From00

  committed
  ee4cc58

  Copy full SHA for ee4cc58

Commits on Sep 8, 2023

• Insert reshape for ColumnParallelLinearBackwardOverlappingPass

  From00

  committed
  57e09f8

  Copy full SHA for 57e09f8

• Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into backward-forward-overlap-for-1f1b

  From00

  committed
  468fa11

  Copy full SHA for 468fa11

Commits on Sep 11, 2023

• Add cross-program event dependency

  From00

  committed
  ab00cd7

  Copy full SHA for ab00cd7

Commits on Sep 12, 2023

• Refine split program in _backward_forward_overlap

  From00

  committed
  8d97c8f

  Copy full SHA for 8d97c8f

Commits on Sep 18, 2023

• Add empirical op cost

  From00

  committed
  91d5e42

  Copy full SHA for 91d5e42

• Add NOTE

  From00

  committed
  5e369a1

  Copy full SHA for 5e369a1

• Remove some redundant codes

  From00

  committed
  50e60c9

  Copy full SHA for 50e60c9

• Remove some redundant codes

  From00

  committed
  4829542

  Copy full SHA for 4829542

• Fix UTs

  From00

  committed
  0d36e20

  Copy full SHA for 0d36e20