Code

Feat general basic communication#8437

Code

Merged

mergify[bot] merged 76 commits intomasterOneflow-Inc/oneflow:masterfrom feat-general_basic_communicationOneflow-Inc/oneflow:feat-general_basic_communicationCopy head branch name to clipboardJul 25, 2022

+1,768-175

Commits

Commits on Jun 5, 2022

• Add a slight cost for B->S and B->P in 2d sbp

  Yipeng1994

  committed
  9b8664c

  Copy full SHA for 9b8664c

Commits on Jun 6, 2022

• Add penalty for P in consumer

  Yipeng1994

  committed
  c32adbb

  Copy full SHA for c32adbb

Commits on Jun 7, 2022

• Merge branch 'master' into patch-sbp_cost

  Yipeng1994

  authored
  362a426

  Copy full SHA for 362a426

• Fix a slight bug

  Yipeng1994

  committed
  403d429

  Copy full SHA for 403d429

• Add at most 1 middle node for general basic communication

  Yipeng1994

  committed
  3ff0d59

  Copy full SHA for 3ff0d59

Commits on Jun 8, 2022

• Add the cost for general basic communication

  Yipeng1994

  committed
  998f883

  Copy full SHA for 998f883

• Add the slight penalty for eager

  Yipeng1994

  committed
  e53ffbc

  Copy full SHA for e53ffbc

• Merge branch 'patch-sbp_cost' of github.com:Oneflow-Inc/oneflow into patch-sbp_cost

  Yipeng1994

  committed
  9145dc6

  Copy full SHA for 9145dc6

Commits on Jun 9, 2022

• Skip initialization of boxing collector if not needed

  Yipeng1994

  committed
  0373803

  Copy full SHA for 0373803

• Fix a bug

  Yipeng1994

  committed
  e7164a7

  Copy full SHA for e7164a7

Commits on Jun 23, 2022

• Dev nd nccl send recv boxing (#8467)

  Show description for 2b16f1b
  

  23 peopleauthored
  2b16f1b

  Copy full SHA for 2b16f1b

• Support different hierarchy

  Yipeng1994

  committed
  2a1810c

  Copy full SHA for 2a1810c

• Merge branch 'master' into feat-general_basic_communication (#8477)

  Show description for f46efa1
  

  28 peopleauthored
  f46efa1

  Copy full SHA for f46efa1

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  2c30a03

  Copy full SHA for 2c30a03

• Ask general basic communication before middle nodes

  Yipeng1994

  committed
  900dcc8

  Copy full SHA for 900dcc8

• Add a task type for general basic communication

  Yipeng1994

  committed
  5eb7510

  Copy full SHA for 5eb7510

• Fix a bug

  Yipeng1994

  committed
  8f39d6d

  Copy full SHA for 8f39d6d

Commits on Jun 24, 2022

• Fix a bug

  Yipeng1994

  committed
  0c9fd15

  Copy full SHA for 0c9fd15

• Fix the bug of transfer from 1d sbp to 2d sbp

  Yipeng1994

  committed
  0c95d76

  Copy full SHA for 0c95d76

Commits on Jun 27, 2022

• Use the intersection to approximate the ratio

  Yipeng1994

  committed
  d4cf04c

  Copy full SHA for d4cf04c

• Use a suitable virtual blob description

  Yipeng1994

  committed
  e843e7e

  Copy full SHA for e843e7e

Commits on Jun 28, 2022

• Remove the checking for balanced splitting

  Yipeng1994

  committed
  7e7724a

  Copy full SHA for 7e7724a

Commits on Jun 29, 2022

• Fix the previous bug, still have another one

  Yipeng1994

  committed
  e7d7fe3

  Copy full SHA for e7d7fe3

• Fix another bug

  Yipeng1994

  committed
  afee00a

  Copy full SHA for afee00a

Commits on Jun 30, 2022

• Update oneflow/core/graph/boxing/hierarchical_sub_task_graph_builder_impl.cpp

  Show description for 3b6baad
  guo-ran

  authored
  3b6baad

  Copy full SHA for 3b6baad

• Use machine 4-7 for hierarchy [2, 2] in the consumer

  Yipeng1994

  committed
  90b0a5d

  Copy full SHA for 90b0a5d

• Add a switch for general basic communication

  Yipeng1994

  committed
  bcede72

  Copy full SHA for bcede72

• Add test script and of format

  Yipeng1994

  committed
  79c905f

  Copy full SHA for 79c905f

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  600c384

  Copy full SHA for 600c384

• Fix conflit of master and remove print-out information

  Yipeng1994

  committed
  fe8fd38

  Copy full SHA for fe8fd38

Commits on Jul 1, 2022

• Skip middle nodes if not enough gains

  Yipeng1994

  committed
  3605117

  Copy full SHA for 3605117

• Fix a typo

  Yipeng1994

  committed
  e9e2d42

  Copy full SHA for e9e2d42

Commits on Jul 2, 2022

• fix nccl send recv bug for different stream

  guo-ran

  committed
  3cf45b2

  Copy full SHA for 3cf45b2

• Merge branch 'feat-general_basic_communication' of https://github.com/Oneflow-Inc/oneflow into feat-general_basic_communication

  guo-ran

  committed
  1b9705d

  Copy full SHA for 1b9705d

Commits on Jul 4, 2022

• hot fix for ncclComm init

  guo-ran

  committed
  27aef14

  Copy full SHA for 27aef14

Commits on Jul 8, 2022

• Reuse streams for different jobs

  Yipeng1994

  committed
  d837d73

  Copy full SHA for d837d73

• Merge branch 'feat-general_basic_communication' of github.com:Oneflow-Inc/oneflow into feat-general_basic_communication

  Yipeng1994

  committed
  ba065fd

  Copy full SHA for ba065fd

• Rename and of format

  Yipeng1994

  committed
  c3c0074

  Copy full SHA for c3c0074

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  ea2ce43

  Copy full SHA for ea2ce43

Commits on Jul 11, 2022

• Skip general basic communication for transfer

  Show description for 0076c1d
  Yipeng1994

  committed
  0076c1d

  Copy full SHA for 0076c1d

Commits on Jul 13, 2022

• Merge branch 'master' into feat-general_basic_communication

  strint

  authored
  bd8444d

  Copy full SHA for bd8444d

Commits on Jul 14, 2022

• Address suggestion

  Yipeng1994

  committed
  f09dc85

  Copy full SHA for f09dc85

Commits on Jul 18, 2022

• Use the more powerful GetRankSendRecvIntersection

  Yipeng1994

  committed
  f4ea3c2

  Copy full SHA for f4ea3c2

• Register nccl send recv op for comm init before

  Show description for e426c52
  Yipeng1994

  committed
  e426c52

  Copy full SHA for e426c52

Commits on Jul 20, 2022

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  41e2e57

  Copy full SHA for 41e2e57

• Remove irrelevant scripts

  Yipeng1994

  committed
  9d2808e

  Copy full SHA for 9d2808e

Commits on Jul 21, 2022

• Address suggestion and of format

  Yipeng1994

  committed
  b32c133

  Copy full SHA for b32c133

• Address suggestion

  Yipeng1994

  committed
  d65ae0d

  Copy full SHA for d65ae0d

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  96487cf

  Copy full SHA for 96487cf

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  921d0d4

  Copy full SHA for 921d0d4

• Static analysis

  Yipeng1994

  committed
  5869aa5

  Copy full SHA for 5869aa5

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  e21597e

  Copy full SHA for e21597e

• Static analysis. Still have another one

  Yipeng1994

  committed
  983ae75

  Copy full SHA for 983ae75

• Merge branch 'feat-general_basic_communication' of github.com:Oneflow-Inc/oneflow into feat-general_basic_communication

  Yipeng1994

  committed
  e87770c

  Copy full SHA for e87770c

Commits on Jul 22, 2022

• Static analysis

  Yipeng1994

  committed
  5b01f68

  Copy full SHA for 5b01f68

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  7cbbeac

  Copy full SHA for 7cbbeac

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  b23f6b3

  Copy full SHA for b23f6b3

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  ae3598e

  Copy full SHA for ae3598e

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  60e421f

  Copy full SHA for 60e421f

• Alleviate on test time

  Yipeng1994

  committed
  cb44617

  Copy full SHA for cb44617

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  185feb0

  Copy full SHA for 185feb0

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  3e91733

  Copy full SHA for 3e91733

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  f5b267a

  Copy full SHA for f5b267a

Commits on Jul 23, 2022

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  f40df8d

  Copy full SHA for f40df8d

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  d4fc161

  Copy full SHA for d4fc161

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  830d889

  Copy full SHA for 830d889

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  8d11afb

  Copy full SHA for 8d11afb

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  b9b7870

  Copy full SHA for b9b7870

Commits on Jul 24, 2022

• nccl logical send recv do not support different hierarchy

  Yipeng1994

  committed
  1deb764

  Copy full SHA for 1deb764

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  2fb1122

  Copy full SHA for 2fb1122

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  9b54b56

  Copy full SHA for 9b54b56

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  bb1b2d1

  Copy full SHA for bb1b2d1

• Merge branch 'master' into feat-general_basic_communication

  mergify[bot]

  authored
  088e754

  Copy full SHA for 088e754

Commits on Jul 25, 2022

• Init boxing collector when asked

  Yipeng1994

  committed
  2abf194

  Copy full SHA for 2abf194

• Merge branch 'feat-general_basic_communication' of github.com:Oneflow-Inc/oneflow into feat-general_basic_communication

  Yipeng1994

  committed
  6c4a674

  Copy full SHA for 6c4a674

• Merge branch 'master' into feat-general_basic_communication

  Yipeng1994

  authored
  6407bb5

  Copy full SHA for 6407bb5