Code

Add horovod for distributed training#825

Code

Merged

marcromeyn merged 30 commits intoNVIDIA-Merlin:mainNVIDIA-Merlin/models:mainfrom edknv:tf/horovod-1edknv/models:tf/horovod-1Copy head branch name to clipboardNov 7, 2022

+369-18

Commits

Commits on Oct 3, 2022

• add horovod for distributed training

  edknv

  committed
  fe99145

  Copy full SHA for fe99145

Commits on Oct 20, 2022

• Add horovod for distributed training

  edknv

  committed
  209910a

  Copy full SHA for 209910a

• Repartition dataset as a workaround.

  edknv

  committed
  e4db9f1

  Copy full SHA for e4db9f1

Commits on Oct 25, 2022

• Move example notebook to separate PR

  edknv

  committed
  9a21450

  Copy full SHA for 9a21450

Commits on Oct 26, 2022

• Enable CI unit tests

  edknv

  committed
  56ff1c3

  Copy full SHA for 56ff1c3

• Merge branch 'main' into tf/horovod-1

  edknv

  committed
  1f78204

  Copy full SHA for 1f78204

• lint

  edknv

  committed
  342ef1d

  Copy full SHA for 342ef1d

• update test to remove seed_fn

  edknv

  committed
  7f19580

  Copy full SHA for 7f19580

• move cupy

  edknv

  committed
  f28d2d7

  Copy full SHA for f28d2d7

• fix errors

  edknv

  committed
  7b90422

  Copy full SHA for 7b90422

• Enable cpu for seed_fn

  edknv

  committed
  76eeb34

  Copy full SHA for 76eeb34

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  e76e9af

  Copy full SHA for e76e9af

Commits on Oct 27, 2022

• adjust learning rate for multi optimizer

  edknv

  committed
  40f868e

  Copy full SHA for 40f868e

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  5ae69de

  Copy full SHA for 5ae69de

Commits on Oct 31, 2022

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  2205a83

  Copy full SHA for 2205a83

• lint

  edknv

  committed
  dbe9879

  Copy full SHA for dbe9879

Commits on Nov 1, 2022

• Merge branch 'main' into tf/horovod-1

  edknv

  committed
  ca1dc79

  Copy full SHA for ca1dc79

• add horovodrun to tox.ini

  edknv

  committed
  af45a77

  Copy full SHA for af45a77

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  8661b3e

  Copy full SHA for 8661b3e

• don't install horovod in tensorflow-dev

  edknv

  committed
  4b1d40d

  Copy full SHA for 4b1d40d

Commits on Nov 2, 2022

• Merge branch 'main' into tf/horovod-1

  bschifferer

  authored
  a43d861

  Copy full SHA for a43d861

• add assertions for steps per epoch

  edknv

  committed
  6013913

  Copy full SHA for 6013913

Commits on Nov 3, 2022

• Merge branch 'main' into tf/horovod-1

  marcromeyn

  authored
  21b16f6

  Copy full SHA for 21b16f6

• add checks for distributed optimizer and callbacks

  edknv

  committed
  72520e6

  Copy full SHA for 72520e6

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  1970a17

  Copy full SHA for 1970a17

• Merge branch 'main' into tf/horovod-1

  marcromeyn

  authored
  2f75857

  Copy full SHA for 2f75857

• remove unused fixture in test

  edknv

  committed
  6f95610

  Copy full SHA for 6f95610

Commits on Nov 4, 2022

• Merge branch 'main' into tf/horovod-1

  edknv

  authored
  2a56d07

  Copy full SHA for 2a56d07

Commits on Nov 5, 2022

• move horovod to separte tox testenv

  edknv

  committed
  0d48d9b

  Copy full SHA for 0d48d9b

Commits on Nov 7, 2022

• Merge branch 'main' into tf/horovod-1

  marcromeyn

  authored
  b728a6b

  Copy full SHA for b728a6b