Code

Remove apex deps#9

Code

Merged

saforem2 merged 16 commits intomainargonne-lcf/Megatron-DeepSpeed:mainfrom remove-apex-depsargonne-lcf/Megatron-DeepSpeed:remove-apex-depsCopy head branch name to clipboardApr 25, 2024

+2,934-3,514

Commits

Commits on Apr 23, 2024

• Remove apex deps from megatron/*

  saforem2

  committed
  133f244

  Copy full SHA for 133f244

• Move generate_config.sh logic into ALCF/helpers.sh

  saforem2

  committed
  42a27fb

  Copy full SHA for 42a27fb

• Add option to launch with mpiexec

  saforem2

  committed
  3be7efc

  Copy full SHA for 3be7efc

Commits on Apr 24, 2024

• Update train_llama_alcf.sh

  saforem2

  committed
  a8a9a59

  Copy full SHA for a8a9a59

• Update ALCF/helpers.sh

  saforem2

  committed
  42140d7

  Copy full SHA for 42140d7

• Update ALCF/helpers.sh, train_llama_alcf.sh

  saforem2

  committed
  fa0c5a6

  Copy full SHA for fa0c5a6

• Add ALCF/sunspot-env.sh

  saforem2

  committed
  4b9c2f2

  Copy full SHA for 4b9c2f2

• Update train_llama_alcf.sh, ALCF/helpers.sh

  saforem2

  committed
  c2e9147

  Copy full SHA for c2e9147

• Update ALCF/helpers.sh

  saforem2

  committed
  41a3f35

  Copy full SHA for 41a3f35

• Much faster check if ezpz installed

  Show description for 71c725e
  saforem2

  committed
  71c725e

  Copy full SHA for 71c725e

• Add option to run in DEBUG mode (i.e. set -euxo pipefail)

  saforem2

  committed
  ae0b4d8

  Copy full SHA for ae0b4d8

• Update ALCF/data-lists/sunspot/*.txt

  saforem2

  committed
  2d6608a

  Copy full SHA for 2d6608a

• Add ALCF/test_sunspot.sh

  saforem2

  committed
  3648af5

  Copy full SHA for 3648af5

Commits on Apr 25, 2024

• Add ALCF/data-lists/sirius/books.txt

  saforem2

  committed
  9796eac

  Copy full SHA for 9796eac

• Add ALCF/test_sirius.sh

  saforem2

  committed
  7b2ab6d

  Copy full SHA for 7b2ab6d

• Update ALCF/test_sirius.sh

  saforem2

  committed
  58cdcca

  Copy full SHA for 58cdcca