nccl|Scope

This is the nccl benchmark plugin for the Scope benchmark project.

NCCL benchmarks for C3SR Scope.

Contributors

• Carl Pearson
• Sarah Hashash

Documentation

See the docs folder for a description of the benchmarks.

Arguments

All support this arguemnt:

• Number of GPUs
  • -g, --ngpus Default: 1.

Changelog

v0.1.1

• Add changelog

v0.1.0

• Bandwidth benchmarks for allGather, allReduce, broadcast, reduce, reduceScatter.
• Disable NCCL|Scope by default (enable with -DENABLE_NCCL=1).