What's New in v0.3.2:
- Add
--use_tensorcore
option for benchmarking in tutel.examples.helloworld. - Read
TUTEL_GLOBAL_TIMEOUT_SEC
from environment variable to configure NCCL timeout setting. - Extend
tutel.examples.helloworld_custom_expert
to explain the way to override MoE with customized expert layers.
How to Setup:
python3 -m pip install -v -U --no-build-isolation https://github.com/microsoft/tutel/archive/refs/tags/v0.3.2.tar.gz