support bf16_optimizer moe expert parallel training and moe EP grad_scale/grad_norm fix#5259
Merged
tjruwase merged 20 commits intodeepspeedai:masterfrom Mar 27, 2024
Merged
support bf16_optimizer moe expert parallel training and moe EP grad_scale/grad_norm fix#5259tjruwase merged 20 commits intodeepspeedai:masterfrom
tjruwase merged 20 commits intodeepspeedai:masterfrom
Commits
Commits on Mar 12, 2024
Commits on Mar 13, 2024
Commits on Mar 19, 2024
Commits on Mar 20, 2024
- committed
- committed
- committed
- committed
- committed
Commits on Mar 21, 2024
- committed
- committed