Fix Zero3 contiguous grads, reduce scatter false accuracy issue#4321
Merged
tjruwase merged 2 commits intodeepspeedai:masterfrom Sep 14, 2023
Merged
Fix Zero3 contiguous grads, reduce scatter false accuracy issue#4321tjruwase merged 2 commits intodeepspeedai:masterfrom
tjruwase merged 2 commits intodeepspeedai:masterfrom
Commits
Commits on Sep 13, 2023
- committed
Nadav Elyahu - authored
