Release overlap_comm & contiguous_gradients restrictions for ZeRO 1#4887

tjruwase merged 2 commits intodeepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

li-plus:opt-zero1li-plus/DeepSpeed:opt-zero1Copy head branch name to clipboard