Skip to content

ZeRO Integration#13

Merged
tjruwase merged 4 commits intomegatron-2.4-ds-pipefrom
olruwase/megatron-2.4_dse
Jun 11, 2021
Merged

ZeRO Integration#13
tjruwase merged 4 commits intomegatron-2.4-ds-pipefrom
olruwase/megatron-2.4_dse

Conversation

@tjruwase
Copy link
Collaborator

@tjruwase tjruwase commented Jun 7, 2021

ZeRO integration changes for e2e run.

@tjruwase tjruwase requested a review from jeffra June 7, 2021 23:43
@tjruwase tjruwase changed the base branch from megatron-2.4-ds to megatron-2.4-ds-pipe June 11, 2021 18:31
@tjruwase tjruwase merged commit 846415c into megatron-2.4-ds-pipe Jun 11, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant