Skip to content

updates across examples to use deepspeed.init_distributed()#71

Merged
jeffra merged 1 commit intomasterfrom
jeffra/dist-init-update
Dec 17, 2020
Merged

updates across examples to use deepspeed.init_distributed()#71
jeffra merged 1 commit intomasterfrom
jeffra/dist-init-update

Conversation

@jeffra
Copy link
Contributor

@jeffra jeffra commented Dec 17, 2020

Updates to support deepspeedai/DeepSpeed#608
Also should fix: deepspeedai/DeepSpeed#461

@jeffra jeffra changed the title updates across examples to use deepspeed.init_distributed() (see #608) updates across examples to use deepspeed.init_distributed() Dec 17, 2020
@jeffra jeffra merged commit 78d69cb into master Dec 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

AssertionError: MPI world size 16 does not match torch world size 8

2 participants