Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

转换规则 torch.nn.parallel.DistributedDataParallel #240

Merged
merged 1 commit into from
Aug 29, 2023

Conversation

LokeZhou
Copy link
Contributor

PR Docs

torch.nn.parallel.DistributedDataParallel 映射文档已存在

PR APIs

torch.nn.parallel.DistributedDataParallel

@paddle-bot
Copy link

paddle-bot bot commented Aug 22, 2023

Thanks for your contribution!

@LokeZhou
Copy link
Contributor Author

ci 里的torch 为CPU版本,部分单测以_开头跳过

@zhwesky2010
Copy link
Collaborator

zhwesky2010 commented Aug 25, 2023

@LokeZhou 映射文档有没有bug,也需要同时校验一下。类似这样:
#263

infoflow 2023-08-29 11-57-33

world_size=1
)
model = torch.nn.Linear(1, 1, bias=False).cuda()
model = torch.nn.parallel.DistributedDataParallel(model)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这些在本地能跑过不

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

可以

obj.run(pytorch_code, ["result"])


def _test_case_2():
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这些在本地能跑过不

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

可以

Copy link
Collaborator

@zhwesky2010 zhwesky2010 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhwesky2010 zhwesky2010 merged commit bba951b into PaddlePaddle:master Aug 29, 2023
@LokeZhou LokeZhou deleted the DistributedDataParallel branch August 29, 2023 05:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants