Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upload global scatter and global gather operators related files #35546

Merged
merged 3 commits into from
Sep 13, 2021

Conversation

youth123
Copy link
Contributor

@youth123 youth123 commented Sep 7, 2021

PR types

New features

PR changes

OPs

Describe

MOE:

  • Global scatter and global gather operators help moe model to dispatch data to each expert.

select_scatter和gather

@paddle-bot-old
Copy link

paddle-bot-old bot commented Sep 7, 2021

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link

@sandyhouse sandyhouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


ring_id = 0 if group is None else group.id
if in_dygraph_mode():
return core.ops.global_gather(x, local_count, \

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

可以在后续pr中删除后面的反斜线

Copy link

@PangHua PangHua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MOE

Copy link
Contributor

@TCChenlong TCChenlong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@XieYunshen XieYunshen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for set_tests_properties(test_xxx PROPERTIES TIMEOUT 120)

@sandyhouse sandyhouse merged commit ecfe837 into PaddlePaddle:develop Sep 13, 2021
AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this pull request Sep 29, 2021
…lePaddle#35546)

* upload global scatter and global gather operators related files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants