Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Reshard] Support partial to shard #58703

Merged
merged 1 commit into from
Nov 9, 2023
Merged

Conversation

LiYuRio
Copy link
Contributor

@LiYuRio LiYuRio commented Nov 6, 2023

PR types

New features

PR changes

Others

Description

支持partial状态到shard状态的转换
Pcard-73145

@ForFishes ForFishes self-requested a review November 7, 2023 02:44
@LiYuRio LiYuRio force-pushed the dev_p_to_s branch 8 times, most recently from c9d5b45 to 90032b3 Compare November 7, 2023 06:56
if (out_split_axis != 0) {
std::vector<int> axis;
for (size_t i = 1; i < vectorize(logical_ddim).size(); ++i) {
axis.emplace_back(i);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whether the axis here is the same as the previous one, no additional calculation is required.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent! You are totally right!

Copy link
Member

@ForFishes ForFishes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@XieYunshen XieYunshen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for set_tests_properties(test_reshard_p_to_s PROPERTIES LABELS "RUN_TYPE=EXCLUSIVE" TIMEOUT 100)

@LiYuRio LiYuRio merged commit 1fc496c into PaddlePaddle:develop Nov 9, 2023
@LiYuRio LiYuRio deleted the dev_p_to_s branch November 9, 2023 03:06
danleifeng pushed a commit to danleifeng/Paddle that referenced this pull request Nov 14, 2023
SecretXV pushed a commit to SecretXV/Paddle that referenced this pull request Nov 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants