Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【Hackathon 6th Fundable Projects 4 No.5】remove parallel executor in run_program op -part #64818

Merged
merged 13 commits into from
Jun 11, 2024

Conversation

ccsuzzh
Copy link
Contributor

@ccsuzzh ccsuzzh commented May 31, 2024

PR Category

Others

PR Types

Others

Description

No.5 移除ParallelExecutor执行器相关代码

  1. remove parallel executor in run_program op
  2. remove parallel executor in executor_cache
  3. remove parallel executor
  4. remove ssa graph executor

TODO:

Copy link

paddle-bot bot commented May 31, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label May 31, 2024
@ccsuzzh ccsuzzh changed the title [don't review]test rm pe in run_program op 【Hackathon 6th Fundable Projects 4 No.5】remove parallel executor in run_program op -part Jun 4, 2024
Copy link
Contributor

@wanghuancoder wanghuancoder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 请 @luotao1 尽早合入,剩余的comment可以由海师傅后面逐步清理。这个PR比较大。一方面防止冲突,另一方面尽早合入看看各方的反馈。

@@ -63,7 +69,7 @@ constexpr char kUseHierarchicalAllReduce[] = "use_hierarchical_allreduce";
typedef std::unordered_set<VarHandleBase *> GraphDepVars;
constexpr char kGraphDepVars[] = "dep_vars";

typedef std::unordered_map<std::string, details::VariableInfo> FusedVars;
typedef std::unordered_map<std::string, VariableInfo> FusedVars;
constexpr char kFusedVars[] = "fused_vars";
constexpr char kFusedVarNamePrefix[] = "@FUSEDVAR@";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这些剩余的代码是有人还在使用?可以梳理一下,如果必须使用,可以换个位置。或者通过这个线索可以发现一些更多可以删除的代码。

test/legacy_test/CMakeLists.txt Show resolved Hide resolved
paddle/fluid/operators/run_program_op.h Show resolved Hide resolved
Copy link
Contributor

@Aurelius84 Aurelius84 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work!

@luotao1 luotao1 merged commit 01acc12 into PaddlePaddle:develop Jun 11, 2024
32 of 33 checks passed
@ccsuzzh ccsuzzh deleted the test_cuda_graph branch June 24, 2024 13:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants