[CINN] Dump more compilation result and optimize parallel compiler flags #55935
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1. Unify FLAGS_cinn_parallel_compile_size and FLAGS_cinn_parallel_compile_thread 2. Add more flags to dump more compile info 3. Support dump lower_func, source_code, ptx and instruction 4. Return more compile info from parallel compiler to graph compiler 5. Refactor graph visualization 6. Refactor parallel compiler's task split
|
你的PR提交成功，感谢你对开源项目的贡献! |
zhhsplendid
reviewed
Aug 4, 2023
cxxly
pushed a commit
to cxxly/Paddle
that referenced
this pull request
Aug 7, 2023
…ags (PaddlePaddle#55935) 1. `Parallel Compiler`： - 合并`FLAGS_cinn_parallel_compile_size`和`FLAGS_cinn_parallel_compile_thread`，通过`FLAGS_cinn_parallel_compile_thread`即可指定编译时使用的线程数，所有的`fusion_groups`将会平均分配到可用的线程上 - 增强编译完成后返回的信息，除`instruction`外，将`lowered_function`、`source_code`、`source_ptx`返回，供上层进一步使用 2. Debug信息： - 新增`FLAGS_ cinn_dump_group_lowered_func`、`FLAGS_cinn_dump_group_source_code`、`FLAGS_ cinn_dump_group_ptx`、`FLAGS_ cinn_dump_group_instruction`，可分别按`fusion_groups`储存编译的每个阶段中的中间代码 - 重新整理`graph_visualization`，所有的可视化图、单测代码均能正确分组储存 3. Bug修复： - 修复`MakeDirectory`不能正确创建文件夹的问题 4. 其他： - 清除了一些无用代码
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
Others
PR changes
Others
Description
Pcard-72511
Parallel Compiler：FLAGS_cinn_parallel_compile_size和FLAGS_cinn_parallel_compile_thread，通过FLAGS_cinn_parallel_compile_thread即可指定编译时使用的线程数，所有的fusion_groups将会平均分配到可用的线程上instruction外，将lowered_function、source_code、source_ptx返回，供上层进一步使用FLAGS_ cinn_dump_group_lowered_func、FLAGS_cinn_dump_group_source_code、FLAGS_ cinn_dump_group_ptx、FLAGS_ cinn_dump_group_instruction，可分别按fusion_groups储存编译的每个阶段中的中间代码graph_visualization，所有的可视化图、单测代码均能正确分组储存MakeDirectory不能正确创建文件夹的问题