Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AutoTuner] support CustomizeSearch mode and customize search range in other modes #59782

Merged
merged 4 commits into from
Dec 9, 2023
Merged

[AutoTuner] support CustomizeSearch mode and customize search range in other modes #59782

merged 4 commits into from
Dec 9, 2023

Conversation

SylarTiaNII
Copy link
Contributor

@SylarTiaNII SylarTiaNII commented Dec 7, 2023 •
edited by Caozhou1995
Loading

PR types

New features

PR changes

Others

Description

PCard-78546

  1. Users can now base on their prior knowledge to customize search range of [dp_degree, mp_degree, pp_degree, sharding_degree, vpp_degree, micro_batch_size] in GridSearch mode and DpEstimationSearch mode to save tuning time.
  2. CustomizeSearch mode is supported now in which users can input several exact configs with a csv file (can be generated by other Autotuner processes or by user themselves) and let Autotuner find the best for them.

@paddle-bot Paddle-bot
Copy link

paddle-bot bot commented Dec 7, 2023

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot Paddle-bot
Copy link

paddle-bot bot commented Dec 7, 2023 •
edited
Loading

✅ This PR's description meets the template requirements!
Please wait for other CI results.

@SylarTiaNII SylarTiaNII changed the title [AutoTuner] support Customize search range in GridSearch and DpEstim… [AutoTuner] support CustomizeSearch and customize search range in other modes Dec 7, 2023
@SylarTiaNII SylarTiaNII changed the title [AutoTuner] support CustomizeSearch and customize search range in other modes [AutoTuner] support CustomizeSearch mode and customize search range in other modes Dec 7, 2023
@SylarTiaNII SylarTiaNII force-pushed the customize_search_space branch from b43b6f3 to a9bc100 Compare December 7, 2023 05:55
@SylarTiaNII
[AutoTuner] support Customize search range in GridSearch and DpEstima…
862506d 
…tionSearch and fully customization in CustomizeSearch mode
@SylarTiaNII SylarTiaNII force-pushed the customize_search_space branch from a9bc100 to 862506d Compare December 7, 2023 06:26
@SylarTiaNII SylarTiaNII force-pushed the customize_search_space branch from af66ebb to 929fc61 Compare December 8, 2023 09:34
@Caozhou1995 Caozhou1995 merged commit 831736a into PaddlePaddle:develop Dec 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Caozhou1995 Caozhou1995 Caozhou1995 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@SylarTiaNII @Caozhou1995