Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

learning rate finder #1014

Closed
wyli opened this issue Sep 9, 2020 · 2 comments · Fixed by #1454
Closed

learning rate finder #1014

wyli opened this issue Sep 9, 2020 · 2 comments · Fixed by #1454
Assignees

Comments

@wyli
Copy link
Contributor

wyli commented Sep 9, 2020

Is your feature request related to a problem? Please describe.
this feature request is about integrating a light-weight learning rate finder
described in https://arxiv.org/abs/1506.01186

"an “LR range test”: run your model for several epochs while letting the learning rate increase linearly between low and high LR values. This test is enormously valuable whenever you are facing a new architecture or dataset."

see also

cc @Can-Zhao

@Can-Zhao
Copy link
Collaborator

Can-Zhao commented Sep 9, 2020

Yes, exactly. Thank you!

@Nic-Ma Nic-Ma self-assigned this Sep 10, 2020
@Nic-Ma
Copy link
Contributor

Nic-Ma commented Sep 10, 2020

Looks interest an idea, will take a look soon.
Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants