New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于学习率以及复现结果 #6

Open

Sihan-Song opened this issue Jul 21, 2022 · 0 comments

Sihan-Song commented Jul 21, 2022

您好，您在论文中提到的是pretrain和fine-tune阶段都使用1e-3作为学习率，但是在复现的时候，使用1e-3来finetune的效果很差，而使用0.3的效果要好一些，请问您实验时的最优学习率是多少呢？
感谢。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment