Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于单卡4090学习率的设置 #224

Open
Amireux52 opened this issue Aug 23, 2024 · 4 comments
Open

关于单卡4090学习率的设置 #224

Amireux52 opened this issue Aug 23, 2024 · 4 comments

Comments

@Amireux52
Copy link

作者您好，如果是单卡4090的话，我bs最大设置为3，学习率可以设置为多少合理，有规律可循吗，
@exiawsh
Copy link
Owner

exiawsh commented Aug 23, 2024

bs为3应该很难收敛。4090一般bs可以开到8，学习率2e-4

@Amireux52
Copy link
Author

bs为3应该很难收敛。4090一般bs可以开到8，学习率2e-4

好滴，谢谢老师

@Amireux52
Copy link
Author

bs为3应该很难收敛。4090一般bs可以开到8，学习率2e-4

去年十月买的4090，没刷bios之前bs只能设置到3，再大就显存报错；据说那批电脑的卡和u都有问题就刷了bios下午，今天刷过之后真可以设置到8，但是resume的话还是会显存报错，从头训练的话就不会报错

@exiawsh
Copy link
Owner

exiawsh commented Aug 23, 2024

使用batchsize 4 + 梯度累积功能。搜一下mmdet文档

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@exiawsh @Amireux52