Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练过程显存大小问题？ #45

Open
ssvicnent opened this issue Jun 11, 2024 · 6 comments
Open

训练过程显存大小问题？ #45

ssvicnent opened this issue Jun 11, 2024 · 6 comments

Comments

@ssvicnent
Copy link

您好，训练和推理该模型时，默认参数下，显存占用大概是多少呢？
@lewandofskee
Copy link
Owner

I remeber that 24G of GPU memory might not be enough for training, and that 32G of GPUmemory would be fine for training.

@Karma1628
Copy link

您好，配置文件里用的12的batch_size用32GB可训的话，我将batch_size调整到4在24GB的4090上还是显存爆炸了，可以问下这是什么原因么

@hhhJB
Copy link

hhhJB commented Oct 24, 2024

您好，配置文件里用的12的batch_size用32GB可训的话，我将batch_size调整到4在24GB的4090上还是显存爆炸了，可以问下这是什么原因么

metoo

@hhhJB
Copy link

hhhJB commented Oct 25, 2024

您好，配置文件里用的12的batch_size用32GB可训的话，我将batch_size调整到4在24GB的4090上还是显存爆炸了，可以问下这是什么原因么

do you figure it out now ?

@Karma1628
Copy link

没有诶，调整到1都会爆炸hha就放弃了

@Karma1628
Copy link

@lewandofskee 希望可以回复一下(☆▽☆)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@ssvicnent @Karma1628 @hhhJB @lewandofskee