New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

memory overflow #574

Open

HEasoner opened this issue Jul 24, 2024 · 0 comments

HEasoner commented Jul 24, 2024

我在进行训练的过程中，随着epoch的进行，内存缓慢的一直增长，达到一定的epoch就会造成溢出导致killed。我在每个epoch循环的结尾都加入了：
jt.sync_all()
jt.gc()
但是问题依然存在，请问有什么办法解决吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment