New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[deepspeed] OVERFLOW! #30

Open

JingerAI opened this issue Apr 14, 2023 · 1 comment

JingerAI commented Apr 14, 2023

训练时，经常报疑似梯度溢出警告？请问大佬能解答下原因和解决方法么？
Rank 0 Skipping step. Attempted loss scale: 65536, reducing to 32768

believeland23 commented May 26, 2023

您解决了吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment