New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

why not use multi-scale D and loss NAN #48

Open

hdmjdp opened this issue Feb 18, 2022 · 0 comments

hdmjdp commented Feb 18, 2022

Line 369 in 2e561ba

discs = [DiscriminatorS(use_spectral_norm=use_spectral_norm)]

such as and another question, sometimes train used FP16 may cause loss=NaN? How can I fix it? thanks

hdmjdp changed the title ~~why not use multi-scale D~~ why not use multi-scale D and loss NAN

ariacat3366 mentioned this issue

loss diverged to nan when training vits with fp16 option enabled. espnet/espnet#4236

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment