New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

why upscaling weight by 1/1-p after concrete dropout #16

Open

heechanlee opened this issue Nov 13, 2020 · 1 comment

heechanlee commented Nov 13, 2020

I can't find why weights are upscaled by 1/1-p after concrete dropout in the paper. Can anyone tell me why?

Author

heechanlee commented Nov 13, 2020 •

edited

Loading

From the comment above, I guess it is for making mean of weights after dropout be W. Is there any reference why we should do that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment