New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for lecun normal weight initialization #2311

Open

RohitRathore1 wants to merge 1 commit into FluxML:master from RohitRathore1:lecum

+42 −0

RohitRathore1 commented Aug 11, 2023 •

edited

Loading

feat: Add LeCun normal weight initialization

Implemented lecun_normal function for weight initialization based on fan-in.
Provided default initializer for flexibility.
Marked lecun_normal as non-differentiable using ChainRulesCore.

It resolves issue #2290

PR Checklist

Tests are added
Entry in NEWS.md
Documentation, if applicable


Support for lecun normal weight initialization

56f36c2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment