New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

为什么使用全0初始化？ #22

Open

liu-nlper opened this issue Jan 8, 2021 · 1 comment

liu-nlper commented Jan 8, 2021

biaffine-ner/util.py

Line 134 in 7a3e32b

initializer=tf.zeros_initializer())

你好，请教一下这里为什么使用全0进行初始化？

Owner

juntaoy commented Jan 8, 2021

Biaffine 最早是用在 Dozat的parser里的，zero_initializer() 也是从原来的代码里就是这样的，我不记得他们有在paper里提到过为什么，估计是实验的结果比较好。

https://github.com/tdozat/Parser-v1/blob/0739216129cd39d69997d28cbc4133b360ea3934/lib/models/nn.py#L336

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment