Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

recurrent layer group 训练和生成时输出 attention weight,生成时输出每个词的概率 #1797

Closed
lcy-seso opened this issue Apr 17, 2017 · 0 comments · Fixed by #2871
Assignees

Comments

@lcy-seso
Copy link
Contributor

lcy-seso commented Apr 17, 2017

目前应用中对layer_group有以下功能要求,需要支持:

  1. 生成阶段留下每个时间步的概率(目前只留下了整个生成序列概率的log prob 之和)。
  2. 生成阶段 attention weight 每个时间步是一个序列,目前RecurrentLayerGroup只能输出非 sequence 层,作为整个lRecurrentLayerGroup的输出。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant