Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SentencePosEncoder.forward中batch_pos_emb和batch_elem_emb的shape不一致的问题 #20

Open
AI-confused opened this issue Dec 23, 2020 · 1 comment

Comments

@AI-confused
Copy link

4901608707329_ pic
多卡运行的时候,token_id会被分散到不同的卡里运行,造成sentence_batch改变,但是batch_pos_emb依然是原来的sentence_batch,相加的过程就会出bug,请问下如何解决,谢谢

@logolemon
Copy link

请问您解决这个问题了吗 我也是卡到这个地方了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants