Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

model.phase problem #49

Open
ChessQian opened this issue Dec 4, 2023 · 0 comments · Fixed by #68
Open

model.phase problem #49

ChessQian opened this issue Dec 4, 2023 · 0 comments · Fixed by #68

Comments

@ChessQian
Copy link
Collaborator

训推一体：
make experience里面在推理阶段 model.phase不是train，导致训练阶段走的也不是train，当前没有报错
训推分离：
两阶段的时候，训练阶段的phase就是train，然后会走到slice的分支，导致shape不一致
修改方式：
需要修改
@ChessQian ChessQian linked a pull request Mar 19, 2024 that will close this issue
update llama_reward_model_tutorial.md and fix bugs #68
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

update llama_reward_model_tutorial.md and fix bugs xhw035/mindrlhf
1 participant
@ChessQian