Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How Can I use render novel pose use stage2? #33

Open
DuanWei1234 opened this issue Jul 2, 2024 · 5 comments
Open

How Can I use render novel pose use stage2? #33

DuanWei1234 opened this issue Jul 2, 2024 · 5 comments

Comments

@DuanWei1234
Copy link

Hello, thanks to your code, I try to run render_novel_pose.py in stage2. I made some changes to load pose_encoder.pth saved in stage2. Also change the pose_batch and transl_batch like stage1, because the original render result is just part of the body.
However, I find there is little different between stage1 and stage2 novel render results(I just used the data neuman_bike and do the same preprocess steps). So, how can I use checkpoint in stage2 to render novel pose?

@DuanWei1234
Copy link
Author

I just changed the script again and made sure that the stage2 checkpoint are loaded correctly,but the results in stage1 and stage2 are so similar,why?
image

@LarkLeeOnePiece
Copy link

LarkLeeOnePiece commented Jul 16, 2024

Hello, did you use the neuman_bike provided by the author or you gennerated it? When I used the provided neuman_bike data, I met something wrong with "smpl_cano_joint_mat.pth". Then I generated the dataset follow the guideline but I got terrible results.

@DuanWei1234
Copy link
Author

Hello, did you use the neuman_bike provided by the author or you gennerated it? When I used the provided neuman_bike data, I met something wrong with "smpl_cano_joint_mat.pth". Then I generated the dataset follow the guideline but I got terrible results.

I just do the preprocessing steps for images by myself

@XiaoQiangSHI
Copy link

I trained my own dataset and when I use the weights from stage 1 to run render_novel_pose.py, I get normal results. However, when I switch the weights to those from stage 2 and run render_novel_pose.py, I get all white images as results.
2024-08-16_16-29

Has anyone encountered the same issue? My email is xiaoqiang.s@outlook.com.

@dongals
Copy link

dongals commented Nov 5, 2024

I trained my own dataset and when I use the weights from stage 1 to run render_novel_pose.py, I get normal results. However, when I switch the weights to those from stage 2 and run render_novel_pose.py, I get all white images as results. 2024-08-16_16-29

Has anyone encountered the same issue? My email is xiaoqiang.s@outlook.com.

I'm encountering the same issue, the white output image. Did you solved this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants