Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use pred_keypoints_3d #5

Open
atonalfreerider opened this issue Jan 3, 2025 · 0 comments
Open

How to use pred_keypoints_3d #5

atonalfreerider opened this issue Jan 3, 2025 · 0 comments

Comments

@atonalfreerider
Copy link

atonalfreerider commented Jan 3, 2025

Thank you for creating this package. I am able to run my own script and get hand data.

I am graphing my own hands in Unity and I am saving the WiLoR output to a json. I have these values for each hand from wilor_preds:

'global_orient' (1,1,3)
'hand_pose' (1,15,3)
'betas' (1,10)
'pred_cam' (1,3)
'pred_keypoints_3d' (1,21,3)
'pred_vertices' (1,778,3)
'pred_cam_t_full' (1,3)
'scaled_focal_length' float64
'pred_keypoints_2d (1,21,2)

The value pred_keypoints_3d gives me points that I can use to draw a 3d hand in Unity, but the points are fixed near the origin. I can't tell if global_orient is an Euler rotation or how to use it. Do the hands get translated relative to the camera via pred_cam_t_full?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant