Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does the dataset provide 3D object bbox? #30

Open
karta2155802 opened this issue Jul 4, 2023 · 4 comments
Open

Does the dataset provide 3D object bbox? #30

karta2155802 opened this issue Jul 4, 2023 · 4 comments

Comments

@karta2155802
Copy link

Thanks for the work!
Is there any way to get the object bbox with its 8 corners in camera coordinate?

@ychao-nvidia
Copy link
Collaborator

ychao-nvidia commented Jul 5, 2023

We don't provide object 3D bounding boxes in the annotation files. However, you can obtain them with:

  1. Computing the canonical bounding box from the object's mesh file (e.g., with min() and max() over the vertices along the x, y, and z axes).
  2. Transforming the 8 corners to the camera frame with the object's ground-truth 6D pose.

@karta2155802
Copy link
Author

Got it.
Thank you very mush!!

@karta2155802
Copy link
Author

karta2155802 commented Jul 10, 2023

Hi,
I met some problems when projecting the hand and object mesh back to the origin(640x480) image.
I used the intrinsics and extrinsics values in DEX_YCB/calibration/intrinsics.
Here's one of my result.
22
I think my mesh position is correct in world coordinate. Am I using the right extrinsics?

@ychao-nvidia
Copy link
Collaborator

It's hard to tell what went wrong here by looking at the image. We have provided an example for visualizing the hand/object mesh in the image space (see here). Perhaps you can debug by comparing with that example?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants