Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve keypoints-with-depth transformation estimation algorithm #55

Open
integraledelebesgue opened this issue Nov 8, 2024 · 0 comments · May be fixed by #57
Open

Improve keypoints-with-depth transformation estimation algorithm #55

integraledelebesgue opened this issue Nov 8, 2024 · 0 comments · May be fixed by #57
Assignees
Labels
pre-arudice An issue related to old observations before AruDice calibration was introduced transformation An issue related to the camera transformation estimation problem

Comments

@integraledelebesgue
Copy link
Member

Issues

  • At the moment, implementation is very simple - we solve PnP problem between images with depths
  • They should be properly transformed into pointclouds in 3D world coordinates
  • Estimation algorithm is actually wrong - keypoints of actors are taken and processed naively - one of the side view perspectives is correct, but the opposite one gives wrong answer
  • In fact, proper estimation without hardcoding actors order can be achieved only by matching faces (Issue #5)

Additional ideas

  • Kabsch algorithm could be extended with colour matching... (not necessarily RGB colors, but maybe a hue or other representation)
@integraledelebesgue integraledelebesgue converted this from a draft issue Nov 8, 2024
@integraledelebesgue integraledelebesgue added pre-arudice An issue related to old observations before AruDice calibration was introduced transformation An issue related to the camera transformation estimation problem labels Nov 8, 2024
@integraledelebesgue integraledelebesgue self-assigned this Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pre-arudice An issue related to old observations before AruDice calibration was introduced transformation An issue related to the camera transformation estimation problem
Projects
Status: In progress
1 participant