Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Default pose detection parameters are inaccurate or bugged [Meta Quest 3S] #24

Open
fresh4 opened this issue Jan 28, 2025 · 0 comments
Open

Comments

@fresh4
Copy link

fresh4 commented Jan 28, 2025

I was recently using this plugin specifically for hand tracking data and came across some pretty frustrating issues when tying it to the Godot XRTools plugin. I was wondering if maybe I set it up incorrectly, but downloading the demo and analyzing the inspect scene it does seem that there is some issues with how finger curl/flex values are being determined (and in turn how they affect the default parameters in the fitness functions).

I'll acknowledge that I'm using the Quest 3S, and I'm not sure if the quality of the tracker in that headset is simply just bad. If so, I don't know if there's anything that could be done about it, but I wanted to bring it up anyway so that it's at least documented.

Diagnosing the fist pose (as I was trying to grab pickable things in my scene but they would keep falling), I was finding that the index finger curl parameter would often suddenly become around -170, instead of the expected 0-180 range, which instantly throws off the fitness function. This happens sometimes if I cover my index with my thumb a certain way, or maybe gripped too tight. Oftentimes when turning my fist fingertips facing away from me. The pose info consistently went from 1 to 0.

No other parameters were quite as egregiously incorrect, but many of them did feel not tuned to recognize my fist very well. I opted to simply remove index tracking for my fist pose (who needs it) and had to fine tune all the other parameters to get it working semi-consistently for that pose.

I can't imagine this is the expected workflow, so let me know if there's any more details I can provide about this. Otherwise I'd appreciate any clarifications on what the issues might be.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant