Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ROS2] Don't lock in mouth pose at the beginning of MovetoMouth #166

Open
amalnanavati opened this issue Feb 23, 2024 · 0 comments
Open

Comments

@amalnanavati
Copy link
Contributor

The fact that the user's mouth pose is locked in at the beginning of MoveToMouth is non-ideal, since they are often looking down at their phone. Instead, the robot arm should adjust to their mouth pose as it is moving to their mouth. Even if we don't do to full visual servoing (i.e., where it tracks their mouth even very close to their mouth), we should at least track their mouth at the beginning of the motion.

#144 lays a foundation for this since now updating the mouth TF frame is asynchronous relative to the MoveToMouth tree. Hence, one way to achieve the above capability is:

  1. In the web app, don't toggle off face detection when the app navigates away from R_DetectingFace. Instead, toggle it off in other parts of the state machine (e.g., U_Bite_Done, and RobotMotion that is not MoveToMouth).
  2. Although the above should be enough, it will mess up in --sim mock since dummy Face Detection returns a hardcoded pose. Instead, dummy FaceDetection should first try to do a TF transform to get the transform from the camera to the base, and if not use the hard-coded staging transform. Then it should multiple that transform my a hardcoded head pose in the base frame.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant