Add Mediapipe Blendshape tracker

[philipqueen]

Use Mediapipe's update FaceLandmarker (V2) to extract blendshapes during face tracking.

Blendshapes are a new standard in facial mocap, based on their use in Apple's ARKit: https://developer.apple.com/documentation/ARKit/arfaceanchor/blendshapelocation

This tracker is not currently intended to be used in FreeMoCap proper. Blendshapes do not have any reason to be triangulated, so they do not fit well into the FreeMoCap pipeline (if more than 1 video is being tracked). However, this tracker will be useful as a standalone tool for animators, and we may someday have interest in adding a blendshape pipeline to FreeMoCap to increase our utility for animators.

Download Instructions:

To download this branch for testing, run pip install "skellytracker@git+https://github.com/freemocap/skellytracker@philip/mediapipe_blendshapes"

Run Instructions:

You can run the blendshape tracker on a video by running skellytracker_blendshapes in the terminal after installing this branch. You can provide with cli flags, or it will prompt you for, an input video path (-i), an output video path (-o), and an output csv path (-c).

TODOS:

• Fix annotation
• Create Recorder
• Create Model Info
• Figure out how to format to CSV properly
• Test - has been tested in Blender by AJC

[ectomia]

20240705220646_1.mp4

Tested concept and functionality and aligns perfectly to industry standard, and uses the same dependencies as Freemocap
Options for output data format such as Json and csv recommended for cross platform application.

Will create a generic face mesh for export option for the Blender Export