Awesome MediaPipe

A curated list of awesome MediaPipe related frameworks, libraries and software. Inspired by awesome-go.

Contributing

Please take a quick gander at the contribution guidelines first. Thanks to all contributors; you rock!

If you see a package or project here that is no longer maintained or is not a good fit, please submit a pull request to improve this file. Thank you!

Contents

• Awesome MediaPipe

  • Desktop examples
  • Android examples
  • iOS examples
  • Myriad X Vision Proocessing Unit
  • Unity examples
  • Cloud examples
  • TensorFlow and TFlite related
  • Python related
  • Pytorch related
  • Sign language hand gesture related
  • Nvidia Jetson integration

• Resources

  • Conferences
  • Meetups
  • Websites
    • Tutorials

Desktop examples

Desktop examples of using MediaPipe.

• How to readout detection proto for Object Detection example

• How to create Bazel project using MediaPipe as external dependence

• Connecting openFrameworks to Google MediaPipe Machine Learning Framework over UDP

• Sign gesture recognition with Mediapipe

• MediaPipe Python examples using WebRTC based OSSDC VisionAI platform

• In browser full body tracking+rendering using MediaPipe JavaScript solution

Android examples

Android examples.

• MediaPipe face detection gpu demo with MediaPipe's Android archive library

• MediaPipe multi-hand tracking gpu demo with MediaPipe's Android archive library

• MediaPipe hair segmentation example in gradle

• Kotlin port of running MediaPipe hand tracking example

iOS

iOS examples.

• Tutorial to create an importable iOS framework: Find memes that match your facial expression 😮

• How to build MediaPipe hand tracking (iOS) as an Xcode project

Myriad X VPU

DepthAI cameras examples.

• Hand tracking with DepthAI

• MediaPipe hands tracking on DepthAI camera through OSSDC VisionAI on WebRTC video stream from Android phone

Unity

• Unity hand tracking with MediaPipe

• Unity MediaPipe Plugin

frameworks

iOS frameworks.

• Prebuilt framework for upper body pose tracking

• Prebuilt framework for hand tracking

Cloud examples

Cloud examples.

• How to install MediaPipe on GPU instance in Amazon EC2.

• MediaPipe Holistic running in Google Colab on WebRTC video stream from Android phone

  • Google Colab to reproduce this demo in less than 5 min

TensorFlow and TFllite related

TensorFlow and TFLite examples.

• Face tracking web utility with applied filters for headtracking spatial audio uses

• Sample code for sharing and testing TFLite models quantized and optimized for ARM devices (e.g. RaspberryPi) with BlazeFace, FaceMesh, BodyPix, and Objectron

Python related

• simple-mediapipe python reimplement

• MediaPipe Holistic running in Google Colab on WebRTC video stream from Android phone

  • Google Colab to reproduce this demo in less than 5 min

• MediaPipe Python Wheel installer (pip) for RaspberryPi OS aarch64, Ubuntu aarch64 Debian aarch64, L4T/Jetson Nano aarch64.

• Recognizes hand signs and finger gestures using Python mediapipe

Flutter related

• Flutter package for MediaPipe Hand tracking example to generate both iOS and Android apps

Pytorch related

Pytorch examples.

Sign language hand gesture related

• Sign Language Gesture Recognition Android

• Sign language gesture recognition using a recurrent neural network (RNN) with Mediapipe hand tracking

• SigNN - American sign language alphabet translation

• System for recognizing signs of the german sign language (DGS) from live webcam

• Hand commander: MQTT implementation of custom hand gestures running on raspberry pi

Nvidia Jetson integration, draft [beta]

• Step by step tutorial on MediaPipe on Nvidia Jetson

Resources

Where to discover new MediaPipe libraries.

Meetups

Add the group of your city/country here (send PR)

Websites

• 3D Web Hands with MediaPipe + tf.js
• Handsfree.js.org - A wrapper library around MediaPipe with a plugin system for quickly creating and sharing handsfree user experiences. Features detailed guides and documentation, integrations and boilerplates, chrome extensions, and more

Tutorials

• Creating Calculators, Beyond the Documentation - Read this after reading the documentation by students at UC Satna Barbara

• MediaPipe with Custom tflite Model - Getting started tutorial by engineers at Indian startup Fynd