SwiftOpenPose

This project was developed by transplanting tf-openpose to Swift.
Community cooperation is welcome.

Environment

• iOS11
• Xcode9

Training Model

There are two learning models available for this project.

• OpenPose Caffe-Model
  • Convert from OpenPose Caffe-Model to MLModel
• tf-openpose Mobilenet Model (instance_normalization Disabled Version)
  • infocom-tpo/tf-openpose .. Model Training and Converter
  • MobileOpenPose.mlmodel .. Model Download

Performance comparison

• BenchMark Hardware: iPad 2017
  • OpenPose Caffe-Model
    • processing time .. range 2-4 Sec.
  • tf-openpose Mobilenet Model
    • processing time .. Less than 1 sec

Dependencies Library

• UpSurge
• OpenCV
  • Download of iOS Pack
  • Opencv lightweight version

Installation

$ git clone https://github.com/infocom-tpo/SwiftOpenPose.git
$ cd SwiftOpenPose
$ pod install
$ curl -o SwiftOpenPose/Resources/MobileOpenPose.mlmodel \
https://s3-ap-northeast-1.amazonaws.com/swiftopenpose/MobileOpenPose.mlmodel

Examples

• Bone Detecter
  This app exports a video with detected bones to photo library.
  You can shoot or select a video to detect bones.

iTunes Store App

Stickman Animator

Stickman Animator is an app to make animations of stickman from videos of people.

Blogs

• Explanation by Japanese
  • AI初心者がOpenPoseのモバイル実装に取り組んだ話

Reference

• OpenPose
• tf-openpose
• OpenPose Caffe Model Convert to CoreML Model
• エネルギー波を繰り出す女子高生

Development By Infocom TPO

Infocom TPO

License

SwiftOpenPose is available under the MIT license. See the LICENSE file for more info.

Citation

@inproceedings{cao2017realtime,
  author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
  year = {2017}
}