中文版

Paddle.js

Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.

Key Features

Module

• paddlejs-core, the core part of the Paddle.js ecosystem, which is responsible for the operation of the inference process of the entire engine.
• paddlejs-converter, model transformation tool for Paddle.js, convert PaddlePaddle models (also known as fluid models) into a browser-friendly format.
• paddlejs-models, model projects, supply flexible low-level APIs for users to implement their AI scenario.
• paddlejs-examples, Paddle.js AI examples
• paddlejs-mediapipe, tools for live and streaming media, support webrtc camera and a lightweight opencv package

Backends

• paddlejs-backend-webgl, webgl backend, the main backend for Paddle.js, ops supported
• paddlejs-backend-webgpu, webgpu backend, an experimental backend, WebGPU draft, ops supported
• paddlejs-backend-wasm, WebAssembly backend, ops supported
• paddlejs-backend-cpu, cpu backend, ops supported
• paddlejs-backend-nodegl, nodegl backend, a backend in Node.js for Paddle.js, using the webgl backend ops. ops supported

Browser/Platforms Coverage

• PC: Chrome, Safari, Firefox
• Phone: Baidu App , Chrome , UC and QQ Browser
• Smartprogram: Baidu Smartprogram, WX miniprogram
• Platform: macOS, Windows

Load Model

1. Support load model files on the network:

• model.json (model structure and operators' attributes)
• chunk_x.dat (model params binary data)

2. Support use model obj

• modelObj.model (model structure json object)
• modelObj.params（model params Float32Array data）

If you dont' want to put model on the network, you can use method 2.

Models Sdk

• gesture model gesture recognition library
• mobilenet model image classification library
• humanseg model human segmentation library
• ocr model optical character recognition library
• ocr detection model optical character detection library

Examples

• image classification game image classification game example in wx miniprogram
• gesture gesture recognition example
• humanStream video-streaming human segmentation
• humanseg human segmentation example
• ocr optical character recognition example
• ocr detection optical character detection example
• mobilenet classify images into 1000 object categories
• wine classify bottles into 7 categories

Feedback and Community Support

• Online video tutorial start video
• Questions, reports, and suggestions are welcome through Github Issues!
• Forum: Opinions and questions are welcome at our PaddlePaddle Forum！
• QQ group chat: 696965088