Skip to content

shentanyue/PaddleLite-generic-demo

BranchesTags
 
 

Repository files navigation

PaddleLite-generic-demo

Classic demo provided for AI accelerators adapted in Paddle Lite. Please check the Paddle Lite's document https://www.paddlepaddle.org.cn/lite for more details.

Model test

cd model_test/shell

Qualcomm QNN

  • Intel CPU (QNN Simulator, Lenovo P720 + Ubuntu 16.04)

    unset FILE_TRANSFER_COMMAND

./run.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 qualcomm_qnn
./run.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 qualcomm_qnn "QUALCOMM_QNN_ENABLE_FP16=true"
./run.sh conv_add_144_192_int8_per_layer 0 1,3,144,192 float32 float32 linux amd64 qualcomm_qnn
./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 qualcomm_qnn localhost 9022 root root
./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 qualcomm_qnn localhost 9022 root root "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,144,192 float32 float32 linux amd64 qualcomm_qnn localhost 9022 root root

  • Qualcomm 8295P EVB (Android)

    adb -s 858e5789 root

./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,144,192 float32 float32 android arm64-v8a qualcomm_qnn 858e5789

  • Qualcomm 8295P EVB (QNX)

    export FILE_TRANSFER_COMMAND=lftp
adb -s 858e5789 root

rm -rf ../assets/models/cache
./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true" cache
./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root "QUALCOMM_QNN_ENABLE_FP16=true" cache

rm -rf ../assets/models/cache
./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,144,192 float32 float32 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,144,192 float32 float32 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

Demo 1. Image classification demo based on MobileNet, ResNet etc.

cd image_classification_demo/shell

Huawei Kirin NPU

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a huawei_kirin_npu UQG0220A15000356
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a huawei_kirin_npu UQG0220A15000356

MediaTek APU

  • MediaTek MT8168 Tablet (Android) 
    ./run_with_adb.sh mobilenet_v1_int8_224_per_layer android armeabi-v7a mediatek_apu 0123456789ABCDEF
./run_with_adb.sh mobilenet_v1_int8_224_per_channel android armeabi-v7a mediatek_apu 0123456789ABCDEF
./run_with_adb.sh resnet50_int8_224_per_layer android armeabi-v7a mediatek_apu 0123456789ABCDEF

Rockchip NPU

  • RK1808EVB (ARM Linux) 
    ./run_with_adb.sh mobilenet_v1_int8_224_per_layer linux arm64 rockchip_npu a133d8abb26137b2
./run_with_adb.sh resnet50_int8_224_per_layer linux arm64 rockchip_npu a133d8abb26137b2
  • Toybirck TB-RK1808S0 (ARM Linux) 
    ./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux arm64 rockchip_npu 192.168.182.8 22 toybrick toybrick
./run_with_ssh.sh resnet50_int8_224_per_layer linux arm64 rockchip_npu 192.168.182.8 22 toybrick toybrick
  • RV1109 (ARM Linux) 
    ./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux armhf rockchip_npu 192.168.100.13 22 root rockchip
./run_with_ssh.sh resnet50_int8_224_per_layer linux armhf rockchip_npu 192.168.100.13 22 root rockchip

Amlogic NPU

  • Amlogic A311D (ARM Linux) 
    ./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux arm64 amlogic_npu 192.168.100.244 22 root 123456
./run_with_ssh.sh resnet50_int8_224_per_layer linux arm64 amlogic_npu 192.168.100.244 22 root 123456

Imagination NNA

  • ROC1 (ARM Linux) 
    ./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux arm64 imagination_nna 192.168.100.10 22 img imgroc1

Huawei Ascend NPU

  • Intel CPU + Huawei Atlas 300C(3010) (Lenovo P720 + Ubuntu 16.04) 
    ./run_with_ssh.sh mobilenet_v1_fp32_224 linux amd64 huawei_ascend_npu localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux amd64 huawei_ascend_npu localhost 9022 root root
  • Kunpeng 920 + Huawei Atlas 300C(3000) (Kunpeng 920 Desktop PC + CentOS 7.6) 
    ./run_with_ssh.sh mobilenet_v1_fp32_224 linux arm64 huawei_ascend_npu localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux arm64 huawei_ascend_npu localhost 9022 root root

Rockchip NPU and Amlogic NPU with TIM-VX

  • Khadas VIM3 (ARM Linux) 
    ./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas
./run_with_ssh.sh mobilenet_v1_fp32_224 linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas
./run_with_ssh.sh resnet50_int8_224_per_layer linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas
./run_with_ssh.sh resnet50_fp32_224 linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas

Kunlunxin XPU with XTCL

  • Intel CPU + Kunlunxin K100 (Lenovo P720 + Ubuntu 16.04) 
    ./run_with_ssh.sh mobilenet_v1_fp32_224 linux amd64 kunlunxin_xtcl localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux amd64 kunlunxin_xtcl localhost 9022 root root
  • ARM CPU + Kunlunxin K200 (ARM Server + KylinOSv10) 
    ./run_with_ssh.sh mobilenet_v1_fp32_224 linux arm64 kunlunxin_xtcl localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux arm64 kunlunxin_xtcl localhost 9022 root root

Cambricon MLU

  • Intel CPU + Cambricon MLU 370 (Lenovo P720 + Ubuntu 16.04) 
    ./run_with_ssh.sh mobilenet_v1_fp32_224 linux amd64 cambricon_mlu localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux amd64 cambricon_mlu localhost 9022 root root

Android NNAPI

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh mobilenet_v1_int8_224_per_layer android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh mobilenet_v1_int8_224_per_channel android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh resnet50_int8_224_per_layer android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh mobilenet_v1_fp32_224 android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh mobilenet_v1_int8_224_per_layer android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh mobilenet_v1_int8_224_per_channel android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh resnet50_fp32_224 android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh resnet50_int8_224_per_layer android armeabi-v7a android_nnapi UQG0220A15000356

Qualcomm QNN

  • Intel CPU (QNN Simulator, Lenovo P720 + Ubuntu 16.04)

    unset FILE_TRANSFER_COMMAND

./run.sh mobilenet_v1_fp32_224 linux amd64 qualcomm_qnn
./run.sh mobilenet_v1_fp32_224 linux amd64 qualcomm_qnn "QUALCOMM_QNN_ENABLE_FP16=true"
./run.sh mobilenet_v1_int8_224_per_layer linux amd64 qualcomm_qnn
./run_with_ssh.sh mobilenet_v1_fp32_224 linux amd64 qualcomm_qnn localhost 9022 root root
./run_with_ssh.sh mobilenet_v1_fp32_224 linux amd64 qualcomm_qnn localhost 9022 root root "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_ssh.sh mobilenet_v1_int8_224_per_layer linux amd64 qualcomm_qnn localhost 9022 root root
./run.sh resnet50_fp32_224 linux amd64 qualcomm_qnn
./run.sh resnet50_fp32_224 linux amd64 qualcomm_qnn "QUALCOMM_QNN_ENABLE_FP16=true"
./run.sh resnet50_int8_224_per_layer linux amd64 qualcomm_qnn
./run_with_ssh.sh resnet50_fp32_224 linux amd64 qualcomm_qnn localhost 9022 root root
./run_with_ssh.sh resnet50_fp32_224 linux amd64 qualcomm_qnn localhost 9022 root root "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_ssh.sh resnet50_int8_224_per_layer linux amd64 qualcomm_qnn localhost 9022 root root

  • Qualcomm 8295P EVB (Android)

    adb -s 858e5789 root

./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_adb.sh mobilenet_v1_int8_224_per_layer android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_adb.sh resnet50_int8_224_per_layer android arm64-v8a qualcomm_qnn 858e5789

  • Qualcomm 8295P EVB (QNX)

    export FILE_TRANSFER_COMMAND=lftp
adb -s 858e5789 root

rm -rf ../assets/models/cache
./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh mobilenet_v1_fp32_224 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh mobilenet_v1_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true" cache
./run_with_ssh.sh mobilenet_v1_fp32_224 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root "QUALCOMM_QNN_ENABLE_FP16=true" cache

rm -rf ../assets/models/cache
./run_with_adb.sh mobilenet_v1_int8_224_per_layer android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh mobilenet_v1_int8_224_per_layer qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh resnet50_fp32_224 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh resnet50_fp32_224 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true" cache
./run_with_ssh.sh resnet50_fp32_224 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root "QUALCOMM_QNN_ENABLE_FP16=true" cache

rm -rf ../assets/models/cache
./run_with_adb.sh resnet50_int8_224_per_layer android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh resnet50_int8_224_per_layer qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

Demo 2. Object detection demo based on SSD

cd ssd_detection_demo/shell

Huawei Kirin NPU

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a huawei_kirin_npu UQG0220A15000356

MediaTek APU

  • MediaTek MT8618 Tablet (Android) 
    ./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer android armeabi-v7a mediatek_apu 0123456789ABCDEF

Rockchip NPU

  • RK1808EVB (ARM Linux) 
    ./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux arm64 rockchip_npu a133d8abb26137b2
  • Toybirck TB-RK1808S0 (ARM Linux) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux arm64 rockchip_npu 192.168.180.8 22 toybrick toybrick
  • RV1109 (ARM Linux) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux armhf rockchip_npu 192.168.100.13 22 root rockchip

Amlogic NPU

  • Amlogic A311D (ARM Linux) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux arm64 amlogic_npu 192.168.100.244 22 root 123456

Imagination NNA

  • ROC1 (ARM Linux) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux arm64 imagination_nna 192.168.100.10 22 img imgroc1

Huawei Ascend NPU

  • Intel CPU + Huawei Atlas 300C(3010) (Ubuntu) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 huawei_ascend_npu localhost 9022 root root
  • Kunpeng 920 + Huawei Atlas 300C(3000) (CentOS) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux arm64 huawei_ascend_npu localhost 9022 root root

Rockchip NPU and Amlogic NPU with TIM-VX

  • Khadas VIM3 (ARM Linux) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas

Kunlunxin XPU with XTCL

  • Intel CPU + Kunlunxin K100 (Ubuntu) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 kunlunxin_xtcl localhost 9022 root root
  • ARM CPU + Kunlunxin K200 (KylinOS) 
    ./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux arm64 kunlunxin_xtcl localhost 9022 root root

Android NNAPI

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer android armeabi-v7a android_nnapi UQG0220A15000356

Qualcomm QNN

  • Intel CPU (QNN Simulator, Lenovo P720 + Ubuntu 16.04)

    unset FILE_TRANSFER_COMMAND

./run.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 qualcomm_qnn
./run.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 qualcomm_qnn "QUALCOMM_QNN_ENABLE_FP16=true"
./run.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux amd64 qualcomm_qnn
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 qualcomm_qnn localhost 9022 root root
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 linux amd64 qualcomm_qnn localhost 9022 root root "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer linux amd64 qualcomm_qnn localhost 9022 root root

  • Qualcomm 8295P EVB (Android)

    adb -s 858e5789 root

./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer android arm64-v8a qualcomm_qnn 858e5789

  • Qualcomm 8295P EVB (QNX)

    export FILE_TRANSFER_COMMAND=lftp
adb -s 858e5789 root

rm -rf ../assets/models/cache
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_fp32_300 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true" cache
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_fp32_300 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root "QUALCOMM_QNN_ENABLE_FP16=true" cache

rm -rf ../assets/models/cache
./run_with_adb.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh ssd_mobilenet_v1_relu_voc_int8_300_per_layer qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

Demo 3. Object detection demo based on YOLO

cd yolo_detection_demo/shell

Huawei Ascend NPU

  • Intel CPU + Huawei Atlas 300C(3010) (Ubuntu) 
    ./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 huawei_ascend_npu localhost 9022 root root
  • Kunpeng 920 + Huawei Atlas 300C(3000) (CentOS) 
    ./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux arm64 huawei_ascend_npu localhost 9022 root root

Kunlunxin XPU with XTCL

  • Intel CPU + Kunlunxin K100 (Ubuntu) 
    ./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 kunlunxin_xtcl localhost 9022 root root
  • ARM CPU + Kunlunxin K100 (KylinOS) 
    ./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux arm64 kunlunxin_xtcl localhost 9022 root root

Cambricon MLU

  • Intel CPU + Cambricon MLU 370 (Ubuntu) 
    ./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 cambricon_mlu localhost 9022 root root

Demo 4. Model test for benchmark or hardware adaptation based on Paddle Lite + NNAdapter

cd model_test/shell

Huawei Kirin NPU

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a huawei_kirin_npu UQG0220A15000356

MediaTek APU

  • MediaTek MT8618 Tablet (Android) 
    ./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 android armeabi-v7a mediatek_apu 0123456789ABCDEF
./run_with_adb.sh conv_bn_relu_224_int8_per_channel 0 1,3,224,224 float32 float32 android armeabi-v7a mediatek_apu 0123456789ABCDEF

Rockchip NPU

  • RK1808EVB (ARM Linux) 
    ./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux arm64 rockchip_npu a133d8abb26137b2
  • Toybirck TB-RK1808S0 (ARM Linux) 
    ./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux arm64 rockchip_npu 192.168.180.8 22 toybrick toybrick
  • RV1109 (ARM Linux) 
    ./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux armhf rockchip_npu 192.168.100.13 22 root rockchip

Amlogic NPU

  • Amlogic A311D (ARM Linux) 
    ./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux arm64 amlogic_npu 192.168.100.244 22 root 123456

Imagination NNA

  • ROC1 (ARM Linux) 
    ./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux arm64 imagination_nna 192.168.100.10 22 img imgroc1

Huawei Ascend NPU

  • Intel CPU + Huawei Atlas 300C(3010) (Ubuntu) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 huawei_ascend_npu localhost 9022 root root
  • Kunpeng 920 + Huawei Atlas 300C(3000) (CentOS) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux arm64 huawei_ascend_npu localhost 9022 root root

Rockchip NPU and Amlogic NPU with TIM-VX

  • Khadas VIM3 (ARM Linux) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas
./run_with_ssh.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 linux arm64 verisilicon_timvx 192.168.100.30 22 khadas khadas

Kunlunxin XPU with XTCL

  • Intel CPU + Kunlunxin K100 (Ubuntu) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 kunlunxin_xtcl localhost 9022 root root
  • ARM CPU + Kunlunxin K200 (KylinOS) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux arm64 kunlunxin_xtcl localhost 9022 root root

Cambricon MLU

  • Intel CPU + Cambricon MLU 370 (Ubuntu) 
    ./run_with_ssh.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 linux amd64 cambricon_mlu localhost 9022 root root

Android NNAPI

  • Huawei P40pro 5G (Android) 
    ./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh conv_bn_relu_224_int8_per_channel 0 1,3,224,224 float32 float32 android arm64-v8a android_nnapi UQG0220A15000356
./run_with_adb.sh conv_bn_relu_224_fp32 0 1,3,224,224 float32 float32 android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh conv_add_144_192_int8_per_layer 0 1,3,192,144 float32 float32 android armeabi-v7a android_nnapi UQG0220A15000356
./run_with_adb.sh conv_bn_relu_224_int8_per_channel 0 1,3,224,224 float32 float32 android armeabi-v7a android_nnapi UQG0220A15000356

Qualcomm QNN

  • Intel CPU (QNN Simulator, Lenovo P720 + Ubuntu 16.04)

    unset FILE_TRANSFER_COMMAND

./run.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 qualcomm_qnn
./run.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 qualcomm_qnn "QUALCOMM_QNN_ENABLE_FP16=true"
./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 qualcomm_qnn localhost 9022 root root
./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 linux amd64 qualcomm_qnn localhost 9022 root root "QUALCOMM_QNN_ENABLE_FP16=true"

  • Qualcomm 8295P EVB (Android)

    adb -s 858e5789 root

./run_with_adb.sh yolov3_mobilenet_v1_270e_coco_fp32_608 android arm64-v8a qualcomm_qnn 858e5789
./run_with_adb.sh yolov3_mobilenet_v1_270e_coco_fp32_608 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true"

  • Qualcomm 8295P EVB (QNX)

    export FILE_TRANSFER_COMMAND=lftp
adb -s 858e5789 root

rm -rf ../assets/models/cache
./run_with_adb.sh yolov3_mobilenet_v1_270e_coco_fp32_608 android arm64-v8a qualcomm_qnn 858e5789 null cache
./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root null cache

rm -rf ../assets/models/cache
./run_with_adb.sh yolov3_mobilenet_v1_270e_coco_fp32_608 android arm64-v8a qualcomm_qnn 858e5789 "QUALCOMM_QNN_ENABLE_FP16=true" cache
./run_with_ssh.sh yolov3_mobilenet_v1_270e_coco_fp32_608 qnx arm64 qualcomm_qnn 192.168.1.1 22 root root "QUALCOMM_QNN_ENABLE_FP16=true" cache

About

Paddle Lite classic demo for AI accelerators

Resources

Readme

License

Apache-2.0 license
Activity

Stars

0 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Shell 60.6%
  • C++ 20.3%
  • Python 11.6%
  • CMake 6.4%
  • Dockerfile 1.1%