Through user investigation, we know that most users are already familiar with python and torch before using mmdeploy. Therefore we provide scripts to simplify mmdeploy installation.
Assuming you already have
- python3 -m pip (
conda
orpyenv
) - nvcc (depends on inference backend)
- torch (not compulsory)
run this script to install mmdeploy + ncnn backend, nproc
is not compulsory.
$ cd /path/to/mmdeploy
$ python3 tools/scripts/build_ubuntu_x64_ncnn.py
..
A sudo password may be required during this time, and the script will try its best to build and install mmdeploy SDK and demo:
- Detect host OS version,
make
job number, whether useroot
and try to fixpython3 -m pip
- Find the necessary basic tools, such as g++-7, cmake, wget, etc.
- Compile necessary dependencies, such as pyncnn, protobuf
The script will also try to avoid affecting host environment:
- The dependencies of source code compilation are placed in the
mmdeploy-dep
directory at the same level as mmdeploy - The script would not modify variables such as PATH, LD_LIBRARY_PATH, PYTHONPATH, etc.
- The environment variables that need to be modified will be printed, please pay attention to the final output
The script will eventually execute python3 tools/check_env.py
, the successful installation should display the version number of the corresponding backend and ops_is_available: True
, for example:
$ python3 tools/check_env.py
..
2022-09-13 14:49:13,767 - mmdeploy - INFO - **********Backend information**********
2022-09-13 14:49:14,116 - mmdeploy - INFO - onnxruntime: 1.8.0 ops_is_avaliable : True
2022-09-13 14:49:14,131 - mmdeploy - INFO - tensorrt: 8.4.1.5 ops_is_avaliable : True
2022-09-13 14:49:14,139 - mmdeploy - INFO - ncnn: 1.0.20220901 ops_is_avaliable : True
2022-09-13 14:49:14,150 - mmdeploy - INFO - pplnn_is_avaliable: True
..
Here is the verified installation script. If you want mmdeploy to support multiple backends at the same time, you can execute each script once:
script | OS version |
---|---|
build_ubuntu_x64_ncnn.py | 18.04/20.04 |
build_ubuntu_x64_ort.py | 18.04/20.04 |
build_ubuntu_x64_pplnn.py | 18.04/20.04 |
build_ubuntu_x64_torchscript.py | 18.04/20.04 |
build_jetson_orin_python38.sh | JetPack5.0 L4T 34.1 |