2. Acceleration

CUDA Execution Provider (Nvidia)

1. Install CUDA Toolkit 11.8

2. Install dependencies:

pip uninstall onnxruntime onnxruntime-gpu
pip install onnxruntime-gpu==1.15.0

3. Usage in case the provider is available:

python run.py --execution-provider cuda

CoreML Execution Provider (MacOS)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-silicon
pip install onnxruntime-silicon==1.13.1

2. Usage in case the provider is available:

python run.py --execution-provider coreml

DirectML Execution Provider (Windows)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-directml
pip install onnxruntime-directml

OpenVINO™ Execution Provider (Intel)

1. Install dependencies:

pip uninstall onnxruntime onnxruntime-openvino
pip install onnxruntime-openvino==1.15.0

2. Usage in case the provider is available:

python run.py --execution-provider openvino

ROCm Execution Provider (AMD)

1. Build and install custom wheels from the onnxruntime source.

2. Usage in case the provider is available:

python run.py --execution-provider rocm