Running Phi3-mini using Olive and ONNX Runtime for efficient inferencing on mobile and web platforms.

This repo is to share all the materials for supporting Demo session DEM709 in Microsoft Build 2024.

• Part 1: Getting optimized models for mobile and web platforms Optimizing Phi-3 for chosen hardware with Olive​

• Part 2: Running phi-3 on Android phone Android chat app with Phi-3 and ONNX Runtime Mobile

• Part 3: Running phi-3 in the browser Web chat app with Phi-3 and ONNX Runtime Web

Blog: Enjoy the Power of Phi-3 with ONNX Runtime on your device​

Learn more

• Olive
• ONNX Runtime ​
• ONNX Runtime Generate API
• Azure Machine learning for Edge ​