Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Install onnxruntime with openvino execution provider #13587

Merged
merged 3 commits into from
Sep 6, 2024
Merged

Conversation

NickM-27
Copy link
Sponsor Collaborator

@NickM-27 NickM-27 commented Sep 6, 2024

This installs onnxruntime with openvino 2024.1, along with the execution providers. This will use openvino when running onnx models like the CLIP models for semantic search

Copy link

netlify bot commented Sep 6, 2024

Deploy Preview for frigate-docs canceled.

Name Link
🔨 Latest commit b313d59
🔍 Latest deploy log https://app.netlify.com/sites/frigate-docs/deploys/66db05a60af79e00088661b9

@hawkeye217 hawkeye217 merged commit 149339a into dev Sep 6, 2024
13 checks passed
@hawkeye217 hawkeye217 deleted the onnx-openvino branch September 6, 2024 19:18
ivanjx pushed a commit to ivanjx/frigate that referenced this pull request Sep 7, 2024
…#13587)

* Install onnxruntime with openvino execution provider

* Update requirements-wheels.txt

* Still include openvino
openvino == 2024.1.*
onnxruntime-openvino == 1.18.*
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can't seem to be able to use devcontainers in the latest version with this change.

33.26 Collecting openvino==2024.1.* (from -r /requirements-wheels.txt (line 32))
33.29   Downloading openvino-2024.1.0-15008-cp39-cp39-manylinux_2_31_aarch64.whl.metadata (8.8 kB)
33.88 ERROR: Ignored the following versions that require a different python version: 1.14.0 Requires-Python >=3.10; 1.14.0rc1 Requires-Python >=3.10; 1.14.0rc2 Requires-Python >=3.10; 1.14.1 Requires-Python >=3.10; 2.1.0 Requires-Python >=3.10; 2.1.0rc1 Requires-Python >=3.10; 2.1.1 Requires-Python >=3.10
33.88 ERROR: Could not find a version that satisfies the requirement onnxruntime-openvino==1.18.* (from versions: none)
34.69 ERROR: No matching distribution found for onnxruntime-openvino==1.18.*
image

Copy link
Sponsor Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you using a Mac? If I had to guess it's failing because there is no arm variant

Copy link

@iursevla iursevla Sep 7, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, @NickM-27 I am (Apple M1 Pro). For MAC users, any alternative? I guess I can just use the old code for the time being to code the fast API stuff.

Copy link
Sponsor Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm that it works 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants