Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HFOnnx expects ORT provider #195

Closed
chintanckg opened this issue Jan 5, 2022 · 2 comments
Closed

HFOnnx expects ORT provider #195

chintanckg opened this issue Jan 5, 2022 · 2 comments
Assignees
Labels
bug Something isn't working
Milestone

Comments

@chintanckg
Copy link

chintanckg commented Jan 5, 2022

embeddings = onnx("sentence-transformers/paraphrase-MiniLM-L6-v2", "pooling", "embeddings.onnx", quantize=True)

ValueError: This ORT build has ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] enabled. Since ORT 1.9, you are required to explicitly set the providers parameter when instantiating InferenceSession. For example, onnxruntime.InferenceSession(..., providers=['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'], ...)

@davidmezzetti davidmezzetti self-assigned this Jan 5, 2022
@davidmezzetti davidmezzetti added this to the v4.0.0 milestone Jan 5, 2022
@davidmezzetti davidmezzetti added the bug Something isn't working label Jan 5, 2022
@davidmezzetti
Copy link
Member

Thank you for reporting this issue! The problem comes in when onnxruntime-gpu is installed as that has multiple providers. Logic has been added to set providers based on the available providers.

This will be available when 4.0 is released. It can also be installed from source right now.

@chintanckg
Copy link
Author

Thank you for reporting this issue! The problem comes in when onnxruntime-gpu is installed as that has multiple providers. Logic has been added to set providers based on the available providers.

This will be available when 4.0 is released. It can also be installed from source right now.

Thanks @davidmezzetti

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants