Rust support

[mirecl]

Are you planning rust lang support for inference?

[pranavsharma]

There's some community contribution here https://docs.rs/onnxruntime/0.0.11/onnxruntime/. We don't have plans so far.

[svenwb]

Hi @nbigaouette,

including you into this thread as I think you are the author of the community Rust API. Do you have any plans to continue this project?

Thanks,
Sven

[nbigaouette]

It was mostly a proof of concept to push, at work, ONNX as a way to deploy models in rust projects at work. Unfortunately priorities have changed so it became a purely personal project. The time I can dedicate to this project is quite small.

The project does work but is rough around the edges. There is a couple of PRs opened that I still need to review to improve that front. Help welcome!

[pjankiewicz]

I'm using this one and it is working great https://github.com/sonos/tract/

[radu-matei]

I'd like to add that we are currently using @nbigaouette's Rust bindings in https://github.com/deislabs/wasi-nn-onnx, which have been very useful.
Having an official Rust crate, even if it just contained the low level bindings generated from the C++ headers (the _sys crate, as it is the convention in Rust), would be extremely helpful in keeping them in sync with new ONNX runtime releases.

[hgaiser]

Considering we have https://github.com/microsoft/onnxruntime/tree/main/rust now, I think this can be closed.

[hudrazine]

Rust support is still experimental, and with no progress on Rust bindings since #12606 , an official release is still in the works.
It is best not to close it yet.

For the current Rust binding, we recommend using pykeio/ort, which is similarly based on nbigaouette/onnxruntime-rs.

[monkeycc]

High performance

Low resource occupancy

Can be deployed on the desktop WebAssembly embedded development board server

Add rust bindings +1