Shared memory regions are not available on Windows

[hahne]

Hi Everyone,

I tested the inference runtime on a model with ONNX runtime and with the Triton Inference Server and with Triton the runtime was around 50% higher than with ONNX.

Now I did some research and saw that shared memory regions should be the solution to getter better runtime performance in Triton, however they are (understandably) not available on Windows.

So I assume there is no way to get native runtime performance with the Triton Inference Server on Windows, or am I missing something?

Kind regards,
Johannes