How to set initial_chunk_size_bytes for CUDAExecutionProvider? #324
-
In the ONNX docs here https://onnxruntime.ai/docs/get-started/with-c.html there is a setting, There doesn't seem to be an ort way to set this, and What is the right way to do it? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Beta Was this translation helpful? Give feedback.
ort
currently doesn't have a safeArenaCfg
wrapper, though even if it did it seems likeOrtCUDAProviderOptionsV2
doesn't support taking anArenaCfg
; only the legacy version does. The only option here might be to use the unsafe API directly.