Skip to content

How to set initial_chunk_size_bytes for CUDAExecutionProvider? #324

Discussion options

You must be logged in to vote

ort currently doesn't have a safe ArenaCfg wrapper, though even if it did it seems like OrtCUDAProviderOptionsV2 doesn't support taking an ArenaCfg; only the legacy version does. The only option here might be to use the unsafe API directly.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@smallbraingames
Comment options

Answer selected by smallbraingames
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants