Stateful/Memory models #20619
bhack
started this conversation in
Ideas / Feature Requests
Stateful/Memory models
#20619
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
How we are going to support stateful model in onnxruntime?
The majority of video segmentation models are going to manage an internal memory inside the same inference session:
https://github.com/hkchengrex/XMem
https://github.com/hkchengrex/Cutie
https://github.com/yoxu515/aot-benchmark/
etc..
See also the thread at:
pytorch/serve#2743 (comment)
Beta Was this translation helpful? Give feedback.
All reactions