Add support for concurrency in AsyncAPI #2100
Labels
AsyncAPI
Something related to the AsyncAPI kind
enhancement
New feature or request
timecapped
Assigned a limited amount of time
Description
Add multi-processing and multi-threading support for AsyncAPI
Motivation
This would allow users to share resources and increase API throughput. This is especially relevant when using GPUs since each replica can only request a whole GPU at a time.
The text was updated successfully, but these errors were encountered: