This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
feat: refactor schema and path for llama cpp endpoint #33
Closed
Description
The list of dependency of triton
https://github.com/triton-inference-server/third_party/blob/main/CMakeLists.txt
Drogon can also be a very fast http client and suffer very minimal latency compared to grpc when coupled on the same system.
We should consider not using triton client