You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The developers of the AI Horde, koboldcpp and aphrodite just agreed for a standard which would allow inference integrators to our APIs to quickly retrieve the information about the API they are working with.
We arranged that the information should live in a .well-known URI and we chose serviceinfo as the endpoint to signify it's use in a service api.
The fields should be self-explanatory, but basically api holds info about each api is served (for example aphrodite serves both Open AI and KoboldAI APIs) whereas the software holds information about the software itself. The version on the root is the version of the .well-known/serviceinfo itself.
We think it would benefit everyone if ComfyUI onboard the same endpoint and we would welcome improvement and extensions on the serviceinfo standard we came up with.
Feature Idea
The developers of the AI Horde, koboldcpp and aphrodite just agreed for a standard which would allow inference integrators to our APIs to quickly retrieve the information about the API they are working with.
We arranged that the information should live in a .well-known URI and we chose
serviceinfo
as the endpoint to signify it's use in a service api.We came up with the following standard (you can see a live example here)
The fields should be self-explanatory, but basically
api
holds info about each api is served (for example aphrodite serves both Open AI and KoboldAI APIs) whereas thesoftware
holds information about the software itself. Theversion
on the root is the version of the.well-known/serviceinfo
itself.We think it would benefit everyone if ComfyUI onboard the same endpoint and we would welcome improvement and extensions on the
serviceinfo
standard we came up with.Relevant PRs
Aphrodite: PygmalionAI/aphrodite-engine#807
AI Horde: Haidra-Org/AI-Horde#466
Existing Solutions
Most inference APIs do not provide this information consistently. This is an attempt to standardize this for all of us.
Other
No response
The text was updated successfully, but these errors were encountered: