Add client-side http connectors to other LLMs #2
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Check out the OpenAI client-side connector here as a reference.
Should be relatively easy to add a simple HTTP wrapper for other LLM providers, including HF.
Though, worth checking per each if it supports streaming.
The text was updated successfully, but these errors were encountered: