koboldcpp as ModelProvider ??? #57
UnsGentoals
started this conversation in
Ideas
Replies: 1 comment 3 replies
-
|
Hi there, we'd love to support that backend - is there a python package that allows for it to be called via some API? If you join our discord, happy to discuss more there! |
Beta Was this translation helpful? Give feedback.
3 replies
-
Beta Was this translation helpful? Give feedback.
-
|
http://localhost:5000/koboldcpp_api |
Beta Was this translation helpful? Give feedback.
-
|
As it's open ai compatible, implementing that should support it automatically |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
https://github.com/LostRuins/koboldcpp
Beta Was this translation helpful? Give feedback.
All reactions