forked from irmen/Tale
-
-
Notifications
You must be signed in to change notification settings - Fork 4
Configure kobold cpp
Rickard Edén edited this page Nov 4, 2024
·
4 revisions
- Start kobold cpp with the model you would like to run.
- Open
llm_config.yaml
and change the following fields:
-
URL: "http://localhost:5001"
or wherever your server runs (this is default kobold cpp) ENDPOINT: "/api/v1/generate"
BACKEND: "kobold_cpp"
If you use a password to secure your api, you can define it in the config with:
API_PASSWORD: "your_password"
If you want to change any generation settings, the game will use DEFAULT_BODY
(and sometimes, still, GENERATION_BODY
)