Skip to content

Configure kobold cpp

Rickard Edén edited this page Nov 4, 2024 · 4 revisions
  1. Start kobold cpp with the model you would like to run.
  2. Open llm_config.yaml and change the following fields:
  • URL: "http://localhost:5001" or wherever your server runs (this is default kobold cpp)
  • ENDPOINT: "/api/v1/generate"
  • BACKEND: "kobold_cpp"

If you use a password to secure your api, you can define it in the config with:

API_PASSWORD: "your_password"

If you want to change any generation settings, the game will use DEFAULT_BODY (and sometimes, still, GENERATION_BODY)