Skip to content

503 Error when using Nano-GPT provider, while same model works via “OpenAI Compatible” #4448

@morpheus9393

Description

@morpheus9393

Plugin Type

VSCode Extension

App Version

4.137.0

Description

There appears to be an issue with the Nano-GPT provider in the Kilo Code VS Code extension.

When selecting Nano-GPT as the provider with many models (e.g. KAT-Coder-Pro-V1) sending a prompt consistently fails with the following error:

Nano-GPT completion error:
503 No fallback services available for this model. Please try again later.

However, the same models work correctly when configured via “OpenAI Compatible” as the provider and manually entering the model name.

Reproduction steps

  1. Open Kilo Code in VS Code

  2. Go to Model / Provider settings

  3. Select:

Provider: Nano-GPT

Model: KAT-Coder-Pro-V1

  1. Send any prompt

  2. Observe error: 503 No fallback services available for this model

Provider

Nano-GPT

Model

GLM 4.6, KAT-Coder-Pro-V1, Kimi K2 (Thinking AND NON-Thinking)

System Information

Windows 10 Pro 64bit
AMD Ryzen7-5800X
RTX 3060
64GB RAM

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    Status

    Intake

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions