Skip to content

Lmstudio Models are not listed correctly #2456

@haltingstate

Description

@haltingstate

Bug: GPT-120B-oss and other loaded models are not displayed in /models in opencode, when using lmstudio

  1. It will use GPT-120B-oss if I set model that is not on lmstudio (like qwen)

  2. but if I set GPT-30B-oss; then it will tell lmstudio to load that model and it loads model

  3. the model I am actually using (GPT-120B) does not show up in /models); and is only used if I select a model that lmstudio has not loaded

Maybe, use API, to check

    1. which models lm studio has loaded/ready (and show in /models)
    1. to check the context size for the model (which I had to increase; maybe put warning)

Very good job on this tool


I have Lmstudio running with GPT-120-oss

I am using opencode (latest).

I did "opencode auth login" and set BS api key for lm studio

  • NOTE: for LMstudio put note "type in any code; unless configured" when doing auth
  • it wasted 2 minutes of my time, looking up that lmstudio does not need api key unless configured; so instructioners were confusing
  • bug: blank api key is rejected as invalid for lmstudio auth,

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions