Enhancement: Fetching models from text-generation-webui (oobabooga)

[Backroads4Me]

What features would you like to see added?

The ability to change models when using text-generation-webui (oobabooga) as the backend.

More details

With the Ollama backend the app fetches the names of all of the available models and allows switching between models. When using the text-generation-webui backend, the only "model" shown is "text-embedding-ada-002" and fetch doesn't work. (Inference does work). This request is to create a custom fetcher for text-generation-webui that works similarly to Ollama's. Ideally, it would also unload models which would allow you to use both backends and switch between them.

Which components are impacted by your request?

UI, Endpoints

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

This is a limitation of ooba's v1/models endpoint. Relevant code line and closed "stale" issue.

Seems like an easy fix from ooba's part, but for whatever reason, it is not implemented (even with an open PR) : oobabooga/text-generation-webui#5720