[Question]: does gptPlugins ENDPOINT support custom LLM endpoint ?

[elvis-cai]

What is your question?

use LiteLLM with PLUGINS in Librechat

More Details

I an using gptPlugins with openAI, it works fine, when I change to Litellm, PLUGINS UI section is gone, not sure if it's supported or anything I miss here

What is the main subject of your question?

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

I'm not sure what you're changing in your configuration that causes the endpoint to disappear, and what you have configured for OpenAI that works, but in general, the plugins endpoint is not expected to work well with a reverse proxy.

There is however something in the works that will natively allow use of tools with custom endpoints. Stay tuned!

[Phlasse]

hi @danny-avila I am also currently looking into routing the gptplugins through litellm (mainly because it allows me to trace with langfuse).

any idea on how that can be achieved? or when the thing you are working on might get released? looking forward!

[danny-avila]

No need for LiteLLM, “Agents” are the answer to this

#3607