updated oobabooga to new api and support for embeddings

[danikhan632]

the current implementation uses the old api which has now been deprecated and the openai interface is the default one any my fork adjusts completions function for that.

Additionally it also implements the embeddings function for oobabooga

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 27, 2023 0:50am

[krrishdholakia]

LGTM! @danikhan632 why are you using litellm with oobabooga? It's already openai-compatible

[danikhan632]

LGTM! @danikhan632 why are you using litellm with oobabooga? It's already openai-compatible

I may have told you about this a while ago however I suppose I did it to make it easier as I am currently working on adding function calling support using guidance and I wanted to also be able to use it with oobabooga.

def function_call_prompt(messages: list, functions: list):
#todo: use guidance to implement this function

[krrishdholakia]

And since oobabooga doesn't support function calling, you're trying to use litellm to do that?

so is it
guidance -> litellm -> oobabooga?

[danikhan632]

And since oobabooga doesn't support function calling, you're trying to use litellm to do that?

so is it guidance -> litellm -> oobabooga?

I suppose so but not just oobabooga but also all the other models

see #1258 as I have already pushed semi working implementation that uses LlamaCpp as of now but is a work in progress