how to use codellama instead of openai api?

[ouvaa]

how to use codellama instead of openai api?
how to make it use llama.cpp?

[uniAIDevs]

I'm working on a solution to integrate the HuggingFace inference API into the program! I'll consider adding an additional feature for this. This may take some time, but I use other developer agents to speed up the small tasks. There will be a alternate version created by me soon!

[bvelker]

It might be more efficient to integrate LiteLLM https://github.com/BerriAI/litellm
It already has access to basically all LLM api's, including Huggingface and Openrouter

[timiil]

It might be more efficient to integrate LiteLLM https://github.com/BerriAI/litellm It already has access to basically all LLM api's, including Huggingface and Openrouter

any example that we can use LiteLLM inside this project