Which specific local open source LLMs can be used with Devika?

[phalexo]

I don't mean to just get connectivity with ollama.

I mean actually producing working code, like it supposedly can with GPT-4.

I have played with Pythogora/gpt-pilot, and the only model that seems to work, with code being produced, is GPT-4.

All open source models don't work. They get into infinite loops trying to correct JSON, etc...

Does this repo work with any LLM that I can install locally?

I'd like to use PhindCodeLlama2 if possible.