What are possible values for local llm with ollama.

[Malli88]

Hi, and first thank you for the superb plugin. It's just awesome!
Could you give please a little bit more documentation about the local llm configuration?
Specific, I mean what possible values there are for adding in the field LLM Model?
I use llama3:70B and couldn't get it up and running.
And, what does you mean with the hint to the Ollama Orgins?

Thanks a lot!

[muhammadammarzahid]

Can you please guide me how to use local installation of ollama? From my understanding, I used the following environment

environment # Uncomment lines below for a fully local setup
 MODEL_FOLDERS=llama3
 MODEL_RELATIONSHIPS=llama3
 MODEL_TAGGING=llama3
 MODEL_NAME=llama3
 MODEL_TEXT=llama3
 MODEL_VISION=llava-llama3


### The fastest way to get started is just to add your OpenAI API key to the .env file.
#OPENAI_API_KEY="sk"

But requests always look for an OPENAI_API_KEY. Do I need to fire up the ollama server myself and make any changes in the configuration?

[YoavTamir00]

I also enountered this problem