Skip to content

chore: updates ollama default model from mistral-nemo to qwen2.5 #150

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
michaelneale merged 1 commit into from
Oct 15, 2024
Merged

chore: updates ollama default model from mistral-nemo to qwen2.5 #150

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions packages/exchange/src/exchange/providers/ollama.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,24 +6,24 @@
from exchange.providers.openai import OpenAiProvider

OLLAMA_HOST = "http://localhost:11434/"
OLLAMA_MODEL = "mistral-nemo"
OLLAMA_MODEL = "qwen2.5"


class OllamaProvider(OpenAiProvider):
"""Provides chat completions for models hosted by Ollama."""

__doc__ += """Here's an example profile configuration to try:
__doc__ += f"""Here's an example profile configuration to try:

First run: ollama pull qwen2.5, then use this profile:

ollama:
provider: ollama
processor: qwen2.5
accelerator: qwen2.5
processor: {OLLAMA_MODEL}
accelerator: {OLLAMA_MODEL}
moderator: truncate
toolkits:
- name: developer
requires: {}
requires: {{}}
Copy link
Collaborator

@michaelneale michaelneale Oct 14, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this needed?

Copy link
Collaborator Author

@codefromthecrypt codefromthecrypt Oct 14, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah because now we are using a format string, so we have to escape the curly

"""

def __init__(self, client: httpx.Client) -> None:
Expand Down