Connect to OpenAI or ollama

[andreasristo]

I tried to connect to openAi to use the "add from picture", but it looks like I have to pay for that. So I decided to install ollama local...
That is also not working.
When I add a picture, after some seconds an error occures "something went wrong"

In my log I see this error:
405 Method Not Allowed "POST /api/recipes/create-from-image?translateLanguage=de-DE HTTP/1.1"

this is my config:

`OPENAI_BASE_URL: http://localhost:11434/v1

OPENAI_SEND_DATABASE_DATA: "true"

OPENAI_ENABLE_IMAGE_SERVICES: "True"

OPENAI_API_KEY: 'ollama'

OPENAI_MODEL: mistral-nemo:latest`

[michael-genson]

Can you try clearing your cache or using another browser? Looks like you're trying to call the old endpoint, but it was changed in V2. That would only happen if your frontend is caching the old version

[andreasristo]

used another PC, but no change.

[michael-genson]

I'm not sure what your deployment looks like, but there must be some sort of caching going on, or otherwise some deployment failure, since that endpoint doesn't exist anymore with V2. I would check any other services you have (e.g. if you're using web hosting) and see if it's doing any caching there. You may also want to rebuild the container.

[andreasristo]

here the new logs:

Traceback (most recent call last):
File "/opt/pysetup/.venv/lib/python3.10/site-packages/openai/_base_client.py", line 1571, in _request
response = await self._client.send(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1674, in send
response = await self._send_handling_auth(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1702, in _send_handling_auth
response = await self._send_handling_redirects(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1739, in _send_handling_redirects
response = await self._send_single_request(request)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_client.py", line 1776, in _send_single_request
response = await transport.handle_async_request(request)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 376, in handle_async_request
with map_httpcore_exceptions():
File "/usr/local/lib/python3.10/contextlib.py", line 153, in exit
self.gen.throw(typ, value, traceback)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 89, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectError: All connection attempts failed
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/app/mealie/services/openai/openai.py", line 177, in get_response
response = await self._get_raw_response(prompt, user_messages, temperature, force_json_response)
File "/app/mealie/services/openai/openai.py", line 142, in _get_raw_response
return await client.chat.completions.create(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/openai/resources/chat/completions.py", line 1633, in create
return await self._post(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/openai/_base_client.py", line 1838, in post
return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/openai/_base_client.py", line 1532, in request
return await self._request(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/openai/_base_client.py", line 1605, in _request
raise APIConnectionError(request=request) from err
openai.APIConnectionError: Connection error.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/app/mealie/services/recipe/recipe_service.py", line 491, in build_recipe_from_images
response = await openai_service.get_response(
File "/app/mealie/services/openai/openai.py", line 182, in get_response
raise Exception(f"OpenAI Request Failed. {e.class.name}: {e}") from e
Exception: OpenAI Request Failed. APIConnectionError: Connection error.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/opt/pysetup/.venv/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 401, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "/opt/pysetup/.venv/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/applications.py", line 123, in call
await self.middleware_stack(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in call
raise exc
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/sessions.py", line 85, in call
await self.app(scope, receive, send_wrapper)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/gzip.py", line 24, in call
await responder(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/gzip.py", line 44, in call
await self.app(scope, receive, self.send_with_gzip)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/routing.py", line 756, in call
await self.middleware_stack(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
await route.handle(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
await self.app(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
response = await func(request)
File "/app/mealie/routes/_base/routers.py", line 35, in custom_route_handler
response = await original_route_handler(request)
File "/opt/pysetup/.venv/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
File "/opt/pysetup/.venv/lib/python3.10/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
return await dependant.call(**values)
File "/app/mealie/routes/recipe/recipe_crud_routes.py", line 322, in create_recipe_from_image
recipe = await self.service.create_from_images(images, translate_language)
File "/app/mealie/services/recipe/recipe_service.py", line 297, in create_from_images
recipe_data = await openai_recipe_service.build_recipe_from_images(
File "/app/mealie/services/recipe/recipe_service.py", line 495, in build_recipe_from_images
raise Exception("Failed to call OpenAI services") from e
Exception: Failed to call OpenAI services

[michael-genson]

It looks like Mealie is failing to connect to your ollama instance:

httpx.ConnectError: All connection attempts failed
OpenAI Request Failed. APIConnectionError: Connection error

Are you sure Mealie is able to see your ollama container on the local network? It looks like you have your config set correctly (assuming you're forwarding your ollama container to http://localhost:11434. Have you tried calling your ollama API outside of Mealie?

[andreasristo]

sorry, but don't know, if mealie can see ollama. (can't ping in that console)
Do you have an idea how o check that?

In a browser on localhost the ollama message "Ollama is running" is availible

[michael-genson]

Can you share your full docker compose? (with secrets redacted)
If you're able to see the "Ollama is running" message that means at least it's broadcasting on the expected port, but not necessarily that Mealie can see it

[andreasristo]

services:

mealie:
image: ghcr.io/mealie-recipes/mealie:v2.0.0
container_name: mealie
restart: always
ports:
- "9925:9000" #
deploy:
resources:
limits:
memory: 1000M #
volumes:
- mealie-data:/app/data/
environment:
# Set Backend ENV Variables Here
ALLOW_SIGNUP: "false"
PUID: 1000
PGID: 1000
TZ: Europe/Berlin
MAX_WORKERS: 1
WEB_CONCURRENCY: 1
BASE_URL: https://xxxxxxxxxx.de
# Database Settings
DB_ENGINE: postgres
POSTGRES_USER: mealie
POSTGRES_PASSWORD: mealie
POSTGRES_SERVER: postgres
POSTGRES_PORT: 5432
POSTGRES_DB: mealie
# OPENAI
OPENAI_BASE_URL: http://localhost:11434/v1
OPENAI_SEND_DATABASE_DATA: "true"
OPENAI_ENABLE_IMAGE_SERVICES: "True"
OPENAI_API_KEY: 'ollama'
OPENAI_MODEL: mistral-nemo:latest

depends_on:
  postgres:
    condition: service_healthy

postgres:
container_name: postgres
image: postgres:15
restart: always
volumes:
- mealie-pgdata:/var/lib/postgresql/data
environment:
POSTGRES_PASSWORD: mealie
POSTGRES_USER: mealie
healthcheck:
test: ["CMD", "pg_isready"]
interval: 30s
timeout: 20s
retries: 3

webui:
image: ghcr.io/open-webui/open-webui:main
expose:
- 8080/tcp
ports:
- 8080:8080/tcp
environment:
- OLLAMA_BASE_URL=http://host.docker.internal:11434
volumes:
- open-webui:/app/backend/data
depends_on:
- ollama

ollama:
image: ollama/ollama
expose:
- 11434/tcp
ports:
- 11434:11434/tcp
healthcheck:
test: ollama --version || exit 1
command: serve
volumes:
- ollama:/root/.ollama

volumes:
ollama:
open-webui:
mealie-data:
mealie-pgdata:

[michael-genson]

Try changing OPENAI_BASE_URL: http://localhost:11434/v1 to OPENAI_BASE_URL: http://ollama:11434/v1

Since they're all on the same compose they have a shared internal network. "expose" exposes the container to the Docker network, rather than the host.

[andreasristo]

Tried...
Exception: Failed to call OpenAI services

[andreasristo]

Do you have a docker-compose.yml which you can share (and all additional configuration-steps)?

[michael-genson]

I'm just using the default OpenAI integration, so I don't have anything to add to that unfortunately. When I hooked up ollama for testing it was a completely different machine

[mikaelheidrich]

Could this be the source of the problem? I’m experiencing the same as OP and looking around the web see many having same trouble with mealie and Ollama.

ollama/ollama#5830

[michael-genson]

That's a completely different issue, if you're getting a 404 something is wrong with your setup