[Bug]: docker-compose up does not work with out-of-date main and latest images

[dkondoetsy]

What happened?

With image: ghcr.io/berriai/litellm:main in the docker compose yaml file,
docker-compose -f docker-compose-litellm.yml up fails with:

raise OpenAIError(openai.OpenAIError: Missing credentials. Please pass one of `api_key`, `azure_ad_token`, `azure_ad_token_provider`, or the `AZURE_OPENAI_API_KEY` or `AZURE_OPENAI_
AD_TOKEN` environment variables.

even though my litellm config specifies a key.

An error also occurs with image: ghcr.io/berriai/litellm:latest

If I change the image to ghcr.io/berriai/litellm:main-v1.15.3, then docker-compose up works.

The main and latest images look old. So maybe latest should be updated on each release?

Relevant log output

No response

Twitter / LinkedIn details

No response

[krrishdholakia]

@dkondoetsy thanks for flagging this. cc: @ishaan-jaff / @Rested, i believe the PR #1197 added auto-deploy on gh releases, perhaps a better way would be to do it on pypi publish (already auto-triggered + passes through ci/cd testing).

I would assume this is where the change needs to be made - https://github.com/BerriAI/litellm/blob/main/.circleci/config.yml

[ishaan-jaff]

Added code to update the ghcr docker image for every new pypi release:
157b21c

cc @dkondoetsy, this will ensure the ghcr container is always on the latest version of litellm

[ishaan-jaff]

closing this issue since it's completed, we now auto deploy to ghcr after passing ci/cd

feel free to re-open @dkondoetsy

[dkondoetsy]

Awesome, thank you so much Ishaan.

…

On Mon, Dec 25, 2023 at 10:09 PM Ishaan Jaff ***@***.***> wrote: closing this issue since it's completed, we now auto deploy to ghcr after passing ci/cd feel free to re-open @dkondoetsy <https://github.com/dkondoetsy> — Reply to this email directly, view it on GitHub <#1233 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AWHT6RREDEBVMDQCH5N54XDYLJS3NAVCNFSM6AAAAABBA56C4SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRZGI4DMMJXGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[RodolfoCastanheira]

had exactly the same problem today

[FilJed]

had exactly the same problem today

Double this.
main-v1.15.3 is still working though.

[chymian]

@ishaan-jaff
+1

I used the latest docker image 1.23.9
encountered this error:

openai.OpenAIError: Missing credentials. Please pass one of `api_key`, `azure_ad_token`, `azure_ad_token_provider`, or the `AZURE_OPENAI_API_KEY` or `AZURE_OPENAI_AD_TOKEN` environment variables

the proxy config has dummy keys configured for every entry (ollama & openai -> ooboga's)

it is working with 1.23.9, using this simple Dockerfile:

FROM python:3.11

# Set the working directory in the container
WORKDIR /app

# Copy the current directory contents into the container at /app
COPY . /app

RUN pip install -U pip && \
                pip install --break-system-packages litellm[proxy] && \
                pip cache purge

COPY start.sh /start.sh

EXPOSE 8000
ENTRYPOINT [ "/bin/bash", "/start.sh" ]

that let me assume, someting with the provided image is nok?