Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create GitHub Action to automatically build docker images #634

Merged
merged 0 commits into from
Oct 18, 2023

Conversation

coconut49
Copy link
Contributor

@coconut49 coconut49 commented Oct 18, 2023

Description

The purpose of this PR is to build a Docker image of LiteLLM Proxy Server via GitHub Action, so that we don't need to clone the entire repository and build the image ourselves when we need to use it. This makes it easier to deploy.

The main change to the code is to allow the user_config_path to be obtained via LITELLM_CONFIG_PATH to fit the container environment.

All other changes are code formatting and can be ignored.

Test

docker run -dti -v ./secrets_template.toml:/litellm.secrets.toml -p 8000:8000 ghcr.io/coconut49/litellm:main
Screenshot 2023-10-18 at 14 28 09

https://github.com/coconut49/litellm/pkgs/container/litellm

image

@vercel
Copy link

vercel bot commented Oct 18, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 18, 2023 4:14pm

@ishaan-jaff
Copy link
Contributor

@coconut49 this looks like an amazing PR but I see no files changed

@coconut49
Copy link
Contributor Author

@coconut49 this looks like an amazing PR but I see no files changed

Hi @ishaan-jaff, I re-pushed the code and I don't know why pull bot cleared my changes.
image

@ishaan-jaff
Copy link
Contributor

cc @krrishdholakia this builds on your work for the proxy

@krrishdholakia
Copy link
Contributor

Hey @coconut49 can we discuss this PR over a call, I'd like to understand this use-case/problem a bit more: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

@krrishdholakia krrishdholakia merged commit 50a3c97 into BerriAI:main Oct 18, 2023
@SlapDrone
Copy link
Contributor

Was just thinking this would be a welcome addition yesterday, nice work. Is it merged though? I see no files changed either.

@krrishdholakia
Copy link
Contributor

krrishdholakia commented Oct 19, 2023

@coconut49 did you pull the PR?

not sure i understand what happened.

@SlapDrone are you currently using the docker image?

@coconut49
Copy link
Contributor Author

Hi @krrishdholakia I submitted the code yesterday, but the bot pulled it before the merge, leading to a force push that overwrote my relevant changes. I am investigating.

Screenshot 2023-10-20 at 12 09 20

@coconut49
Copy link
Contributor Author

Sorry, I uninstalled the pull bot. I will create another PR to replicate the changes.

@coconut49
Copy link
Contributor Author

Hi @krrishdholakia I have submitted the same code changes again in another PR. Could you please review? #655. Thank you.

@SlapDrone
Copy link
Contributor

@coconut49 did you pull the PR?

not sure i understand what happened.

@SlapDrone are you currently using the docker image?

Currently I have a Makefile that clones the repo locally, then builds and tags the docker image, then deletes the local repo. Having this image published natively on ghcr (as @coconut49 has implemented) would be really convenient! :)

@krrishdholakia
Copy link
Contributor

krrishdholakia commented Oct 20, 2023

@SlapDrone i initially built the proxy to solve a user problem for translating openai / non-openai calls locally.

I'm trying to understand why people are using it in prod. Is there any way I can reach out to learn more about your use-case ?

My number is: +17708783016 (works for sms/imessage/whatsapp)
Discord: Krrish#8748
Email: krrish@berri.ai

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants