Skip to content

v1.40.4

Compare
Choose a tag to compare
@github-actions github-actions released this 06 Jun 05:17
· 84 commits to 6b703f0ebf7b0b9eb3c795dc3652c4821b5c6464 since this release

What's Changed

  • feat: clarify slack alerting message by @nibalizer in #4023
  • [Admin UI] Analytics - fix div by 0 error on /model/metrics by @ishaan-jaff in #4021
  • Use DEBUG level for curl command logging by @grav in #2980
  • feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links by @krrishdholakia in #4028
  • [FIX] Proxy redirect to PROXY_BASE_URL/ui after logging in by @ishaan-jaff in #4027
  • [Feat] Audit Logs for Key, User, ProxyModel CRUD operations by @ishaan-jaff in #4030

New Contributors

Full Changelog: v1.40.3...v1.40.4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.40.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.40.4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 74 89.43947919222931 6.450062450815326 0.0 1930 0 64.37952199996744 1143.0389689999743
Aggregated Passed ✅ 74 89.43947919222931 6.450062450815326 0.0 1930 0 64.37952199996744 1143.0389689999743