v1.1.0

What's Changed

🚨 Breaking Change v1.1.0 -> This version is only compatible with OpenAI python 1.1.0
Migration Guide: https://docs.litellm.ai/docs/migration

Key changes in v1.1.0

• Requires openai>=1.0.0
• openai.InvalidRequestError → openai.BadRequestError
• openai.ServiceUnavailableError → openai.APIStatusError
• NEW litellm client, allow users to pass api_key
  • litellm.Litellm(api_key="sk-123")
• response objects now inherit from BaseModel (prev. OpenAIObject)
• NEW default exception - APIConnectionError (prev. APIError)
• litellm.get_max_tokens() now returns an int not a dict

  max_tokens = litellm.get_max_tokens("gpt-3.5-turbo") # returns an int not a dict 
  assert max_tokens==4097

Other updates

• Update function calling docs by @kevinjyee in #673
• Fix data being overwritten by @mc-marcocheng in #679
• Updating the docker image builder for GitHub Action by @coconut49 in #678
• fix: bugs in traceloop integration by @nirga in #647
• Router aembedding by @mc-marcocheng in #691
• support release and debug params for langfuse client by @SlapDrone in #695
• docs error ==> openai.error instead of openai.errors by @josearangos in #700
• refactor Contributing to documentation steps by @josearangos in #713
• Fix Router.set_model_list & Avoid overwriting litellm_params by @mc-marcocheng in #706
• Update Together AI pricing by @dedeswim in #724
• Update README.md by @chinmay7016 in #727
• Router.get_available_deployment: Handle empty input edge case by @mc-marcocheng in #729
• Fix caching for Router by @karvetskiy in #722
• support for custom bedrock runtime endpoint by @canada4663 in #717
• Use supplied headers by @stanfea in #741
• Docker Hub image is built for ARM64 only by @morgendigital in #734
• doc name chagne by @kylehh in #764
• fix: fix bug for the case --model is not specified by @clalanliu in #781
• add custom open ai models to asyncio call by @PrathamSoni in #789
• Fix bad returns in get_available_deployment by @nathankim7 in #790
• Improve message trimming by @duc-phamh in #787
• build(deps): bump postcss from 8.4.27 to 8.4.31 in /docs/my-website by @dependabot in #804
• build(deps): bump urllib3 from 2.0.5 to 2.0.7 by @dependabot in #805
• build(deps): bump @babel/traverse from 7.22.10 to 7.23.3 in /docs/my-website by @dependabot in #806
• Fix ServiceUnavailableError super.init error by @jackmpcollins in #813
• Update Together prices by @dedeswim in #814
• need to re-attempt backoff and yaml imports if the first import attempt fails by @kfsone in #820
• Fix typo for initial_prompt_value and too many values to unpack error by @rodneyxr in #826
• Bedrock llama by @dchristian3188 in #811
• build(deps): bump sharp from 0.32.5 to 0.32.6 in /docs/my-website by @dependabot in #832

New Contributors

• @kevinjyee made their first contribution in #673
• @mc-marcocheng made their first contribution in #679
• @SlapDrone made their first contribution in #695
• @josearangos made their first contribution in #700
• @dedeswim made their first contribution in #724
• @chinmay7016 made their first contribution in #727
• @karvetskiy made their first contribution in #722
• @stanfea made their first contribution in #741
• @morgendigital made their first contribution in #734
• @clalanliu made their first contribution in #781
• @PrathamSoni made their first contribution in #789
• @nathankim7 made their first contribution in #790
• @duc-phamh made their first contribution in #787
• @dependabot made their first contribution in #804
• @jackmpcollins made their first contribution in #813
• @kfsone made their first contribution in #820
• @rodneyxr made their first contribution in #826
• @dchristian3188 made their first contribution in #811

Full Changelog: v0.11.1...v1.1.0