1.16.12

New providers

Xinference Embeddings: https://docs.litellm.ai/docs/providers/xinference
Voyage AI: https://docs.litellm.ai/docs/providers/voyage
Cloudflare AI workers: https://docs.litellm.ai/docs/providers/cloudflare_workers

Fixes:

AWS region name error when passing user bedrock client: #1292
Azure OpenAI models - use correct context window in model_context_window_and_prices.json
Fixes for Azure OpenAI + Streaming - counting prompt tokens correctly: #1264

What's Changed

• Update mistral.md by @nanowell in #1157
• Use current Git folder for building Dockerfile by @Manouchehri in #1076
• (fix) curl example on proxy/quick_start by @ku-suke in #1163
• clarify the need to set an exporter by @nirga in #1162
• Update mistral.md by @ericmjl in #1174
• doc: updated langfuse ver 1.14 in pip install cmd by @speedyankur in #1178
• Fix for issue that occured when proxying to ollama by @clevcode in #1168
• Sample code to prevent logging API key in callback to Slack by @navidre in #1185
• Add partial support of VertexAI safety settings by @neubig in #1190
• docker build and push on release by @Rested in #1197
• Add a default for safety settings in vertex AI by @neubig in #1199
• Make vertex ai work with generate_content by @neubig in #1213
• fix: success_callback logic for cost_tracking by @sihyeonn in #1211
• Add aws_bedrock_runtime_endpoint support by @Manouchehri in #1203
• fix least_busy router by updating min_traffic by @AllentDan in #1195
• Improve langfuse integration by @maxdeichmann in #1183
• usage_based_routing_fix by @sumanth13131 in #1182
• add some GitHub workflows for flake8 and add black dependecy by @bufferoverflow in #1223
• fix: helicone logging by @evantancy in #1249
• update anyscale price link by @prateeksachan in #1246
• Bump aiohttp from 3.8.4 to 3.9.0 by @dependabot in #1180
• updated oobabooga to new api and support for embeddings by @danikhan632 in #1248
• add support for mistral json mode via anyscale by @marmikcfc in #1275
• Adds support for Vertex AI Unicorn by @AshGreh in #1277
• fix typos & add missing names for azure models by @fcakyon in #1290
• fix(proxy_server.py) Check when '_hidden_params' is None by @asedmammad in #1300

New Contributors

• @nanowell made their first contribution in #1157
• @ku-suke made their first contribution in #1163
• @ericmjl made their first contribution in #1174
• @speedyankur made their first contribution in #1178
• @clevcode made their first contribution in #1168
• @navidre made their first contribution in #1185
• @neubig made their first contribution in #1190
• @Rested made their first contribution in #1197
• @sihyeonn made their first contribution in #1211
• @AllentDan made their first contribution in #1195
• @sumanth13131 made their first contribution in #1182
• @bufferoverflow made their first contribution in #1223
• @evantancy made their first contribution in #1249
• @prateeksachan made their first contribution in #1246
• @danikhan632 made their first contribution in #1248
• @marmikcfc made their first contribution in #1275
• @AshGreh made their first contribution in #1277
• @fcakyon made their first contribution in #1290
• @asedmammad made their first contribution in #1300

Full Changelog: v1.15.0...1.16.12