fix(proxy/utils.py): if langfuse trace id passed in, include in slack alert #1839

Merged

krrishdholakia merged 61 commits intomainfrom litellm_slack_langfuse_alerting

Feb 6, 2024

+13-5

Commits on Feb 6, 2024

fix(proxy/utils.py): if langfuse trace id passed in, just send that as part of alert
krrishdholakia
committed
test(test_key_generate_dynamodb.py): fix test
krrishdholakia
committed
Update model_prices_and_context_window.json
krrishdholakia
committed
Fix admin UI title and description

ushuz
authored and
krrishdholakia
committed
fix(langfuse.py): support logging failed llm api calls to langfuse
krrishdholakia
committed
(docs) upperbound_key_generate_params

ishaan-jaff
authored and
krrishdholakia
committed
(feat) upperbound_key_generate_params

ishaan-jaff
authored and
krrishdholakia
committed
(test) test_upperbound_key_params

ishaan-jaff
authored and
krrishdholakia
committed
(feat) proxy - upperbound params /key/generate

ishaan-jaff
authored and
krrishdholakia
committed
(fix) proxy startup test

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) print debug info for test_proxy_gunicorn_startup_config_dict

ishaan-jaff
authored and
krrishdholakia
committed
(fix) test_normal_router_tpm_limit

ishaan-jaff
authored and
krrishdholakia
committed
fix(ollama_chat.py): fix ollama chat completion token counting
krrishdholakia
committed
fix(utils.py): use print_verbose for statements, so debug can be seen when running sdk
krrishdholakia
committed
fix(ollama_chat.py): explicitly state if ollama call is streaming or not
krrishdholakia
committed
bump: version 1.22.6 → 1.22.7
krrishdholakia
committed
build(requirements.txt): update the proxy requirements.txt
krrishdholakia
committed
fix(ollama.py): support format for ollama
krrishdholakia
committed
bump: version 1.22.7 → 1.22.8
krrishdholakia
committed
(ci/cd) run in verbose mode

ishaan-jaff
authored and
krrishdholakia
committed
(fix) rename proxy startup test

ishaan-jaff
authored and
krrishdholakia
committed
(fix) proxy_startup test

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) run pytest without -s

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) run again

ishaan-jaff
authored and
krrishdholakia
committed
(fix) parallel_request_limiter debug

ishaan-jaff
authored and
krrishdholakia
committed
(fix) test_normal_router_tpm_limit

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) fix test_config_no_auth

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) run again

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) run again

ishaan-jaff
authored and
krrishdholakia
committed
fix(utils.py): round max tokens to be int always
krrishdholakia
committed
bump: version 1.22.8 → 1.22.9
krrishdholakia
committed
(feat) show langfuse logging tags better through proxy

ishaan-jaff
authored and
krrishdholakia
committed
(feat )add semantic cache

ishaan-jaff
authored and
krrishdholakia
committed
(feat) working - sync semantic caching

ishaan-jaff
authored and
krrishdholakia
committed
(test) semantic cache

ishaan-jaff
authored and
krrishdholakia
committed
(test) semantic caching

ishaan-jaff
authored and
krrishdholakia
committed
(fix) semantic cache

ishaan-jaff
authored and
krrishdholakia
committed
(feat) RedisSemanticCache - async

ishaan-jaff
authored and
krrishdholakia
committed
(test) async semantic cache

ishaan-jaff
authored and
krrishdholakia
committed
(feat) working semantic-cache on litellm proxy

ishaan-jaff
authored and
krrishdholakia
committed
(feat) redis-semantic cache

ishaan-jaff
authored and
krrishdholakia
committed
(feat) working semantic cache on proxy

ishaan-jaff
authored and
krrishdholakia
committed
(fix) add redisvl==0.0.7

ishaan-jaff
authored and
krrishdholakia
committed
(feat) log semantic_sim to langfuse

ishaan-jaff
authored and
krrishdholakia
committed
allow setting redis_semantic cache_embedding model

ishaan-jaff
authored and
krrishdholakia
committed
(fix) use semantic cache on proxy

ishaan-jaff
authored and
krrishdholakia
committed
(docs) using semantic caching on proxy

ishaan-jaff
authored and
krrishdholakia
committed
(feat) redis-semantic cache on proxy

ishaan-jaff
authored and
krrishdholakia
committed
(fix) test-semantic caching

ishaan-jaff
authored and
krrishdholakia
committed
(docs) redis cache

ishaan-jaff
authored and
krrishdholakia
committed
(docs) litellm semantic caching

ishaan-jaff
authored and
krrishdholakia
committed
(fix) semantic caching

ishaan-jaff
authored and
krrishdholakia
committed
(fix) mark semantic caching as beta test

ishaan-jaff
authored and
krrishdholakia
committed
(ci/cd) run again

ishaan-jaff
authored and
krrishdholakia
committed
test(test_completion.py): fix test
krrishdholakia
committed
(feat) show semantic-cache on health/readiness

ishaan-jaff
authored and
krrishdholakia
committed
(fix) dockerfile requirements.txt

ishaan-jaff
authored and
krrishdholakia
committed
(fix) langfuse show semantic-similarity in tags

ishaan-jaff
authored and
krrishdholakia
committed
(fix) redisvl requirements.txt issue

ishaan-jaff
authored and
krrishdholakia
committed
refactor(main.py): trigger deploy
krrishdholakia
committed
Merge branch 'main' into litellm_slack_langfuse_alerting
krrishdholakia
authored