Skip to content

Commit

Permalink
feat: Refactor subscription streaming and plumb through anthropic sup…
Browse files Browse the repository at this point in the history
…port (#5105)

* Extract/Refactor OpenAI/AzureOpenAI model interfaces

* Add Anthropic client

* Use new payload type

* run anthropic and fix most of the types

* use abc

* add anthropic to type check dependencies

* add anthropic as a container dependency

* fix tool calls for openai

* add back in token usage

* fix type

---------

Co-authored-by: Alexander Song <axiomofjoy@gmail.com>
  • Loading branch information
anticorrelator and axiomofjoy authored Oct 19, 2024
1 parent 33eac82 commit d405f61
Show file tree
Hide file tree
Showing 3 changed files with 229 additions and 94 deletions.
1 change: 1 addition & 0 deletions pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -123,6 +123,7 @@ pg = [
"psycopg[binary,pool]",
]
container = [
"anthropic",
"prometheus-client",
"openai>=1.0.0",
"opentelemetry-sdk",
Expand Down
1 change: 1 addition & 0 deletions requirements/type-check.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
-r ci.txt
anthropic
grpcio
litellm>=1.0.3
openai>=1.0.0
Expand Down
Loading

0 comments on commit d405f61

Please sign in to comment.