Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Llm api dynamic routing #15

Merged
merged 28 commits into from
Oct 18, 2023
Merged

Llm api dynamic routing #15

merged 28 commits into from
Oct 18, 2023

Conversation

reiid00
Copy link
Collaborator

@reiid00 reiid00 commented Oct 18, 2023

Dynamic routing is done.

Needs to be implemented in SDK.

@reiid00
Initial stages of dynamic routing
b4c31d1
@reiid00
config file set up and working, may need some work. TODOs to change f…
da8d5e9 
…unctions to other files.
@reiid00
removed BaseModel extraction, changed routing to received multiple mo…
c44a5c7 
…dels
@reiid00
openai provider
dac1ce5
@reiid00
bedrock provider
0557722
@reiid00
vertexaiprovider
5998108
@reiid00
LLMEngine sperated to new folder for easier readability
138e66e
@reiid00
init function for LLMEngine
a06fb09
@reiid00
VertexAI should be working, bug on not getting default AI parameters
d5c8dab
@reiid00
VertexAI Working
699b0de
@reiid00
OpenAI Provider working
32fb086
@reiid00
Bedrock Model not tested
f23a9f9
@reiid00
Base Provider
c182944
@reiid00
validate_provider_config for providers
97fe501
@reiid00
changed config file according to Providers' configs
54f00f5
@reiid00
API app, only working locally
2dcb8e3
@reiid00
LLMEngine - Constants
4055d76
@reiid00
VertexAI Working, models cannot be instantiated outside main class.
4ce2341
@reiid00
Providers test function
dff56e7
@reiid00
openai provider - validation if config is correct
d65472a
@reiid00
app - dynamic routing endpoint, based on the type of route to create …
aeb3c58 
…the endopoint
@reiid00
config - pydantic v2 validation to config file
ee28e4c
@reiid00
bedrock and openai provider changes
c925a86
@reiid00
config example for dynamic routing
6f1239d
@reiid00
created doc_strings for implemented methods
c519bdd
@reiid00 reiid00 linked an issue Oct 18, 2023 that may be closed by this pull request
FEAT: Dynamic Routing #8
Closed
@reiid00 reiid00 added the enhancement New feature or request label Oct 18, 2023
claudiolemos
claudiolemos approved these changes Oct 18, 2023
View reviewed changes
Copy link
Collaborator

@claudiolemos claudiolemos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work!

@claudiolemos claudiolemos merged commit 2f6c719 into main Oct 18, 2023
3 of 4 checks passed
@claudiolemos claudiolemos deleted the llm-api-dynamic-routing branch October 18, 2023 12:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@claudiolemos claudiolemos claudiolemos approved these changes

Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

FEAT: Dynamic Routing
2 participants
@reiid00 @claudiolemos