Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix bad returns in get_available_deployment #790

Merged

Conversation

nathankim7
Copy link
Contributor

No description provided.

Copy link

vercel bot commented Nov 10, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 10, 2023 6:14am

@PrathamSoni
Copy link
Contributor

Thanks Nathan

@ishaan-jaff
Copy link
Contributor

cc @krrishdholakia this is related to router

@krrishdholakia
Copy link
Contributor

lgtm!

@krrishdholakia
Copy link
Contributor

@nathankim7 do you have a way to repro this scenario? will add it to our test suite.

@krrishdholakia krrishdholakia merged commit 2712385 into BerriAI:main Nov 10, 2023
2 checks passed
@krrishdholakia
Copy link
Contributor

krrishdholakia commented Nov 10, 2023

@nathankim7 @PrathamSoni revisiting this PR - when could you possibly trigger item[0] - wouldn't that imply the random shuffle didn't work (which i can only think of happening if potential deployments is empty)

Screenshot 2023-11-10 at 9 35 03 AM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants