Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Incorrect parsing of new bedrock model names #6644

Closed
bhushitagarwal-circle opened this issue Nov 7, 2024 · 1 comment
Closed

[Bug]: Incorrect parsing of new bedrock model names #6644

bhushitagarwal-circle opened this issue Nov 7, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@bhushitagarwal-circle
Copy link

What happened?

The new names for models released on bedrock have region prepended to them, example, us.anthropic.claude-3-5-sonnet-20241022-v2:0 for new 3.5 sonnet, us.anthropic.claude-3-5-haiku-20241022-v1:0 for new 3.5 haiku, us.meta.llama3-2-90b-instruct-v1:0 for meta 3.2 vision instruct.

This breaks the parsing of provider in the bedrock logic as it tries to separate the model name by . and fetch the first element.

Relevant log output

Error during streaming response: litellm.NotFoundError: BedrockException - Bedrock HTTPX: Unknown provider=us, model=us.meta.llama3-2-90b-instruct-v1:0

Twitter / LinkedIn details

No response

@bhushitagarwal-circle
Copy link
Author

This was resolved in the recent versions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant