Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Azure OpenAI models use incorrect context size #1291

Closed
fcakyon opened this issue Jan 1, 2024 · 0 comments · Fixed by #1290
Closed

[Bug]: Azure OpenAI models use incorrect context size #1291

fcakyon opened this issue Jan 1, 2024 · 0 comments · Fixed by #1290
Labels
bug Something isn't working

Comments

@fcakyon
Copy link
Contributor

fcakyon commented Jan 1, 2024

What happened?

Most Azure model info is incorrect in the LiteLMM json file:

litellm/model_prices_and_context_window.json

Line 122 in ca40a88

"max_tokens": 8192,

Thus, LiteLMM infers incorrect context sizes for most Azure OpenAI models.

This PR fixes this bug: #1290

Relevant log output

No response

Twitter / LinkedIn details

@fcakyon / https://www.linkedin.com/in/fcakyon/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix typos & add missing names for azure models fcakyon/litellm
1 participant
@fcakyon