Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: Allow setting tpm/rpm limits per key #1550

Closed
krrishdholakia opened this issue Jan 22, 2024 · 1 comment
Closed

[Feature]: Allow setting tpm/rpm limits per key #1550

krrishdholakia opened this issue Jan 22, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@krrishdholakia
Copy link
Contributor

The Feature

Allow setting tpm / rpm limits per key

Motivation, pitch

App owners have keys to the proxy, the keys have budgets (money, tpm, rpm)

Twitter / LinkedIn details

No response
@krrishdholakia krrishdholakia added the enhancement New feature or request label Jan 22, 2024
@krrishdholakia krrishdholakia mentioned this issue Jan 22, 2024
Closed
29 tasks
@krrishdholakia
Copy link
Contributor Author

krrishdholakia commented Jan 22, 2024 •
edited
Loading

Closing as we already support this - https://docs.litellm.ai/docs/proxy/users#set-rate-limits

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@krrishdholakia