Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Track token usage per key (spend logs?) #1549

Closed
krrishdholakia opened this issue Jan 22, 2024 · 2 comments
Closed

[Feature]: Track token usage per key (spend logs?) #1549

krrishdholakia opened this issue Jan 22, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@krrishdholakia
Copy link
Contributor

The Feature

Add token usage to spend logs

Motivation, pitch

"We are initially going to provide observability at the app level to the admins and the app owners, ie a breakdown of tokens and costs per app (ie per key). Within each app report we’ll then break down usage per user, so that app owners can identify who is driving up their cost."

Twitter / LinkedIn details

No response

@krrishdholakia
Copy link
Contributor Author

This might be a no-op as we already track usage as part of the spend logs table -

usage Json @default("{}")

Reached out to user to see if this solves it.

@krrishdholakia
Copy link
Contributor Author

Support added for logging this for streaming too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant