-
Notifications
You must be signed in to change notification settings - Fork 850
Closed
Labels
area-aiMicrosoft.Extensions.AI librariesMicrosoft.Extensions.AI libraries
Description
I'd like to read the cached tokens from a ChatResponse but the key in ChatResponse.Usage.AdditionalCounts depends on the provider:
InputTokenDetails.CachedTokenCountfor OpenAICachedContentTokenCountfor VertexAICacheReadInputTokensfor Anthropic
Could we do a breaking a change to have a consistent key for the cached tokens or maybe add the cache tokens as a property of UsageDetails?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
area-aiMicrosoft.Extensions.AI librariesMicrosoft.Extensions.AI libraries