-
Notifications
You must be signed in to change notification settings - Fork 1
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Parent: #348
Depends on: #349, #350
Task
Implement the last_cache_usage() trait method and add comprehensive tests.
Implementation
- Add
last_cache_usage()override inimpl LlmProvider for OpenAiProvider:
fn last_cache_usage(&self) -> Option<(u64, u64)> {
self.last_cache.lock().ok().and_then(|g| *g)
}- Add unit tests:
OpenAiUsagedeserialization with and withoutprompt_tokens_detailsOpenAiUsagedeserialization withcached_tokens: 0PromptTokensDetailsdeserializationOpenAiChatResponsewith usage field presentToolChatResponsewith usage field presentlast_cache_usage()returnsNoneinitially- Verify
(0, cached_tokens)convention
Acceptance criteria
last_cache_usage()returns correct values after API call simulation- All new tests pass
- Existing tests unaffected
cargo clippy --workspace -- -D warningsclean
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request