`General`: Track token usage of LLM service requests#9455

Merged

bassner merged 34 commits intodevelopfrom feature/track-usage-of-iris-requests

Oct 23, 2024

+976-112

Commits on Sep 28, 2024

Define LLM token usage model
alexjoham
committed

Commits on Oct 11, 2024

Commits on Oct 12, 2024

Fix server test failures by checking if tokens received
alexjoham
committed
Update database for cost tracking and trace_id functionality
alexjoham
committed
Update database, add information to competency gen, change traceId calc
alexjoham
committed

Commits on Oct 13, 2024

Implement server Integration tests for token tracking and saving
alexjoham
committed

Commits on Oct 15, 2024

Commits on Oct 16, 2024

Commits on Oct 18, 2024

Rework database, update saveLLMTokens method
alexjoham
committed

Commits on Oct 19, 2024

Implement new service in all Pipelines, update database, update test
alexjoham
committed

Commits on Oct 20, 2024

fix server tests
krusche
committed

Commits on Oct 23, 2024