[FR]: Request to Implement Token Cost Calculation and Logging

[madhankumar2211]

Proposal summary

I would like to propose an enhancement to the project that involves calculating and logging the costs associated with token consumption (both input and output tokens) when using OpenAI's API. This will help users better understand the expenses incurred while interacting with the model.

Motivation

1. Users will have clearer visibility into their usage and costs.
2. Helps in budget management for projects utilizing OpenAI's services.

[jverre]

Hi @madhankumar2211
Agree that this would be very useful, we will try to ship something like this next week. I'll keep you posted on when we start working on it