[QUERY] About chat context management tools in Azure OpenAI SDK #43359
Labels
Client
This issue points to a problem in the data-plane of the library.
customer-reported
Issues that are reported by GitHub users external to the Azure organization.
needs-team-triage
Workflow: This issue needs the team to triage.
OpenAI
question
The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Query/Question
Is there a built-in tool or utility in the Azure OpenAI SDK for managing chat context (history and message truncation)?
Currently, I'm manually managing the chat messages list and context, like this:
I'm looking for functionality that could help with:
Managing conversation history
Automatic message truncation when context length is exceeded
Smart context window management
If such tools don't exist in the SDK, are there any recommended patterns or best practices for implementing this?
The text was updated successfully, but these errors were encountered: