-
Notifications
You must be signed in to change notification settings - Fork 6.5k
Open
Labels
discussionUsed for feature requests, proposals, ideas, etc. Open discussionUsed for feature requests, proposals, ideas, etc. Open discussion
Description
Feature hasn't been suggested before.
- I have verified this feature I'm about to request hasn't been suggested before.
Describe the enhancement you want to request
Currently prune is a basic remove after X amount of tokens have been reached, with a very basic filter of the latest operations. This is not enough when interleave thinking models are debugging complex/deep problems on their big context windows. Removing outputs/results from important steps is making them feel dumb or force them to hallucinate. By implementing a summary and smarter mechanism of that, keeping the feature of reducing unnecessary tokens, we can improve the interaction with the LLM
Metadata
Metadata
Assignees
Labels
discussionUsed for feature requests, proposals, ideas, etc. Open discussionUsed for feature requests, proposals, ideas, etc. Open discussion