Skip to content

[FEATURE]: implement smart pruning #7459

@processtrader

Description

@processtrader

Feature hasn't been suggested before.

  • I have verified this feature I'm about to request hasn't been suggested before.

Describe the enhancement you want to request

Currently prune is a basic remove after X amount of tokens have been reached, with a very basic filter of the latest operations. This is not enough when interleave thinking models are debugging complex/deep problems on their big context windows. Removing outputs/results from important steps is making them feel dumb or force them to hallucinate. By implementing a summary and smarter mechanism of that, keeping the feature of reducing unnecessary tokens, we can improve the interaction with the LLM

Metadata

Metadata

Assignees

Labels

discussionUsed for feature requests, proposals, ideas, etc. Open discussion

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions