Skip to content

Replace O(n*iterations) token scan with incremental counter #640

@bug-ops

Description

@bug-ops

Parent: #621

crates/zeph-core/src/agent/streaming.rs:89-106estimate_tokens iterates all messages every tool-loop iteration. Update cached_prompt_tokens incrementally in push_message/prune_stale_tool_outputs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions