BUG: ToolCallId must have message error in agent

[timfdev]

This bug seemed to randomly occur while in a conversation with the agent.

In #2232 , we capture and show tool calls, this showed that this specific error always occurred in the following scenario:

1. An inital question is asked to the agent.

2. The agent tries to set filter tree, but validation fails

3. The agent retries setting it and succeeds.

4. The agent gives an answer.

5. The user asks a follow up question

6. The server receives an error from OpenAI: 'ToolCallId must have message'

The tool call logging showed that the the failed tool call never exited the inProgress state after failing.
The solution is probably to somehow make sure this failed try is correctly processed , requires some research

[timfdev]

This seems to be the exact issue:

pydantic/pydantic-ai#3197