Add proper retry implementation for OpenAiChatModel streaming

[tzolov]

No description provided.

[csterwa]

@tzolov does the PR referenced here resolve the retry implementation enhancement?

[ThomasVitale]

Adding some context to this issue: a RetryTemplate is used to add retry capabilities to the blocking model calls. At first, the same strategy was used for the streaming calls. After realising that it wasn't working as expected in a reactive stream, the usage of RetryTemplate streaming calls has been removed. In this issue, we would need to come up with a design for a retry feature to adopt in all streaming implementations across the different model providers.

[apappascs]

Hi @ThomasVitale , @tzolov

I've been working on a potential solution for adding retry logic to the ChatModel streaming functionality. To illustrate the approach, I’ve created a branch with the necessary changes main...apappascs:spring-ai:retry-implementation-openai-chatmodel-streaming

Would an implementation like this make sense for the project? I’d love to get feedback and refine the approach further if necessary.