Consumer latency fix extension

[rukai]

This PR demonstrates that the extended consumer latency fix can work, as demonstrated by the produce_consume_partitions3(connection_builder, "partitions3_case4", 1_000_000, 100) test case passing.

However I dont think its worth going ahead with at this time.
The extended solution has no performance impact when fetch.min.bytes = 1 which is the default value.
While at the same time bringing a lot of extra complexity into the implementation which carries some risk.

In particular I would like to see that:

• shotover runs well in production with fetch.min.bytes = 1, in regards to both performance and correctness.
• we experience performance issues with fetch.min.bytes > 1

Before considering landing this implementation.

For now, the recommendation is to just not configure clients with fetch.min.bytes > 1 when connecting to shotover.

[codspeed-hq]

CodSpeed Performance Report

Merging #1781 will not alter performance

_{Comparing rukai:consumer_latency_fix_extension (9c1d989) with main (61b5a98)}

Summary

✅ 38 untouched benchmarks