KAFKA-18049 Upgrade the caffeine version to 3.1.1

[m1a2st]

Jira: https://issues.apache.org/jira/browse/KAFKA-18049
as title

Committer Checklist (excluded from commit message)

• Verify design and implementation
• Verify test coverage and CI build status
• Verify documentation (including upgrade notes)

[divijvaidya]

Can you also please reason about any breaking changes between 2.x and 3.x that we should know about? For your reference, there is only one cache in Kafka code base that uses Caffeine, so it should be easy to reason about it.

[mimaison]

With version 3, do we still need to exclude checker-qual? https://github.com/mimaison/kafka/blob/trunk/build.gradle#L2278-L2280

[ben-manes]

The exclusion was a preference as not used at runtime. It is still a dependency and that pr contains details.

From your usage, I don’t recall any changes you might need to be aware of.

[m1a2st]

Kafka only use in RemoteIndexCache, In caffeine 3.X version, I think the change we should know is

• CacheWriter usages can be replaced by Map computations and Caffeine.evictionListener in 3.0.0
• Update the least support version to Java11 in 3.0.0
• Fixed Map.equals when the traversal triggers an eviction and the subset of live entries matches in 3.1.0
• Improved the frequency sketch by better utilizing the cpu cache line to reduce memory accesses 3.1.2
• Improved builder construction time in 3.1.7

If I have missed anything, feel free to add or supplement further.

[m1a2st]

I will review the failed tests to determine if any changes in Caffeine 3.X version behavior caused the failures.

• FAILED ❌ RemoteIndexCacheTest > testReloadCacheAfterClose()
• FAILED ❌ RemoteIndexCacheTest > testCorrectnessForCacheAndIndexFilesWhenResizeCache()