Switch to lower contention ClockCache

[benaadams]

Changes

• Switch LruCache to ClockCache
  • Doesn't take any locks in the read path; only marking in bitmap as accessed using Interlocked
  • On Set it takes lock scanning the bitmap advancing a "clock" integer and setting each item as 0, until it comes to one already 0, which it evicts.

Types of changes

What types of changes does your code introduce?

• Optimization

Testing

Requires testing

• Yes

If yes, did you write tests?

• Yes

[LukaszRozmej]

Overall well done, but can we remove code duplication, by extracting a shared component that would do the access tracking?

[Scooletz]

The Clock bit operations is pretty similar to the BitFilter in Paprika 😅
The clock is simple and easy to reason about.

I believe we can make atomics simpler. Provided comments.

[Scooletz]

❤️