Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

opt(cache): Use Ristretto to store posting lists #7995

Merged
merged 25 commits into from
Aug 25, 2021
Merged

opt(cache): Use Ristretto to store posting lists #7995

merged 25 commits into from
Aug 25, 2021

Conversation

ahsanbarkati
Copy link
Contributor

@ahsanbarkati ahsanbarkati commented Aug 23, 2021 •
edited by manishrjain
Loading

  • Use some nifty techniques to make Ristretto caching work with MVCC posting lists.
  • Use posting list cache by default.
  • Set max pending to 64 by default.

This PR significantly improves query performance. This coupled with Roaring Bitmaps has shown to improve query latency by 20x for 50% of user queries, and 100x for 25% of them.

This change is Reviewable

@manishrjain manishrjain changed the title fix(pl-cache): Fix posting list cache feat(cache): Use Ristretto to store posting lists Aug 25, 2021
@manishrjain manishrjain changed the title feat(cache): Use Ristretto to store posting lists opt(cache): Use Ristretto to store posting lists Aug 25, 2021
@manishrjain manishrjain merged commit c051c2f into master Aug 25, 2021
@manishrjain manishrjain deleted the ahsan/pl-cache-new branch August 25, 2021 06:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@manishrjain manishrjain Awaiting requested review from manishrjain

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ahsanbarkati @manishrjain