Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

store-gateway: remove fine-grained chunks caching #5816

Merged

Conversation

dimitarvdimitrov
Copy link
Contributor

@dimitarvdimitrov dimitarvdimitrov commented Aug 22, 2023

What this PR does

This is the first PR in a series to remove fine-grained chunks caching - see #3939 (comment)

In this PR I'm removing

  • the experimental configuration parameter to toggle fine-grained chunks caching -blocks-storage.bucket-store.chunks-cache.fine-grained-chunks-caching-enabled
  • the experimental configuration parameter to select how many ranges of chunks get cached per series per block -blocks-storage.bucket-store.fine-grained-chunks-caching-ranges-per-series
    • because the code is still working with rages of chunks, chunks will now be partitioned into one range per series per block, which was the default value
  • the logic to storing and retrieve ranges of chunks from the cache
  • related tests

Note to reviewers

The two major iterators - loadingSeriesChunksSetIterator and loadingSeriesChunksRefsSetIterator - have places which can be futher simplified, but I'm leaving that for another PR, so this is easier to review.

Future PRs will also include removing the ranges of chunks abstraction altogether.

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Copy link
Contributor

@56quarters 56quarters left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

CHANGELOG.md Outdated Show resolved Hide resolved
dimitarvdimitrov and others added 2 commits August 23, 2023 10:27
Signed-off-by: Dimitar Dimitrov <dimitar.dimitrov@grafana.com>
Co-authored-by: Nick Pillitteri <56quarters@users.noreply.github.com>
@pracucci pracucci self-requested a review August 25, 2023 14:30
Copy link
Collaborator

@pracucci pracucci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working on this cleanup. LGTM! Looking forward for the next one ;)

CHANGELOG.md Outdated Show resolved Hide resolved
@dimitarvdimitrov dimitarvdimitrov enabled auto-merge (squash) August 25, 2023 14:52
@dimitarvdimitrov dimitarvdimitrov merged commit 2f0dd89 into main Aug 25, 2023
27 checks passed
@dimitarvdimitrov dimitarvdimitrov deleted the dimitar/st-gw/remove-fine-grained-chunks-caching branch August 25, 2023 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants