Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(v2): metastore index #3586

Draft
wants to merge 34 commits into
base: main
Choose a base branch
from
+1,692 −521
Draft

feat(v2): metastore index #3586

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
92ae04d
Move error checking elsewhere
aleks-p Sep 17, 2024
2fea21d
Add metastore index (wip)
aleks-p Sep 17, 2024
9ced456
Fix a few bugs and tests
aleks-p Sep 17, 2024
d22b6ce
Remove unneeded file
aleks-p Sep 19, 2024
5036116
Fix race condition
aleks-p Sep 19, 2024
49ddafa
Enable new write path for local deployments
aleks-p Sep 19, 2024
227cdb9
Return level 0 blocks, remove duplicates
aleks-p Sep 19, 2024
4fdceb7
Add simple logging
aleks-p Sep 19, 2024
48a355e
Remove unused var
aleks-p Sep 19, 2024
b312c2a
Refactor out metastore index, add partition meta
aleks-p Sep 20, 2024
9e10d70
Refactor, minor perf improvements
aleks-p Sep 23, 2024
6b9e5ab
Fix local setup for v2
aleks-p Sep 23, 2024
8c35544
Replace block truncation with block retention
aleks-p Sep 23, 2024
8e497d6
Refactor some more
aleks-p Sep 23, 2024
231cddc
Add tests, basic config
aleks-p Sep 23, 2024
312cac8
Add documentation
aleks-p Sep 23, 2024
f8ae8cd
Add todo
aleks-p Sep 23, 2024
388f2c2
Remove unused struct field tags
aleks-p Sep 23, 2024
6434a3d
Add todo
aleks-p Sep 23, 2024
7b9f769
Run make fmt
aleks-p Sep 23, 2024
f1a3a8e
Run make fmt
aleks-p Sep 24, 2024
944dffb
Allow longer queries in v2 locally
aleks-p Sep 24, 2024
ad75087
Add test for changing the partition duration
aleks-p Sep 25, 2024
1b138c5
Update test
aleks-p Sep 25, 2024
bcfb774
Address issue with finding / deleting blocks following a partition du…
aleks-p Sep 25, 2024
d4d6c9c
Add test cases
aleks-p Sep 25, 2024
236e065
Remove nested locking primitives
aleks-p Sep 27, 2024
1d70e72
Remove index/models.go
aleks-p Sep 27, 2024
fa8af1c
Improve error handling in ForEachPartition
aleks-p Sep 27, 2024
aa84e8f
Fix access without a lock
aleks-p Sep 27, 2024
4f7a860
Validate block ids at the API level
aleks-p Sep 27, 2024
8f055ed
Improve FindBlocksInRange, add tests
aleks-p Sep 27, 2024
b398012
Switch to a LRU cache for loaded partitions
aleks-p Oct 1, 2024
c5f46ce
Load partition meta on the fly
aleks-p Oct 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .mockery.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,3 +24,7 @@ packages:
github.com/grafana/pyroscope/pkg/experiment/metastore/discovery:
interfaces:
Discovery:
github.com/grafana/pyroscope/pkg/experiment/metastore/index:
interfaces:
Store:
config:
Loading
Loading