Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelize vertical compactions inside a single group #5936

Closed
wants to merge 22 commits into from
Closed

Parallelize vertical compactions inside a single group #5936

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
912172b
Parallelize vertical compactions
fpetkovski Dec 1, 2022
d71c4d1
Run all tasks independently
fpetkovski Dec 2, 2022
c911229
Use errutil.MultiError instead of cortex MultiError
fpetkovski Dec 2, 2022
afe27df
Add test case for progress calculator
fpetkovski Dec 2, 2022
321efdc
Remove ULID return value
fpetkovski Dec 2, 2022
31885e1
Iterate through all errors for a compaction group
fpetkovski Dec 2, 2022
86af2a8
Add test case for large index size
fpetkovski Dec 2, 2022
1248a96
Parametrize concurrency inside single group
fpetkovski Dec 2, 2022
09bdb1a
Change test name
fpetkovski Dec 3, 2022
b58d2bf
Limit concurrency of tasks to global concurrency
fpetkovski Dec 4, 2022
c804045
Improve flag description
fpetkovski Dec 4, 2022
d754370
Fix linter
fpetkovski Dec 4, 2022
24fd336
Add vertical compaction check
fpetkovski Dec 4, 2022
a808840
Adjust e2e tests to not account for empty planning cycles
fpetkovski Dec 4, 2022
7c6dba5
Run make docs
fpetkovski Dec 4, 2022
a7d4a7b
Automatically infer group concurrency
fpetkovski Dec 7, 2022
f476edb
Run make docs
fpetkovski Dec 7, 2022
2662961
Fix tests
fpetkovski Dec 7, 2022
407e98a
Distribute tasks in round-robin manner
fpetkovski Dec 7, 2022
25705dc
Add e2e test for parallel compaction
fpetkovski Dec 7, 2022
e3e94c6
Plan at least one task from each group
fpetkovski Dec 7, 2022
ea766ad
Clean up scheduling
fpetkovski Dec 12, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading