Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

compact: Added overlap check before and after compact. Added extra index check for outsiders. #274

Merged
merged 10 commits into from
Apr 16, 2018

Conversation

bwplotka
Copy link
Member

@bwplotka bwplotka commented Apr 7, 2018

Signed-off-by: Bartek Plotka bwplotka@gmail.com

@bwplotka bwplotka requested a review from fabxc April 7, 2018 15:48
@bwplotka bwplotka changed the title compact: Added overlap check in sync metas. compact: Added overlap check before compact. Apr 7, 2018
@bwplotka bwplotka changed the title compact: Added overlap check before compact. compact: Added overlap check before & after compact. Apr 7, 2018
case <-c:
return nil
case s:= <-c:
return errors.Errorf("caught %s signal. Exiting.", s.String())
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Won't this make our run* functions return an error and make the program overall exit with 1? Seems like that's not what we want.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mhm, yea, let's println or log here instead

metas = append(metas, m.BlockMeta)

for _, s := range m.Compaction.Sources {
exclude[s] = struct{}{}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is not enough. Still we have blocks that are "within" newBlock but are not in new Block sources ): this is kind of confusing -> we have only leafs there, right?

@bwplotka bwplotka changed the base branch from compactor-dirs to comp-dirs April 9, 2018 13:14
bwplotka added 2 commits April 9, 2018 22:28
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

compact: Move overlaps to compact function.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

compact: Added checks after compaction too.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

compact: Added missed output block meta.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

compact: Fixed overlapping check.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
@bwplotka bwplotka changed the base branch from comp-dirs to master April 9, 2018 21:28
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
@bwplotka bwplotka changed the title compact: Added overlap check before & after compact. compact: Added overlap check before and after compact. Added extra index check for outsiders. Apr 10, 2018
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
@bwplotka bwplotka merged commit cd8a8b9 into master Apr 16, 2018
@bwplotka bwplotka deleted the ooo-block branch May 18, 2018 15:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants