Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build up of deleted Shard Group and Shard info in Raft #4726

Closed
otoolep opened this issue Nov 10, 2015 · 1 comment
Closed

Build up of deleted Shard Group and Shard info in Raft #4726

otoolep opened this issue Nov 10, 2015 · 1 comment
Labels
difficulty/medium Resolving this issue should take up to a week

Comments

@otoolep
Copy link
Contributor

otoolep commented Nov 10, 2015

Started with #4709

Due to the way our system works, deleted shard group and shard info stays in the Raft data forever. It's never removed. This is not a huge deal, but is wasteful of RAM and will cause retention enforcement to run slower and slower over time. Again, not a huge difference, but will happen.

The reason the system does soft-deletes of shard groups is so that the rest of the system can be absolutely sure that the associated shards should be deleted (as opposed to the associated shard group simply being missing, implying that the shards should be deleted).

Ideally the system would eventually clean-up all this soft-deleted resources.
@otoolep otoolep added difficulty/medium Resolving this issue should take up to a week category/clustering labels Nov 10, 2015
@jsternberg
Copy link
Contributor

Clustering has been removed from the open source version so I'm going to close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
difficulty/medium Resolving this issue should take up to a week
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@otoolep @jsternberg