Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

release/v20.07 - perf(raft): Use raft storage in managedmode (#6457) #6547

Merged
merged 1 commit into from
Sep 27, 2020
Merged

release/v20.07 - perf(raft): Use raft storage in managedmode (#6457) #6547

merged 1 commit into from
Sep 27, 2020

Commits on Sep 21, 2020

  1. perf(raft): Use raft storage in managedmode (#6457) 

    This PR changes how we use badger in the wal store. Currently we run
badger in normal mode for `w` and `zw` store. We've seen up to 900K
entries for the same hard state (hs) key in `zw` store. These duplicate
keys cause spikes in read latencies in `zw`. The `w` store has more
compactions compared to `zw` store and so it has lesser stale data and
thus lesser spikes in read latencies.

The fix here is to open the `w` and `zw` directories in managed mode and
perform all writes on the same timestamp (max version in the db). This
leads to close to 0 duplicates in the store.

This PR also fixes the raft leader election issue which is a result of high
read latencies.

(cherry picked from commit 6882e37)
(cherry picked from commit ea343c9)
    Ibrahim Jarif committed Sep 21, 2020
    Configuration menu
    Copy the full SHA
    f3ee75a View commit details
    Browse the repository at this point in the history