Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add initial WAL implementation and tests #3569

Merged
merged 20 commits into from
Aug 19, 2015
Merged

Add initial WAL implementation and tests #3569

merged 20 commits into from
Aug 19, 2015

Commits on Aug 16, 2015

  1. Add initial WAL implementation and tests

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    eebdd5b View commit details
    Browse the repository at this point in the history

  2. Refactoring and cleanup based on PR comments

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    1bffb70 View commit details
    Browse the repository at this point in the history

  3. Add WAL back pressure when over memory threshold

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    006403c View commit details
    Browse the repository at this point in the history

  4. Make flush check configurable to avoid race in tests

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    d4b0451 View commit details
    Browse the repository at this point in the history

  5. Make WAL flush after inactive for writes for a given interval.

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    301b014 View commit details
    Browse the repository at this point in the history

  6. Integrate WAL and BZ1 and make BZ1 the default engine.

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    b583b89 View commit details
    Browse the repository at this point in the history

  7. WIP: fix bug with how bz writes index. fix bug with wal not having in… 

    …dex set.
    @pauldix
    Paul Dix authored and pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    a77a919 View commit details
    Browse the repository at this point in the history

  8. mend

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    48ede78 View commit details
    Browse the repository at this point in the history

  9. Fix bug in stress script, remove extraneous printlns

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    6776014 View commit details
    Browse the repository at this point in the history

  10. remove extraneous debug stuff

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    9a53406 View commit details
    Browse the repository at this point in the history

  11. Add failing test for metadata not getting persisted in new shards.

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    abc71ae View commit details
    Browse the repository at this point in the history

  12. Fix bug with new shards not getting series data persisted.

    @pauldix
    pauldix committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    3348dab View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2015

  1. Compress metadata, add Delete to WAL. 

    * All metadata for each shard is now stored in a single key with compressed value
* Creation of new metadata no longer requires a syncrhnous write to Bolt. It is passed to the WAL and written to Bolt periodically outside the write path
* Added DeleteSeries to WAL and updated bz1 to remove series there when DeleteSeries or DropMeasurement are called
    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    a509df0 View commit details
    Browse the repository at this point in the history

  2. Fix vet

    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    41cf76f View commit details
    Browse the repository at this point in the history

  3. Ensure that metadata is always loaded out of the index in sorted order

    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    a3cdf0b View commit details
    Browse the repository at this point in the history

  4. Combine all WAL partition cache maps into one

    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    30bcd3e View commit details
    Browse the repository at this point in the history

  5. Add WAL configuration options

    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    9df3b7d View commit details
    Browse the repository at this point in the history

  6. add WAL recovery

    @benbjohnson
    benbjohnson committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    0f2d66f View commit details
    Browse the repository at this point in the history

  7. Merge pull request #3717 from benbjohnson/pd-wal 

    add WAL recovery
    @pauldix
    pauldix committed Aug 18, 2015
    Configuration menu
    Copy the full SHA
    e7f7be4 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2015

  1. Fix compaction logging, make default idle flush interval 5 minutes.

    @pauldix
    pauldix committed Aug 19, 2015
    Configuration menu
    Copy the full SHA
    028d0a6 View commit details
    Browse the repository at this point in the history