Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: enable bloom filter index #6639

Merged
merged 54 commits into from
Aug 3, 2022
Merged

feat: enable bloom filter index #6639

merged 54 commits into from
Aug 3, 2022

Commits on Jul 15, 2022

  1. enable bloom filter index

    @dantengsky
    dantengsky committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    0f346c0 View commit details
    Browse the repository at this point in the history

  2. tweak ut

    @dantengsky
    dantengsky committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    952e381 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2022

  1. rm unused code

    @dantengsky
    dantengsky committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    86d7ccf View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    d2a7cd2 View commit details
    Browse the repository at this point in the history

  3. fix bloom filter compile err

    @dantengsky
    dantengsky committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    3020d84 View commit details
    Browse the repository at this point in the history

  4. fix: replace deprecated parquet_source_builder

    @dantengsky
    dantengsky committed Jul 19, 2022
    Configuration menu
    Copy the full SHA
    f98df53 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2022

  1. minor refactor

    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    aa97e9f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    e41d62a View commit details
    Browse the repository at this point in the history

  3. add instrument

    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    25f2e36 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    14f0051 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    482b56e View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    3182db5 View commit details
    Browse the repository at this point in the history

  7. wip: block prunner shortcut

    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    3257e7b View commit details
    Browse the repository at this point in the history

  8. wip: refactoring pruner

    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    72a43d7 View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 25, 2022
    Configuration menu
    Copy the full SHA
    60fefd6 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    c5a134c View commit details
    Browse the repository at this point in the history

  2. remove needless tokio spawn

    @dantengsky
    dantengsky committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    3952dc9 View commit details
    Browse the repository at this point in the history

  3. refactor: block prunner shortcuts

    @dantengsky
    dantengsky committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    28e5b96 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. WIP: lifetime seems ok

    @dantengsky
    dantengsky committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    fe18bc0 View commit details
    Browse the repository at this point in the history

  2. Separated filters

    @dantengsky
    dantengsky committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    16f4685 View commit details
    Browse the repository at this point in the history

  3. move predicate cstors to individual mods

    @dantengsky
    dantengsky committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    8d8f507 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2022

  1. tidy up

    @dantengsky
    dantengsky committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    02d1724 View commit details
    Browse the repository at this point in the history

  2. add setting for toggling bloom filter

    @dantengsky
    dantengsky committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    11fa723 View commit details
    Browse the repository at this point in the history

  3. refacor

    @dantengsky
    dantengsky committed Jul 28, 2022
    Configuration menu
    Copy the full SHA
    ead1fa0 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2022

  1. index cache

    @dantengsky
    dantengsky committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    5436f79 View commit details
    Browse the repository at this point in the history

  2. fix ut of settings

    @dantengsky
    dantengsky committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    e51ecd4 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2022

  1. use storage runtime

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    4ec7657 View commit details
    Browse the repository at this point in the history

  2. clean up

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    83d7f07 View commit details
    Browse the repository at this point in the history

  3. disable compression for bloom filter

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    5b9d1b8 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    9b9d27b View commit details
    Browse the repository at this point in the history

  5. versioned index reader

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    f7b4494 View commit details
    Browse the repository at this point in the history

  6. Place index in separate key prefix & populate index size

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    83569a2 View commit details
    Browse the repository at this point in the history

  7. show index in system.tables

    @dantengsky
    dantengsky committed Aug 1, 2022
    Configuration menu
    Copy the full SHA
    ef749ab View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. fix unit tests

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    af2085c View commit details
    Browse the repository at this point in the history

  2. fix stateless test

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    1f60fde View commit details
    Browse the repository at this point in the history

  3. rebuild index during mutations

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    f864cd2 View commit details
    Browse the repository at this point in the history

  4. tweak unit tests

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    4ee34d1 View commit details
    Browse the repository at this point in the history

  5. refactor accumulator

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    38a11eb View commit details
    Browse the repository at this point in the history

  6. tweak cache

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    9225ae4 View commit details
    Browse the repository at this point in the history

  7. try fix sqllogic test

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    0e6f61e View commit details
    Browse the repository at this point in the history

  8. refine limiter

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    b30a9d3 View commit details
    Browse the repository at this point in the history

  9. refine unit test

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    052a640 View commit details
    Browse the repository at this point in the history

  10. refine ut

    @dantengsky
    dantengsky committed Aug 2, 2022
    Configuration menu
    Copy the full SHA
    b4cbd9a View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2022

  1. count bloom filter index cache by bytes

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    2a80550 View commit details
    Browse the repository at this point in the history

  2. add sqlogictest for bloom filter index

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    94e1696 View commit details
    Browse the repository at this point in the history

  3. tidy up

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    aaf4be8 View commit details
    Browse the repository at this point in the history

  4. remove setting "enable_bloom_filter_index"

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    f4c06c5 View commit details
    Browse the repository at this point in the history

  5. adjust test cases

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    c3415d7 View commit details
    Browse the repository at this point in the history

  6. Update query/src/storages/fuse/io/read/snapshot_history_reader.rs 

    Co-authored-by: Zhyass <mytesla@live.com>
    @dantengsky @zhyass
    dantengsky and zhyass authored Aug 3, 2022
    Configuration menu
    Copy the full SHA
    5f5c445 View commit details
    Browse the repository at this point in the history

  7. runtime arrangement tweaks

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    84d053f View commit details
    Browse the repository at this point in the history

  8. make lint

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    0edf55f View commit details
    Browse the repository at this point in the history

  9. Merge remote-tracking branch 'origin/main' into feat-bloom-switch-to-… 

    …external-index
    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    f2e0ecb View commit details
    Browse the repository at this point in the history

  10. bring back sqlogic test

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    89ad8ed View commit details
    Browse the repository at this point in the history

  11. fix logictest cases

    @dantengsky
    dantengsky committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    8477721 View commit details
    Browse the repository at this point in the history