Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(snapshots): write to snapshots during BodyStage #5733

Merged
merged 132 commits into from
Jan 26, 2024

Commits on Nov 15, 2023

  1. Configuration menu
    Copy the full SHA
    999a14e View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. stats

    joshieDo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    34d324d View commit details
    Browse the repository at this point in the history
  2. filter size

    joshieDo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    0a5931a View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c7422ca View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    615e8b4 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    1119adf View commit details
    Browse the repository at this point in the history
  6. improve stats func

    joshieDo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    4a6ae7d View commit details
    Browse the repository at this point in the history
  7. add more stats

    joshieDo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    a784733 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    90c5968 View commit details
    Browse the repository at this point in the history
  9. fmt

    joshieDo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    ab74e35 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. use thread pool instead

    joshieDo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b9c51e9 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. Revert "use thread pool instead"

    This reverts commit b9c51e9.
    joshieDo committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    94cb5e6 View commit details
    Browse the repository at this point in the history
  2. optional filters loading

    joshieDo committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    53189da View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. offsets mmap

    joshieDo committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    b0d62d5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f029ccf View commit details
    Browse the repository at this point in the history
  3. small refactor DataReader

    joshieDo committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    a991bc5 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    92bf0fb View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    2c7595c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    77e3572 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4687864 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Configuration menu
    Copy the full SHA
    df6d39b View commit details
    Browse the repository at this point in the history
  2. fix docs

    joshieDo committed Nov 27, 2023
    Configuration menu
    Copy the full SHA
    96408be View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. Configuration menu
    Copy the full SHA
    b7145dd View commit details
    Browse the repository at this point in the history
  2. add NippyJarWriter

    joshieDo committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    b4271e1 View commit details
    Browse the repository at this point in the history
  3. add consistency check

    joshieDo committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    d3a8051 View commit details
    Browse the repository at this point in the history
  4. fmt

    joshieDo committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    9189c18 View commit details
    Browse the repository at this point in the history
  5. clippy

    joshieDo committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    62131f2 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. fix some function names

    joshieDo committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    299bfc8 View commit details
    Browse the repository at this point in the history
  2. change append_rows docs

    joshieDo committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    05c5caf View commit details
    Browse the repository at this point in the history
  3. use asref [u8] instead

    joshieDo committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    d65b1fc View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    fc86307 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    53afb76 View commit details
    Browse the repository at this point in the history
  6. clippy

    joshieDo committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    4d86bdb View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. Configuration menu
    Copy the full SHA
    42526ea View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    43290a5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    612ee17 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d86575d View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d155996 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    56a2a74 View commit details
    Browse the repository at this point in the history
  7. feat(snapshots): refactor snapshot data access (#5583)

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
    joshieDo and mattsse authored Dec 12, 2023
    Configuration menu
    Copy the full SHA
    0dffeb8 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    a026fd4 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    5e9a3f8 View commit details
    Browse the repository at this point in the history
  10. rename to writer

    joshieDo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    ee87ea2 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    82714d6 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    ede4bd5 View commit details
    Browse the repository at this point in the history
  13. fmt

    joshieDo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    d827ef5 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    0b3c541 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Configuration menu
    Copy the full SHA
    b1bf9ff View commit details
    Browse the repository at this point in the history
  2. whitespace

    joshieDo committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    60c2852 View commit details
    Browse the repository at this point in the history
  3. review fixes

    joshieDo committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    2517658 View commit details
    Browse the repository at this point in the history
  4. smol fix

    joshieDo committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    b6e260e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b355de0 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. use from_mut for jar writer

    joshieDo committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    f795252 View commit details
    Browse the repository at this point in the history
  2. clippy

    joshieDo committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    abb79c1 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. Configuration menu
    Copy the full SHA
    4c9d014 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    457fcfd View commit details
    Browse the repository at this point in the history
  3. feat: DatabaseProvider delegates to SnapshotProvider on different…

    … providers
    
    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    31d8ab6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4c71964 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f68f03b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    89bd906 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    4cf80c7 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    16db801 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    69d8691 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    eccd512 View commit details
    Browse the repository at this point in the history
  11. Update crates/storage/nippy-jar/src/writer.rs

    Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
    joshieDo and onbjerg authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    54831d8 View commit details
    Browse the repository at this point in the history
  12. Update crates/storage/nippy-jar/src/writer.rs

    Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
    joshieDo and onbjerg authored Dec 15, 2023
    Configuration menu
    Copy the full SHA
    54b4877 View commit details
    Browse the repository at this point in the history
  13. use sync_all

    joshieDo committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    4ecfcf2 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    aad40d4 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    144c28b View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    6a33e75 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. Configuration menu
    Copy the full SHA
    ae79086 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    30a35c2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d458a51 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    0d3dc0a View commit details
    Browse the repository at this point in the history
  5. add missing stage error

    joshieDo committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    5e720d1 View commit details
    Browse the repository at this point in the history
  6. fix rename

    joshieDo committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    365468d View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8732595 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. chore(nippy-jar): clippy (#5818)

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
    shekhirin and mattsse authored Dec 20, 2023
    Configuration menu
    Copy the full SHA
    436e606 View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. Configuration menu
    Copy the full SHA
    c58d6a5 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. feat: remove tx_range from filename (#5823)

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 2, 2024
    Configuration menu
    Copy the full SHA
    5be02b8 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Configuration menu
    Copy the full SHA
    8f80230 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b475eae View commit details
    Browse the repository at this point in the history
  3. handle empty blocks

    joshieDo committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    579da38 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c9c8a9f View commit details
    Browse the repository at this point in the history
  5. remove debug_assert

    joshieDo committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    882bd98 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    79a789f View commit details
    Browse the repository at this point in the history
  7. revert test change

    joshieDo committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    a89fdde View commit details
    Browse the repository at this point in the history
  8. minor changes

    joshieDo committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    a32a017 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. fix clippy

    joshieDo committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    ffdc327 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    81635e3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    de73878 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    63c3b15 View commit details
    Browse the repository at this point in the history
  5. clippy

    joshieDo committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    50e4073 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    df3e020 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2024

  1. commit on truncate

    joshieDo committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    d72035d View commit details
    Browse the repository at this point in the history
  2. add more docs and CowJar

    joshieDo committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    d9d41cb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    20039a3 View commit details
    Browse the repository at this point in the history
  4. add a test set_block_range

    joshieDo committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    3d0a14f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    aa269f2 View commit details
    Browse the repository at this point in the history
  6. refactor update_index

    joshieDo committed Jan 15, 2024
    Configuration menu
    Copy the full SHA
    3a183cf View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    9d62f7d View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. Configuration menu
    Copy the full SHA
    464632a View commit details
    Browse the repository at this point in the history
  2. fix cargo docs

    joshieDo committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    cc02564 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. fix bug on unwind to 0

    joshieDo committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    5e5c6cf View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8a21242 View commit details
    Browse the repository at this point in the history
  3. Update crates/interfaces/src/provider.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    7ab3287 View commit details
    Browse the repository at this point in the history
  4. Update crates/storage/provider/src/providers/snapshot/manager.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    61e9f22 View commit details
    Browse the repository at this point in the history
  5. Update crates/stages/src/error.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    8dcd208 View commit details
    Browse the repository at this point in the history
  6. Update crates/primitives/src/snapshot/segment.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    4cf39f2 View commit details
    Browse the repository at this point in the history
  7. Update crates/stages/src/error.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    c416918 View commit details
    Browse the repository at this point in the history
  8. Update crates/stages/src/error.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    a5552ff View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    1517133 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    c6daaee View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    f09aeae View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    586287c View commit details
    Browse the repository at this point in the history
  13. fix parse_filename doc

    joshieDo committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    fcf79ab View commit details
    Browse the repository at this point in the history
  14. replace OsString with str

    joshieDo committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    68c77dd View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    d55c9f7 View commit details
    Browse the repository at this point in the history
  16. Update crates/primitives/src/snapshot/segment.rs

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    joshieDo and shekhirin authored Jan 17, 2024
    Configuration menu
    Copy the full SHA
    0bc9b91 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    dd749fc View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. doc prune_transactions

    joshieDo committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    2a5fc4f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    782f7e3 View commit details
    Browse the repository at this point in the history
  3. entry API on get_writer

    joshieDo committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    b21950b View commit details
    Browse the repository at this point in the history
  4. add more doc on update_index

    joshieDo committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    957a6e1 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. Configuration menu
    Copy the full SHA
    bff7550 View commit details
    Browse the repository at this point in the history
  2. writer -> get_writer

    shekhirin committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    ada94d8 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. Configuration menu
    Copy the full SHA
    a435c69 View commit details
    Browse the repository at this point in the history
  2. Update crates/interfaces/src/provider.rs

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
    joshieDo and mattsse authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    e3fb7f0 View commit details
    Browse the repository at this point in the history
  3. Update crates/primitives/src/snapshot/mod.rs

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
    joshieDo and mattsse authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    7d2ee4f View commit details
    Browse the repository at this point in the history
  4. add track_caller

    joshieDo committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    3912102 View commit details
    Browse the repository at this point in the history
  5. fmt

    joshieDo committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    70e7cc4 View commit details
    Browse the repository at this point in the history
  6. feat(snapshot, prune): transactions (#6122)

    Co-authored-by: joshieDo <ranriver@protonmail.com>
    shekhirin and joshieDo authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    a113e99 View commit details
    Browse the repository at this point in the history