Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Static Files #6444

Merged
merged 71 commits into from
Feb 27, 2024
Merged

Static Files #6444

merged 71 commits into from
Feb 27, 2024

Commits on Jan 18, 2024

  1. feat: add HeadersTD static file segment (#6118) 

    Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @onbjerg @shekhirin
    3 people authored Jan 18, 2024
    Configuration menu
    Copy the full SHA
    02d01ac View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Revert "feat: add HeadersTD static file segment" (#6210)

    @shekhirin
    shekhirin authored Jan 24, 2024
    Configuration menu
    Copy the full SHA
    8394742 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    9acc7d4 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. feat(snapshots): write to snapshots during BodyStage (#5733) 

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
    @joshieDo @mattsse
    @shekhirin @onbjerg
    4 people authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    3dcb835 View commit details
    Browse the repository at this point in the history

  2. feat: add ETL and use it on HeaderStage (#6154) 

    Co-authored-by: Oliver Nordbjerg <hi@notbjerg.me>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @onbjerg @shekhirin
    3 people authored Jan 26, 2024
    Configuration menu
    Copy the full SHA
    bd26c69 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. fix(stages): division by zero in headers progress (#6262)

    @shekhirin
    shekhirin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    f64d7ab View commit details
    Browse the repository at this point in the history

  2. feat(nippy-jar): use reth_primitives::fs to preserve path in errors (… 

    …#6272)
    @shekhirin
    shekhirin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    5b080eb View commit details
    Browse the repository at this point in the history

  3. feat(snapshots): write Receipt to snapshots during ExecutionStage ( 

    #6103)

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
Co-authored-by: Bjerg <onbjerg@users.noreply.github.com>
    @joshieDo @mattsse
    @shekhirin @onbjerg
    4 people authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    17d94cf View commit details
    Browse the repository at this point in the history

  4. fix(snapshot): block increment for Transactions segment (#6274)

    @shekhirin
    shekhirin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    674c8e0 View commit details
    Browse the repository at this point in the history

  5. feat(snapshot, prune): receipts (#6241)

    @shekhirin
    shekhirin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    4384c78 View commit details
    Browse the repository at this point in the history

  6. feat(snapshot, prune): headers (#6230)

    @shekhirin
    shekhirin authored Jan 29, 2024
    Configuration menu
    Copy the full SHA
    d1c3edb View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. feat(snapshot, stages): snapshot stage (#6248)

    @shekhirin
    shekhirin authored Jan 30, 2024
    Configuration menu
    Copy the full SHA
    9c0838e View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. feat(stages): recover senders for both DB and static file transactions ( 

    #6089)
    @shekhirin
    shekhirin authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    d1abb98 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. feat(primitives): remove snapshot block interval from chain spec (#6312)

    @shekhirin
    shekhirin authored Feb 1, 2024
    Configuration menu
    Copy the full SHA
    e4dd02f View commit details
    Browse the repository at this point in the history

  2. feat(bin): use snapshots in stage run and stage unwind (#6322)

    @shekhirin
    shekhirin authored Feb 1, 2024
    Configuration menu
    Copy the full SHA
    87476e0 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. feat(bin): delete snapshot jars in stage drop (#6307)

    @shekhirin
    shekhirin authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    b499acc View commit details
    Browse the repository at this point in the history

  2. feat(bin): delete snapshot jars in db clear (#6311)

    @shekhirin
    shekhirin authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    3ac6a7d View commit details
    Browse the repository at this point in the history

  3. feat(bin): show snapshots in db stats (#6285)

    @shekhirin
    shekhirin authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    333bc2c View commit details
    Browse the repository at this point in the history

  4. feat(storage): make snapshots non-optional in provider factory (#6344)

    @shekhirin
    shekhirin authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    af32e85 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. feat(snapshots): write Headers to snapshots during HeaderStage (#6273) 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Feb 5, 2024
    Configuration menu
    Copy the full SHA
    1a67329 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    0b264e4 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. remove unused imports

    @shekhirin
    shekhirin committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    b68288c View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. fix(blockchain-tree): query latest canonical hashes from both db and … 

    …snapshots (#6468)
    @shekhirin
    shekhirin authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    07e9c6e View commit details
    Browse the repository at this point in the history

  2. feat: replace RangeInclusive with SegmentRangeInclusive on `Segme… 

    …ntHeader` (#6446)

Co-authored-by: Thomas Coratger <thomas.coratger@gmail.com>
    @joshieDo @tcoratger
    joshieDo and tcoratger authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    ffa64ec View commit details
    Browse the repository at this point in the history

  3. feat: use BufWriter on NippyJarWriter (#6482)

    @joshieDo
    joshieDo authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    d9e0634 View commit details
    Browse the repository at this point in the history

  4. feat(primitives): implement Display for SegmentRangeInclusive (#6488 

    )
    @shekhirin
    shekhirin authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    ad56b98 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    613f319 View commit details
    Browse the repository at this point in the history

  6. feat(bin, snapshot, engine): emit and log snapshotter events (#6490)

    @shekhirin
    shekhirin authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    1238e14 View commit details
    Browse the repository at this point in the history

  7. fix(bin): add snapshot hook to list of hooks (#6492)

    @shekhirin
    shekhirin authored Feb 8, 2024
    Configuration menu
    Copy the full SHA
    8535568 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    802e7ec View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c15e487 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    1cddeda View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 12, 2024
    Configuration menu
    Copy the full SHA
    902e603 View commit details
    Browse the repository at this point in the history

  2. feat(bin): db get for snapshots (#6465)

    @shekhirin
    shekhirin authored Feb 12, 2024
    Configuration menu
    Copy the full SHA
    123fc2f View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. feat(bin): db stats --summary to display totals for snapshots (#6584)

    @shekhirin
    shekhirin authored Feb 13, 2024
    Configuration menu
    Copy the full SHA
    71f0793 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. feat(bin): support headers in stage drop (#6582)

    @shekhirin
    shekhirin authored Feb 14, 2024
    Configuration menu
    Copy the full SHA
    cd3a035 View commit details
    Browse the repository at this point in the history

  2. feat: add lz4 to SnapshotSegment::Headers (#6487)

    @joshieDo
    joshieDo authored Feb 14, 2024
    Configuration menu
    Copy the full SHA
    1eb9181 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. feat: check snapshot range on ProviderFactory (#6608)

    @joshieDo
    joshieDo authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    dfb8c61 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    f1c4a8e View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 17, 2024
    Configuration menu
    Copy the full SHA
    0ddf4c8 View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    d58ed04 View commit details
    Browse the repository at this point in the history

  2. fix lint

    @shekhirin
    shekhirin committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    043f07d View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. feat: add debug! log on static file commit times (#6692) 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Feb 20, 2024
    Configuration menu
    Copy the full SHA
    4cdec90 View commit details
    Browse the repository at this point in the history

  2. feat(snapshot, stages): pass snapshot target per segment (#6673)

    @shekhirin
    shekhirin authored Feb 20, 2024
    Configuration menu
    Copy the full SHA
    64ddcc5 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    ce97ef5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/static-files' of github.com:paradigmxyz/reth into … 

    …feat/static-files
    @joshieDo
    joshieDo committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    2a77e14 View commit details
    Browse the repository at this point in the history

  5. feat: adds parallelization to SenderRecovery and TxLookup using `… 

    …SnapshotProvider` (#6654)

Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @mattsse @shekhirin
    3 people authored Feb 20, 2024
    Configuration menu
    Copy the full SHA
    acecfd3 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. fix: SnapshotProvider edge case scenarios on insertion and query (#… 

    …6707)
    @joshieDo
    joshieDo authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    56ea6d5 View commit details
    Browse the repository at this point in the history

  2. feat(book): update CLI section (#6720)

    @shekhirin
    shekhirin authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    0986681 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    5a871d5 View commit details
    Browse the repository at this point in the history

  2. chore: remove static file commit() from inside the stage (#6717)

    @joshieDo
    joshieDo authored Feb 22, 2024
    Configuration menu
    Copy the full SHA
    b0eda75 View commit details
    Browse the repository at this point in the history

  3. feat(storage): static files metrics (#6736)

    @shekhirin
    shekhirin authored Feb 22, 2024
    Configuration menu
    Copy the full SHA
    3d8c2b0 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    537dac8 View commit details
    Browse the repository at this point in the history

  5. chore: remove TotalDifficulty stage configurations and docs (#6744)

    @joshieDo
    joshieDo authored Feb 22, 2024
    Configuration menu
    Copy the full SHA
    cedd896 View commit details
    Browse the repository at this point in the history

  6. fix: SegmentHeader block range is now an Option<_> (#6738) 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Feb 22, 2024
    Configuration menu
    Copy the full SHA
    1431568 View commit details
    Browse the repository at this point in the history

  7. feat: add ETL to TxLookup stage (#6655) 

    Co-authored-by: Matthias Seitz <matthias.seitz@outlook.de>
Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @mattsse @shekhirin
    3 people authored Feb 22, 2024
    Configuration menu
    Copy the full SHA
    aeaabfb View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. chore: rename from snapshot to static file terminology (#6758) 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Feb 23, 2024
    Configuration menu
    Copy the full SHA
    0a6e95c View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. feat(pruner, static-file, node-core): add Started events (#6769)

    @shekhirin
    shekhirin authored Feb 26, 2024
    Configuration menu
    Copy the full SHA
    b896380 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into feat/static-files

    @shekhirin
    shekhirin committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    5ebff60 View commit details
    Browse the repository at this point in the history

  3. feat(stages): remove static files stage, run before loop (#6763)

    @shekhirin
    shekhirin authored Feb 26, 2024
    Configuration menu
    Copy the full SHA
    81c10b4 View commit details
    Browse the repository at this point in the history

  4. fix: make sure we only prune unfinalized data (wrt hive) (#6788) 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
Co-authored-by: pc <pc@pcs-MacBook-Pro.local>
    @joshieDo @shekhirin
    3 people authored Feb 26, 2024
    Configuration menu
    Copy the full SHA
    17ad869 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. Merge remote-tracking branch 'origin/main' into feat/static-files

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    b9d55c2 View commit details
    Browse the repository at this point in the history

  2. change hive workflow to fork branch

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    40ac848 View commit details
    Browse the repository at this point in the history

  3. change hive workflow to fork branch part 2

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    ea4a4c7 View commit details
    Browse the repository at this point in the history

  4. only start the pruner once the tip block has crossed the min block in… 

    …terval
    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    7249fff View commit details
    Browse the repository at this point in the history

  5. feat(pruner): do not prune on first run if not needed (#6823)

    @shekhirin
    shekhirin authored Feb 27, 2024
    Configuration menu
    Copy the full SHA
    9b81c22 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/breaking-changes' into feat/stat… 

    …ic-files
    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    54ab1fc View commit details
    Browse the repository at this point in the history

  7. rename missing tables

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    a0780a9 View commit details
    Browse the repository at this point in the history

  8. missing random_eoa_accounts rename

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    3fbb837 View commit details
    Browse the repository at this point in the history

  9. fix some merge issues on bin db get & acc hashing bench

    @joshieDo
    joshieDo committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    ce86a03 View commit details
    Browse the repository at this point in the history

  10. fix(static-files): break Arc reference cycle (#6795)

    @shekhirin
    shekhirin authored Feb 27, 2024
    Configuration menu
    Copy the full SHA
    4937c00 View commit details
    Browse the repository at this point in the history