Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(snapshots): write Headers to snapshots during HeaderStage #6273

Merged
merged 51 commits into from
Feb 5, 2024
Merged

feat(snapshots): write Headers to snapshots during HeaderStage #6273

merged 51 commits into from
Feb 5, 2024

Commits on Jan 29, 2024

  1. write headers to static files during HeaderStage

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    24b9a1e View commit details
    Browse the repository at this point in the history

  2. get sync gap from the snapshot provider

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    a7132ea View commit details
    Browse the repository at this point in the history

  3. insert_genesis_header writes to static files

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    fd32124 View commit details
    Browse the repository at this point in the history

  4. init_genesis takes a ProviderFactory with snapshots instead

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    5f0d4c6 View commit details
    Browse the repository at this point in the history

  5. append_header uses CompactU256 for td

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    3ed71ee View commit details
    Browse the repository at this point in the history

  6. make sure to commit static file writer on write_headers

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    290f5da View commit details
    Browse the repository at this point in the history

  7. add some docs related to append_X and increment block

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    eee811f View commit details
    Browse the repository at this point in the history

  8. unwind HeaderStage

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    6c50aff View commit details
    Browse the repository at this point in the history

  9. clippy

    @joshieDo
    joshieDo committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    ad6bb26 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. calculate_gas_used_from_headers uses static files

    @joshieDo
    joshieDo committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    debaca4 View commit details
    Browse the repository at this point in the history

  2. change stages test_db to seed to Header static file instead

    @joshieDo
    joshieDo committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    489b582 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/feat/static-files' into feat/hea… 

    …ders-snap-historical
    @joshieDo
    joshieDo committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    c1f5704 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. add warning if mdbx::begin_rw_txn gets stuck waiting rw unlock

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    f8cdc93 View commit details
    Browse the repository at this point in the history

  2. fix deadlock

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    3d2514e View commit details
    Browse the repository at this point in the history

  3. fix header test seed_execution and validation

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    8673d82 View commit details
    Browse the repository at this point in the history

  4. add static file provider to StateProviders

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    155ce6e View commit details
    Browse the repository at this point in the history

  5. get block_hash instead of the whole header

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    b442fee View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/feat/static-files' into feat/hea… 

    …ders-snap-historical
    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    c04e3dc View commit details
    Browse the repository at this point in the history

  7. rm totaldifficulty stage file

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    c988685 View commit details
    Browse the repository at this point in the history

  8. clippy

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    8873287 View commit details
    Browse the repository at this point in the history

  9. change header_sync_gap_lookup test

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    5b20c26 View commit details
    Browse the repository at this point in the history

  10. fix auto mine by adding static headers to fetch_latest_canonical_hashes

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    cc2adfa View commit details
    Browse the repository at this point in the history

  11. remove dbg statement

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    c186a5e View commit details
    Browse the repository at this point in the history

  12. fix range end

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    7ddad97 View commit details
    Browse the repository at this point in the history

  13. clippy

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    78e0ab2 View commit details
    Browse the repository at this point in the history

  14. fix remaining calc

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    8890dc9 View commit details
    Browse the repository at this point in the history

  15. only check header hashes if static files has any

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    4778948 View commit details
    Browse the repository at this point in the history

  16. add temporary snapshots path to beacon engine tests

    @joshieDo
    joshieDo committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    3fda062 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. use tempdir from tempfile

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    9dcf073 View commit details
    Browse the repository at this point in the history

  2. enable test-utils for reth-providers on ef-tests

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    e1647ac View commit details
    Browse the repository at this point in the history

  3. fix fail_init_inconsistent_db test

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    b74b726 View commit details
    Browse the repository at this point in the history

  4. fix prune test

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    d0a14f1 View commit details
    Browse the repository at this point in the history

  5. fix prune tests

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    4b6eb0a View commit details
    Browse the repository at this point in the history

  6. fmt

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    a201af2 View commit details
    Browse the repository at this point in the history

  7. fix bodies stage tests

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    874ae1c View commit details
    Browse the repository at this point in the history

  8. fix merkle stage tests

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    4a36762 View commit details
    Browse the repository at this point in the history

  9. fix update_index when called on the block start of a range without txs

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    ced4432 View commit details
    Browse the repository at this point in the history

  10. fix number of headers to unwind

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    9b0ff57 View commit details
    Browse the repository at this point in the history

  11. remove dbg statement

    @joshieDo
    joshieDo committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    0088ff1 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. Update crates/stages/src/stages/headers.rs 

    Co-authored-by: Alexey Shekhirin <a.shekhirin@gmail.com>
    @joshieDo @shekhirin
    joshieDo and shekhirin authored Feb 2, 2024
    Configuration menu
    Copy the full SHA
    e0668ef View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/feat/static-files' into feat/hea… 

    …ders-snap-historical
    @shekhirin
    shekhirin committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    13382ce View commit details
    Browse the repository at this point in the history

  3. fix snapshotter test

    @shekhirin
    shekhirin committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    94c6d16 View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. make sure we delete the data when pruning all blocks from the first b… 

    …lock range on Headers
    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    132bd00 View commit details
    Browse the repository at this point in the history

  2. no need for &mut self on rows

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    483ae7f View commit details
    Browse the repository at this point in the history

  3. prune len from user header not num_rows

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    c29c100 View commit details
    Browse the repository at this point in the history

  4. Headers segment should not call increment_block before or after appen… 

    …d_header
    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    ed4d768 View commit details
    Browse the repository at this point in the history

  5. fix debug_assert on increment block

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    0210eb9 View commit details
    Browse the repository at this point in the history

  6. temporary/ci: comment fsync

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    f6a8b5e View commit details
    Browse the repository at this point in the history

  7. Revert "temporary/ci: comment fsync" 

    This reverts commit f6a8b5e.
    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    05ad35e View commit details
    Browse the repository at this point in the history

  8. add insert_historical_block

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    b2dfb31 View commit details
    Browse the repository at this point in the history

  9. clippy

    @joshieDo
    joshieDo committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    6c515f5 View commit details
    Browse the repository at this point in the history