Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: better engine downloads #3584

Merged
merged 5 commits into from
Jul 5, 2023
Merged

perf: better engine downloads #3584

merged 5 commits into from
Jul 5, 2023

Conversation

mattsse
Copy link
Collaborator

@mattsse mattsse commented Jul 4, 2023

extracts a fix from #3416 where downloading would stall because we're already synced to the state.finalized hash.

this also changes the target to the safe hash and decreases the pipeline threshold to 8 blocks

@mattsse mattsse added C-perf A change motivated by improving speed, memory usage or disk footprint A-consensus Related to the consensus engine labels Jul 4, 2023
@mattsse mattsse force-pushed the matt/download-improvements branch from 37a0ae2 to f1a226b Compare July 4, 2023 17:57
@codecov
Copy link

codecov bot commented Jul 4, 2023

Codecov Report

Merging #3584 (212cfdd) into main (7da36e0) will increase coverage by 0.03%.
The diff coverage is 0.00%.

Impacted file tree graph

Impacted Files Coverage Δ
crates/consensus/beacon/src/engine/mod.rs 77.87% <0.00%> (+0.11%) ⬆️

... and 8 files with indirect coverage changes

Flag Coverage Δ
integration-tests 16.12% <0.00%> (+<0.01%) ⬆️
unit-tests 63.98% <0.00%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
reth binary 26.41% <ø> (ø)
blockchain tree 81.25% <ø> (ø)
pipeline 86.91% <ø> (ø)
storage (db) 73.48% <ø> (ø)
trie 95.64% <ø> (ø)
txpool 49.82% <ø> (+0.61%) ⬆️
networking 77.90% <ø> (+0.01%) ⬆️
rpc 57.99% <ø> (-0.02%) ⬇️
consensus 62.63% <0.00%> (+0.04%) ⬆️
revm 34.95% <ø> (ø)
payload builder 6.83% <ø> (ø)
primitives 88.29% <ø> (+0.01%) ⬆️

@rkrasiuk
Copy link
Member

rkrasiuk commented Jul 5, 2023

with #3588 we can keep the threshold and finalized hash

@mattsse
Copy link
Collaborator Author

mattsse commented Jul 5, 2023

cool, I'll just revert these then but keep the other changes

Copy link
Member

@rkrasiuk rkrasiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm module one question

Comment on lines 1144 to 1146
Ok(Some(_)) => {
// we're fully synced to the safe block
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this even reachable? under which conditions? should we still attempt to download the missing parent in this case?

Copy link
Collaborator Author

@mattsse mattsse Jul 5, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes we should still attempt to download, because if we set the threshold to 32 but only check the finalized tag here, then this branch is common.

we need to continue downloading, otherwise it would stall

Copy link
Member

@rkrasiuk rkrasiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@mattsse mattsse enabled auto-merge July 5, 2023 10:21
@mattsse mattsse added this pull request to the merge queue Jul 5, 2023
Merged via the queue into main with commit a932e2f Jul 5, 2023
@mattsse mattsse deleted the matt/download-improvements branch July 5, 2023 11:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-consensus Related to the consensus engine C-perf A change motivated by improving speed, memory usage or disk footprint
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants