Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

E3: Prune TotalDifficulty canonical markers #11809

Merged
merged 5 commits into from
Sep 6, 2024
Merged

E3: Prune TotalDifficulty canonical markers #11809

merged 5 commits into from
Sep 6, 2024

Conversation

Giulio2002
Copy link
Contributor

@Giulio2002 Giulio2002 commented Aug 30, 2024

@Giulio2002 Giulio2002 marked this pull request as draft August 30, 2024 14:55
@Giulio2002 Giulio2002 marked this pull request as ready for review September 4, 2024 19:31
@yperbasis yperbasis merged commit a273520 into main Sep 6, 2024
19 checks passed
@yperbasis yperbasis deleted the prune-td branch September 6, 2024 08:27
@AskAlexSharov
Copy link
Collaborator

AskAlexSharov commented Sep 7, 2024

@Giulio2002 not sure if it's related. I see on bor-mainnet:

[INFO] [09-07|06:31:22.708] [2/9 Headers] Waiting for headers...     from=61513999 hash=0x25530d4579281e7754b1e5350aaffd7597305d8b447cf82dd12c9085ce91a23f
[EROR] [09-07|06:31:22.708] Staged Sync                              err="[2/9 Headers] [2/9 Headers] parent's total difficulty not found with hash e55f3971a5eff24b353c11ef1cdd14eaee0957463b79d3fcd56dd9a7034b798c and height 61514999 for header 83c2a556212f8d66ca1571e81c905adaf86043a9ceabc177cd19fc83d63b55a9 61515000: <nil>"

print_stages:

INFO[09-07|06:34:40.393] [snapshots:blocks] Stat                  blocks=61.51M indices=61.51M alloc=16.8GB sys=17.8GB
INFO[09-07|06:34:40.394] [snapshots:bor] Stat                     blocks=61.51M indices=61.51M alloc=16.8GB sys=17.8GB
INFO[09-07|06:34:40.395] [snapshots:history] Stat                 blocks=61.47M txs=4.52B txNum2blockNum="2048=49361K,2560=56030K,2816=59892K,2880=61162K,2896=61475K" first_history_idx_in_db=0 last_comitment_block=61475102 last_comitment_tx_num=4525000000 alloc=16.8GB sys=17.8GB
Note: prune_at doesn't mean 'all data before were deleted' - it just mean stage.Prune function were run to this block. Because 1 stage may prune multiple data types to different prune distance.

 			 stage_at 	 prune_at
OtterSync 		 61513999 	 0
Headers 		 61513999 	 0
BorHeimdall 		 0 		 0
PolygonSync 		 0 		 0
BlockHashes 		 61513999 	 0
Bodies 			 61513999 	 0
Senders 		 61513999 	 0
Execution 		 0 		 0
CustomTrace 		 0 		 0
Translation 		 0 		 0
TxLookup 		 0 		 0
Finish 			 0 		 0
--
prune distance:

blocks: segments=61513999, indices=61513999
blocks.bor: segments=61513999, indices=61513999

state.history: idx steps: 0.00, TxNums_Index(61513999,4528375274), filesAmount: [10 9 9 9 46 46 46 46]

sequence: EthTx=4528375275

in db: first header 0, last header 0, first body 0, last body 0
--

seems i found reason and solution. transactions.seg didn't exists:

ls /erigon-data/snapshots/v1-06151*seg
/erigon-data/snapshots/v1-061514-061515-bodies.seg
/erigon-data/snapshots/v1-061514-061515-headers.seg

and

rm /erigon-data/snapshots/v1-06151*

solved problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants