Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update mainnet shadow fork 6 and ropsten configs and images #4132

Merged
merged 4 commits into from
Jun 8, 2022

Conversation

g11tech
Copy link
Contributor

@g11tech g11tech commented Jun 8, 2022

Motivation
Update mainnet shadow fork 6 and ropsten config and images

@g11tech g11tech requested a review from a team as a code owner June 8, 2022 13:39
@github-actions
Copy link
Contributor

github-actions bot commented Jun 8, 2022

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 4163dc5 Previous: 8015aba Ratio
altair processAttestation - 250000 vs - 7PWei normalcase 3.3737 ms/op 3.6847 ms/op 0.92
altair processAttestation - 250000 vs - 7PWei worstcase 5.5130 ms/op 6.0480 ms/op 0.91
altair processAttestation - setStatus - 1/6 committees join 194.79 us/op 221.14 us/op 0.88
altair processAttestation - setStatus - 1/3 committees join 369.68 us/op 427.45 us/op 0.86
altair processAttestation - setStatus - 1/2 committees join 502.72 us/op 584.72 us/op 0.86
altair processAttestation - setStatus - 2/3 committees join 617.37 us/op 755.33 us/op 0.82
altair processAttestation - setStatus - 4/5 committees join 869.88 us/op 1.0809 ms/op 0.80
altair processAttestation - setStatus - 100% committees join 1.0785 ms/op 1.2114 ms/op 0.89
altair processBlock - 250000 vs - 7PWei normalcase 26.049 ms/op 27.014 ms/op 0.96
altair processBlock - 250000 vs - 7PWei normalcase hashState 33.986 ms/op 36.323 ms/op 0.94
altair processBlock - 250000 vs - 7PWei worstcase 78.326 ms/op 80.967 ms/op 0.97
altair processBlock - 250000 vs - 7PWei worstcase hashState 95.742 ms/op 107.79 ms/op 0.89
phase0 processBlock - 250000 vs - 7PWei normalcase 3.3018 ms/op 3.8537 ms/op 0.86
phase0 processBlock - 250000 vs - 7PWei worstcase 45.969 ms/op 53.748 ms/op 0.86
altair processEth1Data - 250000 vs - 7PWei normalcase 785.89 us/op 802.91 us/op 0.98
Tree 40 250000 create 740.57 ms/op 815.52 ms/op 0.91
Tree 40 250000 get(125000) 258.53 ns/op 294.77 ns/op 0.88
Tree 40 250000 set(125000) 2.2319 us/op 2.6818 us/op 0.83
Tree 40 250000 toArray() 36.204 ms/op 34.369 ms/op 1.05
Tree 40 250000 iterate all - toArray() + loop 33.789 ms/op 35.244 ms/op 0.96
Tree 40 250000 iterate all - get(i) 123.36 ms/op 114.61 ms/op 1.08
MutableVector 250000 create 13.412 ms/op 15.767 ms/op 0.85
MutableVector 250000 get(125000) 11.632 ns/op 15.466 ns/op 0.75
MutableVector 250000 set(125000) 595.81 ns/op 679.49 ns/op 0.88
MutableVector 250000 toArray() 5.3902 ms/op 7.2316 ms/op 0.75
MutableVector 250000 iterate all - toArray() + loop 5.9939 ms/op 7.3809 ms/op 0.81
MutableVector 250000 iterate all - get(i) 2.7629 ms/op 3.4103 ms/op 0.81
Array 250000 create 4.5051 ms/op 6.3535 ms/op 0.71
Array 250000 clone - spread 2.3617 ms/op 3.8775 ms/op 0.61
Array 250000 get(125000) 1.0710 ns/op 1.6730 ns/op 0.64
Array 250000 set(125000) 1.1080 ns/op 1.6870 ns/op 0.66
Array 250000 iterate all - loop 115.03 us/op 173.08 us/op 0.66
effectiveBalanceIncrements clone Uint8Array 300000 57.177 us/op 87.346 us/op 0.65
effectiveBalanceIncrements clone MutableVector 300000 774.00 ns/op 1.2920 us/op 0.60
effectiveBalanceIncrements rw all Uint8Array 300000 228.37 us/op 264.84 us/op 0.86
effectiveBalanceIncrements rw all MutableVector 300000 179.67 ms/op 230.46 ms/op 0.78
phase0 afterProcessEpoch - 250000 vs - 7PWei 171.09 ms/op 228.09 ms/op 0.75
phase0 beforeProcessEpoch - 250000 vs - 7PWei 86.012 ms/op 72.184 ms/op 1.19
altair processEpoch - mainnet_e81889 552.52 ms/op 604.88 ms/op 0.91
mainnet_e81889 - altair beforeProcessEpoch 135.52 ms/op 155.35 ms/op 0.87
mainnet_e81889 - altair processJustificationAndFinalization 64.757 us/op 48.824 us/op 1.33
mainnet_e81889 - altair processInactivityUpdates 10.242 ms/op 11.693 ms/op 0.88
mainnet_e81889 - altair processRewardsAndPenalties 84.183 ms/op 90.387 ms/op 0.93
mainnet_e81889 - altair processRegistryUpdates 14.257 us/op 10.466 us/op 1.36
mainnet_e81889 - altair processSlashings 3.3420 us/op 2.3430 us/op 1.43
mainnet_e81889 - altair processEth1DataReset 3.4170 us/op 2.6760 us/op 1.28
mainnet_e81889 - altair processEffectiveBalanceUpdates 2.0996 ms/op 2.6507 ms/op 0.79
mainnet_e81889 - altair processSlashingsReset 28.350 us/op 14.860 us/op 1.91
mainnet_e81889 - altair processRandaoMixesReset 26.059 us/op 13.949 us/op 1.87
mainnet_e81889 - altair processHistoricalRootsUpdate 4.8570 us/op 2.5530 us/op 1.90
mainnet_e81889 - altair processParticipationFlagUpdates 15.969 us/op 9.2890 us/op 1.72
mainnet_e81889 - altair processSyncCommitteeUpdates 4.7880 us/op 2.3150 us/op 2.07
mainnet_e81889 - altair afterProcessEpoch 170.31 ms/op 205.60 ms/op 0.83
phase0 processEpoch - mainnet_e58758 463.58 ms/op 531.32 ms/op 0.87
mainnet_e58758 - phase0 beforeProcessEpoch 218.60 ms/op 204.07 ms/op 1.07
mainnet_e58758 - phase0 processJustificationAndFinalization 58.273 us/op 35.862 us/op 1.62
mainnet_e58758 - phase0 processRewardsAndPenalties 128.37 ms/op 73.781 ms/op 1.74
mainnet_e58758 - phase0 processRegistryUpdates 31.457 us/op 24.321 us/op 1.29
mainnet_e58758 - phase0 processSlashings 3.3100 us/op 2.3180 us/op 1.43
mainnet_e58758 - phase0 processEth1DataReset 3.2860 us/op 2.6400 us/op 1.24
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 2.1575 ms/op 2.2260 ms/op 0.97
mainnet_e58758 - phase0 processSlashingsReset 17.631 us/op 11.138 us/op 1.58
mainnet_e58758 - phase0 processRandaoMixesReset 25.572 us/op 16.015 us/op 1.60
mainnet_e58758 - phase0 processHistoricalRootsUpdate 4.4920 us/op 2.5780 us/op 1.74
mainnet_e58758 - phase0 processParticipationRecordUpdates 27.819 us/op 13.965 us/op 1.99
mainnet_e58758 - phase0 afterProcessEpoch 145.00 ms/op 176.51 ms/op 0.82
phase0 processEffectiveBalanceUpdates - 250000 normalcase 2.1834 ms/op 3.2079 ms/op 0.68
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.1975 ms/op 3.3686 ms/op 0.65
altair processInactivityUpdates - 250000 normalcase 33.832 ms/op 40.389 ms/op 0.84
altair processInactivityUpdates - 250000 worstcase 35.746 ms/op 34.268 ms/op 1.04
phase0 processRegistryUpdates - 250000 normalcase 28.479 us/op 18.612 us/op 1.53
phase0 processRegistryUpdates - 250000 badcase_full_deposits 501.49 us/op 580.46 us/op 0.86
phase0 processRegistryUpdates - 250000 worstcase 0.5 208.70 ms/op 257.25 ms/op 0.81
altair processRewardsAndPenalties - 250000 normalcase 77.339 ms/op 91.987 ms/op 0.84
altair processRewardsAndPenalties - 250000 worstcase 109.35 ms/op 83.592 ms/op 1.31
phase0 getAttestationDeltas - 250000 normalcase 11.789 ms/op 13.913 ms/op 0.85
phase0 getAttestationDeltas - 250000 worstcase 12.457 ms/op 13.943 ms/op 0.89
phase0 processSlashings - 250000 worstcase 6.1480 ms/op 5.9173 ms/op 1.04
altair processSyncCommitteeUpdates - 250000 276.75 ms/op 310.12 ms/op 0.89
BeaconState.hashTreeRoot - No change 578.00 ns/op 644.00 ns/op 0.90
BeaconState.hashTreeRoot - 1 full validator 60.746 us/op 71.109 us/op 0.85
BeaconState.hashTreeRoot - 32 full validator 671.73 us/op 641.97 us/op 1.05
BeaconState.hashTreeRoot - 512 full validator 6.6734 ms/op 7.0634 ms/op 0.94
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 82.044 us/op 83.149 us/op 0.99
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.1888 ms/op 1.2132 ms/op 0.98
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 15.385 ms/op 19.927 ms/op 0.77
BeaconState.hashTreeRoot - 1 balances 61.216 us/op 71.487 us/op 0.86
BeaconState.hashTreeRoot - 32 balances 581.25 us/op 594.66 us/op 0.98
BeaconState.hashTreeRoot - 512 balances 6.0138 ms/op 5.6667 ms/op 1.06
BeaconState.hashTreeRoot - 250000 balances 84.740 ms/op 96.036 ms/op 0.88
aggregationBits - 2048 els - zipIndexesInBitList 25.105 us/op 36.045 us/op 0.70
regular array get 100000 times 48.490 us/op 71.298 us/op 0.68
wrappedArray get 100000 times 47.335 us/op 74.662 us/op 0.63
arrayWithProxy get 100000 times 29.153 ms/op 31.848 ms/op 0.92
ssz.Root.equals 447.00 ns/op 540.00 ns/op 0.83
byteArrayEquals 464.00 ns/op 503.00 ns/op 0.92
shuffle list - 16384 els 9.9908 ms/op 12.659 ms/op 0.79
shuffle list - 250000 els 144.18 ms/op 183.12 ms/op 0.79
processSlot - 1 slots 13.847 us/op 13.812 us/op 1.00
processSlot - 32 slots 1.9069 ms/op 2.1827 ms/op 0.87
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 636.60 us/op 389.17 us/op 1.64
getCommitteeAssignments - req 1 vs - 250000 vc 4.4093 ms/op 5.7686 ms/op 0.76
getCommitteeAssignments - req 100 vs - 250000 vc 7.6273 ms/op 8.3295 ms/op 0.92
getCommitteeAssignments - req 1000 vs - 250000 vc 7.9046 ms/op 9.1023 ms/op 0.87
computeProposers - vc 250000 18.198 ms/op 19.662 ms/op 0.93
computeEpochShuffling - vc 250000 170.78 ms/op 193.73 ms/op 0.88
getNextSyncCommittee - vc 250000 266.71 ms/op 322.89 ms/op 0.83
pass gossip attestations to forkchoice per slot 3.2806 ms/op 5.5296 ms/op 0.59
computeDeltas 3.3662 ms/op 3.7359 ms/op 0.90
computeProposerBoostScoreFromBalances 749.72 us/op 989.17 us/op 0.76
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 1.9530 ms/op 2.2123 ms/op 0.88
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 73.197 us/op 84.870 us/op 0.86
BLS verify - blst-native 1.9287 ms/op 1.9800 ms/op 0.97
BLS verifyMultipleSignatures 3 - blst-native 3.8211 ms/op 3.9620 ms/op 0.96
BLS verifyMultipleSignatures 8 - blst-native 8.0546 ms/op 8.4253 ms/op 0.96
BLS verifyMultipleSignatures 32 - blst-native 29.618 ms/op 31.176 ms/op 0.95
BLS aggregatePubkeys 32 - blst-native 37.541 us/op 40.605 us/op 0.92
BLS aggregatePubkeys 128 - blst-native 156.69 us/op 162.67 us/op 0.96
getAttestationsForBlock 57.976 ms/op 75.013 ms/op 0.77
isKnown best case - 1 super set check 484.00 ns/op 474.00 ns/op 1.02
isKnown normal case - 2 super set checks 453.00 ns/op 472.00 ns/op 0.96
isKnown worse case - 16 super set checks 463.00 ns/op 468.00 ns/op 0.99
CheckpointStateCache - add get delete 11.946 us/op 10.378 us/op 1.15
validate gossip signedAggregateAndProof - struct 4.5682 ms/op 4.6573 ms/op 0.98
validate gossip attestation - struct 2.0364 ms/op 2.1507 ms/op 0.95
altair verifyImport mainnet_s3766816:31 6.1995 s/op 6.7320 s/op 0.92
pickEth1Vote - no votes 2.0590 ms/op 2.3050 ms/op 0.89
pickEth1Vote - max votes 21.178 ms/op 26.987 ms/op 0.78
pickEth1Vote - Eth1Data hashTreeRoot value x2048 11.566 ms/op 13.092 ms/op 0.88
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 20.221 ms/op 21.601 ms/op 0.94
pickEth1Vote - Eth1Data fastSerialize value x2048 1.4548 ms/op 1.6863 ms/op 0.86
pickEth1Vote - Eth1Data fastSerialize tree x2048 16.415 ms/op 21.187 ms/op 0.77
bytes32 toHexString 940.00 ns/op 1.1260 us/op 0.83
bytes32 Buffer.toString(hex) 681.00 ns/op 750.00 ns/op 0.91
bytes32 Buffer.toString(hex) from Uint8Array 847.00 ns/op 1.0330 us/op 0.82
bytes32 Buffer.toString(hex) + 0x 644.00 ns/op 688.00 ns/op 0.94
Object access 1 prop 0.32200 ns/op 0.39500 ns/op 0.82
Map access 1 prop 0.26900 ns/op 0.30800 ns/op 0.87
Object get x1000 13.437 ns/op 18.036 ns/op 0.75
Map get x1000 0.76700 ns/op 1.0480 ns/op 0.73
Object set x1000 87.989 ns/op 128.81 ns/op 0.68
Map set x1000 66.429 ns/op 82.342 ns/op 0.81
Return object 10000 times 0.35120 ns/op 0.40490 ns/op 0.87
Throw Error 10000 times 5.8736 us/op 6.2353 us/op 0.94
enrSubnets - fastDeserialize 64 bits 2.3570 us/op 2.8200 us/op 0.84
enrSubnets - ssz BitVector 64 bits 688.00 ns/op 784.00 ns/op 0.88
enrSubnets - fastDeserialize 4 bits 340.00 ns/op 418.00 ns/op 0.81
enrSubnets - ssz BitVector 4 bits 692.00 ns/op 815.00 ns/op 0.85
prioritizePeers score -10:0 att 32-0.1 sync 2-0 85.972 us/op 101.84 us/op 0.84
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 123.85 us/op 140.43 us/op 0.88
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 226.12 us/op 230.17 us/op 0.98
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 487.20 us/op 437.78 us/op 1.11
prioritizePeers score 0:0 att 64-1 sync 4-1 477.42 us/op 526.53 us/op 0.91
RateTracker 1000000 limit, 1 obj count per request 161.14 ns/op 204.43 ns/op 0.79
RateTracker 1000000 limit, 2 obj count per request 124.84 ns/op 151.43 ns/op 0.82
RateTracker 1000000 limit, 4 obj count per request 100.36 ns/op 125.30 ns/op 0.80
RateTracker 1000000 limit, 8 obj count per request 88.198 ns/op 113.91 ns/op 0.77
RateTracker with prune 4.1990 us/op 4.4640 us/op 0.94
array of 16000 items push then shift 4.5113 us/op 3.3991 us/op 1.33
LinkedList of 16000 items push then shift 20.763 ns/op 26.529 ns/op 0.78
array of 16000 items push then pop 235.44 ns/op 264.21 ns/op 0.89
LinkedList of 16000 items push then pop 19.313 ns/op 22.250 ns/op 0.87
array of 24000 items push then shift 7.1052 us/op 5.0331 us/op 1.41
LinkedList of 24000 items push then shift 22.230 ns/op 26.009 ns/op 0.85
array of 24000 items push then pop 184.71 ns/op 209.81 ns/op 0.88
LinkedList of 24000 items push then pop 18.237 ns/op 23.049 ns/op 0.79
intersect bitArray bitLen 8 10.714 ns/op 12.855 ns/op 0.83
intersect array and set length 8 169.29 ns/op 176.71 ns/op 0.96
intersect bitArray bitLen 128 66.524 ns/op 82.128 ns/op 0.81
intersect array and set length 128 2.0757 us/op 2.4345 us/op 0.85

by benchmarkbot/action

@wemeetagain wemeetagain merged commit 719d936 into unstable Jun 8, 2022
@wemeetagain wemeetagain deleted the msf-6 branch June 8, 2022 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants