Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Start v0.36.0 nightly releases #3810

Merged
merged 1 commit into from
Mar 1, 2022
Merged

Conversation

dapplion
Copy link
Contributor

@dapplion dapplion commented Feb 28, 2022

@codecov
Copy link

codecov bot commented Feb 28, 2022

Codecov Report

Merging #3810 (606c929) into master (62b2092) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3810   +/-   ##
=======================================
  Coverage   36.82%   36.82%           
=======================================
  Files         324      324           
  Lines        8870     8870           
  Branches     1385     1385           
=======================================
  Hits         3266     3266           
  Misses       5461     5461           
  Partials      143      143           

@github-actions
Copy link
Contributor

Performance Report

✔️ no performance regression detected

🚀🚀 Significant benchmark improvement detected

Benchmark suite Current: fc7b9e2 Previous: 62b2092 Ratio
array of 16000 items push then shift 3.1572 us/op 51.572 us/op 0.06
array of 24000 items push then shift 4.5594 us/op 77.337 us/op 0.06
Full benchmark results
Benchmark suite Current: fc7b9e2 Previous: 62b2092 Ratio
BeaconState.hashTreeRoot - No change 565.00 ns/op 658.00 ns/op 0.86
BeaconState.hashTreeRoot - 1 full validator 80.114 us/op 91.352 us/op 0.88
BeaconState.hashTreeRoot - 32 full validator 1.1830 ms/op 1.2924 ms/op 0.92
BeaconState.hashTreeRoot - 512 full validator 15.846 ms/op 17.166 ms/op 0.92
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 83.209 us/op 89.788 us/op 0.93
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.4129 ms/op 1.6283 ms/op 0.87
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 21.584 ms/op 18.589 ms/op 1.16
BeaconState.hashTreeRoot - 1 balances 56.473 us/op 66.618 us/op 0.85
BeaconState.hashTreeRoot - 32 balances 494.83 us/op 583.13 us/op 0.85
BeaconState.hashTreeRoot - 512 balances 4.9528 ms/op 5.5362 ms/op 0.89
BeaconState.hashTreeRoot - 250000 balances 97.448 ms/op 102.05 ms/op 0.95
processSlot - 1 slots 42.540 us/op 42.988 us/op 0.99
processSlot - 32 slots 2.1263 ms/op 2.2535 ms/op 0.94
getCommitteeAssignments - req 1 vs - 250000 vc 5.2742 ms/op 5.2958 ms/op 1.00
getCommitteeAssignments - req 100 vs - 250000 vc 7.3082 ms/op 7.9403 ms/op 0.92
getCommitteeAssignments - req 1000 vs - 250000 vc 7.8101 ms/op 8.3777 ms/op 0.93
computeProposers - vc 250000 21.586 ms/op 22.131 ms/op 0.98
computeEpochShuffling - vc 250000 191.66 ms/op 207.11 ms/op 0.93
getNextSyncCommittee - vc 250000 349.15 ms/op 364.91 ms/op 0.96
altair processAttestation - 250000 vs - 7PWei normalcase 29.084 ms/op 26.003 ms/op 1.12
altair processAttestation - 250000 vs - 7PWei worstcase 34.195 ms/op 30.458 ms/op 1.12
altair processAttestation - setStatus - 1/6 committees join 11.150 ms/op 9.8285 ms/op 1.13
altair processAttestation - setStatus - 1/3 committees join 22.753 ms/op 20.409 ms/op 1.11
altair processAttestation - setStatus - 1/2 committees join 34.816 ms/op 31.531 ms/op 1.10
altair processAttestation - setStatus - 2/3 committees join 45.616 ms/op 37.182 ms/op 1.23
altair processAttestation - setStatus - 4/5 committees join 55.708 ms/op 43.926 ms/op 1.27
altair processAttestation - setStatus - 100% committees join 71.498 ms/op 56.514 ms/op 1.27
altair processAttestation - updateEpochParticipants - 1/6 committees join 11.527 ms/op 10.352 ms/op 1.11
altair processAttestation - updateEpochParticipants - 1/3 committees join 26.172 ms/op 19.986 ms/op 1.31
altair processAttestation - updateEpochParticipants - 1/2 committees join 24.529 ms/op 16.922 ms/op 1.45
altair processAttestation - updateEpochParticipants - 2/3 committees join 22.475 ms/op 18.164 ms/op 1.24
altair processAttestation - updateEpochParticipants - 4/5 committees join 23.448 ms/op 20.637 ms/op 1.14
altair processAttestation - updateEpochParticipants - 100% committees join 47.247 ms/op 19.488 ms/op 2.42
altair processAttestation - updateAllStatus 17.770 ms/op 17.709 ms/op 1.00
altair processBlock - 250000 vs - 7PWei normalcase 31.036 ms/op 27.237 ms/op 1.14
altair processBlock - 250000 vs - 7PWei worstcase 98.888 ms/op 100.71 ms/op 0.98
altair processEpoch - mainnet_e81889 799.78 ms/op 754.42 ms/op 1.06
mainnet_e81889 - altair beforeProcessEpoch 322.24 ms/op 241.75 ms/op 1.33
mainnet_e81889 - altair processJustificationAndFinalization 68.862 us/op 49.261 us/op 1.40
mainnet_e81889 - altair processInactivityUpdates 18.061 ms/op 15.213 ms/op 1.19
mainnet_e81889 - altair processRewardsAndPenalties 96.814 ms/op 116.02 ms/op 0.83
mainnet_e81889 - altair processRegistryUpdates 10.952 us/op 4.3980 us/op 2.49
mainnet_e81889 - altair processSlashings 1.8540 us/op 820.00 ns/op 2.26
mainnet_e81889 - altair processEth1DataReset 1.8900 us/op 841.00 ns/op 2.25
mainnet_e81889 - altair processEffectiveBalanceUpdates 6.7663 ms/op 5.5572 ms/op 1.22
mainnet_e81889 - altair processSlashingsReset 14.201 us/op 8.8390 us/op 1.61
mainnet_e81889 - altair processRandaoMixesReset 21.092 us/op 19.152 us/op 1.10
mainnet_e81889 - altair processHistoricalRootsUpdate 1.7250 us/op 1.5130 us/op 1.14
mainnet_e81889 - altair processParticipationFlagUpdates 71.057 ms/op 69.044 ms/op 1.03
mainnet_e81889 - altair processSyncCommitteeUpdates 1.0510 us/op 1.0130 us/op 1.04
mainnet_e81889 - altair afterProcessEpoch 225.88 ms/op 248.10 ms/op 0.91
altair processInactivityUpdates - 250000 normalcase 68.969 ms/op 71.313 ms/op 0.97
altair processInactivityUpdates - 250000 worstcase 68.131 ms/op 60.908 ms/op 1.12
altair processParticipationFlagUpdates - 250000 anycase 66.739 ms/op 56.007 ms/op 1.19
altair processRewardsAndPenalties - 250000 normalcase 86.856 ms/op 73.039 ms/op 1.19
altair processRewardsAndPenalties - 250000 worstcase 102.31 ms/op 78.609 ms/op 1.30
altair processSyncCommitteeUpdates - 250000 352.81 ms/op 383.61 ms/op 0.92
Tree 40 250000 create 615.99 ms/op 602.31 ms/op 1.02
Tree 40 250000 get(125000) 323.93 ns/op 269.80 ns/op 1.20
Tree 40 250000 set(125000) 1.9860 us/op 1.8463 us/op 1.08
Tree 40 250000 toArray() 41.049 ms/op 33.469 ms/op 1.23
Tree 40 250000 iterate all - toArray() + loop 42.856 ms/op 34.059 ms/op 1.26
Tree 40 250000 iterate all - get(i) 123.56 ms/op 114.93 ms/op 1.08
MutableVector 250000 create 21.029 ms/op 17.299 ms/op 1.22
MutableVector 250000 get(125000) 13.063 ns/op 11.727 ns/op 1.11
MutableVector 250000 set(125000) 567.93 ns/op 466.46 ns/op 1.22
MutableVector 250000 toArray() 8.6807 ms/op 7.3043 ms/op 1.19
MutableVector 250000 iterate all - toArray() + loop 8.8516 ms/op 7.3771 ms/op 1.20
MutableVector 250000 iterate all - get(i) 3.4751 ms/op 2.7313 ms/op 1.27
Array 250000 create 5.5508 ms/op 4.6729 ms/op 1.19
Array 250000 clone - spread 2.0327 ms/op 2.1678 ms/op 0.94
Array 250000 get(125000) 1.0130 ns/op 1.2140 ns/op 0.83
Array 250000 set(125000) 1.0050 ns/op 1.2160 ns/op 0.83
Array 250000 iterate all - loop 167.86 us/op 164.72 us/op 1.02
effectiveBalanceIncrements clone Uint8Array 300000 71.751 us/op 173.18 us/op 0.41
effectiveBalanceIncrements clone MutableVector 300000 529.00 ns/op 547.00 ns/op 0.97
effectiveBalanceIncrements rw all Uint8Array 300000 301.84 us/op 182.10 us/op 1.66
effectiveBalanceIncrements rw all MutableVector 300000 171.19 ms/op 128.60 ms/op 1.33
aggregationBits - 2048 els - readonlyValues 176.57 us/op 150.65 us/op 1.17
aggregationBits - 2048 els - zipIndexesInBitList 32.936 us/op 25.940 us/op 1.27
regular array get 100000 times 67.442 us/op 65.814 us/op 1.02
wrappedArray get 100000 times 67.385 us/op 61.980 us/op 1.09
arrayWithProxy get 100000 times 31.995 ms/op 33.526 ms/op 0.95
ssz.Root.equals 1.0710 us/op 1.2450 us/op 0.86
ssz.Root.equals with valueOf() 1.2790 us/op 1.3970 us/op 0.92
byteArrayEquals with valueOf() 1.2770 us/op 1.3850 us/op 0.92
phase0 processBlock - 250000 vs - 7PWei normalcase 7.8409 ms/op 7.2352 ms/op 1.08
phase0 processBlock - 250000 vs - 7PWei worstcase 72.934 ms/op 76.173 ms/op 0.96
phase0 afterProcessEpoch - 250000 vs - 7PWei 206.65 ms/op 228.38 ms/op 0.90
phase0 beforeProcessEpoch - 250000 vs - 7PWei 546.87 ms/op 431.55 ms/op 1.27
phase0 processEpoch - mainnet_e58758 783.02 ms/op 690.91 ms/op 1.13
mainnet_e58758 - phase0 beforeProcessEpoch 430.83 ms/op 336.32 ms/op 1.28
mainnet_e58758 - phase0 processJustificationAndFinalization 84.400 us/op 48.351 us/op 1.75
mainnet_e58758 - phase0 processRewardsAndPenalties 113.56 ms/op 82.448 ms/op 1.38
mainnet_e58758 - phase0 processRegistryUpdates 55.572 us/op 29.153 us/op 1.91
mainnet_e58758 - phase0 processSlashings 1.7280 us/op 813.00 ns/op 2.13
mainnet_e58758 - phase0 processEth1DataReset 1.7020 us/op 879.00 ns/op 1.94
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 5.4126 ms/op 4.5278 ms/op 1.20
mainnet_e58758 - phase0 processSlashingsReset 11.894 us/op 5.4610 us/op 2.18
mainnet_e58758 - phase0 processRandaoMixesReset 18.460 us/op 8.2960 us/op 2.23
mainnet_e58758 - phase0 processHistoricalRootsUpdate 1.5820 us/op 947.00 ns/op 1.67
mainnet_e58758 - phase0 processParticipationRecordUpdates 12.180 us/op 6.6000 us/op 1.85
mainnet_e58758 - phase0 afterProcessEpoch 182.02 ms/op 203.52 ms/op 0.89
phase0 processEffectiveBalanceUpdates - 250000 normalcase 6.2798 ms/op 5.3503 ms/op 1.17
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 6.4463 ms/op 5.4759 ms/op 1.18
phase0 processRegistryUpdates - 250000 normalcase 58.542 us/op 47.590 us/op 1.23
phase0 processRegistryUpdates - 250000 badcase_full_deposits 3.0657 ms/op 2.9576 ms/op 1.04
phase0 processRegistryUpdates - 250000 worstcase 0.5 1.6115 s/op 1.3993 s/op 1.15
phase0 getAttestationDeltas - 250000 normalcase 13.278 ms/op 11.763 ms/op 1.13
phase0 getAttestationDeltas - 250000 worstcase 13.367 ms/op 11.981 ms/op 1.12
phase0 processSlashings - 250000 worstcase 34.965 ms/op 29.194 ms/op 1.20
shuffle list - 16384 els 13.040 ms/op 14.195 ms/op 0.92
shuffle list - 250000 els 187.90 ms/op 206.63 ms/op 0.91
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 464.39 us/op 461.74 us/op 1.01
pass gossip attestations to forkchoice per slot 14.429 ms/op 13.775 ms/op 1.05
computeDeltas 3.6187 ms/op 3.2009 ms/op 1.13
computeProposerBoostScoreFromBalances 502.76 us/op 452.30 us/op 1.11
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 1.8952 ms/op 1.8892 ms/op 1.00
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 674.66 us/op 585.58 us/op 1.15
BLS verify - blst-native 1.8583 ms/op 2.1835 ms/op 0.85
BLS verifyMultipleSignatures 3 - blst-native 3.8245 ms/op 4.5109 ms/op 0.85
BLS verifyMultipleSignatures 8 - blst-native 8.2466 ms/op 9.7692 ms/op 0.84
BLS verifyMultipleSignatures 32 - blst-native 29.938 ms/op 35.516 ms/op 0.84
BLS aggregatePubkeys 32 - blst-native 40.226 us/op 46.471 us/op 0.87
BLS aggregatePubkeys 128 - blst-native 154.01 us/op 181.45 us/op 0.85
getAttestationsForBlock 60.057 ms/op 59.595 ms/op 1.01
CheckpointStateCache - add get delete 17.793 us/op 17.053 us/op 1.04
validate gossip signedAggregateAndProof - struct 4.4981 ms/op 5.3807 ms/op 0.84
validate gossip signedAggregateAndProof - treeBacked 4.4179 ms/op 5.1572 ms/op 0.86
validate gossip attestation - struct 2.0868 ms/op 2.4447 ms/op 0.85
validate gossip attestation - treeBacked 2.1046 ms/op 2.4431 ms/op 0.86
pickEth1Vote - no votes 8.4558 ms/op 7.7449 ms/op 1.09
pickEth1Vote - max votes 51.304 ms/op 42.542 ms/op 1.21
pickEth1Vote - Eth1Data hashTreeRoot value x2048 25.232 ms/op 27.413 ms/op 0.92
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 9.6386 ms/op 10.169 ms/op 0.95
pickEth1Vote - Eth1Data fastSerialize value x2048 5.0863 ms/op 4.3419 ms/op 1.17
pickEth1Vote - Eth1Data fastSerialize tree x2048 23.760 ms/op 20.748 ms/op 1.15
bytes32 toHexString 1.6560 us/op 1.7260 us/op 0.96
bytes32 Buffer.toString(hex) 659.00 ns/op 759.00 ns/op 0.87
bytes32 Buffer.toString(hex) from Uint8Array 881.00 ns/op 1.0260 us/op 0.86
bytes32 Buffer.toString(hex) + 0x 656.00 ns/op 755.00 ns/op 0.87
Object access 1 prop 0.31300 ns/op 0.39700 ns/op 0.79
Map access 1 prop 0.29300 ns/op 0.34500 ns/op 0.85
Object get x1000 18.517 ns/op 11.309 ns/op 1.64
Map get x1000 1.0610 ns/op 0.97400 ns/op 1.09
Object set x1000 104.77 ns/op 71.956 ns/op 1.46
Map set x1000 63.416 ns/op 47.671 ns/op 1.33
Return object 10000 times 0.37650 ns/op 0.44730 ns/op 0.84
Throw Error 10000 times 5.8485 us/op 6.0231 us/op 0.97
enrSubnets - fastDeserialize 64 bits 1.2450 us/op 1.3900 us/op 0.90
enrSubnets - ssz BitVector 64 bits 16.638 us/op 17.392 us/op 0.96
enrSubnets - fastDeserialize 4 bits 441.00 ns/op 493.00 ns/op 0.89
enrSubnets - ssz BitVector 4 bits 2.9100 us/op 3.0390 us/op 0.96
RateTracker 1000000 limit, 1 obj count per request 176.16 ns/op 175.32 ns/op 1.00
RateTracker 1000000 limit, 2 obj count per request 130.39 ns/op 127.79 ns/op 1.02
RateTracker 1000000 limit, 4 obj count per request 105.96 ns/op 105.80 ns/op 1.00
RateTracker 1000000 limit, 8 obj count per request 94.935 ns/op 93.641 ns/op 1.01
RateTracker with prune 3.7180 us/op 3.6550 us/op 1.02
array of 16000 items push then shift 3.1572 us/op 51.572 us/op 0.06
LinkedList of 16000 items push then shift 18.043 ns/op 11.606 ns/op 1.55
array of 16000 items push then pop 191.64 ns/op 176.17 ns/op 1.09
LinkedList of 16000 items push then pop 17.064 ns/op 11.188 ns/op 1.53
array of 24000 items push then shift 4.5594 us/op 77.337 us/op 0.06
LinkedList of 24000 items push then shift 20.297 ns/op 11.861 ns/op 1.71
array of 24000 items push then pop 177.87 ns/op 173.30 ns/op 1.03
LinkedList of 24000 items push then pop 18.349 ns/op 11.255 ns/op 1.63

by benchmarkbot/action

@wemeetagain wemeetagain merged commit e734bb9 into master Mar 1, 2022
@wemeetagain wemeetagain deleted the dapplion/start-v0.36.0 branch March 1, 2022 15:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants