test: update spec tests target to v1.4.0-alpha.3

[g11tech]

update version which has non substantive changes for current lodestar build

[github-actions]

Performance Report

✔️ no performance regression detected

Full benchmark results

Benchmark suite	Current: eafedf7	Previous: c0115b0	Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc	653.17 us/op	886.07 us/op	0.74
getPubkeys - validatorsArr - req 1000 vs - 250000 vc	52.951 us/op	45.218 us/op	1.17
BLS verify - blst-native	1.3749 ms/op	1.2209 ms/op	1.13
BLS verifyMultipleSignatures 3 - blst-native	2.7401 ms/op	2.4840 ms/op	1.10
BLS verifyMultipleSignatures 8 - blst-native	5.8766 ms/op	5.3430 ms/op	1.10
BLS verifyMultipleSignatures 32 - blst-native	22.449 ms/op	19.430 ms/op	1.16
BLS aggregatePubkeys 32 - blst-native	29.388 us/op	25.769 us/op	1.14
BLS aggregatePubkeys 128 - blst-native	112.45 us/op	100.59 us/op	1.12
getAttestationsForBlock	65.207 ms/op	58.187 ms/op	1.12
isKnown best case - 1 super set check	297.00 ns/op	252.00 ns/op	1.18
isKnown normal case - 2 super set checks	287.00 ns/op	250.00 ns/op	1.15
isKnown worse case - 16 super set checks	286.00 ns/op	250.00 ns/op	1.14
CheckpointStateCache - add get delete	5.6540 us/op	5.3050 us/op	1.07
validate gossip signedAggregateAndProof - struct	3.1134 ms/op	2.8098 ms/op	1.11
validate gossip attestation - struct	1.4728 ms/op	1.3286 ms/op	1.11
pickEth1Vote - no votes	1.3977 ms/op	1.2866 ms/op	1.09
pickEth1Vote - max votes	12.390 ms/op	9.3586 ms/op	1.32
pickEth1Vote - Eth1Data hashTreeRoot value x2048	10.502 ms/op	8.8657 ms/op	1.18
pickEth1Vote - Eth1Data hashTreeRoot tree x2048	17.712 ms/op	14.510 ms/op	1.22
pickEth1Vote - Eth1Data fastSerialize value x2048	742.99 us/op	634.27 us/op	1.17
pickEth1Vote - Eth1Data fastSerialize tree x2048	9.0877 ms/op	4.8469 ms/op	1.87
bytes32 toHexString	566.00 ns/op	520.00 ns/op	1.09
bytes32 Buffer.toString(hex)	390.00 ns/op	385.00 ns/op	1.01
bytes32 Buffer.toString(hex) from Uint8Array	615.00 ns/op	564.00 ns/op	1.09
bytes32 Buffer.toString(hex) + 0x	389.00 ns/op	362.00 ns/op	1.07
Object access 1 prop	0.17900 ns/op	0.17700 ns/op	1.01
Map access 1 prop	0.18000 ns/op	0.15900 ns/op	1.13
Object get x1000	8.0570 ns/op	7.0510 ns/op	1.14
Map get x1000	0.64400 ns/op	0.62100 ns/op	1.04
Object set x1000	55.057 ns/op	52.134 ns/op	1.06
Map set x1000	45.059 ns/op	43.692 ns/op	1.03
Return object 10000 times	0.24110 ns/op	0.23360 ns/op	1.03
Throw Error 10000 times	4.5305 us/op	4.2826 us/op	1.06
fastMsgIdFn sha256 / 200 bytes	3.6570 us/op	3.4550 us/op	1.06
fastMsgIdFn h32 xxhash / 200 bytes	347.00 ns/op	302.00 ns/op	1.15
fastMsgIdFn h64 xxhash / 200 bytes	474.00 ns/op	401.00 ns/op	1.18
fastMsgIdFn sha256 / 1000 bytes	12.398 us/op	11.731 us/op	1.06
fastMsgIdFn h32 xxhash / 1000 bytes	432.00 ns/op	412.00 ns/op	1.05
fastMsgIdFn h64 xxhash / 1000 bytes	508.00 ns/op	487.00 ns/op	1.04
fastMsgIdFn sha256 / 10000 bytes	115.00 us/op	101.41 us/op	1.13
fastMsgIdFn h32 xxhash / 10000 bytes	2.1150 us/op	1.9050 us/op	1.11
fastMsgIdFn h64 xxhash / 10000 bytes	1.5300 us/op	1.4000 us/op	1.09
enrSubnets - fastDeserialize 64 bits	1.4900 us/op	1.2880 us/op	1.16
enrSubnets - ssz BitVector 64 bits	568.00 ns/op	547.00 ns/op	1.04
enrSubnets - fastDeserialize 4 bits	195.00 ns/op	187.00 ns/op	1.04
enrSubnets - ssz BitVector 4 bits	576.00 ns/op	567.00 ns/op	1.02
prioritizePeers score -10:0 att 32-0.1 sync 2-0	126.29 us/op	105.98 us/op	1.19
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25	153.92 us/op	139.98 us/op	1.10
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5	197.50 us/op	176.00 us/op	1.12
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75	366.67 us/op	347.82 us/op	1.05
prioritizePeers score 0:0 att 64-1 sync 4-1	476.39 us/op	371.27 us/op	1.28
array of 16000 items push then shift	1.8299 us/op	1.6077 us/op	1.14
LinkedList of 16000 items push then shift	10.523 ns/op	8.7670 ns/op	1.20
array of 16000 items push then pop	118.92 ns/op	92.529 ns/op	1.29
LinkedList of 16000 items push then pop	9.5510 ns/op	8.7240 ns/op	1.09
array of 24000 items push then shift	2.6029 us/op	2.3617 us/op	1.10
LinkedList of 24000 items push then shift	9.6760 ns/op	8.8700 ns/op	1.09
array of 24000 items push then pop	98.239 ns/op	76.429 ns/op	1.29
LinkedList of 24000 items push then pop	9.5870 ns/op	8.5290 ns/op	1.12
intersect bitArray bitLen 8	15.390 ns/op	13.238 ns/op	1.16
intersect array and set length 8	95.252 ns/op	78.784 ns/op	1.21
intersect bitArray bitLen 128	50.941 ns/op	46.195 ns/op	1.10
intersect array and set length 128	1.2725 us/op	1.0655 us/op	1.19
Buffer.concat 32 items	3.7450 us/op	2.9260 us/op	1.28
Uint8Array.set 32 items	3.2450 us/op	2.1360 us/op	1.52
transfer serialized Status (84 B)	2.6770 us/op	2.0220 us/op	1.32
copy serialized Status (84 B)	2.1200 us/op	1.7610 us/op	1.20
transfer serialized SignedVoluntaryExit (112 B)	2.7630 us/op	2.3320 us/op	1.18
copy serialized SignedVoluntaryExit (112 B)	2.2630 us/op	1.9640 us/op	1.15
transfer serialized ProposerSlashing (416 B)	3.0700 us/op	3.0940 us/op	0.99
copy serialized ProposerSlashing (416 B)	2.7860 us/op	3.2500 us/op	0.86
transfer serialized Attestation (485 B)	3.0190 us/op	3.2800 us/op	0.92
copy serialized Attestation (485 B)	2.8130 us/op	2.0180 us/op	1.39
transfer serialized AttesterSlashing (33232 B)	3.0770 us/op	2.3810 us/op	1.29
copy serialized AttesterSlashing (33232 B)	8.1420 us/op	5.2030 us/op	1.56
transfer serialized Small SignedBeaconBlock (128000 B)	3.7630 us/op	2.7770 us/op	1.36
copy serialized Small SignedBeaconBlock (128000 B)	26.284 us/op	13.130 us/op	2.00
transfer serialized Avg SignedBeaconBlock (200000 B)	4.8690 us/op	3.0950 us/op	1.57
copy serialized Avg SignedBeaconBlock (200000 B)	36.572 us/op	18.658 us/op	1.96
transfer serialized BlobsSidecar (524380 B)	4.7220 us/op	3.0650 us/op	1.54
copy serialized BlobsSidecar (524380 B)	229.68 us/op	138.30 us/op	1.66
transfer serialized Big SignedBeaconBlock (1000000 B)	5.4190 us/op	3.1040 us/op	1.75
copy serialized Big SignedBeaconBlock (1000000 B)	381.55 us/op	290.41 us/op	1.31
pass gossip attestations to forkchoice per slot	3.3268 ms/op	2.6563 ms/op	1.25
forkChoice updateHead vc 100000 bc 64 eq 0	2.7113 ms/op	2.1123 ms/op	1.28
forkChoice updateHead vc 600000 bc 64 eq 0	15.209 ms/op	12.141 ms/op	1.25
forkChoice updateHead vc 1000000 bc 64 eq 0	28.752 ms/op	24.192 ms/op	1.19
forkChoice updateHead vc 600000 bc 320 eq 0	21.615 ms/op	17.801 ms/op	1.21
forkChoice updateHead vc 600000 bc 1200 eq 0	109.67 ms/op	85.492 ms/op	1.28
forkChoice updateHead vc 600000 bc 64 eq 1000	25.805 ms/op	21.300 ms/op	1.21
forkChoice updateHead vc 600000 bc 64 eq 10000	28.160 ms/op	22.882 ms/op	1.23
forkChoice updateHead vc 600000 bc 64 eq 300000	56.658 ms/op	31.727 ms/op	1.79
computeDeltas	4.0904 ms/op	3.3991 ms/op	1.20
computeProposerBoostScoreFromBalances	2.1916 ms/op	1.8470 ms/op	1.19
altair processAttestation - 250000 vs - 7PWei normalcase	3.9464 ms/op	2.9331 ms/op	1.35
altair processAttestation - 250000 vs - 7PWei worstcase	6.0110 ms/op	4.9194 ms/op	1.22
altair processAttestation - setStatus - 1/6 committees join	182.67 us/op	142.95 us/op	1.28
altair processAttestation - setStatus - 1/3 committees join	357.86 us/op	280.34 us/op	1.28
altair processAttestation - setStatus - 1/2 committees join	466.49 us/op	377.89 us/op	1.23
altair processAttestation - setStatus - 2/3 committees join	581.41 us/op	473.71 us/op	1.23
altair processAttestation - setStatus - 4/5 committees join	811.18 us/op	653.21 us/op	1.24
altair processAttestation - setStatus - 100% committees join	886.10 us/op	766.27 us/op	1.16
altair processBlock - 250000 vs - 7PWei normalcase	19.123 ms/op	18.574 ms/op	1.03
altair processBlock - 250000 vs - 7PWei normalcase hashState	32.350 ms/op	25.929 ms/op	1.25
altair processBlock - 250000 vs - 7PWei worstcase	59.540 ms/op	52.597 ms/op	1.13
altair processBlock - 250000 vs - 7PWei worstcase hashState	76.088 ms/op	70.661 ms/op	1.08
phase0 processBlock - 250000 vs - 7PWei normalcase	2.4679 ms/op	2.8071 ms/op	0.88
phase0 processBlock - 250000 vs - 7PWei worstcase	34.904 ms/op	32.530 ms/op	1.07
altair processEth1Data - 250000 vs - 7PWei normalcase	589.55 us/op	517.52 us/op	1.14
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15	7.6060 us/op	13.028 us/op	0.58
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219	21.740 us/op	29.891 us/op	0.73
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42	13.657 us/op	13.600 us/op	1.00
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18	6.8860 us/op	10.648 us/op	0.65
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020	122.94 us/op	121.47 us/op	1.01
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777	1.1769 ms/op	717.25 us/op	1.64
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384	1.0510 ms/op	1.0599 ms/op	0.99
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384	1.5735 ms/op	946.22 us/op	1.66
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384	2.4690 ms/op	2.7542 ms/op	0.90
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384	1.7273 ms/op	1.7660 ms/op	0.98
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384	4.3045 ms/op	4.2781 ms/op	1.01
Tree 40 250000 create	323.46 ms/op	332.76 ms/op	0.97
Tree 40 250000 get(125000)	202.71 ns/op	193.54 ns/op	1.05
Tree 40 250000 set(125000)	1.0437 us/op	987.51 ns/op	1.06
Tree 40 250000 toArray()	19.255 ms/op	20.803 ms/op	0.93
Tree 40 250000 iterate all - toArray() + loop	20.120 ms/op	21.765 ms/op	0.92
Tree 40 250000 iterate all - get(i)	77.210 ms/op	73.960 ms/op	1.04
MutableVector 250000 create	14.359 ms/op	12.982 ms/op	1.11
MutableVector 250000 get(125000)	7.1320 ns/op	6.5140 ns/op	1.09
MutableVector 250000 set(125000)	281.11 ns/op	253.91 ns/op	1.11
MutableVector 250000 toArray()	2.8991 ms/op	3.1025 ms/op	0.93
MutableVector 250000 iterate all - toArray() + loop	2.8991 ms/op	3.1181 ms/op	0.93
MutableVector 250000 iterate all - get(i)	1.7761 ms/op	1.5485 ms/op	1.15
Array 250000 create	2.6807 ms/op	2.7152 ms/op	0.99
Array 250000 clone - spread	1.2413 ms/op	1.1000 ms/op	1.13
Array 250000 get(125000)	0.67100 ns/op	0.56300 ns/op	1.19
Array 250000 set(125000)	0.77000 ns/op	0.64700 ns/op	1.19
Array 250000 iterate all - loop	103.94 us/op	88.797 us/op	1.17
effectiveBalanceIncrements clone Uint8Array 300000	38.155 us/op	29.683 us/op	1.29
effectiveBalanceIncrements clone MutableVector 300000	446.00 ns/op	353.00 ns/op	1.26
effectiveBalanceIncrements rw all Uint8Array 300000	195.34 us/op	174.32 us/op	1.12
effectiveBalanceIncrements rw all MutableVector 300000	91.470 ms/op	85.026 ms/op	1.08
phase0 afterProcessEpoch - 250000 vs - 7PWei	131.00 ms/op	118.63 ms/op	1.10
phase0 beforeProcessEpoch - 250000 vs - 7PWei	44.191 ms/op	45.056 ms/op	0.98
altair processEpoch - mainnet_e81889	371.05 ms/op	319.88 ms/op	1.16
mainnet_e81889 - altair beforeProcessEpoch	51.748 ms/op	63.794 ms/op	0.81
mainnet_e81889 - altair processJustificationAndFinalization	17.634 us/op	17.695 us/op	1.00
mainnet_e81889 - altair processInactivityUpdates	6.3862 ms/op	6.0084 ms/op	1.06
mainnet_e81889 - altair processRewardsAndPenalties	77.019 ms/op	64.586 ms/op	1.19
mainnet_e81889 - altair processRegistryUpdates	3.0270 us/op	2.6280 us/op	1.15
mainnet_e81889 - altair processSlashings	542.00 ns/op	499.00 ns/op	1.09
mainnet_e81889 - altair processEth1DataReset	634.00 ns/op	530.00 ns/op	1.20
mainnet_e81889 - altair processEffectiveBalanceUpdates	1.4094 ms/op	1.2589 ms/op	1.12
mainnet_e81889 - altair processSlashingsReset	5.0720 us/op	6.6390 us/op	0.76
mainnet_e81889 - altair processRandaoMixesReset	4.6990 us/op	6.4830 us/op	0.72
mainnet_e81889 - altair processHistoricalRootsUpdate	778.00 ns/op	813.00 ns/op	0.96
mainnet_e81889 - altair processParticipationFlagUpdates	5.3440 us/op	2.4200 us/op	2.21
mainnet_e81889 - altair processSyncCommitteeUpdates	1.1280 us/op	588.00 ns/op	1.92
mainnet_e81889 - altair afterProcessEpoch	146.17 ms/op	128.50 ms/op	1.14
phase0 processEpoch - mainnet_e58758	425.69 ms/op	375.33 ms/op	1.13
mainnet_e58758 - phase0 beforeProcessEpoch	156.07 ms/op	141.51 ms/op	1.10
mainnet_e58758 - phase0 processJustificationAndFinalization	23.205 us/op	20.652 us/op	1.12
mainnet_e58758 - phase0 processRewardsAndPenalties	70.258 ms/op	66.607 ms/op	1.05
mainnet_e58758 - phase0 processRegistryUpdates	7.9980 us/op	7.9220 us/op	1.01
mainnet_e58758 - phase0 processSlashings	596.00 ns/op	543.00 ns/op	1.10
mainnet_e58758 - phase0 processEth1DataReset	686.00 ns/op	704.00 ns/op	0.97
mainnet_e58758 - phase0 processEffectiveBalanceUpdates	1.5714 ms/op	1.1938 ms/op	1.32
mainnet_e58758 - phase0 processSlashingsReset	4.1580 us/op	3.3840 us/op	1.23
mainnet_e58758 - phase0 processRandaoMixesReset	5.0070 us/op	5.4310 us/op	0.92
mainnet_e58758 - phase0 processHistoricalRootsUpdate	1.2530 us/op	661.00 ns/op	1.90
mainnet_e58758 - phase0 processParticipationRecordUpdates	4.3320 us/op	4.1110 us/op	1.05
mainnet_e58758 - phase0 afterProcessEpoch	116.18 ms/op	99.868 ms/op	1.16
phase0 processEffectiveBalanceUpdates - 250000 normalcase	2.3218 ms/op	1.2603 ms/op	1.84
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5	1.4502 ms/op	1.5797 ms/op	0.92
altair processInactivityUpdates - 250000 normalcase	32.344 ms/op	26.234 ms/op	1.23
altair processInactivityUpdates - 250000 worstcase	29.927 ms/op	25.824 ms/op	1.16
phase0 processRegistryUpdates - 250000 normalcase	8.6180 us/op	7.8290 us/op	1.10
phase0 processRegistryUpdates - 250000 badcase_full_deposits	345.10 us/op	262.81 us/op	1.31
phase0 processRegistryUpdates - 250000 worstcase 0.5	144.11 ms/op	122.30 ms/op	1.18
altair processRewardsAndPenalties - 250000 normalcase	77.191 ms/op	60.124 ms/op	1.28
altair processRewardsAndPenalties - 250000 worstcase	78.985 ms/op	69.009 ms/op	1.14
phase0 getAttestationDeltas - 250000 normalcase	7.5483 ms/op	7.1504 ms/op	1.06
phase0 getAttestationDeltas - 250000 worstcase	6.7408 ms/op	6.8858 ms/op	0.98
phase0 processSlashings - 250000 worstcase	3.7964 ms/op	3.7676 ms/op	1.01
altair processSyncCommitteeUpdates - 250000	194.94 ms/op	187.73 ms/op	1.04
BeaconState.hashTreeRoot - No change	414.00 ns/op	291.00 ns/op	1.42
BeaconState.hashTreeRoot - 1 full validator	55.506 us/op	54.366 us/op	1.02
BeaconState.hashTreeRoot - 32 full validator	625.63 us/op	530.49 us/op	1.18
BeaconState.hashTreeRoot - 512 full validator	6.7275 ms/op	5.1459 ms/op	1.31
BeaconState.hashTreeRoot - 1 validator.effectiveBalance	69.201 us/op	72.163 us/op	0.96
BeaconState.hashTreeRoot - 32 validator.effectiveBalance	1.0736 ms/op	914.92 us/op	1.17
BeaconState.hashTreeRoot - 512 validator.effectiveBalance	13.587 ms/op	11.686 ms/op	1.16
BeaconState.hashTreeRoot - 1 balances	66.183 us/op	50.114 us/op	1.32
BeaconState.hashTreeRoot - 32 balances	576.14 us/op	492.14 us/op	1.17
BeaconState.hashTreeRoot - 512 balances	5.0022 ms/op	4.5405 ms/op	1.10
BeaconState.hashTreeRoot - 250000 balances	90.471 ms/op	74.842 ms/op	1.21
aggregationBits - 2048 els - zipIndexesInBitList	17.477 us/op	16.626 us/op	1.05
regular array get 100000 times	36.250 us/op	33.552 us/op	1.08
wrappedArray get 100000 times	36.188 us/op	42.050 us/op	0.86
arrayWithProxy get 100000 times	19.886 ms/op	17.057 ms/op	1.17
ssz.Root.equals	648.00 ns/op	637.00 ns/op	1.02
byteArrayEquals	629.00 ns/op	616.00 ns/op	1.02
shuffle list - 16384 els	7.5253 ms/op	7.1379 ms/op	1.05
shuffle list - 250000 els	110.49 ms/op	106.01 ms/op	1.04
processSlot - 1 slots	10.573 us/op	9.2370 us/op	1.14
processSlot - 32 slots	1.4670 ms/op	1.3796 ms/op	1.06
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei	40.229 ms/op	36.628 ms/op	1.10
getCommitteeAssignments - req 1 vs - 250000 vc	3.2195 ms/op	3.0074 ms/op	1.07
getCommitteeAssignments - req 100 vs - 250000 vc	4.5879 ms/op	4.4183 ms/op	1.04
getCommitteeAssignments - req 1000 vs - 250000 vc	4.9713 ms/op	4.6918 ms/op	1.06
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei	5.7700 ns/op	5.3500 ns/op	1.08
state getBlockRootAtSlot - 250000 vs - 7PWei	629.25 ns/op	916.22 ns/op	0.69
computeProposers - vc 250000	11.764 ms/op	11.003 ms/op	1.07
computeEpochShuffling - vc 250000	111.65 ms/op	106.87 ms/op	1.04
getNextSyncCommittee - vc 250000	183.71 ms/op	182.48 ms/op	1.01
computeSigningRoot for AttestationData	14.292 us/op	14.352 us/op	1.00
hash AttestationData serialized data then Buffer.toString(base64)	2.7160 us/op	2.4974 us/op	1.09
toHexString serialized data	1.1609 us/op	1.0806 us/op	1.07
Buffer.toString(base64)	344.63 ns/op	316.12 ns/op	1.09

by benchmarkbot/action

[wemeetagain]

🎉 This PR is included in v1.9.0 🎉