Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test: update beacon api spec to v2.5.0 #6354

Merged
merged 12 commits into from
Feb 27, 2024
Merged

test: update beacon api spec to v2.5.0 #6354

merged 12 commits into from
Feb 27, 2024

Conversation

jeluard
Copy link
Contributor

@jeluard jeluard commented Jan 25, 2024 •
edited
Loading

Motivation

Reflect latest beacon-APIs spec changes. Recents fixes allow us to remove a bunch of workarounds and have more tests pass.

Fixes #6170
Fixes #6187
Fixes #6206
Fixes #6167

@jeluard jeluard changed the title Jeluard/beacon apis update chore: update beacon-apis specs Jan 25, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Feb 22, 2024 •
edited
Loading

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 9170b1a Previous: 53f8f99 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 950.23 us/op 688.59 us/op 1.38
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 126.53 us/op 115.21 us/op 1.10
BLS verify - blst-native 1.3765 ms/op 1.4655 ms/op 0.94
BLS verifyMultipleSignatures 3 - blst-native 2.8576 ms/op 3.1562 ms/op 0.91
BLS verifyMultipleSignatures 8 - blst-native 6.3185 ms/op 6.1628 ms/op 1.03
BLS verifyMultipleSignatures 32 - blst-native 23.609 ms/op 25.022 ms/op 0.94
BLS verifyMultipleSignatures 64 - blst-native 48.003 ms/op 47.853 ms/op 1.00
BLS verifyMultipleSignatures 128 - blst-native 91.273 ms/op 92.856 ms/op 0.98
BLS deserializing 10000 signatures 930.19 ms/op 1.0055 s/op 0.93
BLS deserializing 100000 signatures 9.1659 s/op 9.7152 s/op 0.94
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3790 ms/op 1.4797 ms/op 0.93
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5498 ms/op 1.7701 ms/op 0.88
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.4609 ms/op 2.6747 ms/op 0.92
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.6486 ms/op 4.1978 ms/op 0.87
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.9496 ms/op 6.4479 ms/op 0.92
BLS aggregatePubkeys 32 - blst-native 27.771 us/op 30.295 us/op 0.92
BLS aggregatePubkeys 128 - blst-native 105.62 us/op 115.77 us/op 0.91
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 69.725 ms/op 69.609 ms/op 1.00
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 65.603 ms/op 68.238 ms/op 0.96
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 53.276 ms/op 54.899 ms/op 0.97
getSlashingsAndExits - default max 315.60 us/op 237.12 us/op 1.33
getSlashingsAndExits - 2k 620.30 us/op 927.37 us/op 0.67
proposeBlockBody type=full, size=empty 6.8514 ms/op 7.3259 ms/op 0.94
isKnown best case - 1 super set check 674.00 ns/op 743.00 ns/op 0.91
isKnown normal case - 2 super set checks 671.00 ns/op 916.00 ns/op 0.73
isKnown worse case - 16 super set checks 744.00 ns/op 837.00 ns/op 0.89
CheckpointStateCache - add get delete 6.9840 us/op 8.4690 us/op 0.82
validate api signedAggregateAndProof - struct 3.2131 ms/op 3.2351 ms/op 0.99
validate gossip signedAggregateAndProof - struct 3.0737 ms/op 3.1390 ms/op 0.98
validate gossip attestation - vc 640000 1.4995 ms/op 1.5341 ms/op 0.98
batch validate gossip attestation - vc 640000 - chunk 32 189.10 us/op 197.10 us/op 0.96
batch validate gossip attestation - vc 640000 - chunk 64 167.39 us/op 172.48 us/op 0.97
batch validate gossip attestation - vc 640000 - chunk 128 162.88 us/op 166.50 us/op 0.98
batch validate gossip attestation - vc 640000 - chunk 256 153.34 us/op 165.38 us/op 0.93
pickEth1Vote - no votes 1.3635 ms/op 1.5331 ms/op 0.89
pickEth1Vote - max votes 12.435 ms/op 16.000 ms/op 0.78
pickEth1Vote - Eth1Data hashTreeRoot value x2048 22.628 ms/op 26.465 ms/op 0.86
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 35.297 ms/op 55.562 ms/op 0.64
pickEth1Vote - Eth1Data fastSerialize value x2048 807.78 us/op 801.01 us/op 1.01
pickEth1Vote - Eth1Data fastSerialize tree x2048 6.1208 ms/op 5.4711 ms/op 1.12
bytes32 toHexString 880.00 ns/op 603.00 ns/op 1.46
bytes32 Buffer.toString(hex) 341.00 ns/op 370.00 ns/op 0.92
bytes32 Buffer.toString(hex) from Uint8Array 615.00 ns/op 537.00 ns/op 1.15
bytes32 Buffer.toString(hex) + 0x 318.00 ns/op 336.00 ns/op 0.95
Object access 1 prop 0.24300 ns/op 0.21600 ns/op 1.13
Map access 1 prop 0.16900 ns/op 0.17600 ns/op 0.96
Object get x1000 9.0770 ns/op 7.9890 ns/op 1.14
Map get x1000 0.99100 ns/op 0.93500 ns/op 1.06
Object set x1000 81.715 ns/op 81.651 ns/op 1.00
Map set x1000 59.911 ns/op 52.517 ns/op 1.14
Return object 10000 times 0.28630 ns/op 0.26130 ns/op 1.10
Throw Error 10000 times 4.2335 us/op 4.2046 us/op 1.01
fastMsgIdFn sha256 / 200 bytes 3.6210 us/op 3.5510 us/op 1.02
fastMsgIdFn h32 xxhash / 200 bytes 410.00 ns/op 355.00 ns/op 1.15
fastMsgIdFn h64 xxhash / 200 bytes 432.00 ns/op 420.00 ns/op 1.03
fastMsgIdFn sha256 / 1000 bytes 12.230 us/op 11.762 us/op 1.04
fastMsgIdFn h32 xxhash / 1000 bytes 519.00 ns/op 492.00 ns/op 1.05
fastMsgIdFn h64 xxhash / 1000 bytes 512.00 ns/op 480.00 ns/op 1.07
fastMsgIdFn sha256 / 10000 bytes 112.46 us/op 107.03 us/op 1.05
fastMsgIdFn h32 xxhash / 10000 bytes 2.3940 us/op 2.0180 us/op 1.19
fastMsgIdFn h64 xxhash / 10000 bytes 1.5990 us/op 1.4350 us/op 1.11
send data - 1000 256B messages 27.472 ms/op 22.933 ms/op 1.20
send data - 1000 512B messages 32.127 ms/op 35.104 ms/op 0.92
send data - 1000 1024B messages 55.915 ms/op 48.159 ms/op 1.16
send data - 1000 1200B messages 48.014 ms/op 42.243 ms/op 1.14
send data - 1000 2048B messages 60.119 ms/op 60.770 ms/op 0.99
send data - 1000 4096B messages 52.383 ms/op 55.088 ms/op 0.95
send data - 1000 16384B messages 133.54 ms/op 153.21 ms/op 0.87
send data - 1000 65536B messages 533.15 ms/op 555.06 ms/op 0.96
enrSubnets - fastDeserialize 64 bits 1.9100 us/op 1.6470 us/op 1.16
enrSubnets - ssz BitVector 64 bits 567.00 ns/op 604.00 ns/op 0.94
enrSubnets - fastDeserialize 4 bits 250.00 ns/op 274.00 ns/op 0.91
enrSubnets - ssz BitVector 4 bits 557.00 ns/op 634.00 ns/op 0.88
prioritizePeers score -10:0 att 32-0.1 sync 2-0 123.95 us/op 147.20 us/op 0.84
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 149.21 us/op 173.07 us/op 0.86
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 219.63 us/op 221.93 us/op 0.99
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 390.07 us/op 420.19 us/op 0.93
prioritizePeers score 0:0 att 64-1 sync 4-1 459.71 us/op 455.49 us/op 1.01
array of 16000 items push then shift 1.7907 us/op 1.9032 us/op 0.94
LinkedList of 16000 items push then shift 13.177 ns/op 12.769 ns/op 1.03
array of 16000 items push then pop 122.89 ns/op 145.34 ns/op 0.85
LinkedList of 16000 items push then pop 10.114 ns/op 11.438 ns/op 0.88
array of 24000 items push then shift 2.8833 us/op 2.8314 us/op 1.02
LinkedList of 24000 items push then shift 12.765 ns/op 10.792 ns/op 1.18
array of 24000 items push then pop 183.45 ns/op 188.29 ns/op 0.97
LinkedList of 24000 items push then pop 9.8220 ns/op 10.130 ns/op 0.97
intersect bitArray bitLen 8 6.5870 ns/op 6.6060 ns/op 1.00
intersect array and set length 8 104.32 ns/op 93.199 ns/op 1.12
intersect bitArray bitLen 128 39.615 ns/op 40.360 ns/op 0.98
intersect array and set length 128 1.1837 us/op 1.2468 us/op 0.95
bitArray.getTrueBitIndexes() bitLen 128 2.0300 us/op 2.1610 us/op 0.94
bitArray.getTrueBitIndexes() bitLen 248 3.7830 us/op 3.6880 us/op 1.03
bitArray.getTrueBitIndexes() bitLen 512 7.3010 us/op 7.8090 us/op 0.93
Buffer.concat 32 items 1.2450 us/op 1.1590 us/op 1.07
Uint8Array.set 32 items 2.6340 us/op 2.0250 us/op 1.30
Set add up to 64 items then delete first 5.4452 us/op 5.8289 us/op 0.93
OrderedSet add up to 64 items then delete first 7.2450 us/op 7.7910 us/op 0.93
Set add up to 64 items then delete last 5.7717 us/op 6.1213 us/op 0.94
OrderedSet add up to 64 items then delete last 7.7592 us/op 7.9404 us/op 0.98
Set add up to 64 items then delete middle 5.7069 us/op 6.2409 us/op 0.91
OrderedSet add up to 64 items then delete middle 9.1109 us/op 9.8269 us/op 0.93
Set add up to 128 items then delete first 11.381 us/op 12.325 us/op 0.92
OrderedSet add up to 128 items then delete first 15.896 us/op 16.295 us/op 0.98
Set add up to 128 items then delete last 11.340 us/op 11.701 us/op 0.97
OrderedSet add up to 128 items then delete last 15.312 us/op 15.429 us/op 0.99
Set add up to 128 items then delete middle 11.362 us/op 11.463 us/op 0.99
OrderedSet add up to 128 items then delete middle 21.337 us/op 21.927 us/op 0.97
Set add up to 256 items then delete first 22.811 us/op 24.800 us/op 0.92
OrderedSet add up to 256 items then delete first 31.731 us/op 33.589 us/op 0.94
Set add up to 256 items then delete last 22.452 us/op 24.877 us/op 0.90
OrderedSet add up to 256 items then delete last 30.516 us/op 33.465 us/op 0.91
Set add up to 256 items then delete middle 23.032 us/op 25.161 us/op 0.92
OrderedSet add up to 256 items then delete middle 55.315 us/op 57.909 us/op 0.96
transfer serialized Status (84 B) 2.1650 us/op 2.2050 us/op 0.98
copy serialized Status (84 B) 1.6500 us/op 1.6960 us/op 0.97
transfer serialized SignedVoluntaryExit (112 B) 2.1890 us/op 2.1140 us/op 1.04
copy serialized SignedVoluntaryExit (112 B) 1.6250 us/op 1.5910 us/op 1.02
transfer serialized ProposerSlashing (416 B) 2.6060 us/op 3.2190 us/op 0.81
copy serialized ProposerSlashing (416 B) 2.7630 us/op 2.5480 us/op 1.08
transfer serialized Attestation (485 B) 2.7330 us/op 2.6520 us/op 1.03
copy serialized Attestation (485 B) 2.6600 us/op 3.4990 us/op 0.76
transfer serialized AttesterSlashing (33232 B) 3.0270 us/op 3.4930 us/op 0.87
copy serialized AttesterSlashing (33232 B) 10.282 us/op 10.220 us/op 1.01
transfer serialized Small SignedBeaconBlock (128000 B) 3.3240 us/op 3.5360 us/op 0.94
copy serialized Small SignedBeaconBlock (128000 B) 34.650 us/op 31.452 us/op 1.10
transfer serialized Avg SignedBeaconBlock (200000 B) 4.1840 us/op 4.1330 us/op 1.01
copy serialized Avg SignedBeaconBlock (200000 B) 48.084 us/op 42.764 us/op 1.12
transfer serialized BlobsSidecar (524380 B) 4.2440 us/op 4.1760 us/op 1.02
copy serialized BlobsSidecar (524380 B) 159.72 us/op 131.97 us/op 1.21
transfer serialized Big SignedBeaconBlock (1000000 B) 3.9140 us/op 5.9850 us/op 0.65
copy serialized Big SignedBeaconBlock (1000000 B) 339.68 us/op 261.24 us/op 1.30
pass gossip attestations to forkchoice per slot 4.8492 ms/op 4.4491 ms/op 1.09
forkChoice updateHead vc 100000 bc 64 eq 0 779.74 us/op 785.00 us/op 0.99
forkChoice updateHead vc 600000 bc 64 eq 0 6.3027 ms/op 4.8686 ms/op 1.29
forkChoice updateHead vc 1000000 bc 64 eq 0 7.9130 ms/op 9.2844 ms/op 0.85
forkChoice updateHead vc 600000 bc 320 eq 0 4.7587 ms/op 5.1787 ms/op 0.92
forkChoice updateHead vc 600000 bc 1200 eq 0 5.3658 ms/op 5.7253 ms/op 0.94
forkChoice updateHead vc 600000 bc 7200 eq 0 6.5460 ms/op 6.6276 ms/op 0.99
forkChoice updateHead vc 600000 bc 64 eq 1000 11.974 ms/op 13.289 ms/op 0.90
forkChoice updateHead vc 600000 bc 64 eq 10000 13.278 ms/op 15.870 ms/op 0.84
forkChoice updateHead vc 600000 bc 64 eq 300000 28.526 ms/op 40.851 ms/op 0.70
computeDeltas 500000 validators 300 proto nodes 7.3038 ms/op 7.3342 ms/op 1.00
computeDeltas 500000 validators 1200 proto nodes 7.2095 ms/op 7.6225 ms/op 0.95
computeDeltas 500000 validators 7200 proto nodes 7.0281 ms/op 7.0726 ms/op 0.99
computeDeltas 750000 validators 300 proto nodes 10.536 ms/op 10.470 ms/op 1.01
computeDeltas 750000 validators 1200 proto nodes 12.100 ms/op 10.821 ms/op 1.12
computeDeltas 750000 validators 7200 proto nodes 11.638 ms/op 11.397 ms/op 1.02
computeDeltas 1400000 validators 300 proto nodes 23.822 ms/op 21.476 ms/op 1.11
computeDeltas 1400000 validators 1200 proto nodes 22.911 ms/op 21.532 ms/op 1.06
computeDeltas 1400000 validators 7200 proto nodes 24.165 ms/op 22.233 ms/op 1.09
computeDeltas 2100000 validators 300 proto nodes 34.161 ms/op 33.216 ms/op 1.03
computeDeltas 2100000 validators 1200 proto nodes 34.768 ms/op 34.139 ms/op 1.02
computeDeltas 2100000 validators 7200 proto nodes 35.618 ms/op 33.194 ms/op 1.07
altair processAttestation - 250000 vs - 7PWei normalcase 5.4594 ms/op 3.7464 ms/op 1.46
altair processAttestation - 250000 vs - 7PWei worstcase 7.3403 ms/op 5.3926 ms/op 1.36
altair processAttestation - setStatus - 1/6 committees join 292.13 us/op 204.79 us/op 1.43
altair processAttestation - setStatus - 1/3 committees join 605.52 us/op 397.84 us/op 1.52
altair processAttestation - setStatus - 1/2 committees join 719.30 us/op 493.57 us/op 1.46
altair processAttestation - setStatus - 2/3 committees join 949.63 us/op 611.89 us/op 1.55
altair processAttestation - setStatus - 4/5 committees join 1.2240 ms/op 879.12 us/op 1.39
altair processAttestation - setStatus - 100% committees join 1.3223 ms/op 1.1404 ms/op 1.16
altair processBlock - 250000 vs - 7PWei normalcase 13.487 ms/op 13.362 ms/op 1.01
altair processBlock - 250000 vs - 7PWei normalcase hashState 45.529 ms/op 49.896 ms/op 0.91
altair processBlock - 250000 vs - 7PWei worstcase 48.691 ms/op 53.837 ms/op 0.90
altair processBlock - 250000 vs - 7PWei worstcase hashState 130.88 ms/op 112.75 ms/op 1.16
phase0 processBlock - 250000 vs - 7PWei normalcase 4.2431 ms/op 3.8228 ms/op 1.11
phase0 processBlock - 250000 vs - 7PWei worstcase 39.179 ms/op 40.072 ms/op 0.98
altair processEth1Data - 250000 vs - 7PWei normalcase 888.87 us/op 1.1017 ms/op 0.81
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 27.588 us/op 23.996 us/op 1.15
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 99.778 us/op 88.486 us/op 1.13
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 42.768 us/op 43.046 us/op 0.99
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 23.194 us/op 30.935 us/op 0.75
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 286.54 us/op 271.08 us/op 1.06
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 2.1286 ms/op 2.2769 ms/op 0.93
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 2.2983 ms/op 3.3185 ms/op 0.69
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 2.6367 ms/op 2.4594 ms/op 1.07
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 5.2449 ms/op 6.0820 ms/op 0.86
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 3.6339 ms/op 3.7066 ms/op 0.98
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 7.7594 ms/op 10.810 ms/op 0.72
Tree 40 250000 create 838.27 ms/op 800.78 ms/op 1.05
Tree 40 250000 get(125000) 238.27 ns/op 249.67 ns/op 0.95
Tree 40 250000 set(125000) 2.6651 us/op 2.5852 us/op 1.03
Tree 40 250000 toArray() 27.002 ms/op 30.349 ms/op 0.89
Tree 40 250000 iterate all - toArray() + loop 26.497 ms/op 28.616 ms/op 0.93
Tree 40 250000 iterate all - get(i) 83.555 ms/op 87.675 ms/op 0.95
MutableVector 250000 create 20.749 ms/op 21.133 ms/op 0.98
MutableVector 250000 get(125000) 6.7990 ns/op 7.3370 ns/op 0.93
MutableVector 250000 set(125000) 399.19 ns/op 675.30 ns/op 0.59
MutableVector 250000 toArray() 4.3528 ms/op 5.0373 ms/op 0.86
MutableVector 250000 iterate all - toArray() + loop 4.7355 ms/op 5.0474 ms/op 0.94
MutableVector 250000 iterate all - get(i) 1.6053 ms/op 1.8627 ms/op 0.86
Array 250000 create 3.9698 ms/op 4.5063 ms/op 0.88
Array 250000 clone - spread 1.4738 ms/op 1.8837 ms/op 0.78
Array 250000 get(125000) 1.2480 ns/op 2.0770 ns/op 0.60
Array 250000 set(125000) 5.4470 ns/op 6.1580 ns/op 0.88
Array 250000 iterate all - loop 179.76 us/op 194.09 us/op 0.93
effectiveBalanceIncrements clone Uint8Array 300000 62.857 us/op 62.515 us/op 1.01
effectiveBalanceIncrements clone MutableVector 300000 464.00 ns/op 574.00 ns/op 0.81
effectiveBalanceIncrements rw all Uint8Array 300000 209.90 us/op 223.79 us/op 0.94
effectiveBalanceIncrements rw all MutableVector 300000 160.98 ms/op 156.02 ms/op 1.03
phase0 afterProcessEpoch - 250000 vs - 7PWei 127.35 ms/op 134.89 ms/op 0.94
phase0 beforeProcessEpoch - 250000 vs - 7PWei 64.529 ms/op 64.225 ms/op 1.00
altair processEpoch - mainnet_e81889 618.27 ms/op 587.72 ms/op 1.05
mainnet_e81889 - altair beforeProcessEpoch 109.25 ms/op 96.075 ms/op 1.14
mainnet_e81889 - altair processJustificationAndFinalization 25.295 us/op 15.791 us/op 1.60
mainnet_e81889 - altair processInactivityUpdates 7.3618 ms/op 7.4364 ms/op 0.99
mainnet_e81889 - altair processRewardsAndPenalties 75.413 ms/op 67.156 ms/op 1.12
mainnet_e81889 - altair processRegistryUpdates 6.2980 us/op 3.2860 us/op 1.92
mainnet_e81889 - altair processSlashings 854.00 ns/op 429.00 ns/op 1.99
mainnet_e81889 - altair processEth1DataReset 1.0560 us/op 1.1180 us/op 0.94
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.8702 ms/op 1.8424 ms/op 1.02
mainnet_e81889 - altair processSlashingsReset 7.8190 us/op 5.1250 us/op 1.53
mainnet_e81889 - altair processRandaoMixesReset 12.732 us/op 7.2520 us/op 1.76
mainnet_e81889 - altair processHistoricalRootsUpdate 1.0900 us/op 1.1180 us/op 0.97
mainnet_e81889 - altair processParticipationFlagUpdates 3.9580 us/op 2.2290 us/op 1.78
mainnet_e81889 - altair processSyncCommitteeUpdates 1.2710 us/op 675.00 ns/op 1.88
mainnet_e81889 - altair afterProcessEpoch 128.55 ms/op 127.83 ms/op 1.01
capella processEpoch - mainnet_e217614 2.8911 s/op 2.2671 s/op 1.28
mainnet_e217614 - capella beforeProcessEpoch 606.18 ms/op 466.14 ms/op 1.30
mainnet_e217614 - capella processJustificationAndFinalization 20.753 us/op 14.404 us/op 1.44
mainnet_e217614 - capella processInactivityUpdates 24.179 ms/op 19.486 ms/op 1.24
mainnet_e217614 - capella processRewardsAndPenalties 519.98 ms/op 401.61 ms/op 1.29
mainnet_e217614 - capella processRegistryUpdates 50.797 us/op 20.000 us/op 2.54
mainnet_e217614 - capella processSlashings 1.0860 us/op 594.00 ns/op 1.83
mainnet_e217614 - capella processEth1DataReset 1.0240 us/op 416.00 ns/op 2.46
mainnet_e217614 - capella processEffectiveBalanceUpdates 6.8101 ms/op 4.4598 ms/op 1.53
mainnet_e217614 - capella processSlashingsReset 6.5130 us/op 3.5340 us/op 1.84
mainnet_e217614 - capella processRandaoMixesReset 8.0110 us/op 3.7500 us/op 2.14
mainnet_e217614 - capella processHistoricalRootsUpdate 732.00 ns/op 572.00 ns/op 1.28
mainnet_e217614 - capella processParticipationFlagUpdates 3.8120 us/op 1.6030 us/op 2.38
mainnet_e217614 - capella afterProcessEpoch 400.09 ms/op 333.19 ms/op 1.20
phase0 processEpoch - mainnet_e58758 591.48 ms/op 480.43 ms/op 1.23
mainnet_e58758 - phase0 beforeProcessEpoch 195.75 ms/op 147.61 ms/op 1.33
mainnet_e58758 - phase0 processJustificationAndFinalization 33.840 us/op 15.797 us/op 2.14
mainnet_e58758 - phase0 processRewardsAndPenalties 70.865 ms/op 55.519 ms/op 1.28
mainnet_e58758 - phase0 processRegistryUpdates 18.357 us/op 9.9400 us/op 1.85
mainnet_e58758 - phase0 processSlashings 891.00 ns/op 601.00 ns/op 1.48
mainnet_e58758 - phase0 processEth1DataReset 792.00 ns/op 489.00 ns/op 1.62
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.6429 ms/op 1.1637 ms/op 1.41
mainnet_e58758 - phase0 processSlashingsReset 8.1700 us/op 2.6810 us/op 3.05
mainnet_e58758 - phase0 processRandaoMixesReset 4.5430 us/op 4.0220 us/op 1.13
mainnet_e58758 - phase0 processHistoricalRootsUpdate 592.00 ns/op 658.00 ns/op 0.90
mainnet_e58758 - phase0 processParticipationRecordUpdates 6.4230 us/op 3.6420 us/op 1.76
mainnet_e58758 - phase0 afterProcessEpoch 101.56 ms/op 104.31 ms/op 0.97
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.7951 ms/op 1.4450 ms/op 1.24
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.6630 ms/op 1.8016 ms/op 0.92
altair processInactivityUpdates - 250000 normalcase 26.556 ms/op 34.428 ms/op 0.77
altair processInactivityUpdates - 250000 worstcase 26.736 ms/op 32.515 ms/op 0.82
phase0 processRegistryUpdates - 250000 normalcase 22.048 us/op 9.1250 us/op 2.42
phase0 processRegistryUpdates - 250000 badcase_full_deposits 700.45 us/op 443.12 us/op 1.58
phase0 processRegistryUpdates - 250000 worstcase 0.5 175.75 ms/op 147.50 ms/op 1.19
altair processRewardsAndPenalties - 250000 normalcase 64.913 ms/op 68.467 ms/op 0.95
altair processRewardsAndPenalties - 250000 worstcase 61.642 ms/op 64.356 ms/op 0.96
phase0 getAttestationDeltas - 250000 normalcase 12.771 ms/op 10.622 ms/op 1.20
phase0 getAttestationDeltas - 250000 worstcase 12.266 ms/op 9.4588 ms/op 1.30
phase0 processSlashings - 250000 worstcase 139.64 us/op 95.085 us/op 1.47
altair processSyncCommitteeUpdates - 250000 178.52 ms/op 167.53 ms/op 1.07
BeaconState.hashTreeRoot - No change 822.00 ns/op 392.00 ns/op 2.10
BeaconState.hashTreeRoot - 1 full validator 151.45 us/op 130.47 us/op 1.16
BeaconState.hashTreeRoot - 32 full validator 1.8655 ms/op 1.8883 ms/op 0.99
BeaconState.hashTreeRoot - 512 full validator 20.176 ms/op 21.241 ms/op 0.95
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 201.42 us/op 211.39 us/op 0.95
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.6323 ms/op 2.9063 ms/op 0.91
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 35.236 ms/op 36.968 ms/op 0.95
BeaconState.hashTreeRoot - 1 balances 167.65 us/op 168.47 us/op 1.00
BeaconState.hashTreeRoot - 32 balances 1.7951 ms/op 1.7335 ms/op 1.04
BeaconState.hashTreeRoot - 512 balances 16.402 ms/op 16.361 ms/op 1.00
BeaconState.hashTreeRoot - 250000 balances 285.64 ms/op 238.57 ms/op 1.20
aggregationBits - 2048 els - zipIndexesInBitList 35.077 us/op 23.156 us/op 1.51
byteArrayEquals 32 109.55 ns/op 75.970 ns/op 1.44
Buffer.compare 32 69.672 ns/op 58.022 ns/op 1.20
byteArrayEquals 1024 2.4487 us/op 2.1076 us/op 1.16
Buffer.compare 1024 92.412 ns/op 73.351 ns/op 1.26
byteArrayEquals 16384 45.590 us/op 33.478 us/op 1.36
Buffer.compare 16384 376.58 ns/op 280.66 ns/op 1.34
byteArrayEquals 123687377 302.85 ms/op 260.76 ms/op 1.16
Buffer.compare 123687377 10.394 ms/op 7.8148 ms/op 1.33
byteArrayEquals 32 - diff last byte 80.977 ns/op 75.579 ns/op 1.07
Buffer.compare 32 - diff last byte 69.358 ns/op 58.565 ns/op 1.18
byteArrayEquals 1024 - diff last byte 2.3936 us/op 2.0856 us/op 1.15
Buffer.compare 1024 - diff last byte 79.339 ns/op 75.657 ns/op 1.05
byteArrayEquals 16384 - diff last byte 37.027 us/op 33.998 us/op 1.09
Buffer.compare 16384 - diff last byte 350.70 ns/op 254.61 ns/op 1.38
byteArrayEquals 123687377 - diff last byte 273.88 ms/op 258.94 ms/op 1.06
Buffer.compare 123687377 - diff last byte 7.8268 ms/op 8.4061 ms/op 0.93
byteArrayEquals 32 - random bytes 6.2750 ns/op 5.6000 ns/op 1.12
Buffer.compare 32 - random bytes 63.585 ns/op 62.271 ns/op 1.02
byteArrayEquals 1024 - random bytes 5.7430 ns/op 5.9520 ns/op 0.96
Buffer.compare 1024 - random bytes 62.528 ns/op 66.204 ns/op 0.94
byteArrayEquals 16384 - random bytes 5.6420 ns/op 5.6230 ns/op 1.00
Buffer.compare 16384 - random bytes 63.107 ns/op 69.117 ns/op 0.91
byteArrayEquals 123687377 - random bytes 8.7800 ns/op 9.0600 ns/op 0.97
Buffer.compare 123687377 - random bytes 66.950 ns/op 78.300 ns/op 0.86
regular array get 100000 times 46.285 us/op 48.015 us/op 0.96
wrappedArray get 100000 times 46.349 us/op 49.640 us/op 0.93
arrayWithProxy get 100000 times 14.809 ms/op 14.509 ms/op 1.02
ssz.Root.equals 56.926 ns/op 57.853 ns/op 0.98
byteArrayEquals 55.556 ns/op 58.140 ns/op 0.96
Buffer.compare 12.004 ns/op 11.569 ns/op 1.04
shuffle list - 16384 els 7.2867 ms/op 7.1868 ms/op 1.01
shuffle list - 250000 els 107.14 ms/op 106.34 ms/op 1.01
processSlot - 1 slots 17.502 us/op 16.854 us/op 1.04
processSlot - 32 slots 3.2676 ms/op 3.3946 ms/op 0.96
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 64.463 ms/op 60.381 ms/op 1.07
getCommitteeAssignments - req 1 vs - 250000 vc 2.9440 ms/op 2.6825 ms/op 1.10
getCommitteeAssignments - req 100 vs - 250000 vc 4.0388 ms/op 3.8977 ms/op 1.04
getCommitteeAssignments - req 1000 vs - 250000 vc 4.5077 ms/op 4.3067 ms/op 1.05
findModifiedValidators - 10000 modified validators 700.18 ms/op 576.50 ms/op 1.21
findModifiedValidators - 1000 modified validators 532.33 ms/op 464.94 ms/op 1.14
findModifiedValidators - 100 modified validators 562.96 ms/op 469.87 ms/op 1.20
findModifiedValidators - 10 modified validators 499.82 ms/op 498.14 ms/op 1.00
findModifiedValidators - 1 modified validators 576.60 ms/op 444.46 ms/op 1.30
findModifiedValidators - no difference 544.29 ms/op 471.36 ms/op 1.15
compare ViewDUs 5.6316 s/op 5.4867 s/op 1.03
compare each validator Uint8Array 1.9888 s/op 2.2965 s/op 0.87
compare ViewDU to Uint8Array 1.5677 s/op 1.5671 s/op 1.00
migrate state 1000000 validators, 24 modified, 0 new 1.0430 s/op 930.89 ms/op 1.12
migrate state 1000000 validators, 1700 modified, 1000 new 1.2213 s/op 1.1415 s/op 1.07
migrate state 1000000 validators, 3400 modified, 2000 new 1.4802 s/op 1.4727 s/op 1.01
migrate state 1500000 validators, 24 modified, 0 new 1.0311 s/op 949.26 ms/op 1.09
migrate state 1500000 validators, 1700 modified, 1000 new 1.2709 s/op 1.4166 s/op 0.90
migrate state 1500000 validators, 3400 modified, 2000 new 1.5406 s/op 1.7594 s/op 0.88
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 5.1200 ns/op 5.6100 ns/op 0.91
state getBlockRootAtSlot - 250000 vs - 7PWei 711.35 ns/op 785.74 ns/op 0.91
computeProposers - vc 250000 9.8443 ms/op 13.419 ms/op 0.73
computeEpochShuffling - vc 250000 110.04 ms/op 137.72 ms/op 0.80
getNextSyncCommittee - vc 250000 171.63 ms/op 182.59 ms/op 0.94
computeSigningRoot for AttestationData 27.414 us/op 35.831 us/op 0.77
hash AttestationData serialized data then Buffer.toString(base64) 2.4528 us/op 2.7717 us/op 0.88
toHexString serialized data 1.2538 us/op 1.3643 us/op 0.92
Buffer.toString(base64) 262.60 ns/op 292.11 ns/op 0.90

by benchmarkbot/action

@nflaig nflaig changed the title chore: update beacon-apis specs test: update beacon api spec to v2.5.0 Feb 27, 2024
@nflaig nflaig marked this pull request as ready for review February 27, 2024 13:34
@nflaig nflaig requested a review from a team as a code owner February 27, 2024 13:34
@codecov Codecov
Copy link

codecov bot commented Feb 27, 2024

Codecov Report

Merging #6354 (3d20207) into unstable (e9a3f07) will increase coverage by 0.00%.
Report is 1 commits behind head on unstable.
The diff coverage is n/a.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #6354   +/-   ##
=========================================
  Coverage     61.72%   61.72%           
=========================================
  Files           555      555           
  Lines         58204    58204           
  Branches       1839     1844    +5     
=========================================
+ Hits          35925    35927    +2     
+ Misses        22240    22238    -2     
  Partials         39       39

nflaig
nflaig approved these changes Feb 27, 2024
View reviewed changes
Copy link
Member

@nflaig nflaig left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@nflaig nflaig merged commit 645d491 into unstable Feb 27, 2024
20 of 21 checks passed
@nflaig nflaig deleted the jeluard/beacon-apis-update branch February 27, 2024 15:22
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.17.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nflaig nflaig nflaig approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@jeluard @wemeetagain @nflaig