Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Devnet-5 config update for setup script #3821

Merged
merged 1 commit into from
Mar 3, 2022
Merged

Devnet-5 config update for setup script #3821

merged 1 commit into from
Mar 3, 2022

Conversation

g11tech
Copy link
Contributor

@g11tech g11tech commented Mar 2, 2022

Motivation
Configs are out for joining the kiln v2 spec devnet-5

This PR updates the easy one command spinup script for testing devnet-5 with lodestar. Plus some cleanup (kintsugi,devnet3)

How to test devnet-5 with lodestar!

cd kiln/devnets

To run lodestar with geth:
./setup.sh --dataDir devnet5-data --elClient geth --devnetVars ./devnet5.vars --dockerWithSudo --withTerminal "gnome-terminal --disable-factory --"

To run lodestar with nethermind:
./setup.sh --dataDir devnet5-data --elClient nethermind --devnetVars ./devnet5.vars --dockerWithSudo --withTerminal "gnome-terminal --disable-factory --"

@codecov
Copy link

codecov bot commented Mar 2, 2022

Codecov Report

Merging #3821 (dfd90eb) into master (cf5b293) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3821   +/-   ##
=======================================
  Coverage   36.43%   36.43%           
=======================================
  Files         325      325           
  Lines        8984     8984           
  Branches     1402     1402           
=======================================
  Hits         3273     3273           
  Misses       5568     5568           
  Partials      143      143           

@github-actions
Copy link
Contributor

github-actions bot commented Mar 2, 2022

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 1e1c2dc Previous: cf5b293 Ratio
BeaconState.hashTreeRoot - No change 699.00 ns/op 633.00 ns/op 1.10
BeaconState.hashTreeRoot - 1 full validator 98.242 us/op 101.08 us/op 0.97
BeaconState.hashTreeRoot - 32 full validator 1.4061 ms/op 1.3221 ms/op 1.06
BeaconState.hashTreeRoot - 512 full validator 19.563 ms/op 17.016 ms/op 1.15
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 97.787 us/op 90.002 us/op 1.09
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 2.0101 ms/op 1.5653 ms/op 1.28
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 22.804 ms/op 19.587 ms/op 1.16
BeaconState.hashTreeRoot - 1 balances 70.625 us/op 66.965 us/op 1.05
BeaconState.hashTreeRoot - 32 balances 622.70 us/op 543.96 us/op 1.14
BeaconState.hashTreeRoot - 512 balances 6.3153 ms/op 5.2948 ms/op 1.19
BeaconState.hashTreeRoot - 250000 balances 106.24 ms/op 99.036 ms/op 1.07
processSlot - 1 slots 48.601 us/op 43.083 us/op 1.13
processSlot - 32 slots 2.5138 ms/op 2.2490 ms/op 1.12
getCommitteeAssignments - req 1 vs - 250000 vc 6.3703 ms/op 5.6536 ms/op 1.13
getCommitteeAssignments - req 100 vs - 250000 vc 8.9483 ms/op 7.8454 ms/op 1.14
getCommitteeAssignments - req 1000 vs - 250000 vc 9.6946 ms/op 8.5910 ms/op 1.13
computeProposers - vc 250000 25.854 ms/op 23.618 ms/op 1.09
computeEpochShuffling - vc 250000 226.94 ms/op 205.95 ms/op 1.10
getNextSyncCommittee - vc 250000 417.77 ms/op 374.61 ms/op 1.12
altair processAttestation - 250000 vs - 7PWei normalcase 34.421 ms/op 33.249 ms/op 1.04
altair processAttestation - 250000 vs - 7PWei worstcase 41.183 ms/op 38.770 ms/op 1.06
altair processAttestation - setStatus - 1/6 committees join 13.587 ms/op 11.288 ms/op 1.20
altair processAttestation - setStatus - 1/3 committees join 27.763 ms/op 23.168 ms/op 1.20
altair processAttestation - setStatus - 1/2 committees join 43.677 ms/op 35.529 ms/op 1.23
altair processAttestation - setStatus - 2/3 committees join 56.947 ms/op 51.098 ms/op 1.11
altair processAttestation - setStatus - 4/5 committees join 69.764 ms/op 56.374 ms/op 1.24
altair processAttestation - setStatus - 100% committees join 85.790 ms/op 69.723 ms/op 1.23
altair processAttestation - updateEpochParticipants - 1/6 committees join 15.326 ms/op 12.346 ms/op 1.24
altair processAttestation - updateEpochParticipants - 1/3 committees join 29.827 ms/op 25.631 ms/op 1.16
altair processAttestation - updateEpochParticipants - 1/2 committees join 24.423 ms/op 24.020 ms/op 1.02
altair processAttestation - updateEpochParticipants - 2/3 committees join 30.025 ms/op 25.170 ms/op 1.19
altair processAttestation - updateEpochParticipants - 4/5 committees join 26.697 ms/op 29.833 ms/op 0.89
altair processAttestation - updateEpochParticipants - 100% committees join 27.994 ms/op 27.314 ms/op 1.02
altair processAttestation - updateAllStatus 23.156 ms/op 22.740 ms/op 1.02
altair processBlock - 250000 vs - 7PWei normalcase 45.792 ms/op 38.012 ms/op 1.20
altair processBlock - 250000 vs - 7PWei worstcase 122.75 ms/op 115.31 ms/op 1.06
altair processEpoch - mainnet_e81889 922.36 ms/op 859.92 ms/op 1.07
mainnet_e81889 - altair beforeProcessEpoch 323.07 ms/op 361.57 ms/op 0.89
mainnet_e81889 - altair processJustificationAndFinalization 74.611 us/op 64.418 us/op 1.16
mainnet_e81889 - altair processInactivityUpdates 21.547 ms/op 19.804 ms/op 1.09
mainnet_e81889 - altair processRewardsAndPenalties 161.59 ms/op 101.05 ms/op 1.60
mainnet_e81889 - altair processRegistryUpdates 10.538 us/op 10.798 us/op 0.98
mainnet_e81889 - altair processSlashings 2.9750 us/op 3.4530 us/op 0.86
mainnet_e81889 - altair processEth1DataReset 3.0810 us/op 3.6530 us/op 0.84
mainnet_e81889 - altair processEffectiveBalanceUpdates 7.5688 ms/op 6.7906 ms/op 1.11
mainnet_e81889 - altair processSlashingsReset 16.660 us/op 22.108 us/op 0.75
mainnet_e81889 - altair processRandaoMixesReset 22.412 us/op 30.396 us/op 0.74
mainnet_e81889 - altair processHistoricalRootsUpdate 4.1440 us/op 4.4250 us/op 0.94
mainnet_e81889 - altair processParticipationFlagUpdates 81.182 ms/op 80.311 ms/op 1.01
mainnet_e81889 - altair processSyncCommitteeUpdates 2.5770 us/op 3.4140 us/op 0.75
mainnet_e81889 - altair afterProcessEpoch 262.81 ms/op 254.38 ms/op 1.03
altair processInactivityUpdates - 250000 normalcase 83.696 ms/op 77.143 ms/op 1.08
altair processInactivityUpdates - 250000 worstcase 85.720 ms/op 77.521 ms/op 1.11
altair processParticipationFlagUpdates - 250000 anycase 69.741 ms/op 76.534 ms/op 0.91
altair processRewardsAndPenalties - 250000 normalcase 126.23 ms/op 92.460 ms/op 1.37
altair processRewardsAndPenalties - 250000 worstcase 123.78 ms/op 106.88 ms/op 1.16
altair processSyncCommitteeUpdates - 250000 433.15 ms/op 410.34 ms/op 1.06
Tree 40 250000 create 894.57 ms/op 703.74 ms/op 1.27
Tree 40 250000 get(125000) 385.01 ns/op 346.74 ns/op 1.11
Tree 40 250000 set(125000) 2.6854 us/op 1.9803 us/op 1.36
Tree 40 250000 toArray() 47.832 ms/op 41.234 ms/op 1.16
Tree 40 250000 iterate all - toArray() + loop 48.014 ms/op 40.443 ms/op 1.19
Tree 40 250000 iterate all - get(i) 141.52 ms/op 132.82 ms/op 1.07
MutableVector 250000 create 29.157 ms/op 23.335 ms/op 1.25
MutableVector 250000 get(125000) 15.613 ns/op 14.396 ns/op 1.08
MutableVector 250000 set(125000) 700.90 ns/op 586.01 ns/op 1.20
MutableVector 250000 toArray() 10.486 ms/op 9.8213 ms/op 1.07
MutableVector 250000 iterate all - toArray() + loop 10.970 ms/op 9.9601 ms/op 1.10
MutableVector 250000 iterate all - get(i) 4.0329 ms/op 4.3055 ms/op 0.94
Array 250000 create 6.7121 ms/op 5.7769 ms/op 1.16
Array 250000 clone - spread 2.7604 ms/op 2.4354 ms/op 1.13
Array 250000 get(125000) 1.2850 ns/op 1.1810 ns/op 1.09
Array 250000 set(125000) 1.2960 ns/op 1.1740 ns/op 1.10
Array 250000 iterate all - loop 200.13 us/op 183.51 us/op 1.09
effectiveBalanceIncrements clone Uint8Array 300000 88.614 us/op 67.461 us/op 1.31
effectiveBalanceIncrements clone MutableVector 300000 836.00 ns/op 735.00 ns/op 1.14
effectiveBalanceIncrements rw all Uint8Array 300000 359.61 us/op 333.43 us/op 1.08
effectiveBalanceIncrements rw all MutableVector 300000 234.87 ms/op 193.08 ms/op 1.22
aggregationBits - 2048 els - readonlyValues 222.14 us/op 197.60 us/op 1.12
aggregationBits - 2048 els - zipIndexesInBitList 42.428 us/op 36.586 us/op 1.16
regular array get 100000 times 80.554 us/op 75.178 us/op 1.07
wrappedArray get 100000 times 80.542 us/op 76.079 us/op 1.06
arrayWithProxy get 100000 times 34.737 ms/op 32.933 ms/op 1.05
ssz.Root.equals 1.3480 us/op 1.2780 us/op 1.05
ssz.Root.equals with valueOf() 1.6140 us/op 1.4930 us/op 1.08
byteArrayEquals with valueOf() 1.5770 us/op 1.4320 us/op 1.10
phase0 processBlock - 250000 vs - 7PWei normalcase 9.5435 ms/op 8.5554 ms/op 1.12
phase0 processBlock - 250000 vs - 7PWei worstcase 87.391 ms/op 81.105 ms/op 1.08
phase0 afterProcessEpoch - 250000 vs - 7PWei 247.43 ms/op 228.21 ms/op 1.08
phase0 beforeProcessEpoch - 250000 vs - 7PWei 662.38 ms/op 617.06 ms/op 1.07
phase0 processEpoch - mainnet_e58758 897.20 ms/op 844.49 ms/op 1.06
mainnet_e58758 - phase0 beforeProcessEpoch 496.70 ms/op 502.65 ms/op 0.99
mainnet_e58758 - phase0 processJustificationAndFinalization 77.463 us/op 94.390 us/op 0.82
mainnet_e58758 - phase0 processRewardsAndPenalties 113.10 ms/op 90.104 ms/op 1.26
mainnet_e58758 - phase0 processRegistryUpdates 42.213 us/op 65.771 us/op 0.64
mainnet_e58758 - phase0 processSlashings 3.0970 us/op 3.8530 us/op 0.80
mainnet_e58758 - phase0 processEth1DataReset 2.8140 us/op 3.8790 us/op 0.73
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 6.4130 ms/op 5.9721 ms/op 1.07
mainnet_e58758 - phase0 processSlashingsReset 15.072 us/op 20.429 us/op 0.74
mainnet_e58758 - phase0 processRandaoMixesReset 20.560 us/op 30.084 us/op 0.68
mainnet_e58758 - phase0 processHistoricalRootsUpdate 3.9910 us/op 5.2410 us/op 0.76
mainnet_e58758 - phase0 processParticipationRecordUpdates 14.290 us/op 17.428 us/op 0.82
mainnet_e58758 - phase0 afterProcessEpoch 223.73 ms/op 210.45 ms/op 1.06
phase0 processEffectiveBalanceUpdates - 250000 normalcase 7.1530 ms/op 6.7833 ms/op 1.05
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 7.7530 ms/op 7.3329 ms/op 1.06
phase0 processRegistryUpdates - 250000 normalcase 52.908 us/op 64.304 us/op 0.82
phase0 processRegistryUpdates - 250000 badcase_full_deposits 3.2630 ms/op 3.1090 ms/op 1.05
phase0 processRegistryUpdates - 250000 worstcase 0.5 1.7423 s/op 1.6230 s/op 1.07
phase0 getAttestationDeltas - 250000 normalcase 15.489 ms/op 14.479 ms/op 1.07
phase0 getAttestationDeltas - 250000 worstcase 15.122 ms/op 14.678 ms/op 1.03
phase0 processSlashings - 250000 worstcase 39.508 ms/op 37.001 ms/op 1.07
shuffle list - 16384 els 15.437 ms/op 15.498 ms/op 1.00
shuffle list - 250000 els 220.67 ms/op 214.61 ms/op 1.03
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 546.42 us/op 521.40 us/op 1.05
pass gossip attestations to forkchoice per slot 16.997 ms/op 15.198 ms/op 1.12
computeDeltas 3.8398 ms/op 3.6439 ms/op 1.05
computeProposerBoostScoreFromBalances 596.53 us/op 562.24 us/op 1.06
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 2.4949 ms/op 2.1135 ms/op 1.18
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 835.47 us/op 792.54 us/op 1.05
BLS verify - blst-native 2.2163 ms/op 2.1887 ms/op 1.01
BLS verifyMultipleSignatures 3 - blst-native 4.5168 ms/op 4.5066 ms/op 1.00
BLS verifyMultipleSignatures 8 - blst-native 9.8205 ms/op 9.6566 ms/op 1.02
BLS verifyMultipleSignatures 32 - blst-native 35.674 ms/op 34.622 ms/op 1.03
BLS aggregatePubkeys 32 - blst-native 46.915 us/op 44.401 us/op 1.06
BLS aggregatePubkeys 128 - blst-native 182.89 us/op 169.58 us/op 1.08
getAttestationsForBlock 73.528 ms/op 66.289 ms/op 1.11
CheckpointStateCache - add get delete 21.933 us/op 19.848 us/op 1.11
validate gossip signedAggregateAndProof - struct 5.7286 ms/op 4.9744 ms/op 1.15
validate gossip signedAggregateAndProof - treeBacked 5.5734 ms/op 4.8056 ms/op 1.16
validate gossip attestation - struct 2.6254 ms/op 2.3469 ms/op 1.12
validate gossip attestation - treeBacked 2.5485 ms/op 2.2815 ms/op 1.12
pickEth1Vote - no votes 10.828 ms/op 9.3109 ms/op 1.16
pickEth1Vote - max votes 59.946 ms/op 52.216 ms/op 1.15
pickEth1Vote - Eth1Data hashTreeRoot value x2048 29.666 ms/op 29.581 ms/op 1.00
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 10.963 ms/op 10.518 ms/op 1.04
pickEth1Vote - Eth1Data fastSerialize value x2048 6.0151 ms/op 5.5213 ms/op 1.09
pickEth1Vote - Eth1Data fastSerialize tree x2048 26.496 ms/op 25.370 ms/op 1.04
bytes32 toHexString 1.9530 us/op 1.7280 us/op 1.13
bytes32 Buffer.toString(hex) 832.00 ns/op 763.00 ns/op 1.09
bytes32 Buffer.toString(hex) from Uint8Array 1.1620 us/op 1.0860 us/op 1.07
bytes32 Buffer.toString(hex) + 0x 824.00 ns/op 818.00 ns/op 1.01
Object access 1 prop 0.41300 ns/op 0.32900 ns/op 1.26
Map access 1 prop 0.35800 ns/op 0.31100 ns/op 1.15
Object get x1000 20.341 ns/op 19.493 ns/op 1.04
Map get x1000 1.2720 ns/op 1.1040 ns/op 1.15
Object set x1000 124.77 ns/op 110.01 ns/op 1.13
Map set x1000 76.488 ns/op 67.359 ns/op 1.14
Return object 10000 times 0.45040 ns/op 0.41760 ns/op 1.08
Throw Error 10000 times 6.8318 us/op 6.5021 us/op 1.05
enrSubnets - fastDeserialize 64 bits 1.4480 us/op 1.3050 us/op 1.11
enrSubnets - ssz BitVector 64 bits 19.731 us/op 17.395 us/op 1.13
enrSubnets - fastDeserialize 4 bits 532.00 ns/op 477.00 ns/op 1.12
enrSubnets - ssz BitVector 4 bits 3.4280 us/op 3.3260 us/op 1.03
RateTracker 1000000 limit, 1 obj count per request 212.15 ns/op 190.77 ns/op 1.11
RateTracker 1000000 limit, 2 obj count per request 155.87 ns/op 139.88 ns/op 1.11
RateTracker 1000000 limit, 4 obj count per request 130.50 ns/op 116.08 ns/op 1.12
RateTracker 1000000 limit, 8 obj count per request 116.99 ns/op 103.37 ns/op 1.13
RateTracker with prune 4.3800 us/op 3.8660 us/op 1.13
array of 16000 items push then shift 3.6990 us/op 3.4328 us/op 1.08
LinkedList of 16000 items push then shift 19.406 ns/op 17.314 ns/op 1.12
array of 16000 items push then pop 227.33 ns/op 232.41 ns/op 0.98
LinkedList of 16000 items push then pop 18.905 ns/op 18.621 ns/op 1.02
array of 24000 items push then shift 5.4129 us/op 5.0387 us/op 1.07
LinkedList of 24000 items push then shift 21.167 ns/op 18.976 ns/op 1.12
array of 24000 items push then pop 231.25 ns/op 200.18 ns/op 1.16
LinkedList of 24000 items push then pop 20.379 ns/op 19.349 ns/op 1.05

by benchmarkbot/action

Copy link
Contributor

@dapplion dapplion left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's goo!

@g11tech g11tech merged commit bdeef8d into master Mar 3, 2022
@g11tech g11tech deleted the g11tech/devnet5 branch March 3, 2022 05:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants