Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Refactor Benchmarks for Less Wasm Memory Usage #9373

Merged
77 commits merged into from
Aug 1, 2021

Conversation

shawntabrizi
Copy link
Member

@shawntabrizi shawntabrizi commented Jul 19, 2021

This extracts the repeat and steps loop of the benchmarking pipeline outside of the wasm instance, and into the client, which reduces the wasm memory needs of the benchmarking pipeline by collecting the results of each repeat using the client memory instead.

To do this, we made the following changes:

  • Expose the list of available benchmarks from the runtime from the runtime apis
    • This allowed us to create a proper --list flag which shows the available benchmarks for the runtime
  • Make it so that dispatch_benchmark does at most 1 benchmark (one pallet, one extrinsic, one repeat, one step) per call
    • Extracted wildcard flags for pallet / extrinsic and determining which benchmarks need to run into CLI
    • Move steps and repeat loop into the CLI
      • Modified the steps and repeat input into the runtime to be a tuple, such that we describe to the benchmark which loop and step we are on out of the total loops and steps
  • Some code which re-collects all the benchmarks that are run so they are organized in an expected way for analysis

fixes: #9285

@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 19, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-refactor-benchmarks" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
"pallet_balances": "transfer"
"pallet_balances": "set_balance_creating"
"pallet_balances": "force_transfer"
"pallet_balances": "transfer_all"
"pallet_balances": "transfer_keep_alive"
"pallet_balances": "set_balance_killing"
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    76.26
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    76.26
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.73
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.73
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    74.71
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    74.71
              µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    69.78
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    69.78
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    56.68
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    56.68
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.08
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    37.08
              µs

Reads = 1
Writes = 1

…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 19, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-refactor-benchmarks" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
"pallet_balances": "set_balance_creating"
"pallet_balances": "transfer_keep_alive"
"pallet_balances": "force_transfer"
"pallet_balances": "transfer"
"pallet_balances": "transfer_all"
"pallet_balances": "set_balance_killing"
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.43
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    30.43
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    55.63
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    55.63
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    74.59
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    74.59
              µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    75.29
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    75.29
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    68.79
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    68.79
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     37.1
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     37.1
              µs

Reads = 1
Writes = 1

@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_staking

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 19, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-refactor-benchmarks" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
"pallet_staking": "kick"
"pallet_staking": "set_controller"
"pallet_staking": "force_new_era_always"
"pallet_staking": "withdraw_unbonded_update"
"pallet_staking": "force_unstake"
"pallet_staking": "cancel_deferred_slash"
"pallet_staking": "withdraw_unbonded_kill"
"pallet_staking": "payout_stakers_alive_staked"
"pallet_staking": "rebond"
"pallet_staking": "get_npos_voters"
"pallet_staking": "force_no_eras"
"pallet_staking": "set_invulnerables"
"pallet_staking": "payout_stakers_dead_controller"
"pallet_staking": "chill"
"pallet_staking": "set_payee"
"pallet_staking": "nominate"
"pallet_staking": "get_npos_targets"
"pallet_staking": "force_new_era"
"pallet_staking": "set_history_depth"
"pallet_staking": "set_staking_limits"
"pallet_staking": "bond_extra"
"pallet_staking": "validate"
"pallet_staking": "set_validator_count"
"pallet_staking": "unbond"
"pallet_staking": "reap_stash"
"pallet_staking": "new_era"
"pallet_staking": "bond"
"pallet_staking": "chill_other"
Pallet: "pallet_staking", Extrinsic: "kick", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19.84
    + k    16.68
              µs

Reads = 1 + (1 * k)
Writes = 0 + (1 * k)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    k   mean µs  sigma µs       %
    1      37.4     0.128    0.3%
    3     72.12     0.336    0.4%
    5     103.5     0.395    0.3%
    7     137.8     0.347    0.2%
    9     169.6     0.323    0.1%
   11     204.4     0.641    0.3%
   13     237.7     0.951    0.3%
   15     269.9      0.52    0.1%
   17     302.2     0.925    0.3%
   19     335.6     0.782    0.2%
   21     372.2     0.962    0.2%
   23     401.3     1.058    0.2%
   25     436.6     1.084    0.2%
   27     469.1     1.085    0.2%
   29     503.9     1.106    0.2%
   31     534.4     1.066    0.1%
   33     575.4     7.371    1.2%
   35     600.9     2.352    0.3%
   37     634.8     1.201    0.1%
   39       669     7.336    1.0%
   41     702.3      1.45    0.2%
   43     732.7     2.311    0.3%
   45     763.7     1.785    0.2%
   47     804.1     3.114    0.3%
   49     839.2      5.89    0.7%
   51     868.4     1.755    0.2%
   53       905      2.89    0.3%
   55     941.2     3.988    0.4%
   57     970.5     2.477    0.2%
   59      1003     3.947    0.3%
   61      1035       6.8    0.6%
   63      1072     2.873    0.2%
   65      1098     2.569    0.2%
   67      1130     2.668    0.2%
   69      1175     6.074    0.5%
   71      1205     11.28    0.9%
   73      1236     3.044    0.2%
   75      1270     7.576    0.5%
   77      1301     8.901    0.6%
   79      1333     3.142    0.2%
   81      1366     5.456    0.3%
   83      1394     4.452    0.3%
   85      1424     5.733    0.4%
   87      1462     5.755    0.3%
   89      1511     10.69    0.7%
   91      1536     3.551    0.2%
   93      1568     10.39    0.6%
   95      1592     4.115    0.2%
   97      1643     13.22    0.8%
   99      1660     4.428    0.2%
  101      1698     11.37    0.6%
  103      1738     9.763    0.5%
  105      1795     14.37    0.8%
  107      1819     6.837    0.3%
  109      1851     8.976    0.4%
  111      1890      7.33    0.3%
  113      1921     10.15    0.5%
  115      1953     4.358    0.2%
  117      1982     11.19    0.5%
  119      2008     6.496    0.3%
  121      2054     10.15    0.4%
  123      2104      16.3    0.7%
  125      2111     8.384    0.3%
  127      2148     9.545    0.4%

Quality and confidence:
param     error
k          0.01

Model:
Time ~=    15.68
    + k    16.77
              µs

Reads = 1 + (1 * k)
Writes = 0 + (1 * k)
Pallet: "pallet_staking", Extrinsic: "set_controller", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    26.43
              µs

Reads = 3
Writes = 3
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    26.43
              µs

Reads = 3
Writes = 3
Pallet: "pallet_staking", Extrinsic: "force_new_era_always", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     2.37
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     2.37
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "withdraw_unbonded_update", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    51.69
    + s    0.025
              µs

Reads = 4 + (0 * s)
Writes = 3 + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0     51.39     0.197    0.3%
    2     51.35      0.12    0.2%
    4     51.67     0.132    0.2%
    6     51.39     0.163    0.3%
    8     51.74     0.148    0.2%
   10     51.97     0.118    0.2%
   12     52.17     0.153    0.2%
   14     52.09     0.129    0.2%
   16     51.87     0.172    0.3%
   18      52.3     0.192    0.3%
   20     52.34     0.119    0.2%
   22      52.2     0.191    0.3%
   24     52.36     0.162    0.3%
   26     52.24      0.15    0.2%
   28     52.36     0.141    0.2%
   30      52.6     0.192    0.3%
   32     52.52     0.115    0.2%
   34     52.51     0.166    0.3%
   36     52.48     0.077    0.1%
   38     52.92     0.117    0.2%
   40     52.98     0.114    0.2%
   42     53.12     0.066    0.1%
   44     53.24     0.238    0.4%
   46     52.77     0.192    0.3%
   48     53.16     0.111    0.2%
   50     53.28     0.089    0.1%
   52     53.24     0.166    0.3%
   54     53.29     0.126    0.2%
   56     53.32     0.149    0.2%
   58     53.24     0.146    0.2%
   60     53.59     0.215    0.4%
   62      53.4     0.169    0.3%
   64     53.55     0.185    0.3%
   66     53.23     0.136    0.2%
   68     53.53     0.135    0.2%
   70      53.9     0.064    0.1%
   72      53.6     0.123    0.2%
   74     53.41     0.168    0.3%
   76     53.81     0.208    0.3%
   78     53.63     0.105    0.1%
   80     53.98     0.228    0.4%
   82     53.69     0.204    0.3%
   84     53.99     0.128    0.2%
   86     53.53     0.186    0.3%
   88     53.67     0.121    0.2%
   90     53.75     0.115    0.2%
   92     53.97     0.103    0.1%
   94     53.68     0.173    0.3%
   96     53.94     0.146    0.2%
   98     54.02     0.107    0.1%
  100     54.12     0.185    0.3%

Quality and confidence:
param     error
s             0

Model:
Time ~=    51.71
    + s    0.026
              µs

Reads = 4 + (0 * s)
Writes = 3 + (0 * s)
Pallet: "pallet_staking", Extrinsic: "force_unstake", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    61.74
    + s    2.396
              µs

Reads = 6 + (0 * s)
Writes = 6 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0     57.47     0.118    0.2%
    2      65.5      0.12    0.1%
    4     70.46     0.169    0.2%
    6     75.86     0.208    0.2%
    8     80.48     0.142    0.1%
   10     85.14     0.155    0.1%
   12     90.16     0.226    0.2%
   14     95.72     0.172    0.1%
   16     100.6     0.197    0.1%
   18     105.3     0.175    0.1%
   20     110.1     0.198    0.1%
   22     115.1     0.231    0.2%
   24     119.4     0.262    0.2%
   26     124.5     0.186    0.1%
   28     129.5     0.348    0.2%
   30     133.7     0.122    0.0%
   32     138.4     0.172    0.1%
   34     143.4      0.26    0.1%
   36     148.5     0.276    0.1%
   38     153.1     0.356    0.2%
   40     157.8     0.202    0.1%
   42     162.9     0.344    0.2%
   44     167.5     0.209    0.1%
   46     172.2     0.229    0.1%
   48     177.1     0.269    0.1%
   50     181.2     0.306    0.1%
   52       186     0.292    0.1%
   54     191.3     0.203    0.1%
   56     195.8     0.205    0.1%
   58     200.7     0.199    0.0%
   60     204.9     0.391    0.1%
   62       211     0.296    0.1%
   64     214.8     0.367    0.1%
   66     219.5      0.21    0.0%
   68     224.4     0.419    0.1%
   70     229.6      0.45    0.1%
   72     233.9     0.617    0.2%
   74     239.3     0.375    0.1%
   76     243.4     0.336    0.1%
   78     247.6     0.454    0.1%
   80     253.5     1.061    0.4%
   82     257.3     0.323    0.1%
   84       262     0.282    0.1%
   86     267.3     0.261    0.0%
   88       272     0.456    0.1%
   90     276.2     0.495    0.1%
   92     284.1     1.791    0.6%
   94     288.1     0.611    0.2%
   96     292.3     0.342    0.1%
   98     297.5     0.407    0.1%
  100     301.3     0.462    0.1%

Quality and confidence:
param     error
s         0.001

Model:
Time ~=    61.43
    + s    2.402
              µs

Reads = 6 + (0 * s)
Writes = 6 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "cancel_deferred_slash", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     3793
    + s       20
              µs

Reads = 1 + (0 * s)
Writes = 1 + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    1     250.2     0.926    0.3%
   20     991.2     0.959    0.0%
   39      1721     10.29    0.5%
   58      2446      12.2    0.4%
   77      3150     4.287    0.1%
   96      3833     8.904    0.2%
  115      4501     9.895    0.2%
  134      5150     3.969    0.0%
  153      5798     13.85    0.2%
  172      6419     9.658    0.1%
  191      7035      11.2    0.1%
  210      7636     24.21    0.3%
  229      8212     15.57    0.1%
  248      8801     12.64    0.1%
  267      9353     11.12    0.1%
  286      9924     31.86    0.3%
  305     10440     28.38    0.2%
  324     10930     23.33    0.2%
  343     11440      25.6    0.2%
  362     11930     30.58    0.2%
  381     12400     26.79    0.2%
  400     12830     13.98    0.1%
  419     13280     17.49    0.1%
  438     13720     17.61    0.1%
  457     14120     19.68    0.1%
  476     14560     29.55    0.2%
  495     14910     17.56    0.1%
  514     15290     34.43    0.2%
  533     15650     21.02    0.1%
  552     16000     18.25    0.1%
  571     16340     32.94    0.2%
  590     16650     25.74    0.1%
  609     16960     28.85    0.1%
  628     17250     35.04    0.2%
  647     17530     28.28    0.1%
  666     17750     29.92    0.1%
  685     18000     25.94    0.1%
  704     18240     36.13    0.1%
  723     18460     48.21    0.2%
  742     18630     34.11    0.1%
  761     18870     24.83    0.1%
  780     19000     38.62    0.2%
  799     19170     35.13    0.1%
  818     19310     43.01    0.2%
  837     19440     24.13    0.1%
  856     19560     33.86    0.1%
  875     19670     25.37    0.1%
  894     19780     31.15    0.1%
  913     19830     31.41    0.1%
  932     19860     24.05    0.1%
  951     19950     43.97    0.2%
  970     19960     33.53    0.1%
  989     19990     45.37    0.2%

Quality and confidence:
param     error
s         0.222

Model:
Time ~=     3382
    + s    19.96
              µs

Reads = 1 + (0 * s)
Writes = 1 + (0 * s)
Pallet: "pallet_staking", Extrinsic: "withdraw_unbonded_kill", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    86.17
    + s    2.352
              µs

Reads = 8 + (0 * s)
Writes = 6 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0      81.8      0.25    0.3%
    2     89.72     0.172    0.1%
    4      95.1     0.133    0.1%
    6     99.93     0.241    0.2%
    8     103.9     0.175    0.1%
   10       109     0.243    0.2%
   12     114.1     0.265    0.2%
   14     119.4     0.185    0.1%
   16     123.7     0.258    0.2%
   18     128.9     0.212    0.1%
   20     133.6     0.253    0.1%
   22     138.3     0.296    0.2%
   24     143.5     0.122    0.0%
   26       148      0.23    0.1%
   28     152.5     0.436    0.2%
   30     157.4     0.286    0.1%
   32     161.9     0.464    0.2%
   34     166.6     0.239    0.1%
   36     170.9     0.266    0.1%
   38     175.8     0.272    0.1%
   40     181.4     1.036    0.5%
   42     185.8     0.239    0.1%
   44     190.3     0.403    0.2%
   46     194.9     0.303    0.1%
   48     200.3     0.721    0.3%
   50     203.6     0.262    0.1%
   52     207.7     0.179    0.0%
   54     212.9     0.363    0.1%
   56     217.7      0.43    0.1%
   58     223.1     0.867    0.3%
   60     226.5     0.215    0.0%
   62     232.1     0.496    0.2%
   64     236.6     0.379    0.1%
   66     241.3     0.156    0.0%
   68     245.5      0.36    0.1%
   70     251.4     0.519    0.2%
   72     254.9     0.512    0.2%
   74     259.8     0.238    0.0%
   76     264.6     0.416    0.1%
   78     268.9     0.397    0.1%
   80       274     0.847    0.3%
   82       279     0.587    0.2%
   84     283.1     0.694    0.2%
   86     286.2     0.343    0.1%
   88       293     0.491    0.1%
   90     296.8     0.548    0.1%
   92     303.5     0.482    0.1%
   94     307.5     0.663    0.2%
   96     312.7     0.556    0.1%
   98     316.5     0.501    0.1%
  100     321.5      0.61    0.1%

Quality and confidence:
param     error
s         0.001

Model:
Time ~=    85.98
    + s    2.355
              µs

Reads = 8 + (0 * s)
Writes = 6 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "payout_stakers_alive_staked", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    153.2
    + n    62.02
              µs

Reads = 11 + (5 * n)
Writes = 3 + (3 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     206.1     0.372    0.1%
    6     519.6     6.012    1.1%
   11     839.8     7.048    0.8%
   16      1142     8.334    0.7%
   21      1452     3.814    0.2%
   26      1774     10.14    0.5%
   31      2064     13.23    0.6%
   36      2387     7.948    0.3%
   41      2692     9.287    0.3%
   46      3020     10.18    0.3%
   51      3311     10.96    0.3%
   56      3615     11.48    0.3%
   61      3895     6.422    0.1%
   66      4247     13.07    0.3%
   71      4549     17.78    0.3%
   76      4861     10.44    0.2%
   81      5145     15.11    0.2%
   86      5468      17.4    0.3%
   91      5832     13.45    0.2%
   96      6171     12.47    0.2%
  101      6466     15.56    0.2%
  106      6746     25.01    0.3%
  111      7034      16.9    0.2%
  116      7367     30.72    0.4%
  121      7692     13.47    0.1%
  126      7979     26.94    0.3%
  131      8316     19.94    0.2%
  136      8593      25.3    0.2%
  141      8875     12.12    0.1%
  146      9185     14.09    0.1%
  151      9527     25.95    0.2%
  156      9810     43.02    0.4%
  161     10080     27.57    0.2%
  166     10460     32.19    0.3%
  171     10730     41.65    0.3%
  176     11060     34.33    0.3%
  181     11420     21.58    0.1%
  186     11740     26.98    0.2%
  191     12070     38.35    0.3%
  196     12270     31.02    0.2%
  201     12630      39.2    0.3%
  206     12950     11.79    0.0%
  211     13240     23.94    0.1%
  216     13610     26.26    0.1%
  221     13900     36.32    0.2%
  226     14160     32.12    0.2%
  231     14440     35.55    0.2%
  236     14820     34.07    0.2%
  241     15040      28.8    0.1%
  246     15360     33.08    0.2%
  251     15680     39.46    0.2%
  256     16040     29.46    0.1%

Quality and confidence:
param     error
n         0.022

Model:
Time ~=    154.3
    + n    62.04
              µs

Reads = 11 + (5 * n)
Writes = 3 + (3 * n)
Pallet: "pallet_staking", Extrinsic: "rebond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.59
    + l     0.06
              µs

Reads = 3 + (0 * l)
Writes = 3 + (0 * l)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    l   mean µs  sigma µs       %
    1     49.35     0.129    0.2%
    2     48.72     0.165    0.3%
    3     48.35     0.201    0.4%
    4     48.48     0.181    0.3%
    5     48.59     0.192    0.3%
    6     48.66     0.244    0.5%
    7     49.01     0.112    0.2%
    8      48.8     0.178    0.3%
    9     49.13     0.162    0.3%
   10        49     0.168    0.3%
   11     49.27     0.167    0.3%
   12     49.59     0.103    0.2%
   13      49.5     0.203    0.4%
   14     49.58     0.148    0.2%
   15     49.48      0.16    0.3%
   16     49.53     0.185    0.3%
   17     50.02     0.152    0.3%
   18     49.99     0.118    0.2%
   19     50.06     0.181    0.3%
   20     49.97     0.184    0.3%
   21     49.92     0.114    0.2%
   22     49.94     0.122    0.2%
   23     50.17     0.121    0.2%
   24     49.95     0.109    0.2%
   25     49.98     0.133    0.2%
   26      50.2     0.151    0.3%
   27     49.84     0.242    0.4%
   28     50.43     0.155    0.3%
   29     50.33     0.154    0.3%
   30     50.34     0.166    0.3%
   31     50.26     0.117    0.2%
   32     50.25     0.186    0.3%

Quality and confidence:
param     error
l         0.001

Model:
Time ~=    48.59
    + l     0.06
              µs

Reads = 3 + (0 * l)
Writes = 3 + (0 * l)
Pallet: "pallet_staking", Extrinsic: "get_npos_voters", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v    26.37
    + n    28.25
    + s    21.21
              µs

Reads = 3 + (3 * v) + (3 * n) + (1 * s)
Writes = 0 + (0 * v) + (0 * n) + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v     n     s   mean µs  sigma µs       %
  500  1000    20     41370     265.5    0.6%
  510  1000    20     41650     110.1    0.2%
  520  1000    20     42600     86.58    0.2%
  530  1000    20     42130     270.1    0.6%
  540  1000    20     42210     175.4    0.4%
  550  1000    20     42550     169.2    0.3%
  560  1000    20     43210     120.1    0.2%
  570  1000    20     43170     243.9    0.5%
  580  1000    20     43560     111.8    0.2%
  590  1000    20     44200     145.7    0.3%
  600  1000    20     43900     125.8    0.2%
  610  1000    20     44500     195.4    0.4%
  620  1000    20     43920     193.5    0.4%
  630  1000    20     44480     169.8    0.3%
  640  1000    20     45240     116.1    0.2%
  650  1000    20     45300     195.1    0.4%
  660  1000    20     45510     115.2    0.2%
  670  1000    20     46010     260.4    0.5%
  680  1000    20     46620     198.5    0.4%
  690  1000    20     46510     150.5    0.3%
  700  1000    20     46030     158.6    0.3%
  710  1000    20     47040       231    0.4%
  720  1000    20     48010     199.7    0.4%
  730  1000    20     47870     89.44    0.1%
  740  1000    20     48420     216.3    0.4%
  750  1000    20     47800     250.2    0.5%
  760  1000    20     48310     180.4    0.3%
  770  1000    20     49290     132.1    0.2%
  780  1000    20     48820     212.3    0.4%
  790  1000    20     48890     145.7    0.2%
  800  1000    20     48420     154.4    0.3%
  810  1000    20     49360     176.5    0.3%
  820  1000    20     49320     270.8    0.5%
  830  1000    20     50650     207.1    0.4%
  840  1000    20     49860     174.6    0.3%
  850  1000    20     50330     279.7    0.5%
  860  1000    20     51340     191.6    0.3%
  870  1000    20     51100     200.9    0.3%
  880  1000    20     52040     255.3    0.4%
  890  1000    20     51590     240.8    0.4%
  900  1000    20     52040     211.5    0.4%
  910  1000    20     52760     95.95    0.1%
  920  1000    20     52570     157.3    0.2%
  930  1000    20     52960     380.8    0.7%
  940  1000    20     53600     230.7    0.4%
  950  1000    20     54220     259.9    0.4%
  960  1000    20     53790       218    0.4%
  970  1000    20     53740     264.7    0.4%
  980  1000    20     53870     259.5    0.4%
  990  1000    20     54100     152.8    0.2%
 1000   500    20     40050     162.1    0.4%
 1000   510    20     40950       204    0.4%
 1000   520    20     40910     191.8    0.4%
 1000   530    20     41390     148.5    0.3%
 1000   540    20     41430     174.3    0.4%
 1000   550    20     41850     151.4    0.3%
 1000   560    20     42610     160.3    0.3%
 1000   570    20     42340     161.6    0.3%
 1000   580    20     42690     98.18    0.2%
 1000   590    20     42880     131.7    0.3%
 1000   600    20     42740     151.7    0.3%
 1000   610    20     43980     191.9    0.4%
 1000   620    20     43890     118.2    0.2%
 1000   630    20     44390       261    0.5%
 1000   640    20     43760     153.2    0.3%
 1000   650    20     43890     127.5    0.2%
 1000   660    20     45030     258.8    0.5%
 1000   670    20     45240       109    0.2%
 1000   680    20     45840     165.6    0.3%
 1000   690    20     45870     127.6    0.2%
 1000   700    20     46150     299.6    0.6%
 1000   710    20     46440     124.4    0.2%
 1000   720    20     46510     322.1    0.6%
 1000   730    20     46840     223.6    0.4%
 1000   740    20     47040     170.5    0.3%
 1000   750    20     47500     125.3    0.2%
 1000   760    20     47550     160.6    0.3%
 1000   770    20     47570     247.6    0.5%
 1000   780    20     48810     188.7    0.3%
 1000   790    20     48200       179    0.3%
 1000   800    20     48180     122.1    0.2%
 1000   810    20     49220     313.6    0.6%
 1000   820    20     49030     265.7    0.5%
 1000   830    20     49950     222.2    0.4%
 1000   840    20     49980     182.7    0.3%
 1000   850    20     49870     205.7    0.4%
 1000   860    20     51110     180.7    0.3%
 1000   870    20     51360     160.3    0.3%
 1000   880    20     51080     314.5    0.6%
 1000   890    20     51710     215.7    0.4%
 1000   900    20     52100     233.6    0.4%
 1000   910    20     52140     163.2    0.3%
 1000   920    20     52540       294    0.5%
 1000   930    20     52660     172.8    0.3%
 1000   940    20     52980     132.7    0.2%
 1000   950    20     52610     308.2    0.5%
 1000   960    20     53690     89.41    0.1%
 1000   970    20     53980     228.9    0.4%
 1000   980    20     53550       276    0.5%
 1000   990    20     53880     122.9    0.2%
 1000  1000     1     53630     240.7    0.4%
 1000  1000     2     54010     263.8    0.4%
 1000  1000     3     53720     470.8    0.8%
 1000  1000     4     54150     219.6    0.4%
 1000  1000     5     54630     270.8    0.4%
 1000  1000     6     53680     222.9    0.4%
 1000  1000     7     54870     119.1    0.2%
 1000  1000     8     54170       253    0.4%
 1000  1000     9     54360     328.8    0.6%
 1000  1000    10     54530     192.4    0.3%
 1000  1000    11     53920     370.8    0.6%
 1000  1000    12     54590       246    0.4%
 1000  1000    13     54760     158.2    0.2%
 1000  1000    14     54680     249.3    0.4%
 1000  1000    15     54880     143.7    0.2%
 1000  1000    16     54730     272.1    0.4%
 1000  1000    17     53910     178.6    0.3%
 1000  1000    18     54240     169.7    0.3%
 1000  1000    19     54650     199.1    0.3%
 1000  1000    20     54300     182.4    0.3%

Quality and confidence:
param     error
v         0.095
n         0.095
s         3.234

Model:
Time ~=        0
    + v    26.31
    + n    28.53
    + s    31.15
              µs

Reads = 3 + (3 * v) + (3 * n) + (1 * s)
Writes = 0 + (0 * v) + (0 * n) + (0 * s)
Pallet: "pallet_staking", Extrinsic: "force_no_eras", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.396
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.396
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "set_invulnerables", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.393
    + v    0.005
              µs

Reads = 0 + (0 * v)
Writes = 1 + (0 * v)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v   mean µs  sigma µs       %
    0     2.446     0.013    0.5%
   20     2.707     0.027    0.9%
   40      2.86     0.024    0.8%
   60     2.889     0.019    0.6%
   80     2.955     0.025    0.8%
  100      3.02     0.022    0.7%
  120     3.115     0.027    0.8%
  140     3.211     0.024    0.7%
  160     3.243     0.028    0.8%
  180     3.356     0.031    0.9%
  200     3.436     0.027    0.7%
  220     3.507     0.029    0.8%
  240     3.543     0.016    0.4%
  260     3.649     0.021    0.5%
  280     3.791      0.04    1.0%
  300     3.843     0.036    0.9%
  320     3.937     0.041    1.0%
  340     4.037      0.05    1.2%
  360     4.175      0.04    0.9%
  380     4.196     0.032    0.7%
  400     4.306     0.044    1.0%
  420     4.461     0.042    0.9%
  440     4.596     0.052    1.1%
  460     4.712     0.044    0.9%
  480     4.881      0.06    1.2%
  500     4.941     0.099    2.0%
  520     5.077     0.051    1.0%
  540     5.232     0.083    1.5%
  560     5.348     0.064    1.1%
  580     5.474     0.062    1.1%
  600     5.606      0.04    0.7%
  620     5.685     0.055    0.9%
  640     5.741     0.036    0.6%
  660      5.92     0.036    0.6%
  680     6.076     0.055    0.9%
  700     6.107     0.048    0.7%
  720     6.232     0.037    0.5%
  740     6.305     0.034    0.5%
  760     6.395     0.058    0.9%
  780     6.588     0.067    1.0%
  800     6.704     0.035    0.5%
  820     6.778     0.051    0.7%
  840     6.896      0.04    0.5%
  860     7.025     0.046    0.6%
  880     7.038     0.055    0.7%
  900     7.183     0.045    0.6%
  920      7.25     0.038    0.5%
  940      7.42     0.044    0.5%
  960     7.529     0.043    0.5%
  980     7.607     0.093    1.2%
 1000     7.751     0.067    0.8%

Quality and confidence:
param     error
v             0

Model:
Time ~=    2.389
    + v    0.005
              µs

Reads = 0 + (0 * v)
Writes = 1 + (0 * v)
Pallet: "pallet_staking", Extrinsic: "payout_stakers_dead_controller", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    118.8
    + n    48.46
              µs

Reads = 10 + (3 * n)
Writes = 2 + (1 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     163.4      2.02    1.2%
    6     410.8     2.574    0.6%
   11     645.1     2.106    0.3%
   16     907.9     13.29    1.4%
   21      1143     12.66    1.1%
   26      1372     7.898    0.5%
   31      1612     7.802    0.4%
   36      1872     11.73    0.6%
   41      2115     9.087    0.4%
   46      2366     13.55    0.5%
   51      2599      12.1    0.4%
   56      2848     6.033    0.2%
   61      3071     13.24    0.4%
   66      3299     11.06    0.3%
   71      3563     17.92    0.5%
   76      3798     9.557    0.2%
   81      4057     13.16    0.3%
   86      4279     16.97    0.3%
   91      4540     38.41    0.8%
   96      4747     24.86    0.5%
  101      5002     11.49    0.2%
  106      5227     11.51    0.2%
  111      5477     17.62    0.3%
  116      5731     15.32    0.2%
  121      5959     9.313    0.1%
  126      6194     12.87    0.2%
  131      6471     16.59    0.2%
  136      6715     19.78    0.2%
  141      6940     6.953    0.1%
  146      7202     20.56    0.2%
  151      7466     10.91    0.1%
  156      7714     14.75    0.1%
  161      7939     11.58    0.1%
  166      8175     20.43    0.2%
  171      8413     16.99    0.2%
  176      8670      17.3    0.1%
  181      8899     20.16    0.2%
  186      9126     36.83    0.4%
  191      9394     39.17    0.4%
  196      9649      40.2    0.4%
  201      9839     29.26    0.2%
  206     10120     26.69    0.2%
  211     10350     26.59    0.2%
  216     10600     18.88    0.1%
  221     10830     27.14    0.2%
  226     11090     19.07    0.1%
  231     11280     31.64    0.2%
  236     11550      40.1    0.3%
  241     11790     25.32    0.2%
  246     12060     19.47    0.1%
  251     12310     36.82    0.2%
  256     12480     25.35    0.2%

Quality and confidence:
param     error
n         0.015

Model:
Time ~=    117.2
    + n    48.49
              µs

Reads = 10 + (3 * n)
Writes = 2 + (1 * n)
Pallet: "pallet_staking", Extrinsic: "chill", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    18.44
              µs

Reads = 3
Writes = 0
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    18.44
              µs

Reads = 3
Writes = 0
Pallet: "pallet_staking", Extrinsic: "set_payee", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    12.21
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    12.21
              µs

Reads = 1
Writes = 1
Pallet: "pallet_staking", Extrinsic: "nominate", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    41.39
    + n    5.434
              µs

Reads = 7 + (1 * n)
Writes = 2 + (0 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     46.52     0.186    0.3%
    2     52.23     0.179    0.3%
    3     57.16     0.213    0.3%
    4     62.88     0.172    0.2%
    5     68.31     0.222    0.3%
    6     74.29      0.09    0.1%
    7     79.29     0.125    0.1%
    8     85.33     0.198    0.2%
    9     90.81     0.211    0.2%
   10     96.84     0.344    0.3%
   11     102.2     0.332    0.3%
   12     106.9     0.205    0.1%
   13     111.8     0.206    0.1%
   14     116.9     0.205    0.1%
   15       122     0.312    0.2%
   16     127.1     0.495    0.3%

Quality and confidence:
param     error
n         0.011

Model:
Time ~=    41.51
    + n    5.416
              µs

Reads = 7 + (1 * n)
Writes = 2 + (0 * n)
Pallet: "pallet_staking", Extrinsic: "get_npos_targets", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v    11.34
              µs

Reads = 1 + (1 * v)
Writes = 0 + (0 * v)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v   mean µs  sigma µs       %
  500      5559     44.88    0.8%
  510      5724     30.06    0.5%
  520      5751      31.9    0.5%
  530      5903      59.5    1.0%
  540      6093      27.2    0.4%
  550      6158     49.94    0.8%
  560      6261     22.53    0.3%
  570      6364     25.84    0.4%
  580      6451     27.17    0.4%
  590      6519     23.97    0.3%
  600      6765     26.06    0.3%
  610      6694     79.58    1.1%
  620      6886     24.71    0.3%
  630      7109     47.64    0.6%
  640      7106     40.77    0.5%
  650      7261     43.88    0.6%
  660      7318     38.46    0.5%
  670      7381     43.44    0.5%
  680      7562     51.45    0.6%
  690      7680     37.97    0.4%
  700      7798     34.11    0.4%
  710      7854     34.48    0.4%
  720      8083     33.13    0.4%
  730      8201     48.97    0.5%
  740      8308     32.98    0.3%
  750      8385     71.72    0.8%
  760      8519     50.16    0.5%
  770      8669     47.97    0.5%
  780      8585     23.45    0.2%
  790      8812     54.21    0.6%
  800      8915     69.81    0.7%
  810      8908     29.84    0.3%
  820      9261     69.13    0.7%
  830      9261     50.49    0.5%
  840      9417     106.7    1.1%
  850      9509     41.66    0.4%
  860      9555     66.22    0.6%
  870      9699     51.21    0.5%
  880      9909     48.99    0.4%
  890      9937     89.99    0.9%
  900     10120     50.61    0.5%
  910     10160     79.47    0.7%
  920     10340     31.14    0.3%
  930     10360     56.31    0.5%
  940     10830     79.05    0.7%
  950     10620     64.79    0.6%
  960     10610     70.29    0.6%
  970     10800     65.26    0.6%
  980     11040      65.5    0.5%
  990     11270     49.85    0.4%
 1000     11340     35.12    0.3%

Quality and confidence:
param     error
v         0.028

Model:
Time ~=        0
    + v    11.36
              µs

Reads = 1 + (1 * v)
Writes = 0 + (0 * v)
Pallet: "pallet_staking", Extrinsic: "force_new_era", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.332
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.332
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "set_history_depth", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + e     34.8
              µs

Reads = 2 + (0 * e)
Writes = 4 + (7 * e)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    e   mean µs  sigma µs       %
    1     42.97     0.107    0.2%
    2     69.56     0.158    0.2%
    3     94.51     0.263    0.2%
    4     124.5     0.418    0.3%
    5       150     0.406    0.2%
    6     175.7     0.386    0.2%
    7     202.5     0.465    0.2%
    8     226.7     0.536    0.2%
    9     254.6     0.518    0.2%
   10       285     1.277    0.4%
   11     311.8     0.866    0.2%
   12       339     0.848    0.2%
   13       365     0.782    0.2%
   14     394.8     1.161    0.2%
   15     423.5     2.047    0.4%
   16       452     1.172    0.2%
   17     481.8      0.71    0.1%
   18     511.8     1.819    0.3%
   19     538.6     1.094    0.2%
   20     570.3     1.712    0.3%
   21     601.9     2.921    0.4%
   22     632.7     2.814    0.4%
   23     664.1     1.118    0.1%
   24     692.9      4.14    0.5%
   25     726.1     2.336    0.3%
   26     761.5     1.448    0.1%
   27     793.4     2.887    0.3%
   28     829.2     1.155    0.1%
   29     861.3     12.53    1.4%
   30     887.4     2.267    0.2%
   31     913.1     2.505    0.2%
   32     949.1      3.01    0.3%
   33     987.5     7.584    0.7%
   34      1020     2.307    0.2%
   35      1049     2.421    0.2%
   36      1098     10.09    0.9%
   37      1112     10.59    0.9%
   38      1142     6.414    0.5%
   39      1172     7.982    0.6%
   40      1203     4.913    0.4%
   41      1239     10.01    0.8%
   42      1269     3.063    0.2%
   43      1306     9.691    0.7%
   44      1333      6.15    0.4%
   45      1378     12.98    0.9%
   46      1412     13.67    0.9%
   47      1447     10.93    0.7%
   48      1490     12.23    0.8%
   49      1506     3.392    0.2%
   50      1541     3.319    0.2%
   51      1588     11.77    0.7%
   52      1628     9.922    0.6%
   53      1687     12.39    0.7%
   54      1706     10.35    0.6%
   55      1743     15.69    0.9%
   56      1762     5.346    0.3%
   57      1814     11.93    0.6%
   58      1856     13.71    0.7%
   59      1873     10.48    0.5%
   60      1931      15.7    0.8%
   61      1959     14.11    0.7%
   62      1990      8.19    0.4%
   63      2005     9.622    0.4%
   64      2076     9.194    0.4%
   65      2071     5.285    0.2%
   66      2115     11.61    0.5%
   67      2155     17.82    0.8%
   68      2203     10.23    0.4%
   69      2237     12.37    0.5%
   70      2273     12.21    0.5%
   71      2320     10.04    0.4%
   72      2366     9.315    0.3%
   73      2410     6.207    0.2%
   74      2436     10.67    0.4%
   75      2474     11.36    0.4%
   76      2503     19.57    0.7%
   77      2540     8.886    0.3%
   78      2582     10.24    0.3%
   79      2597     14.95    0.5%
   80      2678     12.47    0.4%
   81      2715     7.266    0.2%
   82      2739     10.71    0.3%
   83      2780     9.314    0.3%
   84      2839     10.76    0.3%
   85      2890      11.7    0.4%
   86      2905     14.48    0.4%
   87      2964     18.72    0.6%
   88      2998     12.74    0.4%
   89      3040     5.051    0.1%
   90      3083     11.11    0.3%
   91      3132     9.764    0.3%
   92      3176     12.67    0.3%
   93      3189     6.812    0.2%
   94      3239     15.84    0.4%
   95      3307     13.28    0.4%
   96      3331     11.24    0.3%
   97      3382     17.01    0.5%
   98      3415     13.77    0.4%
   99      3464     9.525    0.2%
  100      3502      10.3    0.2%

Quality and confidence:
param     error
e         0.068

Model:
Time ~=        0
    + e    35.02
              µs

Reads = 2 + (0 * e)
Writes = 4 + (7 * e)
Pallet: "pallet_staking", Extrinsic: "set_staking_limits", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    6.412
              µs

Reads = 0
Writes = 5
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    6.412
              µs

Reads = 0
Writes = 5
Pallet: "pallet_staking", Extrinsic: "bond_extra", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    56.61
              µs

Reads = 3
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    56.61
              µs

Reads = 3
Writes = 2
Pallet: "pallet_staking", Extrinsic: "validate", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    34.65
              µs

Reads = 6
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    34.65
              µs

Reads = 6
Writes = 2
Pallet: "pallet_staking", Extrinsic: "set_validator_count", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.284
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.284
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "unbond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    60.74
              µs

Reads = 6
Writes = 3
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    60.74
              µs

Reads = 6
Writes = 3
Pallet: "pallet_staking", Extrinsic: "reap_stash", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    72.92
    + s    2.333
              µs

Reads = 7 + (0 * s)
Writes = 8 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    1     73.34     0.114    0.1%
    2     75.85      0.16    0.2%
    3     78.28     0.269    0.3%
    4     81.31     0.125    0.1%
    5     83.89     0.161    0.1%
    6     86.19     0.232    0.2%
    7      88.7     0.113    0.1%
    8     91.09     0.088    0.0%
    9     93.36     0.166    0.1%
   10     95.87     0.133    0.1%
   11     98.44     0.224    0.2%
   12     100.9     0.222    0.2%
   13     102.9     0.133    0.1%
   14     105.8     0.185    0.1%
   15     107.6      0.14    0.1%
   16       110     0.278    0.2%
   17     112.3      0.19    0.1%
   18       115     0.305    0.2%
   19     116.8     0.174    0.1%
   20     119.3     0.118    0.0%
   21     122.2     0.138    0.1%
   22     124.4     0.181    0.1%
   23     126.8     0.156    0.1%
   24     130.4     1.181    0.9%
   25     131.8     0.348    0.2%
   26     134.3     0.457    0.3%
   27     136.5     0.092    0.0%
   28     139.2     0.197    0.1%
   29     141.2     0.232    0.1%
   30     143.8     0.223    0.1%
   31     145.9     0.172    0.1%
   32     147.9      0.17    0.1%
   33     150.1     0.144    0.0%
   34     152.7     0.144    0.0%
   35     154.7     0.222    0.1%
   36     157.2     0.425    0.2%
   37       160     0.254    0.1%
   38     161.9     0.261    0.1%
   39     164.8     0.383    0.2%
   40       167     0.144    0.0%
   41     169.3     0.207    0.1%
   42     171.8     0.515    0.2%
   43     173.4      0.22    0.1%
   44     176.1     0.353    0.2%
   45     178.2     0.395    0.2%
   46     180.4      0.31    0.1%
   47     182.7     0.231    0.1%
   48     185.5     0.272    0.1%
   49     187.2     0.306    0.1%
   50     189.2     0.255    0.1%
   51     191.3     0.277    0.1%
   52     194.2      0.32    0.1%
   53     196.8     0.372    0.1%
   54     199.1     0.341    0.1%
   55     201.7     0.299    0.1%
   56       204     0.255    0.1%
   57     206.5     0.402    0.1%
   58     208.5     0.306    0.1%
   59     211.3     0.394    0.1%
   60     212.2     0.268    0.1%
   61     215.8     0.268    0.1%
   62     217.9     0.441    0.2%
   63       220     0.214    0.0%
   64       222     0.279    0.1%
   65     224.8     0.433    0.1%
   66     227.1     0.383    0.1%
   67     229.1     0.308    0.1%
   68     231.4     0.306    0.1%
   69     233.6      0.53    0.2%
   70       236     0.586    0.2%
   71     238.8     0.585    0.2%
   72     240.7     0.296    0.1%
   73     242.2     0.393    0.1%
   74       245      0.53    0.2%
   75     248.1     0.546    0.2%
   76       250     0.458    0.1%
   77     251.8     0.176    0.0%
   78     254.4      0.55    0.2%
   79     257.5     0.862    0.3%
   80       258      0.47    0.1%
   81     260.5     0.459    0.1%
   82     263.9     0.734    0.2%
   83     265.3     0.285    0.1%
   84     267.6     0.449    0.1%
   85     271.1     1.307    0.4%
   86     272.3     0.704    0.2%
   87     275.6     0.331    0.1%
   88     277.8     1.049    0.3%
   89     280.1     0.762    0.2%
   90     281.5     0.281    0.0%
   91     283.8     0.593    0.2%
   92     288.4     0.638    0.2%
   93     290.6     0.563    0.1%
   94     292.1     0.502    0.1%
   95     293.4     0.256    0.0%
   96     296.7     0.279    0.0%
   97     299.5     0.383    0.1%
   98     302.1     0.809    0.2%
   99     304.5     0.495    0.1%
  100       307     1.414    0.4%

Quality and confidence:
param     error
s             0

Model:
Time ~=    72.93
    + s    2.332
              µs

Reads = 7 + (0 * s)
Writes = 8 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "new_era", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v      287
    + n    48.26
              µs

Reads = 10 + (3 * v) + (3 * n)
Writes = 4 + (3 * v) + (0 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v     n   mean µs  sigma µs       %
    1   100      2825     20.07    0.7%
    2   100      3095     10.35    0.3%
    3   100      3289     10.54    0.3%
    4   100      3533     17.04    0.4%
    5   100      3801     9.474    0.2%
    6   100      4078     12.79    0.3%
    7   100      4405     9.998    0.2%
    8   100      4649     17.32    0.3%
    9   100      5069     11.79    0.2%
   10     1     618.4     10.13    1.6%
   10     2     682.4     8.602    1.2%
   10     3     721.6      12.9    1.7%
   10     4     766.9     3.496    0.4%
   10     5     819.6     6.803    0.8%
   10     6       874     11.93    1.3%
   10     7     926.5     13.57    1.4%
   10     8       972     12.09    1.2%
   10     9      1031     14.04    1.3%
   10    10      1071     12.68    1.1%
   10    11      1125     13.03    1.1%
   10    12      1154     11.85    1.0%
   10    13      1233     14.96    1.2%
   10    14      1285     13.82    1.0%
   10    15      1332     12.75    0.9%
   10    16      1363     11.61    0.8%
   10    17      1410     8.523    0.6%
   10    18      1467     12.74    0.8%
   10    19      1502      10.4    0.6%
   10    20      1552     8.513    0.5%
   10    21      1580     13.15    0.8%
   10    22      1644     15.03    0.9%
   10    23      1714     10.01    0.5%
   10    24      1748     10.52    0.6%
   10    25      1809     11.26    0.6%
   10    26      1854     12.25    0.6%
   10    27      1912      14.5    0.7%
   10    28      1973     7.201    0.3%
   10    29      2016     12.52    0.6%
   10    30      2063     10.27    0.4%
   10    31      2106     7.638    0.3%
   10    32      2159     9.635    0.4%
   10    33      2214     12.96    0.5%
   10    34      2255     12.65    0.5%
   10    35      2314     11.56    0.4%
   10    36      2349     10.04    0.4%
   10    37      2415     11.29    0.4%
   10    38      2467     8.446    0.3%
   10    39      2517     11.01    0.4%
   10    40      2539     9.462    0.3%
   10    41      2634     13.09    0.4%
   10    42      2638     14.86    0.5%
   10    43      2724     14.21    0.5%
   10    44      2747     16.47    0.5%
   10    45      2796     17.92    0.6%
   10    46      2836     16.24    0.5%
   10    47      2879     7.044    0.2%
   10    48      2954     9.777    0.3%
   10    49      2975     18.69    0.6%
   10    50      3038     16.42    0.5%
   10    51      3028     17.47    0.5%
   10    52      3124     11.75    0.3%
   10    53      3173      16.4    0.5%
   10    54      3194     16.45    0.5%
   10    55      3294     15.09    0.4%
   10    56      3298     20.77    0.6%
   10    57      3344     28.63    0.8%
   10    58      3423     14.51    0.4%
   10    59      3460     17.77    0.5%
   10    60      3541     14.34    0.4%
   10    61      3566      16.6    0.4%
   10    62      3617     12.87    0.3%
   10    63      3662     14.83    0.4%
   10    64      3696     12.03    0.3%
   10    65      3784     14.99    0.3%
   10    66      3841     16.68    0.4%
   10    67      3862     15.15    0.3%
   10    68      3914     11.24    0.2%
   10    69      3941     12.42    0.3%
   10    70      4002     20.07    0.5%
   10    71      4024     5.854    0.1%
   10    72      4108     10.53    0.2%
   10    73      4149     14.18    0.3%
   10    74      4161     13.21    0.3%
   10    75      4269     9.372    0.2%
   10    76      4312     12.75    0.2%
   10    77      4331     17.44    0.4%
   10    78      4355     11.76    0.2%
   10    79      4387     16.31    0.3%
   10    80      4467     8.711    0.1%
   10    81      4509     9.617    0.2%
   10    82      4578     17.97    0.3%
   10    83      4615     13.88    0.3%
   10    84      4631     17.38    0.3%
   10    85      4681     17.65    0.3%
   10    86      4723     19.95    0.4%
   10    87      4781     10.57    0.2%
   10    88      4785     10.31    0.2%
   10    89      4880      18.8    0.3%
   10    90      4925     10.77    0.2%
   10    91      4966     14.27    0.2%
   10    92      5026     8.477    0.1%
   10    93      5061     10.86    0.2%
   10    94      5096     13.61    0.2%
   10    95      5160      17.2    0.3%
   10    96      5207     13.33    0.2%
   10    97      5253     24.49    0.4%
   10    98      5322     18.24    0.3%
   10    99      5351     14.23    0.2%
   10   100      5392     13.57    0.2%

Quality and confidence:
param     error
v         0.847
n         0.042

Model:
Time ~=        0
    + v    302.6
    + n    47.99
              µs

Reads = 10 + (3 * v) + (3 * n)
Writes = 4 + (3 * v) + (0 * n)
Pallet: "pallet_staking", Extrinsic: "bond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    73.98
              µs

Reads = 5
Writes = 4
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    73.98
              µs

Reads = 5
Writes = 4
Pallet: "pallet_staking", Extrinsic: "chill_other", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    61.38
              µs

Reads = 7
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    61.38
              µs

Reads = 7
Writes = 2

Parity Benchmarking Bot and others added 3 commits July 19, 2021 03:32
…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_balances

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 21, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-refactor-benchmarks" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
"pallet_balances": "transfer"
"pallet_balances": "transfer_keep_alive"
"pallet_balances": "set_balance_creating"
"pallet_balances": "set_balance_killing"
"pallet_balances": "force_transfer"
"pallet_balances": "transfer_all"
Pallet: "pallet_balances", Extrinsic: "transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    78.13
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    78.13
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "transfer_keep_alive", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    57.45
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    57.45
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_creating", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    31.66
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    31.66
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "set_balance_killing", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     37.9
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     37.9
              µs

Reads = 1
Writes = 1
Pallet: "pallet_balances", Extrinsic: "force_transfer", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    76.51
              µs

Reads = 2
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    76.51
              µs

Reads = 2
Writes = 2
Pallet: "pallet_balances", Extrinsic: "transfer_all", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=       71
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=       71
              µs

Reads = 1
Writes = 1

Parity Benchmarking Bot and others added 4 commits July 21, 2021 03:02
…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi
Copy link
Member Author

/benchmark runtime pallet pallet_staking

@parity-benchapp
Copy link

parity-benchapp bot commented Jul 21, 2021

Benchmark Runtime Pallet for branch "shawntabrizi-refactor-benchmarks" with command cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic="*" --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

Results
"pallet_staking": "bond"
"pallet_staking": "bond_extra"
"pallet_staking": "unbond"
"pallet_staking": "withdraw_unbonded_update"
"pallet_staking": "withdraw_unbonded_kill"
"pallet_staking": "validate"
"pallet_staking": "kick"
"pallet_staking": "nominate"
"pallet_staking": "chill"
"pallet_staking": "set_payee"
"pallet_staking": "set_controller"
"pallet_staking": "set_validator_count"
"pallet_staking": "force_no_eras"
"pallet_staking": "force_new_era"
"pallet_staking": "force_new_era_always"
"pallet_staking": "set_invulnerables"
"pallet_staking": "force_unstake"
"pallet_staking": "cancel_deferred_slash"
"pallet_staking": "payout_stakers_dead_controller"
"pallet_staking": "payout_stakers_alive_staked"
"pallet_staking": "rebond"
"pallet_staking": "set_history_depth"
"pallet_staking": "reap_stash"
"pallet_staking": "new_era"
"pallet_staking": "get_npos_voters"
"pallet_staking": "get_npos_targets"
"pallet_staking": "set_staking_limits"
"pallet_staking": "chill_other"
Pallet: "pallet_staking", Extrinsic: "bond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     73.5
              µs

Reads = 5
Writes = 4
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     73.5
              µs

Reads = 5
Writes = 4
Pallet: "pallet_staking", Extrinsic: "bond_extra", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    57.01
              µs

Reads = 3
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    57.01
              µs

Reads = 3
Writes = 2
Pallet: "pallet_staking", Extrinsic: "unbond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    61.25
              µs

Reads = 6
Writes = 3
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    61.25
              µs

Reads = 6
Writes = 3
Pallet: "pallet_staking", Extrinsic: "withdraw_unbonded_update", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    52.05
    + s    0.021
              µs

Reads = 4 + (0 * s)
Writes = 3 + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0     51.75     0.173    0.3%
    2     51.99     0.086    0.1%
    4     51.82     0.172    0.3%
    6     52.13     0.164    0.3%
    8     52.06     0.199    0.3%
   10     51.93     0.133    0.2%
   12      52.5     0.158    0.3%
   14     52.14     0.252    0.4%
   16     52.47     0.348    0.6%
   18     52.46     0.198    0.3%
   20     52.61     0.177    0.3%
   22     52.41      0.18    0.3%
   24     52.79     0.178    0.3%
   26     52.53     0.114    0.2%
   28      52.6     0.265    0.5%
   30     52.57     0.135    0.2%
   32     52.67      0.14    0.2%
   34     53.16     0.236    0.4%
   36     53.15     0.133    0.2%
   38     52.96     0.156    0.2%
   40     53.02     0.122    0.2%
   42     53.21      0.16    0.3%
   44        53     0.129    0.2%
   46      53.3     0.104    0.1%
   48     53.28     0.154    0.2%
   50      52.9     0.176    0.3%
   52     53.31     0.175    0.3%
   54      53.4     0.129    0.2%
   56     53.39       0.2    0.3%
   58     53.59     0.207    0.3%
   60     53.51     0.166    0.3%
   62      53.6     0.124    0.2%
   64     53.71     0.097    0.1%
   66     53.41     0.093    0.1%
   68     53.57     0.073    0.1%
   70     53.77     0.228    0.4%
   72     53.62      0.08    0.1%
   74     53.56     0.106    0.1%
   76     53.82      0.17    0.3%
   78     53.72     0.346    0.6%
   80     53.94     0.211    0.3%
   82     53.94     0.275    0.5%
   84     53.69     0.079    0.1%
   86     54.09     0.192    0.3%
   88     53.79     0.122    0.2%
   90     53.96     0.083    0.1%
   92     53.86     0.138    0.2%
   94     54.09     0.382    0.7%
   96     53.85     0.249    0.4%
   98     53.78     0.255    0.4%
  100        54     0.122    0.2%

Quality and confidence:
param     error
s             0

Model:
Time ~=    52.06
    + s    0.022
              µs

Reads = 4 + (0 * s)
Writes = 3 + (0 * s)
Pallet: "pallet_staking", Extrinsic: "withdraw_unbonded_kill", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    86.65
    + s    2.419
              µs

Reads = 8 + (0 * s)
Writes = 6 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0     82.31     0.317    0.3%
    2     90.14     0.154    0.1%
    4     95.81     0.227    0.2%
    6     100.6     0.201    0.1%
    8     106.1     0.447    0.4%
   10     110.3     0.203    0.1%
   12     116.3      0.26    0.2%
   14     120.8     0.272    0.2%
   16       125     0.402    0.3%
   18     130.5     0.298    0.2%
   20     134.6     0.237    0.1%
   22     140.1     0.156    0.1%
   24     145.6     0.285    0.1%
   26     149.8     0.205    0.1%
   28     154.8     0.369    0.2%
   30     159.6     0.556    0.3%
   32     164.6     0.498    0.3%
   34     168.9     0.559    0.3%
   36     173.5      0.56    0.3%
   38     178.5     0.219    0.1%
   40     183.9     0.361    0.1%
   42     188.6     0.644    0.3%
   44     193.4       0.5    0.2%
   46     197.9     0.533    0.2%
   48       203     0.392    0.1%
   50     207.1     0.798    0.3%
   52     212.1     0.337    0.1%
   54     217.5     0.386    0.1%
   56       222     0.451    0.2%
   58     227.4     0.618    0.2%
   60     231.4     0.698    0.3%
   62       237      1.14    0.4%
   64       241     0.835    0.3%
   66     245.4     0.516    0.2%
   68     250.8     0.534    0.2%
   70     255.8     1.485    0.5%
   72     260.4     0.723    0.2%
   74     266.2     1.489    0.5%
   76     269.7     0.994    0.3%
   78     275.5     0.715    0.2%
   80     280.2      0.52    0.1%
   82     285.6     0.985    0.3%
   84       289     0.464    0.1%
   86     292.8     1.568    0.5%
   88       299     0.921    0.3%
   90     302.4     0.809    0.2%
   92     311.5     0.855    0.2%
   94     314.3     1.107    0.3%
   96     319.8      1.02    0.3%
   98     324.3     1.145    0.3%
  100     328.8     0.872    0.2%

Quality and confidence:
param     error
s         0.001

Model:
Time ~=     86.3
    + s    2.425
              µs

Reads = 8 + (0 * s)
Writes = 6 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "validate", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    35.18
              µs

Reads = 6
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    35.18
              µs

Reads = 6
Writes = 2
Pallet: "pallet_staking", Extrinsic: "kick", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    19.76
    + k    16.81
              µs

Reads = 1 + (1 * k)
Writes = 0 + (1 * k)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    k   mean µs  sigma µs       %
    1     37.64     0.263    0.6%
    3     72.28     0.243    0.3%
    5     104.1       0.2    0.1%
    7     138.3     0.715    0.5%
    9     171.8     0.538    0.3%
   11     205.7     0.359    0.1%
   13     239.7     0.327    0.1%
   15       274     4.081    1.4%
   17     305.1       0.9    0.2%
   19       338     0.795    0.2%
   21     374.4      3.78    1.0%
   23     404.4     1.074    0.2%
   25     440.1     1.134    0.2%
   27     473.4     3.711    0.7%
   29       506     1.112    0.2%
   31     538.9     0.947    0.1%
   33     576.2     9.483    1.6%
   35     607.2      1.22    0.2%
   37     644.9     7.492    1.1%
   39     671.3     2.442    0.3%
   41     708.3     3.714    0.5%
   43     738.7     2.198    0.2%
   45     773.3     1.832    0.2%
   47     804.5     1.287    0.1%
   49     839.1      2.17    0.2%
   51     870.7     1.925    0.2%
   53     913.7     3.326    0.3%
   55     948.1     3.329    0.3%
   57     977.6     1.252    0.1%
   59      1004      1.87    0.1%
   61      1041     4.259    0.4%
   63      1075     3.083    0.2%
   65      1116     5.229    0.4%
   67      1146     1.485    0.1%
   69      1191     9.964    0.8%
   71      1220     6.986    0.5%
   73      1249     8.383    0.6%
   75      1275     3.458    0.2%
   77      1319     11.11    0.8%
   79      1349     11.44    0.8%
   81      1376     3.682    0.2%
   83      1415     4.593    0.3%
   85      1448     5.442    0.3%
   87      1473     2.976    0.2%
   89      1517     11.41    0.7%
   91      1552     9.301    0.5%
   93      1573     8.303    0.5%
   95      1611     7.879    0.4%
   97      1645       7.5    0.4%
   99      1678     7.357    0.4%
  101      1717     15.42    0.8%
  103      1760     15.07    0.8%
  105      1792     9.434    0.5%
  107      1830     13.95    0.7%
  109      1858     12.01    0.6%
  111      1896     11.82    0.6%
  113      1928        14    0.7%
  115      1957      7.54    0.3%
  117      1999     6.255    0.3%
  119      2040     14.38    0.7%
  121      2068      13.4    0.6%
  123      2111     11.58    0.5%
  125      2127     11.79    0.5%
  127      2174     15.44    0.7%

Quality and confidence:
param     error
k          0.01

Model:
Time ~=    16.16
    + k    16.89
              µs

Reads = 1 + (1 * k)
Writes = 0 + (1 * k)
Pallet: "pallet_staking", Extrinsic: "nominate", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    41.55
    + n    5.592
              µs

Reads = 7 + (1 * n)
Writes = 2 + (0 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     47.08     0.141    0.2%
    2     52.68     0.237    0.4%
    3     58.12     0.232    0.3%
    4     63.26     0.155    0.2%
    5     69.41     0.269    0.3%
    6     75.81     0.162    0.2%
    7     80.45     0.283    0.3%
    8     86.98       0.2    0.2%
    9     92.55      0.23    0.2%
   10     97.43      0.31    0.3%
   11     103.4     0.453    0.4%
   12     108.7     0.449    0.4%
   13     114.4     0.563    0.4%
   14       119     0.644    0.5%
   15     125.4     0.434    0.3%
   16     130.4     0.418    0.3%

Quality and confidence:
param     error
n         0.009

Model:
Time ~=    41.63
    + n    5.582
              µs

Reads = 7 + (1 * n)
Writes = 2 + (0 * n)
Pallet: "pallet_staking", Extrinsic: "chill", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     18.7
              µs

Reads = 3
Writes = 0
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=     18.7
              µs

Reads = 3
Writes = 0
Pallet: "pallet_staking", Extrinsic: "set_payee", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    12.68
              µs

Reads = 1
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    12.68
              µs

Reads = 1
Writes = 1
Pallet: "pallet_staking", Extrinsic: "set_controller", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    26.72
              µs

Reads = 3
Writes = 3
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    26.72
              µs

Reads = 3
Writes = 3
Pallet: "pallet_staking", Extrinsic: "set_validator_count", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.309
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.309
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "force_no_eras", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.508
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.508
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "force_new_era", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.483
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.483
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "force_new_era_always", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.487
              µs

Reads = 0
Writes = 1
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.487
              µs

Reads = 0
Writes = 1
Pallet: "pallet_staking", Extrinsic: "set_invulnerables", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    2.478
    + v    0.005
              µs

Reads = 0 + (0 * v)
Writes = 1 + (0 * v)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v   mean µs  sigma µs       %
    0     2.532     0.018    0.7%
   20     2.739     0.023    0.8%
   40     2.891     0.025    0.8%
   60     2.956     0.044    1.4%
   80     3.028     0.035    1.1%
  100     3.119     0.027    0.8%
  120     3.205      0.02    0.6%
  140     3.292     0.029    0.8%
  160     3.336     0.032    0.9%
  180      3.41     0.023    0.6%
  200     3.493     0.037    1.0%
  220     3.588      0.03    0.8%
  240     3.628      0.03    0.8%
  260      3.78     0.024    0.6%
  280     3.835     0.025    0.6%
  300     3.951      0.04    1.0%
  320     4.032      0.05    1.2%
  340     4.081     0.045    1.1%
  360     4.228     0.043    1.0%
  380     4.305     0.032    0.7%
  400     4.394     0.049    1.1%
  420     4.546     0.036    0.7%
  440     4.625     0.046    0.9%
  460     4.788     0.039    0.8%
  480      4.94     0.072    1.4%
  500      5.06     0.063    1.2%
  520     5.118     0.041    0.8%
  540     5.239     0.067    1.2%
  560     5.397     0.063    1.1%
  580      5.55     0.074    1.3%
  600     5.669     0.032    0.5%
  620     5.761     0.036    0.6%
  640     5.726     0.049    0.8%
  660     5.982     0.052    0.8%
  680     6.094     0.074    1.2%
  700     6.129     0.044    0.7%
  720     6.284     0.066    1.0%
  740     6.418     0.059    0.9%
  760     6.463     0.032    0.4%
  780     6.579     0.067    1.0%
  800     6.799     0.041    0.6%
  820     6.814     0.062    0.9%
  840     6.916     0.026    0.3%
  860     7.045     0.082    1.1%
  880     7.151     0.039    0.5%
  900     7.205     0.068    0.9%
  920     7.329     0.071    0.9%
  940     7.446     0.043    0.5%
  960     7.576     0.072    0.9%
  980     7.692     0.074    0.9%
 1000     7.863     0.077    0.9%

Quality and confidence:
param     error
v             0

Model:
Time ~=    2.465
    + v    0.005
              µs

Reads = 0 + (0 * v)
Writes = 1 + (0 * v)
Pallet: "pallet_staking", Extrinsic: "force_unstake", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    62.28
    + s    2.452
              µs

Reads = 6 + (0 * s)
Writes = 6 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    0     57.69     0.191    0.3%
    2     65.92     0.192    0.2%
    4     70.93     0.186    0.2%
    6     76.48     0.292    0.3%
    8     81.65     0.212    0.2%
   10     86.04     0.315    0.3%
   12     91.01     0.176    0.1%
   14      97.2     0.199    0.2%
   16     102.3     0.166    0.1%
   18       107     0.242    0.2%
   20     111.9     0.324    0.2%
   22     116.3      0.33    0.2%
   24     121.5     0.434    0.3%
   26     126.5     0.349    0.2%
   28     131.4     0.248    0.1%
   30     136.3     0.344    0.2%
   32       141      0.38    0.2%
   34     145.5     0.484    0.3%
   36       151     0.454    0.3%
   38     156.3     0.661    0.4%
   40     160.2     0.438    0.2%
   42     165.5     0.725    0.4%
   44       170     0.362    0.2%
   46     175.7     0.844    0.4%
   48     180.1     0.772    0.4%
   50     185.5     0.425    0.2%
   52     189.1     0.898    0.4%
   54     195.3     0.962    0.4%
   56     199.8     0.734    0.3%
   58     206.1     1.873    0.9%
   60       210     1.049    0.4%
   62     215.1     0.558    0.2%
   64     218.5      0.58    0.2%
   66     223.5     0.842    0.3%
   68     228.3     0.731    0.3%
   70     234.7     0.872    0.3%
   72     238.5     0.856    0.3%
   74     244.4     0.982    0.4%
   76     247.4     1.071    0.4%
   78     252.8     1.361    0.5%
   80     257.1     1.116    0.4%
   82       262     1.916    0.7%
   84       268     1.597    0.5%
   86     271.4     1.491    0.5%
   88     277.6     1.277    0.4%
   90     281.4     1.238    0.4%
   92     287.5     0.959    0.3%
   94     293.9     0.818    0.2%
   96     297.7     1.841    0.6%
   98     303.1     1.086    0.3%
  100     307.2     1.203    0.3%

Quality and confidence:
param     error
s         0.001

Model:
Time ~=    62.07
    + s    2.454
              µs

Reads = 6 + (0 * s)
Writes = 6 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "cancel_deferred_slash", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=     3857
    + s    19.95
              µs

Reads = 1 + (0 * s)
Writes = 1 + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    1       259     0.353    0.1%
   20      1006      9.71    0.9%
   39      1729     11.23    0.6%
   58      2457     19.55    0.7%
   77      3148     21.38    0.6%
   96      3841     10.41    0.2%
  115      4507      3.98    0.0%
  134      5169      20.2    0.3%
  153      5827     17.88    0.3%
  172      6438     13.22    0.2%
  191      7042     10.52    0.1%
  210      7657     10.38    0.1%
  229      8274     30.92    0.3%
  248      8823     21.42    0.2%
  267      9367      23.4    0.2%
  286      9918     26.08    0.2%
  305     10440     23.55    0.2%
  324     10950      33.8    0.3%
  343     11440     18.23    0.1%
  362     11940     25.05    0.2%
  381     12400     16.19    0.1%
  400     12870     26.37    0.2%
  419     13300     10.97    0.0%
  438     13750     35.98    0.2%
  457     14160     19.03    0.1%
  476     14570     36.03    0.2%
  495     14990     43.68    0.2%
  514     15290     21.31    0.1%
  533     15690     17.65    0.1%
  552     16030        13    0.0%
  571     16320     15.07    0.0%
  590     16690      17.4    0.1%
  609     16960      17.7    0.1%
  628     17230     31.66    0.1%
  647     17520     28.14    0.1%
  666     17780     22.64    0.1%
  685     18010     16.61    0.0%
  704     18240      14.8    0.0%
  723     18450     22.94    0.1%
  742     18680     22.46    0.1%
  761     18860     25.79    0.1%
  780     18990     17.78    0.0%
  799     19160     24.77    0.1%
  818     19320     20.36    0.1%
  837     19460     31.09    0.1%
  856     19530      21.3    0.1%
  875     19660      25.9    0.1%
  894     19760     28.51    0.1%
  913     19880     29.93    0.1%
  932     19910     32.28    0.1%
  951     19910     21.68    0.1%
  970     19950     31.56    0.1%
  989     19970      29.5    0.1%

Quality and confidence:
param     error
s         0.223

Model:
Time ~=     3403
    + s    19.94
              µs

Reads = 1 + (0 * s)
Writes = 1 + (0 * s)
Pallet: "pallet_staking", Extrinsic: "payout_stakers_dead_controller", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    113.5
    + n    48.58
              µs

Reads = 10 + (3 * n)
Writes = 2 + (1 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     162.7     0.593    0.3%
    6     407.7     1.561    0.3%
   11     647.7     1.666    0.2%
   16     893.9     5.741    0.6%
   21      1138     7.555    0.6%
   26      1375     8.711    0.6%
   31      1621     15.15    0.9%
   36      1871     15.95    0.8%
   41      2108     14.92    0.7%
   46      2345     13.45    0.5%
   51      2581     14.89    0.5%
   56      2826     7.804    0.2%
   61      3077     16.09    0.5%
   66      3290     11.48    0.3%
   71      3560     16.31    0.4%
   76      3787     9.794    0.2%
   81      4055     15.14    0.3%
   86      4275     16.22    0.3%
   91      4540     13.89    0.3%
   96      4786     17.07    0.3%
  101      5014     14.59    0.2%
  106      5256     21.78    0.4%
  111      5485     17.87    0.3%
  116      5717     17.95    0.3%
  121      5950     11.35    0.1%
  126      6213     15.04    0.2%
  131      6486     19.49    0.3%
  136      6720     18.74    0.2%
  141      6981     9.616    0.1%
  146      7222     16.75    0.2%
  151      7479     15.88    0.2%
  156      7715      15.9    0.2%
  161      7954     24.54    0.3%
  166      8189     18.83    0.2%
  171      8411     10.71    0.1%
  176      8747     28.16    0.3%
  181      8967     20.11    0.2%
  186      9159     20.12    0.2%
  191      9410     34.33    0.3%
  196      9622      26.5    0.2%
  201      9920     19.24    0.1%
  206     10130     16.38    0.1%
  211     10390     19.43    0.1%
  216     10610     18.73    0.1%
  221     10820      11.9    0.1%
  226     11080     22.76    0.2%
  231     11350     19.44    0.1%
  236     11510     45.82    0.3%
  241     11820     30.43    0.2%
  246     12020     23.91    0.1%
  251     12270     12.01    0.0%
  256     12580     25.56    0.2%

Quality and confidence:
param     error
n         0.017

Model:
Time ~=    111.1
    + n    48.61
              µs

Reads = 10 + (3 * n)
Writes = 2 + (1 * n)
Pallet: "pallet_staking", Extrinsic: "payout_stakers_alive_staked", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    148.7
    + n    62.18
              µs

Reads = 11 + (5 * n)
Writes = 3 + (3 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    n   mean µs  sigma µs       %
    1     205.8     1.098    0.5%
    6     518.6     0.764    0.1%
   11     829.3     1.721    0.2%
   16      1137     3.199    0.2%
   21      1466      4.88    0.3%
   26      1777     12.35    0.6%
   31      2071     6.805    0.3%
   36      2381     11.79    0.4%
   41      2693     11.91    0.4%
   46      3012     7.617    0.2%
   51      3318     10.18    0.3%
   56      3627     16.62    0.4%
   61      3943     25.59    0.6%
   66      4272     15.27    0.3%
   71      4536     15.67    0.3%
   76      4867     20.28    0.4%
   81      5169     19.81    0.3%
   86      5493     15.26    0.2%
   91      5860     12.87    0.2%
   96      6161     17.29    0.2%
  101      6410     20.19    0.3%
  106      6745     22.33    0.3%
  111      7074     18.06    0.2%
  116      7346     19.11    0.2%
  121      7659     14.48    0.1%
  126      8012     20.03    0.2%
  131      8324     13.77    0.1%
  136      8611     13.78    0.1%
  141      8909     20.21    0.2%
  146      9216     29.41    0.3%
  151      9524      21.5    0.2%
  156      9839     23.36    0.2%
  161     10120     9.439    0.0%
  166     10470     15.94    0.1%
  171     10720     29.86    0.2%
  176     11120     22.04    0.1%
  181     11400     41.51    0.3%
  186     11820     24.68    0.2%
  191     12070     13.63    0.1%
  196     12320      22.4    0.1%
  201     12650     33.66    0.2%
  206     12960     26.61    0.2%
  211     13280     44.72    0.3%
  216     13610        17    0.1%
  221     13860     32.14    0.2%
  226     14210     30.65    0.2%
  231     14490     45.16    0.3%
  236     14750     32.93    0.2%
  241     15200     60.96    0.4%
  246     15420     35.59    0.2%
  251     15730      49.7    0.3%
  256     16110     50.22    0.3%

Quality and confidence:
param     error
n         0.022

Model:
Time ~=    148.3
    + n    62.21
              µs

Reads = 11 + (5 * n)
Writes = 3 + (3 * n)
Pallet: "pallet_staking", Extrinsic: "rebond", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    48.66
    + l    0.063
              µs

Reads = 3 + (0 * l)
Writes = 3 + (0 * l)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    l   mean µs  sigma µs       %
    1     49.24     0.258    0.5%
    2     48.57     0.123    0.2%
    3     48.49     0.112    0.2%
    4      48.5     0.119    0.2%
    5     48.76     0.195    0.3%
    6     49.15     0.061    0.1%
    7        49     0.187    0.3%
    8     48.72     0.243    0.4%
    9     48.95     0.079    0.1%
   10     49.61     0.246    0.4%
   11     49.31     0.201    0.4%
   12     49.55     0.217    0.4%
   13     49.81     0.214    0.4%
   14     49.31     0.214    0.4%
   15     49.88     0.146    0.2%
   16     49.67     0.231    0.4%
   17     50.16     0.197    0.3%
   18     50.16     0.176    0.3%
   19     50.11     0.091    0.1%
   20     50.22     0.155    0.3%
   21     49.97     0.328    0.6%
   22     50.07     0.115    0.2%
   23     50.28     0.187    0.3%
   24     50.28     0.182    0.3%
   25      50.1     0.133    0.2%
   26      50.7     0.155    0.3%
   27     50.25     0.213    0.4%
   28     50.46     0.253    0.5%
   29     50.22     0.269    0.5%
   30     50.31     0.149    0.2%
   31     50.29     0.163    0.3%
   32     50.34      0.11    0.2%

Quality and confidence:
param     error
l         0.002

Model:
Time ~=    48.66
    + l    0.063
              µs

Reads = 3 + (0 * l)
Writes = 3 + (0 * l)
Pallet: "pallet_staking", Extrinsic: "set_history_depth", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + e    34.59
              µs

Reads = 2 + (0 * e)
Writes = 4 + (7 * e)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    e   mean µs  sigma µs       %
    1     42.49     0.275    0.6%
    2     69.56     0.425    0.6%
    3     95.06     0.312    0.3%
    4     123.8      0.31    0.2%
    5       149     0.391    0.2%
    6     173.2     0.541    0.3%
    7     201.2      0.76    0.3%
    8     226.5     0.899    0.3%
    9     253.4     0.547    0.2%
   10     283.1     2.062    0.7%
   11     310.8     1.403    0.4%
   12     341.9     5.028    1.4%
   13     362.4     0.575    0.1%
   14     394.1     1.278    0.3%
   15     420.9     0.607    0.1%
   16     451.3     2.157    0.4%
   17     481.9     1.032    0.2%
   18     510.1     1.903    0.3%
   19     536.8      0.58    0.1%
   20     565.7     0.971    0.1%
   21     602.1     6.305    1.0%
   22     626.8     1.843    0.2%
   23     663.8     6.957    1.0%
   24     687.2     1.931    0.2%
   25     727.7     3.096    0.4%
   26     753.1     2.428    0.3%
   27     784.2     2.622    0.3%
   28     822.9     9.722    1.1%
   29     852.3     3.647    0.4%
   30     879.8     4.641    0.5%
   31     917.6     1.602    0.1%
   32     942.4      1.42    0.1%
   33     977.4     2.321    0.2%
   34      1022     9.383    0.9%
   35      1049     12.72    1.2%
   36      1084     10.31    0.9%
   37      1106     9.078    0.8%
   38      1130     3.092    0.2%
   39      1165      4.22    0.3%
   40      1187     2.848    0.2%
   41      1236     7.445    0.6%
   42      1257      2.01    0.1%
   43      1297     15.72    1.2%
   44      1329     3.491    0.2%
   45      1366     4.337    0.3%
   46      1392     2.968    0.2%
   47      1432     5.565    0.3%
   48      1480     12.04    0.8%
   49      1500     8.337    0.5%
   50      1549     10.48    0.6%
   51      1581     10.25    0.6%
   52      1623     4.099    0.2%
   53      1645     4.314    0.2%
   54      1674     5.176    0.3%
   55      1728     11.83    0.6%
   56      1779     13.16    0.7%
   57      1805     10.48    0.5%
   58      1830      11.6    0.6%
   59      1881     8.079    0.4%
   60      1912      7.86    0.4%
   61      1935     5.289    0.2%
   62      1956     9.311    0.4%
   63      1987     6.329    0.3%
   64      2029     14.33    0.7%
   65      2072     10.38    0.5%
   66      2113     10.44    0.4%
   67      2156      15.2    0.7%
   68      2183     10.29    0.4%
   69      2212      12.6    0.5%
   70      2255     13.15    0.5%
   71      2289     11.12    0.4%
   72      2336     10.18    0.4%
   73      2368     7.673    0.3%
   74      2401     11.93    0.4%
   75      2480     6.416    0.2%
   76      2493     11.17    0.4%
   77      2551     10.32    0.4%
   78      2575     12.22    0.4%
   79      2604     8.529    0.3%
   80      2652     10.92    0.4%
   81      2691     7.219    0.2%
   82      2725      9.84    0.3%
   83      2781     14.95    0.5%
   84      2843     19.43    0.6%
   85      2870     11.53    0.4%
   86      2909      17.6    0.6%
   87      2954     15.82    0.5%
   88      3007     10.93    0.3%
   89      3021     20.36    0.6%
   90      3073     10.93    0.3%
   91      3107     16.22    0.5%
   92      3179     17.26    0.5%
   93      3198     11.12    0.3%
   94      3213     7.614    0.2%
   95      3282     7.461    0.2%
   96      3335     17.35    0.5%
   97      3375     14.49    0.4%
   98      3367      10.8    0.3%
   99      3456     15.12    0.4%
  100      3457     13.12    0.3%

Quality and confidence:
param     error
e          0.07

Model:
Time ~=        0
    + e    34.85
              µs

Reads = 2 + (0 * e)
Writes = 4 + (7 * e)
Pallet: "pallet_staking", Extrinsic: "reap_stash", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    73.46
    + s    2.391
              µs

Reads = 7 + (0 * s)
Writes = 8 + (1 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    s   mean µs  sigma µs       %
    1     74.29     0.202    0.2%
    2     76.86     0.243    0.3%
    3     79.35     0.173    0.2%
    4     82.46     0.247    0.2%
    5     84.64     0.161    0.1%
    6     87.25     0.247    0.2%
    7     89.94     0.184    0.2%
    8      91.9     0.231    0.2%
    9     94.25     0.111    0.1%
   10     96.74     0.206    0.2%
   11      99.8     0.211    0.2%
   12     102.1      0.17    0.1%
   13     104.5      0.15    0.1%
   14     106.9     0.327    0.3%
   15     109.6     0.258    0.2%
   16     111.3     0.312    0.2%
   17       114     0.233    0.2%
   18     116.8       0.2    0.1%
   19     118.7     0.292    0.2%
   20     121.2     0.251    0.2%
   21     123.7     0.269    0.2%
   22     126.5     0.345    0.2%
   23     128.7     0.253    0.1%
   24     131.5     0.267    0.2%
   25     134.2     0.288    0.2%
   26     136.1     0.312    0.2%
   27     138.4     0.673    0.4%
   28     141.2     0.303    0.2%
   29     143.6     0.145    0.1%
   30       146     0.208    0.1%
   31     147.7     0.483    0.3%
   32     150.3     0.751    0.4%
   33     152.8     0.582    0.3%
   34     154.9     0.336    0.2%
   35     157.3     0.488    0.3%
   36     160.8     0.527    0.3%
   37     161.9     0.436    0.2%
   38     164.5      0.41    0.2%
   39     167.2     0.413    0.2%
   40     169.1     0.401    0.2%
   41     171.9     0.546    0.3%
   42     174.4     0.841    0.4%
   43     176.4     0.701    0.3%
   44     179.3     0.385    0.2%
   45     181.3     0.566    0.3%
   46       183     0.534    0.2%
   47     186.2     0.452    0.2%
   48     188.3     0.661    0.3%
   49     191.2     0.471    0.2%
   50     192.4     0.806    0.4%
   51     195.1     0.863    0.4%
   52     196.5     0.491    0.2%
   53     200.4     0.694    0.3%
   54       203     0.547    0.2%
   55       206     0.463    0.2%
   56     208.2     0.907    0.4%
   57     209.6       0.7    0.3%
   58     212.1     1.014    0.4%
   59     214.8     0.998    0.4%
   60     216.5     0.381    0.1%
   61     220.8     0.672    0.3%
   62     222.1     0.741    0.3%
   63     223.9       1.1    0.4%
   64     225.9     0.707    0.3%
   65     228.4     1.458    0.6%
   66       232     1.256    0.5%
   67     233.2      0.91    0.3%
   68     235.6     0.828    0.3%
   69     238.3     0.736    0.3%
   70     239.5      0.93    0.3%
   71     243.6     0.773    0.3%
   72     244.4     0.887    0.3%
   73     247.7     1.009    0.4%
   74     250.8      0.92    0.3%
   75     252.4     1.212    0.4%
   76     255.8     0.294    0.1%
   77     257.3     0.993    0.3%
   78     260.4     1.046    0.4%
   79     263.2     0.705    0.2%
   80     264.4     0.868    0.3%
   81       266     0.737    0.2%
   82     268.3      0.93    0.3%
   83     271.7     1.283    0.4%
   84     272.4      1.41    0.5%
   85     276.1     0.957    0.3%
   86     278.7     0.968    0.3%
   87     280.7     1.757    0.6%
   88     281.4     1.485    0.5%
   89     285.1     0.966    0.3%
   90     286.7     1.031    0.3%
   91       289     1.188    0.4%
   92     294.2     1.315    0.4%
   93     296.6     1.119    0.3%
   94     298.3     0.759    0.2%
   95     299.7     1.637    0.5%
   96     304.2     1.074    0.3%
   97     305.5     1.081    0.3%
   98     309.9     1.818    0.5%
   99     310.9     1.366    0.4%
  100     312.7      1.96    0.6%

Quality and confidence:
param     error
s         0.001

Model:
Time ~=    73.47
    + s     2.39
              µs

Reads = 7 + (0 * s)
Writes = 8 + (1 * s)
Pallet: "pallet_staking", Extrinsic: "new_era", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v    289.4
    + n     48.7
              µs

Reads = 10 + (3 * v) + (3 * n)
Writes = 4 + (3 * v) + (0 * n)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v     n   mean µs  sigma µs       %
    1   100      2826     18.97    0.6%
    2   100      3101     17.24    0.5%
    3   100      3315     7.136    0.2%
    4   100      3494     12.79    0.3%
    5   100      3806     14.62    0.3%
    6   100      4080     12.46    0.3%
    7   100      4405      10.6    0.2%
    8   100      4671     10.43    0.2%
    9   100      5096     14.06    0.2%
   10     1     612.7      2.04    0.3%
   10     2     692.6     4.499    0.6%
   10     3       719     10.55    1.4%
   10     4     777.2     10.42    1.3%
   10     5     820.7     1.458    0.1%
   10     6     874.2      12.9    1.4%
   10     7     930.6      14.2    1.5%
   10     8     970.4     9.629    0.9%
   10     9      1024     7.768    0.7%
   10    10      1071     11.66    1.0%
   10    11      1111     3.985    0.3%
   10    12      1170     11.03    0.9%
   10    13      1223     5.216    0.4%
   10    14      1281      9.79    0.7%
   10    15      1330     12.58    0.9%
   10    16      1369     13.21    0.9%
   10    17      1423     10.86    0.7%
   10    18      1468     10.09    0.6%
   10    19      1505     11.98    0.7%
   10    20      1566     10.71    0.6%
   10    21      1600     12.28    0.7%
   10    22      1643     6.158    0.3%
   10    23      1730     10.16    0.5%
   10    24      1786     9.828    0.5%
   10    25      1822     8.652    0.4%
   10    26      1858      6.05    0.3%
   10    27      1923     11.32    0.5%
   10    28      1961      4.41    0.2%
   10    29      2026     14.12    0.6%
   10    30      2090     14.62    0.6%
   10    31      2111     19.49    0.9%
   10    32      2183     10.53    0.4%
   10    33      2240     11.77    0.5%
   10    34      2267     11.38    0.5%
   10    35      2313     14.19    0.6%
   10    36      2384     9.384    0.3%
   10    37      2409     9.464    0.3%
   10    38      2501     13.29    0.5%
   10    39      2519     15.24    0.6%
   10    40      2572     18.36    0.7%
   10    41      2641     14.46    0.5%
   10    42      2668     13.57    0.5%
   10    43      2761      10.2    0.3%
   10    44      2754     13.44    0.4%
   10    45      2796     13.41    0.4%
   10    46      2880     13.92    0.4%
   10    47      2902     22.06    0.7%
   10    48      2957     14.27    0.4%
   10    49      2982     11.27    0.3%
   10    50      3041     22.41    0.7%
   10    51      3068     19.62    0.6%
   10    52      3120     13.88    0.4%
   10    53      3193     20.75    0.6%
   10    54      3229        16    0.4%
   10    55      3293     12.11    0.3%
   10    56      3328     14.82    0.4%
   10    57      3391     17.12    0.5%
   10    58      3456     14.06    0.4%
   10    59      3508     11.42    0.3%
   10    60      3562      18.1    0.5%
   10    61      3651     17.32    0.4%
   10    62      3646      9.82    0.2%
   10    63      3693      17.1    0.4%
   10    64      3765     19.55    0.5%
   10    65      3824     15.21    0.3%
   10    66      3870     17.64    0.4%
   10    67      3893     11.63    0.2%
   10    68      3934      15.1    0.3%
   10    69      3958     14.75    0.3%
   10    70      4056     15.15    0.3%
   10    71      4030     12.81    0.3%
   10    72      4124     13.23    0.3%
   10    73      4175     6.095    0.1%
   10    74      4177     14.59    0.3%
   10    75      4241     12.49    0.2%
   10    76      4340     12.48    0.2%
   10    77      4370     14.04    0.3%
   10    78      4382     12.59    0.2%
   10    79      4397     18.22    0.4%
   10    80      4507     16.49    0.3%
   10    81      4554     15.43    0.3%
   10    82      4599      12.8    0.2%
   10    83      4666     11.97    0.2%
   10    84      4648     15.92    0.3%
   10    85      4712     15.79    0.3%
   10    86      4778     18.54    0.3%
   10    87      4868     20.86    0.4%
   10    88      4868     11.48    0.2%
   10    89      4858     10.97    0.2%
   10    90      4969     10.08    0.2%
   10    91      4992     15.91    0.3%
   10    92      5079     15.48    0.3%
   10    93      5093     19.86    0.3%
   10    94      5105     13.18    0.2%
   10    95      5220     14.65    0.2%
   10    96      5253     11.11    0.2%
   10    97      5305     10.56    0.1%
   10    98      5331     14.08    0.2%
   10    99      5424     20.84    0.3%
   10   100      5400     14.94    0.2%

Quality and confidence:
param     error
v          0.97
n         0.048

Model:
Time ~=        0
    + v    308.4
    + n    48.37
              µs

Reads = 10 + (3 * v) + (3 * n)
Writes = 4 + (3 * v) + (0 * n)
Pallet: "pallet_staking", Extrinsic: "get_npos_voters", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v    25.67
    + n    29.13
    + s    47.28
              µs

Reads = 3 + (3 * v) + (3 * n) + (1 * s)
Writes = 0 + (0 * v) + (0 * n) + (0 * s)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v     n     s   mean µs  sigma µs       %
  500  1000    20     41030     132.5    0.3%
  510  1000    20     42140       128    0.3%
  520  1000    20     42530     191.3    0.4%
  530  1000    20     41940     160.3    0.3%
  540  1000    20     42980     166.8    0.3%
  550  1000    20     42340     240.8    0.5%
  560  1000    20     42920     85.64    0.1%
  570  1000    20     43390     142.5    0.3%
  580  1000    20     43830     166.6    0.3%
  590  1000    20     44650     127.8    0.2%
  600  1000    20     44250     173.9    0.3%
  610  1000    20     44620     163.1    0.3%
  620  1000    20     44600     148.5    0.3%
  630  1000    20     45420     181.9    0.4%
  640  1000    20     45080     175.6    0.3%
  650  1000    20     45590     239.2    0.5%
  660  1000    20     45860       249    0.5%
  670  1000    20     46080     171.1    0.3%
  680  1000    20     46940       105    0.2%
  690  1000    20     47130     153.3    0.3%
  700  1000    20     47300     97.53    0.2%
  710  1000    20     46590     209.5    0.4%
  720  1000    20     46870     124.5    0.2%
  730  1000    20     46890     117.7    0.2%
  740  1000    20     47190     144.6    0.3%
  750  1000    20     47660     311.9    0.6%
  760  1000    20     48620     156.9    0.3%
  770  1000    20     48520     268.1    0.5%
  780  1000    20     48710     188.3    0.3%
  790  1000    20     49900       231    0.4%
  800  1000    20     49110     202.2    0.4%
  810  1000    20     49630       115    0.2%
  820  1000    20     49720     339.4    0.6%
  830  1000    20     50700     217.3    0.4%
  840  1000    20     50400     177.3    0.3%
  850  1000    20     49900     153.1    0.3%
  860  1000    20     50490       178    0.3%
  870  1000    20     50420     120.6    0.2%
  880  1000    20     52020     256.4    0.4%
  890  1000    20     52430     190.2    0.3%
  900  1000    20     52530     140.9    0.2%
  910  1000    20     52320       145    0.2%
  920  1000    20     51800     127.1    0.2%
  930  1000    20     52240     243.3    0.4%
  940  1000    20     53150     229.8    0.4%
  950  1000    20     53540     227.4    0.4%
  960  1000    20     53220     156.5    0.2%
  970  1000    20     53910       195    0.3%
  980  1000    20     53670     294.9    0.5%
  990  1000    20     55040     151.5    0.2%
 1000   500    20     40050     157.2    0.3%
 1000   510    20     40600       227    0.5%
 1000   520    20     40550     134.9    0.3%
 1000   530    20     41490     170.3    0.4%
 1000   540    20     41260     215.6    0.5%
 1000   550    20     41860       213    0.5%
 1000   560    20     42210     143.6    0.3%
 1000   570    20     42230     285.4    0.6%
 1000   580    20     43290     130.5    0.3%
 1000   590    20     42790     67.34    0.1%
 1000   600    20     43330     124.6    0.2%
 1000   610    20     43560     118.7    0.2%
 1000   620    20     43700     190.9    0.4%
 1000   630    20     44540     132.6    0.2%
 1000   640    20     44300     126.5    0.2%
 1000   650    20     43960       286    0.6%
 1000   660    20     44880     215.9    0.4%
 1000   670    20     44830     258.6    0.5%
 1000   680    20     45510     190.6    0.4%
 1000   690    20     46000     186.5    0.4%
 1000   700    20     45930     85.86    0.1%
 1000   710    20     46090     105.9    0.2%
 1000   720    20     46730       232    0.4%
 1000   730    20     46850     98.35    0.2%
 1000   740    20     46780     161.6    0.3%
 1000   750    20     47290     205.3    0.4%
 1000   760    20     47370     200.3    0.4%
 1000   770    20     48250     228.2    0.4%
 1000   780    20     48260     147.4    0.3%
 1000   790    20     48880     372.3    0.7%
 1000   800    20     49180     246.9    0.5%
 1000   810    20     49810     214.5    0.4%
 1000   820    20     50090     160.1    0.3%
 1000   830    20     49340     287.3    0.5%
 1000   840    20     50490     259.1    0.5%
 1000   850    20     50910     299.2    0.5%
 1000   860    20     50550       186    0.3%
 1000   870    20     51630     136.9    0.2%
 1000   880    20     50990     189.5    0.3%
 1000   890    20     52140     150.3    0.2%
 1000   900    20     52590     134.7    0.2%
 1000   910    20     52040     224.5    0.4%
 1000   920    20     52840     96.33    0.1%
 1000   930    20     53120     191.7    0.3%
 1000   940    20     53040     345.5    0.6%
 1000   950    20     53030       121    0.2%
 1000   960    20     53760     89.39    0.1%
 1000   970    20     53560     304.6    0.5%
 1000   980    20     54170     187.6    0.3%
 1000   990    20     55140     175.2    0.3%
 1000  1000     1     53880     181.3    0.3%
 1000  1000     2     53000     131.5    0.2%
 1000  1000     3     53800     128.1    0.2%
 1000  1000     4     54050     368.6    0.6%
 1000  1000     5     53850     110.2    0.2%
 1000  1000     6     53570     166.5    0.3%
 1000  1000     7     55050       245    0.4%
 1000  1000     8     53910     108.5    0.2%
 1000  1000     9     54930     169.9    0.3%
 1000  1000    10     53990     133.7    0.2%
 1000  1000    11     54420     422.6    0.7%
 1000  1000    12     54470     204.6    0.3%
 1000  1000    13     55060     138.3    0.2%
 1000  1000    14     54850       142    0.2%
 1000  1000    15     54170       151    0.2%
 1000  1000    16     54420     208.2    0.3%
 1000  1000    17     54550     171.8    0.3%
 1000  1000    18     54870     195.8    0.3%
 1000  1000    19     54630     209.1    0.3%
 1000  1000    20     54400     155.1    0.2%

Quality and confidence:
param     error
v         0.102
n         0.102
s         3.473

Model:
Time ~=        0
    + v     26.4
    + n    28.82
    + s     49.4
              µs

Reads = 3 + (3 * v) + (3 * n) + (1 * s)
Writes = 0 + (0 * v) + (0 * n) + (0 * s)
Pallet: "pallet_staking", Extrinsic: "get_npos_targets", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=        0
    + v    11.32
              µs

Reads = 1 + (1 * v)
Writes = 0 + (0 * v)
Min Squares Analysis
========
-- Extrinsic Time --

Data points distribution:
    v   mean µs  sigma µs       %
  500      5508     31.63    0.5%
  510      5684     22.88    0.4%
  520      5760     29.08    0.5%
  530      5949     32.03    0.5%
  540      6016     37.38    0.6%
  550      6146     49.99    0.8%
  560      6215     31.54    0.5%
  570      6240     41.02    0.6%
  580      6564     31.56    0.4%
  590      6570     48.32    0.7%
  600      6653      28.1    0.4%
  610      6817     59.06    0.8%
  620      6919     45.97    0.6%
  630      7025     28.64    0.4%
  640      7138     40.94    0.5%
  650      7312     31.55    0.4%
  660      7450     61.42    0.8%
  670      7534     31.45    0.4%
  680      7540     42.36    0.5%
  690      7793     49.59    0.6%
  700      7766     27.41    0.3%
  710      7891     27.82    0.3%
  720      8070     43.82    0.5%
  730      8343     49.85    0.5%
  740      8404     50.87    0.6%
  750      8219     43.14    0.5%
  760      8443     58.87    0.6%
  770      8693     52.18    0.6%
  780      8649     47.47    0.5%
  790      8752     41.26    0.4%
  800      8842     45.98    0.5%
  810      9020     60.54    0.6%
  820      9074     32.68    0.3%
  830      9328      42.4    0.4%
  840      9475     47.46    0.5%
  850      9504      48.6    0.5%
  860      9635     54.11    0.5%
  870      9664     69.28    0.7%
  880      9812      82.3    0.8%
  890      9990     56.28    0.5%
  900     10060      66.1    0.6%
  910     10100     101.7    1.0%
  920     10430     36.77    0.3%
  930     10400     67.44    0.6%
  940     10810     30.78    0.2%
  950     10830     73.97    0.6%
  960     10660      35.8    0.3%
  970     10810      74.1    0.6%
  980     10990     58.41    0.5%
  990     11080     89.33    0.8%
 1000     11210     60.04    0.5%

Quality and confidence:
param     error
v         0.029

Model:
Time ~=        0
    + v    11.33
              µs

Reads = 1 + (1 * v)
Writes = 0 + (0 * v)
Pallet: "pallet_staking", Extrinsic: "set_staking_limits", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    6.599
              µs

Reads = 0
Writes = 5
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    6.599
              µs

Reads = 0
Writes = 5
Pallet: "pallet_staking", Extrinsic: "chill_other", Lowest values: [], Highest values: [], Steps: [50], Repeat: 20
Median Slopes Analysis
========
-- Extrinsic Time --

Model:
Time ~=    62.74
              µs

Reads = 7
Writes = 2
Min Squares Analysis
========
-- Extrinsic Time --

Model:
Time ~=    62.74
              µs

Reads = 7
Writes = 2

@shawntabrizi shawntabrizi changed the title Refactor Benchmarks for Less Wasm Memory Usage Refactor Benchmarks for Less Wasm Memory Usage (Repeat Loop) Jul 21, 2021
Parity Benchmarking Bot and others added 7 commits July 21, 2021 04:10
…path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs
@shawntabrizi shawntabrizi marked this pull request as ready for review July 30, 2021 11:18
.gitlab-ci.yml Outdated Show resolved Hide resolved
@shawntabrizi
Copy link
Member Author

bot merge

@ghost
Copy link

ghost commented Aug 1, 2021

Trying merge.

@ghost ghost merged commit c181160 into master Aug 1, 2021
@ghost ghost deleted the shawntabrizi-refactor-benchmarks branch August 1, 2021 18:13
@arkpar
Copy link
Member

arkpar commented Aug 2, 2021

This was bot-merged even though it breaks polkadot build. The companion is still waiting for review.
cc @TriplEight

@TriplEight
Copy link
Contributor

TriplEight commented Aug 2, 2021

this means that on the next version bump we will release the broken packages, I remember mentioning to comment out this job before this gets fixed.
It's not cool breaking CI every time you can't merge.

ericjmiller pushed a commit to ericjmiller/substrate that referenced this pull request Aug 2, 2021
* extract repeat out of benchmark

* remove r

* unused

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* use linked map to keep order

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* Delete pallet_balances.rs

* Delete out

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* steps and repeat to tuple (current_*, total_*)

* idea for list command

* fmt

* use benchmark list in cli

* handle steps in cli

* move log update to cli

* fmt

* remove old todo

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* benchmark metadata function

* don't need this warm up

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* fix warnings

* fix node-template

* fix

* fmt

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* improve docs

* improve cli

* fix format

* fix bug?

* Revert "fix bug?"

This reverts commit 8051bf1.

* skip frame-metadata

* extract repeat out of benchmark

* remove r

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* use linked map to keep order

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* Delete pallet_balances.rs

* Delete out

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* steps and repeat to tuple (current_*, total_*)

* idea for list command

* fmt

* use benchmark list in cli

* handle steps in cli

* move log update to cli

* remove old todo

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* benchmark metadata function

* don't need this warm up

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* fix warnings

* fix node-template

* fix

* fmt

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* improve docs

* improve cli

* fix format

* fix bug?

* Revert "fix bug?"

This reverts commit 8051bf1.

* skip frame-metadata

* Update .gitlab-ci.yml

* fix import

* Update .gitlab-ci.yml

Co-authored-by: Parity Benchmarking Bot <admin@parity.io>
bkchr added a commit that referenced this pull request Aug 2, 2021
* copying rustfmt from root to node-template build.
Also, running rustfmt on this.

* Update .maintain/node-template-release/src/main.rs

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Add some important events to batch & staking to ensure ease of analysis (#9462)

* Add some important events to batch & staking to ensure ease of analysis

* Update frame/staking/src/pallet/mod.rs

Co-authored-by: Zeke Mostov <32168567+emostov@users.noreply.github.com>

* Update lib.rs

* fix test

Co-authored-by: Zeke Mostov <32168567+emostov@users.noreply.github.com>
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>

* Move client consensus parts out of primitives and into client/consensus/api (#9319)

* moved client code out of primitives

* bump ci

* Fixup from merge.

* Removed unused deps thanks to review feedback

* Removing unneeded deps

* updating lock file

* note about rustfmt

* fixed typo to bump ci

* Move lonely CacheKeyId to parent

* cargo fmt

* updating import style

* Update docs/STYLE_GUIDE.md

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>

* Refactor Benchmarks for Less Wasm Memory Usage (#9373)

* extract repeat out of benchmark

* remove r

* unused

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* use linked map to keep order

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* Delete pallet_balances.rs

* Delete out

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* steps and repeat to tuple (current_*, total_*)

* idea for list command

* fmt

* use benchmark list in cli

* handle steps in cli

* move log update to cli

* fmt

* remove old todo

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* benchmark metadata function

* don't need this warm up

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* fix warnings

* fix node-template

* fix

* fmt

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* improve docs

* improve cli

* fix format

* fix bug?

* Revert "fix bug?"

This reverts commit 8051bf1.

* skip frame-metadata

* extract repeat out of benchmark

* remove r

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* use linked map to keep order

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* Delete pallet_balances.rs

* Delete out

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* steps and repeat to tuple (current_*, total_*)

* idea for list command

* fmt

* use benchmark list in cli

* handle steps in cli

* move log update to cli

* remove old todo

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* benchmark metadata function

* don't need this warm up

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_balances --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/balances/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* fix warnings

* fix node-template

* fix

* fmt

* line width

* cargo run --quiet --release --features=runtime-benchmarks --manifest-path=bin/node/cli/Cargo.toml -- benchmark --chain=dev --steps=50 --repeat=20 --pallet=pallet_staking --extrinsic=* --execution=wasm --wasm-execution=compiled --heap-pages=4096 --output=./frame/staking/src/weights.rs --template=./.maintain/frame-weight-template.hbs

* improve docs

* improve cli

* fix format

* fix bug?

* Revert "fix bug?"

This reverts commit 8051bf1.

* skip frame-metadata

* Update .gitlab-ci.yml

* fix import

* Update .gitlab-ci.yml

Co-authored-by: Parity Benchmarking Bot <admin@parity.io>

* Warp sync part I (#9227)

* Started warp sync

* BABE & GRANDPA recovery

* Warp sync protocol

* Sync warp proofs first

* Added basic documentation

* Apply suggestions from code review

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>

* Style changes

* Apply suggestions from code review

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>

* fmt

* Apply suggestions from code review

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>

* Fixed chage trie pruning wrt missing blocks

* Restore parent finalization

* fmt

* fmt

* Revert pwasm-utils bump

* Change error type & check API version

* Apply suggestions from code review

Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Build fix

* Fixed target block check

* Formatting

Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>
Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>

* Add rustfmt skip to default frame benchmarking template (#9473)

This was missed in the introduction pr of rustfmt. There we only had
updated the Substrate local template.

* CI: stop publishing to crates.io until unleash is fixed (#9474)

* CI: stop publishing to crates.io until unleash is fixed; allow restarting k8s runners

* CI: fix CI if ci-release tag is pushed

Co-authored-by: Eric Miller <emiller@lirio.co>
Co-authored-by: Bastian Köcher <bkchr@users.noreply.github.com>
Co-authored-by: Gavin Wood <gavin@parity.io>
Co-authored-by: Zeke Mostov <32168567+emostov@users.noreply.github.com>
Co-authored-by: Shawn Tabrizi <shawntabrizi@gmail.com>
Co-authored-by: Squirrel <gilescope@gmail.com>
Co-authored-by: André Silva <123550+andresilva@users.noreply.github.com>
Co-authored-by: Parity Benchmarking Bot <admin@parity.io>
Co-authored-by: Arkadiy Paronyan <arkady.paronyan@gmail.com>
Co-authored-by: Denis Pisarev <denis.pisarev@parity.io>
This pull request was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A0-please_review Pull request needs code review. C1-low PR touches the given topic and has a low impact on builders. D2-notlive 💤 PR contains changes in a runtime directory that is not deployed to a chain that requires an audit.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Isolate the runtime instance of each benchmark
5 participants