Skip to content

Benchmark Results

303248153 edited this page Jan 22, 2020 · 4 revisions

Benchmark results (2020-01-21)

benchmark environment:

  • cpu model: Intel(R) Xeon(R) CPU E31225 @ 3.10GHz
  • cpu cores: 4

benchmark options:

  • best of n: 3

Benchmark outputs

actix-web

version: 2.0.0

actix-web / 1 core / 100 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms   68.34us   7.10ms   94.75%
    Req/Sec    40.48k     0.90k   49.09k    63.33%
  Latency Distribution
     50%    1.24ms
     75%    1.26ms
     90%    1.29ms
     99%    1.33ms
  4833443 requests in 1.00m, 525.49MB read
Requests/sec:  80516.92
Transfer/sec:      8.75MB
actix-web / 1 core / 10000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   139.87ms    2.50ms 153.61ms   95.90%
    Req/Sec    35.86k   642.44    36.83k    94.07%
  Latency Distribution
     50%  139.78ms
     75%  140.39ms
     90%  141.06ms
     99%  143.75ms
  8551414 requests in 2.00m, 0.91GB read
Requests/sec:  71222.78
Transfer/sec:      7.74MB
actix-web / 1 core / 20000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   167.27ms  272.59ms  11.64s    98.64%
    Req/Sec    69.44k    11.10k   80.31k    94.93%
  Latency Distribution
     50%  138.77ms
     75%  143.01ms
     90%  145.24ms
     99%    1.05s
  10775831 requests in 3.05m, 1.14GB read
  Socket errors: connect 0, read 576, write 0, timeout 0
  Non-2xx or 3xx responses: 158078
Requests/sec:  58860.81
Transfer/sec:      6.39MB
actix-web / 2 cores / 100 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   673.24us  374.49us  17.39ms   74.05%
    Req/Sec    75.22k     1.56k   85.56k    89.33%
  Latency Distribution
     50%  508.00us
     75%    1.08ms
     90%    1.14ms
     99%    1.18ms
  8982989 requests in 1.00m, 0.95GB read
Requests/sec: 149625.67
Transfer/sec:     16.27MB
actix-web / 2 cores / 10000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    64.05ms    3.67ms  83.91ms   66.44%
    Req/Sec    71.30k     1.86k   78.20k    77.72%
  Latency Distribution
     50%   63.35ms
     75%   67.39ms
     90%   69.12ms
     99%   72.07ms
  16984097 requests in 2.00m, 1.80GB read
Requests/sec: 141524.73
Transfer/sec:     15.39MB
actix-web / 2 cores / 20000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    90.61ms  283.15ms   7.19s    98.53%
    Req/Sec    82.44k    14.60k  107.92k    96.86%
  Latency Distribution
     50%   57.38ms
     75%   59.19ms
     90%   61.85ms
     99%    1.21s
  11225376 requests in 3.02m, 1.19GB read
  Socket errors: connect 0, read 355, write 0, timeout 0
  Non-2xx or 3xx responses: 177988
Requests/sec:  61898.53
Transfer/sec:      6.72MB
actix-web / 1 core / 100 connections with 1000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.922ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.911ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.91ms  424.84us   3.74ms   63.28%
    Req/Sec   521.95    117.04     1.00k    60.34%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.88ms
 75.000%    1.23ms
 90.000%    1.48ms
 99.000%    1.92ms
 99.900%    2.16ms
 99.990%    2.23ms
 99.999%    3.74ms
100.000%    3.74ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.098     0.000000            1         1.00
       0.364     0.100000         5006         1.11
       0.488     0.200000         9983         1.25
       0.619     0.300000        14924         1.43
       0.748     0.400000        19903         1.67
       0.879     0.500000        24903         2.00
       0.944     0.550000        27359         2.22
       1.020     0.600000        29849         2.50
       1.097     0.650000        32365         2.86
       1.168     0.700000        34847         3.33
       1.227     0.750000        37307         4.00
       1.259     0.775000        38553         4.44
       1.293     0.800000        39813         5.00
       1.328     0.825000        41047         5.71
       1.370     0.850000        42291         6.67
       1.422     0.875000        43539         8.00
       1.452     0.887500        44152         8.89
       1.480     0.900000        44785        10.00
       1.507     0.912500        45406        11.43
       1.538     0.925000        46020        13.33
       1.583     0.937500        46641        16.00
       1.613     0.943750        46950        17.78
       1.643     0.950000        47256        20.00
       1.679     0.956250        47568        22.86
       1.718     0.962500        47882        26.67
       1.757     0.968750        48186        32.00
       1.777     0.971875        48345        35.56
       1.799     0.975000        48500        40.00
       1.822     0.978125        48656        45.71
       1.846     0.981250        48815        53.33
       1.867     0.984375        48965        64.00
       1.879     0.985938        49042        71.11
       1.892     0.987500        49120        80.00
       1.908     0.989062        49200        91.43
       1.925     0.990625        49278       106.67
       1.948     0.992188        49355       128.00
       1.960     0.992969        49395       142.22
       1.970     0.993750        49430       160.00
       1.984     0.994531        49470       182.86
       2.005     0.995313        49508       213.33
       2.029     0.996094        49546       256.00
       2.049     0.996484        49570       284.44
       2.067     0.996875        49585       320.00
       2.089     0.997266        49605       365.71
       2.109     0.997656        49625       426.67
       2.129     0.998047        49649       512.00
       2.133     0.998242        49658       568.89
       2.139     0.998437        49667       640.00
       2.143     0.998633        49673       731.43
       2.159     0.998828        49684       853.33
       2.163     0.999023        49692      1024.00
       2.177     0.999121        49700      1137.78
       2.181     0.999219        49703      1280.00
       2.183     0.999316        49706      1462.86
       2.191     0.999414        49712      1706.67
       2.197     0.999512        49716      2048.00
       2.201     0.999561        49720      2275.56
       2.203     0.999609        49722      2560.00
       2.205     0.999658        49723      2925.71
       2.207     0.999707        49726      3413.33
       2.209     0.999756        49728      4096.00
       2.211     0.999780        49730      4551.11
       2.217     0.999805        49731      5120.00
       2.221     0.999829        49733      5851.43
       2.221     0.999854        49733      6826.67
       2.223     0.999878        49734      8192.00
       2.229     0.999890        49735      9102.22
       2.249     0.999902        49736     10240.00
       2.249     0.999915        49736     11702.86
       3.301     0.999927        49737     13653.33
       3.301     0.999939        49737     16384.00
       3.337     0.999945        49738     18204.44
       3.337     0.999951        49738     20480.00
       3.337     0.999957        49738     23405.71
       3.495     0.999963        49739     27306.67
       3.495     0.999969        49739     32768.00
       3.495     0.999973        49739     36408.89
       3.495     0.999976        49739     40960.00
       3.495     0.999979        49739     46811.43
       3.745     0.999982        49740     54613.33
       3.745     1.000000        49740          inf
#[Mean    =        0.910, StdDeviation   =        0.425]
#[Max     =        3.744, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59923 requests in 1.00m, 6.51MB read
Requests/sec:    998.69
Transfer/sec:    111.18KB
actix-web / 1 core / 10000 connections with 5000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.267ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.202ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    3.58ms  37.82ms   94.28%
    Req/Sec     2.68k     1.46k   21.78k    96.39%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.61ms
 75.000%    2.52ms
 90.000%    3.55ms
 99.000%   22.06ms
 99.900%   30.51ms
 99.990%   34.37ms
 99.999%   36.54ms
100.000%   37.85ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.312     0.000000            1         1.00
       0.791     0.100000        42539         1.11
       1.061     0.200000        85080         1.25
       1.270     0.300000       127735         1.43
       1.431     0.400000       170245         1.67
       1.606     0.500000       212696         2.00
       1.729     0.550000       233952         2.22
       1.922     0.600000       255099         2.50
       2.137     0.650000       276461         2.86
       2.329     0.700000       297681         3.33
       2.521     0.750000       318851         4.00
       2.631     0.775000       329508         4.44
       2.763     0.800000       340110         5.00
       2.957     0.825000       350761         5.71
       3.171     0.850000       361351         6.67
       3.355     0.875000       372041         8.00
       3.445     0.887500       377308         8.89
       3.551     0.900000       382652        10.00
       3.695     0.912500       387917        11.43
       4.099     0.925000       393229        13.33
       5.059     0.937500       398534        16.00
       6.339     0.943750       401188        17.78
       7.787     0.950000       403844        20.00
       9.279     0.956250       406509        22.86
      10.839     0.962500       409162        26.67
      12.687     0.968750       411819        32.00
      13.791     0.971875       413148        35.56
      14.991     0.975000       414473        40.00
      16.287     0.978125       415800        45.71
      17.679     0.981250       417138        53.33
      19.119     0.984375       418463        64.00
      19.903     0.985938       419126        71.11
      20.703     0.987500       419787        80.00
      21.535     0.989062       420452        91.43
      22.431     0.990625       421120       106.67
      23.407     0.992188       421777       128.00
      23.919     0.992969       422113       142.22
      24.559     0.993750       422442       160.00
      25.151     0.994531       422776       182.86
      25.807     0.995313       423106       213.33
      26.607     0.996094       423441       256.00
      26.975     0.996484       423607       284.44
      27.375     0.996875       423772       320.00
      27.823     0.997266       423935       365.71
      28.351     0.997656       424102       426.67
      28.927     0.998047       424268       512.00
      29.247     0.998242       424351       568.89
      29.551     0.998437       424437       640.00
      29.839     0.998633       424517       731.43
      30.175     0.998828       424601       853.33
      30.543     0.999023       424682      1024.00
      30.751     0.999121       424727      1137.78
      30.991     0.999219       424766      1280.00
      31.247     0.999316       424807      1462.86
      31.551     0.999414       424849      1706.67
      32.079     0.999512       424893      2048.00
      32.223     0.999561       424911      2275.56
      32.415     0.999609       424932      2560.00
      32.719     0.999658       424952      2925.71
      33.151     0.999707       424974      3413.33
      33.375     0.999756       424997      4096.00
      33.471     0.999780       425004      4551.11
      33.631     0.999805       425015      5120.00
      33.759     0.999829       425028      5851.43
      33.887     0.999854       425036      6826.67
      34.239     0.999878       425047      8192.00
      34.303     0.999890       425051      9102.22
      34.527     0.999902       425057     10240.00
      34.719     0.999915       425061     11702.86
      35.071     0.999927       425066     13653.33
      35.487     0.999939       425072     16384.00
      35.583     0.999945       425076     18204.44
      35.647     0.999951       425077     20480.00
      35.679     0.999957       425080     23405.71
      35.775     0.999963       425082     27306.67
      36.063     0.999969       425085     32768.00
      36.095     0.999973       425086     36408.89
      36.127     0.999976       425087     40960.00
      36.191     0.999979       425088     46811.43
      36.351     0.999982       425090     54613.33
      36.479     0.999985       425092     65536.00
      36.479     0.999986       425092     72817.78
      36.479     0.999988       425092     81920.00
      36.543     0.999989       425093     93622.86
      36.799     0.999991       425094    109226.67
      36.799     0.999992       425094    131072.00
      36.991     0.999993       425095    145635.56
      36.991     0.999994       425095    163840.00
      36.991     0.999995       425095    187245.71
      37.119     0.999995       425096    218453.33
      37.119     0.999996       425096    262144.00
      37.119     0.999997       425096    291271.11
      37.119     0.999997       425096    327680.00
      37.119     0.999997       425096    374491.43
      37.855     0.999998       425097    436906.67
      37.855     1.000000       425097          inf
#[Mean    =        2.556, StdDeviation   =        3.583]
#[Max     =       37.824, Total count    =       425097]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542379 requests in 2.00m, 58.97MB read
Requests/sec:   4519.69
Transfer/sec:    503.17KB
actix-web / 1 core / 10000 connections with 10000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 28.958ms, rate sampling interval: 190ms
  Thread calibration: mean lat.: 35.215ms, rate sampling interval: 230ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    85.08ms   64.73ms 347.39ms   70.50%
    Req/Sec     5.27k     2.65k   13.06k    68.02%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   67.14ms
 75.000%  122.30ms
 90.000%  182.91ms
 99.000%  264.70ms
 99.900%  295.93ms
 99.990%  319.74ms
 99.999%  329.73ms
100.000%  347.65ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.591     0.000000            1         1.00
      17.647     0.100000        85099         1.11
      27.807     0.200000       170075         1.25
      38.847     0.300000       255088         1.43
      51.743     0.400000       340017         1.67
      67.135     0.500000       425191         2.00
      76.031     0.550000       467569         2.22
      86.079     0.600000       510060         2.50
      97.343     0.650000       552634         2.86
     109.183     0.700000       595055         3.33
     122.303     0.750000       637617         4.00
     129.791     0.775000       658891         4.44
     137.983     0.800000       680001         5.00
     147.199     0.825000       701491         5.71
     157.567     0.850000       722608         6.67
     169.087     0.875000       743814         8.00
     175.615     0.887500       754548         8.89
     182.911     0.900000       765080        10.00
     191.231     0.912500       775703        11.43
     200.447     0.925000       786353        13.33
     210.431     0.937500       796966        16.00
     215.807     0.943750       802197        17.78
     221.311     0.950000       807572        20.00
     226.815     0.956250       812908        22.86
     232.447     0.962500       818214        26.67
     238.079     0.968750       823452        32.00
     241.151     0.971875       826106        35.56
     244.479     0.975000       828778        40.00
     248.063     0.978125       831447        45.71
     251.775     0.981250       834117        53.33
     255.743     0.984375       836705        64.00
     258.175     0.985938       838080        71.11
     260.479     0.987500       839408        80.00
     263.167     0.989062       840791        91.43
     265.727     0.990625       842105       106.67
     268.543     0.992188       843421       128.00
     269.823     0.992969       844016       142.22
     271.615     0.993750       844704       160.00
     273.663     0.994531       845381       182.86
     275.967     0.995313       846045       213.33
     278.783     0.996094       846704       256.00
     280.319     0.996484       847034       284.44
     282.111     0.996875       847355       320.00
     284.159     0.997266       847700       365.71
     285.951     0.997656       847994       426.67
     288.511     0.998047       848358       512.00
     289.535     0.998242       848509       568.89
     290.815     0.998437       848673       640.00
     292.351     0.998633       848838       731.43
     293.887     0.998828       848995       853.33
     296.191     0.999023       849165      1024.00
     297.215     0.999121       849243      1137.78
     298.751     0.999219       849337      1280.00
     300.287     0.999316       849416      1462.86
     302.335     0.999414       849498      1706.67
     304.127     0.999512       849583      2048.00
     305.151     0.999561       849625      2275.56
     306.431     0.999609       849658      2560.00
     307.967     0.999658       849701      2925.71
     308.991     0.999707       849745      3413.33
     311.039     0.999756       849782      4096.00
     312.319     0.999780       849801      4551.11
     313.343     0.999805       849819      5120.00
     314.879     0.999829       849840      5851.43
     316.671     0.999854       849862      6826.67
     318.719     0.999878       849885      8192.00
     318.975     0.999890       849893      9102.22
     319.999     0.999902       849907     10240.00
     320.767     0.999915       849913     11702.86
     321.535     0.999927       849923     13653.33
     323.071     0.999939       849937     16384.00
     323.327     0.999945       849939     18204.44
     323.839     0.999951       849947     20480.00
     324.095     0.999957       849950     23405.71
     324.863     0.999963       849954     27306.67
     326.399     0.999969       849960     32768.00
     327.423     0.999973       849964     36408.89
     327.679     0.999976       849966     40960.00
     327.935     0.999979       849967     46811.43
     328.447     0.999982       849971     54613.33
     328.959     0.999985       849974     65536.00
     328.959     0.999986       849974     72817.78
     329.471     0.999988       849976     81920.00
     329.471     0.999989       849976     93622.86
     329.727     0.999991       849978    109226.67
     330.239     0.999992       849982    131072.00
     330.239     0.999993       849982    145635.56
     330.239     0.999994       849982    163840.00
     330.239     0.999995       849982    187245.71
     330.239     0.999995       849982    218453.33
     330.239     0.999996       849982    262144.00
     331.007     0.999997       849983    291271.11
     331.007     0.999997       849983    327680.00
     331.007     0.999997       849983    374491.43
     334.079     0.999998       849984    436906.67
     334.079     0.999998       849984    524288.00
     334.079     0.999998       849984    582542.22
     334.079     0.999998       849984    655360.00
     334.079     0.999999       849984    748982.86
     347.647     0.999999       849985    873813.33
     347.647     1.000000       849985          inf
#[Mean    =       85.082, StdDeviation   =       64.729]
#[Max     =      347.392, Total count    =       849985]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079041 requests in 2.00m, 117.31MB read
Requests/sec:   8973.03
Transfer/sec:      0.98MB
actix-web / 2 cores / 100 connections with 1000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.901ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.913ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.90ms  443.54us   9.42ms   63.13%
    Req/Sec   524.60    132.73     1.11k    73.45%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.86ms
 75.000%    1.24ms
 90.000%    1.50ms
 99.000%    1.93ms
 99.900%    2.19ms
 99.990%    7.39ms
 99.999%    9.43ms
100.000%    9.43ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.102     0.000000            1         1.00
       0.350     0.100000         4980         1.11
       0.462     0.200000         9969         1.25
       0.584     0.300000        14947         1.43
       0.725     0.400000        19915         1.67
       0.860     0.500000        24872         2.00
       0.929     0.550000        27379         2.22
       1.003     0.600000        29852         2.50
       1.082     0.650000        32331         2.86
       1.161     0.700000        34818         3.33
       1.237     0.750000        37338         4.00
       1.272     0.775000        38577         4.44
       1.306     0.800000        39807         5.00
       1.344     0.825000        41054         5.71
       1.394     0.850000        42306         6.67
       1.444     0.875000        43526         8.00
       1.470     0.887500        44153         8.89
       1.496     0.900000        44784        10.00
       1.518     0.912500        45403        11.43
       1.542     0.925000        46022        13.33
       1.576     0.937500        46638        16.00
       1.601     0.943750        46953        17.78
       1.624     0.950000        47260        20.00
       1.652     0.956250        47566        22.86
       1.683     0.962500        47882        26.67
       1.721     0.968750        48188        32.00
       1.742     0.971875        48345        35.56
       1.770     0.975000        48502        40.00
       1.795     0.978125        48658        45.71
       1.825     0.981250        48811        53.33
       1.861     0.984375        48966        64.00
       1.880     0.985938        49042        71.11
       1.899     0.987500        49123        80.00
       1.915     0.989062        49200        91.43
       1.933     0.990625        49280       106.67
       1.952     0.992188        49357       128.00
       1.964     0.992969        49392       142.22
       1.976     0.993750        49431       160.00
       1.991     0.994531        49469       182.86
       2.009     0.995313        49508       213.33
       2.029     0.996094        49546       256.00
       2.053     0.996484        49566       284.44
       2.071     0.996875        49585       320.00
       2.089     0.997266        49604       365.71
       2.111     0.997656        49625       426.67
       2.131     0.998047        49643       512.00
       2.143     0.998242        49653       568.89
       2.157     0.998437        49663       640.00
       2.167     0.998633        49672       731.43
       2.177     0.998828        49683       853.33
       2.197     0.999023        49692      1024.00
       2.205     0.999121        49699      1137.78
       2.223     0.999219        49703      1280.00
       2.227     0.999316        49707      1462.86
       2.233     0.999414        49711      1706.67
       2.263     0.999512        49717      2048.00
       2.271     0.999561        49720      2275.56
       2.275     0.999609        49722      2560.00
       2.277     0.999658        49723      2925.71
       3.047     0.999707        49726      3413.33
       4.715     0.999756        49728      4096.00
       5.087     0.999780        49730      4551.11
       5.223     0.999805        49731      5120.00
       5.243     0.999829        49732      5851.43
       5.263     0.999854        49733      6826.67
       7.327     0.999878        49734      8192.00
       7.391     0.999890        49735      9102.22
       7.463     0.999902        49736     10240.00
       7.463     0.999915        49736     11702.86
       7.551     0.999927        49737     13653.33
       7.551     0.999939        49737     16384.00
       9.183     0.999945        49738     18204.44
       9.183     0.999951        49738     20480.00
       9.183     0.999957        49738     23405.71
       9.263     0.999963        49739     27306.67
       9.263     0.999969        49739     32768.00
       9.263     0.999973        49739     36408.89
       9.263     0.999976        49739     40960.00
       9.263     0.999979        49739     46811.43
       9.431     0.999982        49740     54613.33
       9.431     1.000000        49740          inf
#[Mean    =        0.899, StdDeviation   =        0.444]
#[Max     =        9.424, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59925 requests in 1.00m, 6.51MB read
Requests/sec:    998.73
Transfer/sec:    111.19KB
actix-web / 2 cores / 10000 connections with 5000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.246ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.271ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    3.60ms  41.79ms   94.13%
    Req/Sec     2.68k     1.49k   22.44k    96.23%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.61ms
 75.000%    2.53ms
 90.000%    3.56ms
 99.000%   21.68ms
 99.900%   31.68ms
 99.990%   37.15ms
 99.999%   39.42ms
100.000%   41.82ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.314     0.000000            1         1.00
       0.801     0.100000        42545         1.11
       1.051     0.200000        85038         1.25
       1.262     0.300000       127624         1.43
       1.431     0.400000       170331         1.67
       1.611     0.500000       212683         2.00
       1.732     0.550000       233976         2.22
       1.910     0.600000       255140         2.50
       2.129     0.650000       276445         2.86
       2.327     0.700000       297839         3.33
       2.525     0.750000       318925         4.00
       2.633     0.775000       329535         4.44
       2.763     0.800000       340153         5.00
       2.941     0.825000       350862         5.71
       3.157     0.850000       361435         6.67
       3.355     0.875000       372110         8.00
       3.451     0.887500       377359         8.89
       3.557     0.900000       382738        10.00
       3.699     0.912500       387985        11.43
       4.111     0.925000       393320        13.33
       5.351     0.937500       398624        16.00
       6.739     0.943750       401269        17.78
       8.111     0.950000       403926        20.00
       9.591     0.956250       406599        22.86
      11.095     0.962500       409242        26.67
      12.711     0.968750       411902        32.00
      13.639     0.971875       413233        35.56
      14.711     0.975000       414558        40.00
      15.855     0.978125       415888        45.71
      17.119     0.981250       417213        53.33
      18.543     0.984375       418557        64.00
      19.311     0.985938       419215        71.11
      20.143     0.987500       419876        80.00
      21.071     0.989062       420537        91.43
      22.111     0.990625       421207       106.67
      23.327     0.992188       421870       128.00
      24.063     0.992969       422199       142.22
      24.799     0.993750       422533       160.00
      25.567     0.994531       422861       182.86
      26.383     0.995313       423192       213.33
      27.263     0.996094       423528       256.00
      27.711     0.996484       423692       284.44
      28.255     0.996875       423857       320.00
      28.767     0.997266       424024       365.71
      29.311     0.997656       424189       426.67
      29.935     0.998047       424360       512.00
      30.223     0.998242       424439       568.89
      30.543     0.998437       424521       640.00
      30.991     0.998633       424604       731.43
      31.311     0.998828       424692       853.33
      31.711     0.999023       424771      1024.00
      31.983     0.999121       424812      1137.78
      32.255     0.999219       424853      1280.00
      32.655     0.999316       424895      1462.86
      33.119     0.999414       424937      1706.67
      33.567     0.999512       424979      2048.00
      33.887     0.999561       425000      2275.56
      34.271     0.999609       425020      2560.00
      34.623     0.999658       425040      2925.71
      35.199     0.999707       425062      3413.33
      35.615     0.999756       425083      4096.00
      35.903     0.999780       425093      4551.11
      36.063     0.999805       425102      5120.00
      36.383     0.999829       425113      5851.43
      36.639     0.999854       425123      6826.67
      36.863     0.999878       425135      8192.00
      37.055     0.999890       425139      9102.22
      37.279     0.999902       425144     10240.00
      37.471     0.999915       425150     11702.86
      37.567     0.999927       425154     13653.33
      37.983     0.999939       425160     16384.00
      38.111     0.999945       425163     18204.44
      38.175     0.999951       425165     20480.00
      38.207     0.999957       425167     23405.71
      38.335     0.999963       425170     27306.67
      38.399     0.999969       425173     32768.00
      38.431     0.999973       425174     36408.89
      38.623     0.999976       425175     40960.00
      38.655     0.999979       425176     46811.43
      38.783     0.999982       425179     54613.33
      38.783     0.999985       425179     65536.00
      38.975     0.999986       425180     72817.78
      38.975     0.999988       425180     81920.00
      39.423     0.999989       425181     93622.86
      39.711     0.999991       425182    109226.67
      39.711     0.999992       425182    131072.00
      39.743     0.999993       425183    145635.56
      39.743     0.999994       425183    163840.00
      39.743     0.999995       425183    187245.71
      41.823     0.999995       425185    218453.33
      41.823     1.000000       425185          inf
#[Mean    =        2.562, StdDeviation   =        3.602]
#[Max     =       41.792, Total count    =       425185]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542384 requests in 2.00m, 58.97MB read
Requests/sec:   4519.72
Transfer/sec:    503.17KB
actix-web / 2 cores / 10000 connections with 10000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 36.687ms, rate sampling interval: 236ms
  Thread calibration: mean lat.: 33.891ms, rate sampling interval: 225ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    87.65ms   63.22ms 323.07ms   70.47%
    Req/Sec     5.16k     2.46k   11.31k    66.93%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   70.46ms
 75.000%  124.61ms
 90.000%  184.06ms
 99.000%  262.40ms
 99.900%  295.93ms
 99.990%  311.30ms
 99.999%  317.18ms
100.000%  323.33ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.972     0.000000            1         1.00
      21.695     0.100000        84990         1.11
      31.775     0.200000       169998         1.25
      42.239     0.300000       254912         1.43
      54.975     0.400000       340061         1.67
      70.463     0.500000       424988         2.00
      79.423     0.550000       467548         2.22
      89.151     0.600000       509985         2.50
      99.839     0.650000       552486         2.86
     111.551     0.700000       594983         3.33
     124.607     0.750000       637424         4.00
     131.967     0.775000       658505         4.44
     139.903     0.800000       679766         5.00
     148.863     0.825000       701239         5.71
     158.719     0.850000       722389         6.67
     170.367     0.875000       743462         8.00
     177.023     0.887500       754141         8.89
     184.063     0.900000       764816        10.00
     191.359     0.912500       775450        11.43
     199.167     0.925000       785951        13.33
     208.255     0.937500       796631        16.00
     213.247     0.943750       802002        17.78
     218.367     0.950000       807329        20.00
     223.743     0.956250       812621        22.86
     229.375     0.962500       817836        26.67
     235.391     0.968750       823168        32.00
     238.719     0.971875       825808        35.56
     242.175     0.975000       828440        40.00
     246.015     0.978125       831156        45.71
     249.855     0.981250       833773        53.33
     253.951     0.984375       836426        64.00
     256.127     0.985938       837739        71.11
     258.431     0.987500       839076        80.00
     260.863     0.989062       840426        91.43
     263.679     0.990625       841775       106.67
     266.751     0.992188       843078       128.00
     268.543     0.992969       843739       142.22
     270.591     0.993750       844385       160.00
     272.895     0.994531       845041       182.86
     275.455     0.995313       845698       213.33
     278.527     0.996094       846363       256.00
     280.319     0.996484       846703       284.44
     282.111     0.996875       847014       320.00
     284.159     0.997266       847360       365.71
     286.463     0.997656       847709       426.67
     288.767     0.998047       848033       512.00
     290.047     0.998242       848200       568.89
     291.327     0.998437       848357       640.00
     292.607     0.998633       848529       731.43
     294.143     0.998828       848692       853.33
     296.191     0.999023       848851      1024.00
     297.215     0.999121       848945      1137.78
     297.983     0.999219       849001      1280.00
     299.263     0.999316       849093      1462.86
     300.543     0.999414       849167      1706.67
     302.079     0.999512       849253      2048.00
     302.847     0.999561       849302      2275.56
     303.871     0.999609       849336      2560.00
     304.639     0.999658       849379      2925.71
     305.919     0.999707       849420      3413.33
     307.199     0.999756       849462      4096.00
     307.711     0.999780       849481      4551.11
     308.735     0.999805       849504      5120.00
     309.247     0.999829       849528      5851.43
     309.759     0.999854       849545      6826.67
     310.271     0.999878       849561      8192.00
     311.039     0.999890       849578      9102.22
     311.295     0.999902       849583     10240.00
     311.551     0.999915       849593     11702.86
     312.319     0.999927       849602     13653.33
     313.343     0.999939       849614     16384.00
     313.599     0.999945       849618     18204.44
     313.855     0.999951       849623     20480.00
     314.367     0.999957       849628     23405.71
     314.879     0.999963       849633     27306.67
     315.903     0.999969       849641     32768.00
     315.903     0.999973       849641     36408.89
     316.159     0.999976       849644     40960.00
     316.415     0.999979       849648     46811.43
     316.671     0.999982       849649     54613.33
     317.183     0.999985       849656     65536.00
     317.183     0.999986       849656     72817.78
     317.183     0.999988       849656     81920.00
     317.183     0.999989       849656     93622.86
     317.439     0.999991       849659    109226.67
     317.439     0.999992       849659    131072.00
     317.439     0.999993       849659    145635.56
     317.439     0.999994       849659    163840.00
     317.695     0.999995       849660    187245.71
     322.303     0.999995       849661    218453.33
     322.303     0.999996       849661    262144.00
     322.815     0.999997       849663    291271.11
     322.815     0.999997       849663    327680.00
     322.815     0.999997       849663    374491.43
     322.815     0.999998       849663    436906.67
     322.815     0.999998       849663    524288.00
     322.815     0.999998       849663    582542.22
     322.815     0.999998       849663    655360.00
     322.815     0.999999       849663    748982.86
     323.327     0.999999       849664    873813.33
     323.327     1.000000       849664          inf
#[Mean    =       87.654, StdDeviation   =       63.223]
#[Max     =      323.072, Total count    =       849664]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079401 requests in 2.00m, 117.35MB read
Requests/sec:   8978.16
Transfer/sec:      0.98MB

aspnetcore

version: 3.1.0

aspnetcore / 1 core / 100 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms  814.97us  50.55ms   94.13%
    Req/Sec    19.75k     1.08k   22.74k    83.33%
  Latency Distribution
     50%    2.45ms
     75%    2.49ms
     90%    2.62ms
     99%    4.70ms
  2357975 requests in 1.00m, 276.60MB read
Requests/sec:  39288.56
Transfer/sec:      4.61MB
aspnetcore / 1 core / 10000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   337.36ms   63.64ms   1.97s    79.17%
    Req/Sec    14.97k     9.24k   43.14k    66.81%
  Latency Distribution
     50%  334.37ms
     75%  372.46ms
     90%  400.69ms
     99%  436.36ms
  3495573 requests in 2.00m, 410.04MB read
Requests/sec:  29116.29
Transfer/sec:      3.42MB
aspnetcore / 1 core / 20000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   823.80ms    1.90s    0.92m    99.08%
    Req/Sec    17.97k    14.63k   64.76k    65.45%
  Latency Distribution
     50%  704.70ms
     75%  744.78ms
     90%  778.75ms
     99%    1.96s
  4929848 requests in 3.00m, 578.28MB read
  Socket errors: connect 0, read 0, write 707, timeout 0
Requests/sec:  27372.50
Transfer/sec:      3.21MB
aspnetcore / 2 cores / 100 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.52ms    1.28ms  37.18ms   96.83%
    Req/Sec    36.56k     1.12k   42.62k    76.92%
  Latency Distribution
     50%    1.34ms
     75%    1.44ms
     90%    1.58ms
     99%    9.19ms
  4366166 requests in 1.00m, 512.16MB read
Requests/sec:  72735.10
Transfer/sec:      8.53MB
aspnetcore / 2 cores / 10000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   168.59ms  169.60ms   7.84s    99.51%
    Req/Sec    30.94k     9.54k   50.59k    66.90%
  Latency Distribution
     50%  156.87ms
     75%  177.28ms
     90%  199.98ms
     99%  252.61ms
  7358903 requests in 2.00m, 863.21MB read
Requests/sec:  61305.56
Transfer/sec:      7.19MB
aspnetcore / 2 cores / 20000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   346.60ms  326.28ms  14.29s    99.70%
    Req/Sec    30.24k    14.37k   69.37k    65.35%
  Latency Distribution
     50%  325.65ms
     75%  364.28ms
     90%  411.97ms
     99%  483.92ms
  10204625 requests in 3.00m, 1.17GB read
Requests/sec:  56666.43
Transfer/sec:      6.65MB
aspnetcore / 1 core / 100 connections with 1000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 1.113ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 1.088ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.08ms  452.46us  11.64ms   62.93%
    Req/Sec   523.36    124.34     1.00k    73.70%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.07ms
 75.000%    1.41ms
 90.000%    1.69ms
 99.000%    2.06ms
 99.900%    2.34ms
 99.990%    5.99ms
 99.999%   11.65ms
100.000%   11.65ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.153     0.000000            1         1.00
       0.485     0.100000         5001         1.11
       0.636     0.200000         9950         1.25
       0.783     0.300000        14922         1.43
       0.930     0.400000        19916         1.67
       1.069     0.500000        24875         2.00
       1.138     0.550000        27384         2.22
       1.204     0.600000        29869         2.50
       1.269     0.650000        32338         2.86
       1.336     0.700000        34826         3.33
       1.406     0.750000        37311         4.00
       1.448     0.775000        38559         4.44
       1.490     0.800000        39793         5.00
       1.540     0.825000        41055         5.71
       1.591     0.850000        42295         6.67
       1.641     0.875000        43537         8.00
       1.666     0.887500        44167         8.89
       1.694     0.900000        44791        10.00
       1.721     0.912500        45402        11.43
       1.749     0.925000        46030        13.33
       1.781     0.937500        46637        16.00
       1.797     0.943750        46946        17.78
       1.815     0.950000        47267        20.00
       1.837     0.956250        47571        22.86
       1.862     0.962500        47878        26.67
       1.890     0.968750        48195        32.00
       1.907     0.971875        48347        35.56
       1.927     0.975000        48501        40.00
       1.948     0.978125        48655        45.71
       1.972     0.981250        48809        53.33
       1.997     0.984375        48963        64.00
       2.011     0.985938        49046        71.11
       2.027     0.987500        49119        80.00
       2.044     0.989062        49196        91.43
       2.067     0.990625        49276       106.67
       2.091     0.992188        49356       128.00
       2.107     0.992969        49393       142.22
       2.125     0.993750        49431       160.00
       2.143     0.994531        49469       182.86
       2.161     0.995313        49513       213.33
       2.185     0.996094        49546       256.00
       2.201     0.996484        49567       284.44
       2.211     0.996875        49586       320.00
       2.225     0.997266        49604       365.71
       2.241     0.997656        49625       426.67
       2.257     0.998047        49643       512.00
       2.277     0.998242        49653       568.89
       2.293     0.998437        49663       640.00
       2.307     0.998633        49674       731.43
       2.319     0.998828        49682       853.33
       2.367     0.999023        49693      1024.00
       2.397     0.999121        49697      1137.78
       2.499     0.999219        49702      1280.00
       2.725     0.999316        49706      1462.86
       2.813     0.999414        49711      1706.67
       2.989     0.999512        49716      2048.00
       3.057     0.999561        49719      2275.56
       3.087     0.999609        49721      2560.00
       3.161     0.999658        49723      2925.71
       3.273     0.999707        49726      3413.33
       3.387     0.999756        49728      4096.00
       3.441     0.999780        49730      4551.11
       3.479     0.999805        49731      5120.00
       3.571     0.999829        49732      5851.43
       3.863     0.999854        49733      6826.67
       3.889     0.999878        49734      8192.00
       5.991     0.999890        49735      9102.22
       6.343     0.999902        49736     10240.00
       6.343     0.999915        49736     11702.86
       6.351     0.999927        49737     13653.33
       6.351     0.999939        49737     16384.00
       6.403     0.999945        49738     18204.44
       6.403     0.999951        49738     20480.00
       6.403     0.999957        49738     23405.71
       6.631     0.999963        49739     27306.67
       6.631     0.999969        49739     32768.00
       6.631     0.999973        49739     36408.89
       6.631     0.999976        49739     40960.00
       6.631     0.999979        49739     46811.43
      11.647     0.999982        49740     54613.33
      11.647     1.000000        49740          inf
#[Mean    =        1.080, StdDeviation   =        0.452]
#[Max     =       11.640, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59925 requests in 1.00m, 7.03MB read
Requests/sec:    998.72
Transfer/sec:    119.96KB
aspnetcore / 1 core / 10000 connections with 5000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 4.284ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 4.336ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.26ms    8.51ms  92.35ms   92.23%
    Req/Sec     2.67k     1.83k   44.00k    93.19%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.79ms
 75.000%    2.82ms
 90.000%    7.44ms
 99.000%   49.76ms
 99.900%   66.56ms
 99.990%   85.63ms
 99.999%   90.56ms
100.000%   92.42ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.327     0.000000            1         1.00
       0.852     0.100000        42537         1.11
       1.169     0.200000        85139         1.25
       1.376     0.300000       127623         1.43
       1.552     0.400000       170197         1.67
       1.794     0.500000       212613         2.00
       1.979     0.550000       233848         2.22
       2.157     0.600000       255176         2.50
       2.329     0.650000       276516         2.86
       2.527     0.700000       297768         3.33
       2.819     0.750000       318916         4.00
       3.055     0.775000       329500         4.44
       3.285     0.800000       340167         5.00
       3.495     0.825000       350772         5.71
       3.781     0.850000       361378         6.67
       4.367     0.875000       371985         8.00
       5.059     0.887500       377289         8.89
       7.443     0.900000       382603        10.00
      10.135     0.912500       387926        11.43
      13.655     0.925000       393233        13.33
      17.599     0.937500       398560        16.00
      19.519     0.943750       401218        17.78
      21.503     0.950000       403866        20.00
      23.519     0.956250       406532        22.86
      25.807     0.962500       409176        26.67
      28.559     0.968750       411838        32.00
      30.111     0.971875       413163        35.56
      31.967     0.975000       414493        40.00
      34.399     0.978125       415815        45.71
      37.663     0.981250       417143        53.33
      41.887     0.984375       418475        64.00
      44.159     0.985938       419142        71.11
      46.367     0.987500       419801        80.00
      48.415     0.989062       420467        91.43
      50.591     0.990625       421134       106.67
      52.703     0.992188       421794       128.00
      53.823     0.992969       422127       142.22
      55.007     0.993750       422457       160.00
      56.095     0.994531       422790       182.86
      57.055     0.995313       423122       213.33
      57.983     0.996094       423456       256.00
      58.527     0.996484       423624       284.44
      59.007     0.996875       423785       320.00
      59.551     0.997266       423952       365.71
      60.191     0.997656       424118       426.67
      60.863     0.998047       424283       512.00
      61.503     0.998242       424369       568.89
      62.271     0.998437       424450       640.00
      63.199     0.998633       424533       731.43
      64.895     0.998828       424615       853.33
      66.687     0.999023       424698      1024.00
      67.775     0.999121       424740      1137.78
      69.247     0.999219       424781      1280.00
      71.423     0.999316       424823      1462.86
      73.343     0.999414       424864      1706.67
      75.711     0.999512       424906      2048.00
      76.927     0.999561       424927      2275.56
      77.695     0.999609       424947      2560.00
      78.847     0.999658       424969      2925.71
      80.063     0.999707       424989      3413.33
      81.471     0.999756       425010      4096.00
      82.175     0.999780       425020      4551.11
      82.879     0.999805       425030      5120.00
      83.519     0.999829       425041      5851.43
      84.479     0.999854       425051      6826.67
      85.055     0.999878       425063      8192.00
      85.247     0.999890       425067      9102.22
      86.143     0.999902       425072     10240.00
      86.719     0.999915       425077     11702.86
      87.295     0.999927       425082     13653.33
      88.063     0.999939       425088     16384.00
      88.319     0.999945       425090     18204.44
      88.639     0.999951       425093     20480.00
      88.895     0.999957       425095     23405.71
      89.343     0.999963       425098     27306.67
      89.663     0.999969       425102     32768.00
      89.663     0.999973       425102     36408.89
      89.791     0.999976       425103     40960.00
      89.983     0.999979       425104     46811.43
      90.111     0.999982       425107     54613.33
      90.111     0.999985       425107     65536.00
      90.239     0.999986       425108     72817.78
      90.239     0.999988       425108     81920.00
      90.559     0.999989       425109     93622.86
      90.687     0.999991       425110    109226.67
      90.687     0.999992       425110    131072.00
      91.071     0.999993       425111    145635.56
      91.071     0.999994       425111    163840.00
      91.071     0.999995       425111    187245.71
      91.647     0.999995       425112    218453.33
      91.647     0.999996       425112    262144.00
      91.647     0.999997       425112    291271.11
      91.647     0.999997       425112    327680.00
      91.647     0.999997       425112    374491.43
      92.415     0.999998       425113    436906.67
      92.415     1.000000       425113          inf
#[Mean    =        4.265, StdDeviation   =        8.515]
#[Max     =       92.352, Total count    =       425113]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542363 requests in 2.00m, 63.62MB read
Requests/sec:   4519.57
Transfer/sec:    542.88KB
aspnetcore / 1 core / 10000 connections with 10000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 40.072ms, rate sampling interval: 239ms
  Thread calibration: mean lat.: 41.407ms, rate sampling interval: 243ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    93.30ms   66.33ms 446.21ms   69.58%
    Req/Sec     5.14k     2.30k   10.90k    68.65%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   77.63ms
 75.000%  131.07ms
 90.000%  192.90ms
 99.000%  277.76ms
 99.900%  340.22ms
 99.990%  385.02ms
 99.999%  435.97ms
100.000%  446.46ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.768     0.000000            1         1.00
      22.687     0.100000        85121         1.11
      33.919     0.200000       170174         1.25
      46.431     0.300000       255162         1.43
      60.959     0.400000       340238         1.67
      77.631     0.500000       425506         2.00
      86.271     0.550000       467761         2.22
      95.487     0.600000       510313         2.50
     105.663     0.650000       552800         2.86
     117.375     0.700000       595376         3.33
     131.071     0.750000       637858         4.00
     138.751     0.775000       659422         4.44
     146.815     0.800000       680644         5.00
     155.903     0.825000       701649         5.71
     166.527     0.850000       723057         6.67
     178.943     0.875000       744210         8.00
     185.855     0.887500       754854         8.89
     192.895     0.900000       765397        10.00
     200.831     0.912500       776128        11.43
     209.407     0.925000       786728        13.33
     218.495     0.937500       797328        16.00
     223.615     0.943750       802666        17.78
     228.863     0.950000       808035        20.00
     234.239     0.956250       813230        22.86
     239.999     0.962500       818569        26.67
     246.271     0.968750       823858        32.00
     249.727     0.971875       826557        35.56
     253.439     0.975000       829236        40.00
     257.407     0.978125       831865        45.71
     261.631     0.981250       834550        53.33
     266.239     0.984375       837195        64.00
     269.055     0.985938       838539        71.11
     272.127     0.987500       839847        80.00
     275.455     0.989062       841177        91.43
     279.295     0.990625       842477       106.67
     284.671     0.992188       843836       128.00
     287.487     0.992969       844474       142.22
     290.559     0.993750       845149       160.00
     294.143     0.994531       845792       182.86
     298.495     0.995313       846458       213.33
     303.871     0.996094       847129       256.00
     306.943     0.996484       847454       284.44
     310.783     0.996875       847792       320.00
     315.135     0.997266       848121       365.71
     318.975     0.997656       848443       426.67
     324.351     0.998047       848787       512.00
     326.655     0.998242       848943       568.89
     329.471     0.998437       849118       640.00
     332.287     0.998633       849288       731.43
     336.127     0.998828       849443       853.33
     340.735     0.999023       849608      1024.00
     343.807     0.999121       849696      1137.78
     345.855     0.999219       849780      1280.00
     347.903     0.999316       849863      1462.86
     350.975     0.999414       849941      1706.67
     355.327     0.999512       850019      2048.00
     358.143     0.999561       850067      2275.56
     360.959     0.999609       850105      2560.00
     363.775     0.999658       850148      2925.71
     366.847     0.999707       850185      3413.33
     371.711     0.999756       850230      4096.00
     373.503     0.999780       850250      4551.11
     374.783     0.999805       850271      5120.00
     376.319     0.999829       850290      5851.43
     379.647     0.999854       850310      6826.67
     382.719     0.999878       850331      8192.00
     383.999     0.999890       850342      9102.22
     385.279     0.999902       850351     10240.00
     386.815     0.999915       850362     11702.86
     388.607     0.999927       850373     13653.33
     391.167     0.999939       850383     16384.00
     392.447     0.999945       850388     18204.44
     393.471     0.999951       850394     20480.00
     393.983     0.999957       850398     23405.71
     395.519     0.999963       850404     27306.67
     401.151     0.999969       850410     32768.00
     406.527     0.999973       850411     36408.89
     410.623     0.999976       850414     40960.00
     416.255     0.999979       850416     46811.43
     418.303     0.999982       850419     54613.33
     423.167     0.999985       850422     65536.00
     434.943     0.999986       850423     72817.78
     435.199     0.999988       850424     81920.00
     435.967     0.999989       850425     93622.86
     438.783     0.999991       850427    109226.67
     439.295     0.999992       850428    131072.00
     439.551     0.999993       850429    145635.56
     439.551     0.999994       850429    163840.00
     445.951     0.999995       850430    187245.71
     446.207     0.999995       850432    218453.33
     446.207     0.999996       850432    262144.00
     446.207     0.999997       850432    291271.11
     446.207     0.999997       850432    327680.00
     446.207     0.999997       850432    374491.43
     446.463     0.999998       850434    436906.67
     446.463     1.000000       850434          inf
#[Mean    =       93.297, StdDeviation   =       66.329]
#[Max     =      446.208, Total count    =       850434]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079451 requests in 2.00m, 126.62MB read
Requests/sec:   8977.63
Transfer/sec:      1.05MB
aspnetcore / 2 cores / 100 connections with 1000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 1.108ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 1.120ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.05ms  456.50us   7.10ms   62.08%
    Req/Sec   525.25    132.35     1.00k    68.89%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.05ms
 75.000%    1.39ms
 90.000%    1.67ms
 99.000%    2.00ms
 99.900%    2.24ms
 99.990%    6.66ms
 99.999%    7.11ms
100.000%    7.11ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.165     0.000000            1         1.00
       0.454     0.100000         5022         1.11
       0.583     0.200000         9963         1.25
       0.730     0.300000        14924         1.43
       0.892     0.400000        19915         1.67
       1.050     0.500000        24871         2.00
       1.125     0.550000        27359         2.22
       1.197     0.600000        29851         2.50
       1.265     0.650000        32347         2.86
       1.330     0.700000        34840         3.33
       1.390     0.750000        37309         4.00
       1.419     0.775000        38567         4.44
       1.455     0.800000        39824         5.00
       1.501     0.825000        41046         5.71
       1.555     0.850000        42296         6.67
       1.612     0.875000        43544         8.00
       1.640     0.887500        44160         8.89
       1.668     0.900000        44790        10.00
       1.698     0.912500        45389        11.43
       1.729     0.925000        46037        13.33
       1.758     0.937500        46654        16.00
       1.773     0.943750        46945        17.78
       1.791     0.950000        47253        20.00
       1.810     0.956250        47576        22.86
       1.830     0.962500        47884        26.67
       1.855     0.968750        48194        32.00
       1.869     0.971875        48347        35.56
       1.882     0.975000        48507        40.00
       1.897     0.978125        48655        45.71
       1.918     0.981250        48812        53.33
       1.939     0.984375        48967        64.00
       1.954     0.985938        49045        71.11
       1.967     0.987500        49120        80.00
       1.983     0.989062        49197        91.43
       2.000     0.990625        49276       106.67
       2.023     0.992188        49353       128.00
       2.037     0.992969        49392       142.22
       2.059     0.993750        49435       160.00
       2.079     0.994531        49472       182.86
       2.095     0.995313        49509       213.33
       2.119     0.996094        49550       256.00
       2.131     0.996484        49568       284.44
       2.139     0.996875        49586       320.00
       2.149     0.997266        49604       365.71
       2.175     0.997656        49627       426.67
       2.187     0.998047        49645       512.00
       2.197     0.998242        49653       568.89
       2.205     0.998437        49663       640.00
       2.213     0.998633        49674       731.43
       2.225     0.998828        49682       853.33
       2.249     0.999023        49693      1024.00
       2.261     0.999121        49698      1137.78
       2.273     0.999219        49703      1280.00
       2.279     0.999316        49706      1462.86
       2.295     0.999414        49711      1706.67
       2.329     0.999512        49716      2048.00
       2.337     0.999561        49719      2275.56
       2.399     0.999609        49721      2560.00
       2.921     0.999658        49723      2925.71
       5.027     0.999707        49726      3413.33
       5.155     0.999756        49728      4096.00
       5.375     0.999780        49730      4551.11
       5.383     0.999805        49731      5120.00
       6.459     0.999829        49732      5851.43
       6.491     0.999854        49733      6826.67
       6.631     0.999878        49734      8192.00
       6.659     0.999890        49735      9102.22
       6.695     0.999902        49736     10240.00
       6.695     0.999915        49736     11702.86
       6.855     0.999927        49737     13653.33
       6.855     0.999939        49737     16384.00
       6.971     0.999945        49738     18204.44
       6.971     0.999951        49738     20480.00
       6.971     0.999957        49738     23405.71
       7.039     0.999963        49739     27306.67
       7.039     0.999969        49739     32768.00
       7.039     0.999973        49739     36408.89
       7.039     0.999976        49739     40960.00
       7.039     0.999979        49739     46811.43
       7.107     0.999982        49740     54613.33
       7.107     1.000000        49740          inf
#[Mean    =        1.051, StdDeviation   =        0.457]
#[Max     =        7.104, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59922 requests in 1.00m, 7.03MB read
Requests/sec:    998.70
Transfer/sec:    119.96KB
aspnetcore / 2 cores / 10000 connections with 5000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 3.263ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 3.313ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.75ms    3.95ms  76.54ms   93.78%
    Req/Sec     2.68k     1.50k   22.22k    95.94%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.74ms
 75.000%    2.59ms
 90.000%    3.82ms
 99.000%   23.17ms
 99.900%   33.69ms
 99.990%   67.33ms
 99.999%   75.01ms
100.000%   76.61ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.318     0.000000            1         1.00
       0.881     0.100000        42590         1.11
       1.166     0.200000        85182         1.25
       1.359     0.300000       127538         1.43
       1.531     0.400000       170092         1.67
       1.736     0.500000       212573         2.00
       1.886     0.550000       233881         2.22
       2.047     0.600000       255112         2.50
       2.211     0.650000       276416         2.86
       2.383     0.700000       297530         3.33
       2.585     0.750000       318884         4.00
       2.713     0.775000       329502         4.44
       2.879     0.800000       340067         5.00
       3.099     0.825000       350660         5.71
       3.309     0.850000       361335         6.67
       3.513     0.875000       371942         8.00
       3.637     0.887500       377248         8.89
       3.817     0.900000       382545        10.00
       4.167     0.912500       387904        11.43
       4.599     0.925000       393171        13.33
       6.671     0.937500       398483        16.00
       7.795     0.943750       401147        17.78
       8.911     0.950000       403808        20.00
      10.199     0.956250       406465        22.86
      11.655     0.962500       409113        26.67
      13.519     0.968750       411760        32.00
      14.607     0.971875       413089        35.56
      15.847     0.975000       414425        40.00
      17.151     0.978125       415747        45.71
      18.495     0.981250       417083        53.33
      19.951     0.984375       418402        64.00
      20.815     0.985938       419076        71.11
      21.695     0.987500       419733        80.00
      22.591     0.989062       420402        91.43
      23.631     0.990625       421065       106.67
      24.735     0.992188       421725       128.00
      25.295     0.992969       422057       142.22
      25.919     0.993750       422390       160.00
      26.543     0.994531       422724       182.86
      27.279     0.995313       423051       213.33
      28.271     0.996094       423382       256.00
      28.831     0.996484       423554       284.44
      29.359     0.996875       423716       320.00
      29.967     0.997266       423883       365.71
      30.591     0.997656       424048       426.67
      31.295     0.998047       424216       512.00
      31.695     0.998242       424295       568.89
      32.127     0.998437       424381       640.00
      32.559     0.998633       424463       731.43
      33.087     0.998828       424544       853.33
      33.727     0.999023       424630      1024.00
      34.047     0.999121       424670      1137.78
      34.527     0.999219       424710      1280.00
      35.039     0.999316       424755      1462.86
      35.967     0.999414       424793      1706.67
      37.407     0.999512       424836      2048.00
      40.831     0.999561       424857      2275.56
      44.799     0.999609       424876      2560.00
      49.087     0.999658       424897      2925.71
      52.703     0.999707       424918      3413.33
      57.247     0.999756       424939      4096.00
      59.455     0.999780       424949      4551.11
      61.599     0.999805       424959      5120.00
      63.967     0.999829       424970      5851.43
      65.535     0.999854       424980      6826.67
      66.495     0.999878       424992      8192.00
      66.751     0.999890       424996      9102.22
      67.391     0.999902       425001     10240.00
      68.543     0.999915       425006     11702.86
      69.759     0.999927       425011     13653.33
      70.783     0.999939       425017     16384.00
      71.551     0.999945       425019     18204.44
      72.063     0.999951       425022     20480.00
      72.383     0.999957       425025     23405.71
      73.279     0.999963       425027     27306.67
      74.175     0.999969       425030     32768.00
      74.303     0.999973       425031     36408.89
      74.431     0.999976       425034     40960.00
      74.431     0.999979       425034     46811.43
      74.559     0.999982       425035     54613.33
      74.687     0.999985       425036     65536.00
      74.943     0.999986       425037     72817.78
      74.943     0.999988       425037     81920.00
      75.007     0.999989       425039     93622.86
      75.007     0.999991       425039    109226.67
      75.007     0.999992       425039    131072.00
      75.327     0.999993       425040    145635.56
      75.327     0.999994       425040    163840.00
      75.327     0.999995       425040    187245.71
      75.455     0.999995       425041    218453.33
      75.455     0.999996       425041    262144.00
      75.455     0.999997       425041    291271.11
      75.455     0.999997       425041    327680.00
      75.455     0.999997       425041    374491.43
      76.607     0.999998       425042    436906.67
      76.607     1.000000       425042          inf
#[Mean    =        2.753, StdDeviation   =        3.952]
#[Max     =       76.544, Total count    =       425042]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542355 requests in 2.00m, 63.62MB read
Requests/sec:   4519.42
Transfer/sec:    542.86KB
aspnetcore / 2 cores / 10000 connections with 10000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 33.424ms, rate sampling interval: 226ms
  Thread calibration: mean lat.: 31.984ms, rate sampling interval: 209ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    84.76ms   64.26ms 335.36ms   72.12%
    Req/Sec     5.20k     2.65k   12.15k    65.45%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   64.89ms
 75.000%  120.96ms
 90.000%  185.09ms
 99.000%  262.40ms
 99.900%  293.63ms
 99.990%  314.62ms
 99.999%  323.07ms
100.000%  335.61ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.792     0.000000            1         1.00
      19.695     0.100000        85084         1.11
      29.455     0.200000       170149         1.25
      39.263     0.300000       255319         1.43
      50.623     0.400000       340410         1.67
      64.895     0.500000       425358         2.00
      73.535     0.550000       468197         2.22
      83.263     0.600000       510643         2.50
      94.207     0.650000       552988         2.86
     106.623     0.700000       595681         3.33
     120.959     0.750000       638113         4.00
     129.023     0.775000       659464         4.44
     137.727     0.800000       680675         5.00
     147.455     0.825000       701930         5.71
     158.335     0.850000       723183         6.67
     171.007     0.875000       744427         8.00
     177.791     0.887500       755014         8.89
     185.087     0.900000       765774        10.00
     193.023     0.912500       776274        11.43
     201.855     0.925000       786992        13.33
     211.071     0.937500       797597        16.00
     215.807     0.943750       802890        17.78
     220.671     0.950000       808205        20.00
     225.663     0.956250       813566        22.86
     230.783     0.962500       818853        26.67
     236.415     0.968750       824129        32.00
     239.487     0.971875       826822        35.56
     242.815     0.975000       829519        40.00
     246.015     0.978125       832112        45.71
     249.727     0.981250       834802        53.33
     253.567     0.984375       837413        64.00
     255.615     0.985938       838763        71.11
     258.047     0.987500       840120        80.00
     260.607     0.989062       841452        91.43
     263.679     0.990625       842814       106.67
     266.751     0.992188       844106       128.00
     268.543     0.992969       844798       142.22
     270.335     0.993750       845421       160.00
     272.639     0.994531       846097       182.86
     274.943     0.995313       846776       213.33
     277.759     0.996094       847455       256.00
     279.039     0.996484       847739       284.44
     280.575     0.996875       848057       320.00
     282.367     0.997266       848418       365.71
     284.159     0.997656       848745       426.67
     286.207     0.998047       849065       512.00
     287.487     0.998242       849222       568.89
     288.767     0.998437       849376       640.00
     290.559     0.998633       849561       731.43
     292.095     0.998828       849711       853.33
     294.143     0.999023       849890      1024.00
     295.167     0.999121       849969      1137.78
     296.447     0.999219       850051      1280.00
     297.727     0.999316       850132      1462.86
     299.263     0.999414       850215      1706.67
     300.799     0.999512       850298      2048.00
     301.823     0.999561       850341      2275.56
     302.591     0.999609       850376      2560.00
     303.615     0.999658       850418      2925.71
     304.895     0.999707       850460      3413.33
     306.175     0.999756       850499      4096.00
     307.455     0.999780       850526      4551.11
     308.479     0.999805       850541      5120.00
     310.015     0.999829       850563      5851.43
     311.295     0.999854       850583      6826.67
     312.831     0.999878       850602      8192.00
     313.855     0.999890       850613      9102.22
     314.879     0.999902       850623     10240.00
     316.159     0.999915       850635     11702.86
     316.671     0.999927       850645     13653.33
     317.439     0.999939       850654     16384.00
     317.695     0.999945       850659     18204.44
     318.207     0.999951       850665     20480.00
     318.719     0.999957       850670     23405.71
     319.231     0.999963       850678     27306.67
     319.743     0.999969       850681     32768.00
     319.999     0.999973       850682     36408.89
     320.767     0.999976       850685     40960.00
     321.535     0.999979       850687     46811.43
     322.047     0.999982       850692     54613.33
     322.559     0.999985       850694     65536.00
     322.559     0.999986       850694     72817.78
     323.071     0.999988       850696     81920.00
     323.071     0.999989       850696     93622.86
     324.607     0.999991       850698    109226.67
     328.447     0.999992       850699    131072.00
     328.959     0.999993       850700    145635.56
     328.959     0.999994       850700    163840.00
     329.215     0.999995       850702    187245.71
     329.215     0.999995       850702    218453.33
     329.215     0.999996       850702    262144.00
     329.983     0.999997       850703    291271.11
     329.983     0.999997       850703    327680.00
     329.983     0.999997       850703    374491.43
     332.031     0.999998       850704    436906.67
     332.031     0.999998       850704    524288.00
     332.031     0.999998       850704    582542.22
     332.031     0.999998       850704    655360.00
     332.031     0.999999       850704    748982.86
     335.615     0.999999       850705    873813.33
     335.615     1.000000       850705          inf
#[Mean    =       84.759, StdDeviation   =       64.262]
#[Max     =      335.360, Total count    =       850705]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079452 requests in 2.00m, 126.62MB read
Requests/sec:   8977.10
Transfer/sec:      1.05MB

cpv-framework

version: 0.2.0.0

cpv-framework / 1 core / 100 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms  194.13us   6.32ms   87.68%
    Req/Sec    42.54k   608.12    47.06k    73.00%
  Latency Distribution
     50%    1.16ms
     75%    1.19ms
     90%    1.23ms
     99%    2.03ms
  5083203 requests in 1.00m, 848.35MB read
Requests/sec:  84691.95
Transfer/sec:     14.13MB
cpv-framework / 1 core / 10000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   130.20ms    2.74ms 209.88ms   98.96%
    Req/Sec    38.56k   787.19    41.53k    98.75%
  Latency Distribution
     50%  130.22ms
     75%  130.59ms
     90%  130.97ms
     99%  131.80ms
  9192411 requests in 2.00m, 1.50GB read
Requests/sec:  76556.09
Transfer/sec:     12.78MB
cpv-framework / 1 core / 20000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   262.87ms    6.72ms 382.62ms   99.48%
    Req/Sec    38.19k    13.44k   61.45k    52.21%
  Latency Distribution
     50%  263.08ms
     75%  263.72ms
     90%  264.18ms
     99%  265.71ms
  12991629 requests in 3.00m, 2.12GB read
Requests/sec:  72151.32
Transfer/sec:     12.04MB
cpv-framework / 2 cores / 100 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   584.47us  263.88us   8.45ms   85.77%
    Req/Sec    85.75k     1.30k   89.98k    89.58%
  Latency Distribution
     50%  508.00us
     75%  524.00us
     90%    0.99ms
     99%    1.05ms
  10239406 requests in 1.00m, 1.67GB read
Requests/sec: 170555.82
Transfer/sec:     28.46MB
cpv-framework / 2 cores / 10000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    65.17ms    3.57ms 119.55ms   72.39%
    Req/Sec    68.86k     1.82k   76.87k    77.73%
  Latency Distribution
     50%   64.54ms
     75%   66.52ms
     90%   71.00ms
     99%   73.29ms
  16417275 requests in 2.00m, 2.68GB read
Requests/sec: 136694.89
Transfer/sec:     22.81MB
cpv-framework / 2 cores / 20000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   137.41ms    8.75ms 245.08ms   62.49%
    Req/Sec    65.23k     2.90k   77.16k    67.42%
  Latency Distribution
     50%  138.84ms
     75%  144.24ms
     90%  147.82ms
     99%  153.54ms
  22191649 requests in 3.00m, 3.62GB read
Requests/sec: 123234.96
Transfer/sec:     20.57MB
cpv-framework / 1 core / 100 connections with 1000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.932ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.924ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.92ms  421.55us   2.27ms   62.70%
    Req/Sec   526.94    132.35     1.00k    69.76%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.91ms
 75.000%    1.24ms
 90.000%    1.48ms
 99.000%    1.91ms
 99.900%    2.12ms
 99.990%    2.21ms
 99.999%    2.27ms
100.000%    2.27ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.073     0.000000            1         1.00
       0.361     0.100000         4981         1.11
       0.498     0.200000         9950         1.25
       0.638     0.300000        14935         1.43
       0.777     0.400000        19930         1.67
       0.911     0.500000        24887         2.00
       0.982     0.550000        27382         2.22
       1.051     0.600000        29859         2.50
       1.119     0.650000        32342         2.86
       1.184     0.700000        34855         3.33
       1.244     0.750000        37333         4.00
       1.275     0.775000        38556         4.44
       1.308     0.800000        39820         5.00
       1.340     0.825000        41038         5.71
       1.379     0.850000        42297         6.67
       1.425     0.875000        43531         8.00
       1.450     0.887500        44162         8.89
       1.476     0.900000        44793        10.00
       1.504     0.912500        45402        11.43
       1.533     0.925000        46019        13.33
       1.568     0.937500        46636        16.00
       1.590     0.943750        46943        17.78
       1.618     0.950000        47257        20.00
       1.653     0.956250        47571        22.86
       1.693     0.962500        47879        26.67
       1.730     0.968750        48187        32.00
       1.747     0.971875        48342        35.56
       1.768     0.975000        48505        40.00
       1.789     0.978125        48655        45.71
       1.813     0.981250        48813        53.33
       1.839     0.984375        48967        64.00
       1.854     0.985938        49044        71.11
       1.874     0.987500        49122        80.00
       1.892     0.989062        49197        91.43
       1.918     0.990625        49278       106.67
       1.940     0.992188        49355       128.00
       1.953     0.992969        49392       142.22
       1.971     0.993750        49430       160.00
       1.988     0.994531        49468       182.86
       2.006     0.995313        49507       213.33
       2.023     0.996094        49546       256.00
       2.034     0.996484        49566       284.44
       2.049     0.996875        49589       320.00
       2.057     0.997266        49604       365.71
       2.067     0.997656        49626       426.67
       2.083     0.998047        49645       512.00
       2.089     0.998242        49653       568.89
       2.095     0.998437        49663       640.00
       2.107     0.998633        49672       731.43
       2.115     0.998828        49683       853.33
       2.125     0.999023        49693      1024.00
       2.129     0.999121        49697      1137.78
       2.137     0.999219        49704      1280.00
       2.139     0.999316        49706      1462.86
       2.151     0.999414        49711      1706.67
       2.161     0.999512        49716      2048.00
       2.171     0.999561        49719      2275.56
       2.179     0.999609        49721      2560.00
       2.181     0.999658        49723      2925.71
       2.185     0.999707        49727      3413.33
       2.193     0.999756        49730      4096.00
       2.193     0.999780        49730      4551.11
       2.197     0.999805        49731      5120.00
       2.201     0.999829        49732      5851.43
       2.211     0.999854        49733      6826.67
       2.213     0.999878        49735      8192.00
       2.213     0.999890        49735      9102.22
       2.223     0.999902        49737     10240.00
       2.223     0.999915        49737     11702.86
       2.223     0.999927        49737     13653.33
       2.223     0.999939        49737     16384.00
       2.227     0.999945        49738     18204.44
       2.227     0.999951        49738     20480.00
       2.227     0.999957        49738     23405.71
       2.267     0.999963        49739     27306.67
       2.267     0.999969        49739     32768.00
       2.267     0.999973        49739     36408.89
       2.267     0.999976        49739     40960.00
       2.267     0.999979        49739     46811.43
       2.271     0.999982        49740     54613.33
       2.271     1.000000        49740          inf
#[Mean    =        0.923, StdDeviation   =        0.422]
#[Max     =        2.270, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59922 requests in 1.00m, 10.00MB read
Requests/sec:    998.69
Transfer/sec:    170.67KB
cpv-framework / 1 core / 10000 connections with 5000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.240ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.242ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    3.49ms  37.76ms   94.03%
    Req/Sec     2.68k     1.46k   21.78k    96.28%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.62ms
 75.000%    2.50ms
 90.000%    3.55ms
 99.000%   20.72ms
 99.900%   30.08ms
 99.990%   34.33ms
 99.999%   36.32ms
100.000%   37.79ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.312     0.000000            1         1.00
       0.817     0.100000        42570         1.11
       1.066     0.200000        85061         1.25
       1.270     0.300000       127601         1.43
       1.438     0.400000       170224         1.67
       1.616     0.500000       212642         2.00
       1.732     0.550000       233898         2.22
       1.909     0.600000       255177         2.50
       2.115     0.650000       276538         2.86
       2.305     0.700000       297745         3.33
       2.497     0.750000       318972         4.00
       2.605     0.775000       329576         4.44
       2.735     0.800000       340121         5.00
       2.917     0.825000       350822         5.71
       3.143     0.850000       361395         6.67
       3.349     0.875000       372078         8.00
       3.445     0.887500       377372         8.89
       3.553     0.900000       382629        10.00
       3.705     0.912500       387967        11.43
       4.131     0.925000       393276        13.33
       5.395     0.937500       398572        16.00
       6.827     0.943750       401229        17.78
       8.239     0.950000       403883        20.00
       9.671     0.956250       406544        22.86
      11.199     0.962500       409199        26.67
      12.831     0.968750       411855        32.00
      13.727     0.971875       413194        35.56
      14.703     0.975000       414515        40.00
      15.823     0.978125       415843        45.71
      16.959     0.981250       417189        53.33
      18.127     0.984375       418508        64.00
      18.783     0.985938       419164        71.11
      19.471     0.987500       419837        80.00
      20.239     0.989062       420493        91.43
      21.071     0.990625       421161       106.67
      22.095     0.992188       421819       128.00
      22.703     0.992969       422156       142.22
      23.343     0.993750       422492       160.00
      24.079     0.994531       422819       182.86
      24.879     0.995313       423155       213.33
      25.727     0.996094       423483       256.00
      26.223     0.996484       423647       284.44
      26.815     0.996875       423813       320.00
      27.375     0.997266       423981       365.71
      27.967     0.997656       424144       426.67
      28.527     0.998047       424310       512.00
      28.799     0.998242       424393       568.89
      29.103     0.998437       424477       640.00
      29.423     0.998633       424559       731.43
      29.775     0.998828       424644       853.33
      30.143     0.999023       424726      1024.00
      30.399     0.999121       424767      1137.78
      30.639     0.999219       424810      1280.00
      30.911     0.999316       424851      1462.86
      31.199     0.999414       424891      1706.67
      31.631     0.999512       424933      2048.00
      31.823     0.999561       424955      2275.56
      32.015     0.999609       424975      2560.00
      32.207     0.999658       424995      2925.71
      32.479     0.999707       425016      3413.33
      32.895     0.999756       425038      4096.00
      33.023     0.999780       425049      4551.11
      33.215     0.999805       425057      5120.00
      33.375     0.999829       425070      5851.43
      33.599     0.999854       425080      6826.67
      33.983     0.999878       425089      8192.00
      34.239     0.999890       425094      9102.22
      34.399     0.999902       425099     10240.00
      34.463     0.999915       425104     11702.86
      34.623     0.999927       425109     13653.33
      34.815     0.999939       425115     16384.00
      34.911     0.999945       425117     18204.44
      35.039     0.999951       425122     20480.00
      35.039     0.999957       425122     23405.71
      35.135     0.999963       425125     27306.67
      35.263     0.999969       425128     32768.00
      35.391     0.999973       425131     36408.89
      35.391     0.999976       425131     40960.00
      35.391     0.999979       425131     46811.43
      35.647     0.999982       425133     54613.33
      35.903     0.999985       425134     65536.00
      36.191     0.999986       425135     72817.78
      36.191     0.999988       425135     81920.00
      36.319     0.999989       425136     93622.86
      36.863     0.999991       425137    109226.67
      36.863     0.999992       425137    131072.00
      36.991     0.999993       425138    145635.56
      36.991     0.999994       425138    163840.00
      36.991     0.999995       425138    187245.71
      37.407     0.999995       425139    218453.33
      37.407     0.999996       425139    262144.00
      37.407     0.999997       425139    291271.11
      37.407     0.999997       425139    327680.00
      37.407     0.999997       425139    374491.43
      37.791     0.999998       425140    436906.67
      37.791     1.000000       425140          inf
#[Mean    =        2.547, StdDeviation   =        3.488]
#[Max     =       37.760, Total count    =       425140]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542379 requests in 2.00m, 90.52MB read
Requests/sec:   4519.74
Transfer/sec:    772.42KB
cpv-framework / 1 core / 10000 connections with 10000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 32.808ms, rate sampling interval: 203ms
  Thread calibration: mean lat.: 29.743ms, rate sampling interval: 199ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    85.65ms   65.05ms 342.02ms   71.40%
    Req/Sec     5.28k     2.81k   12.13k    66.42%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   66.62ms
 75.000%  122.56ms
 90.000%  185.21ms
 99.000%  265.73ms
 99.900%  304.38ms
 99.990%  324.10ms
 99.999%  328.70ms
100.000%  342.27ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.850     0.000000            1         1.00
      18.831     0.100000        85092         1.11
      29.247     0.200000       170082         1.25
      39.551     0.300000       255114         1.43
      51.519     0.400000       340102         1.67
      66.623     0.500000       425258         2.00
      75.519     0.550000       467729         2.22
      85.375     0.600000       510120         2.50
      96.447     0.650000       552465         2.86
     108.863     0.700000       594983         3.33
     122.559     0.750000       637606         4.00
     130.495     0.775000       658728         4.44
     139.263     0.800000       679958         5.00
     148.607     0.825000       701396         5.71
     159.103     0.850000       722589         6.67
     171.135     0.875000       743827         8.00
     177.919     0.887500       754427         8.89
     185.215     0.900000       764977        10.00
     193.535     0.912500       775680        11.43
     202.623     0.925000       786274        13.33
     212.351     0.937500       796867        16.00
     217.343     0.943750       802119        17.78
     222.591     0.950000       807487        20.00
     227.967     0.956250       812744        22.86
     233.727     0.962500       818124        26.67
     239.487     0.968750       823409        32.00
     242.559     0.971875       826108        35.56
     245.631     0.975000       828754        40.00
     248.831     0.978125       831331        45.71
     252.415     0.981250       834003        53.33
     256.511     0.984375       836647        64.00
     258.815     0.985938       837991        71.11
     261.247     0.987500       839318        80.00
     263.935     0.989062       840644        91.43
     267.007     0.990625       841988       106.67
     270.335     0.992188       843292       128.00
     272.127     0.992969       843950       142.22
     274.175     0.993750       844643       160.00
     276.479     0.994531       845296       182.86
     279.295     0.995313       845992       213.33
     282.623     0.996094       846636       256.00
     284.415     0.996484       846933       284.44
     286.463     0.996875       847268       320.00
     288.767     0.997266       847621       365.71
     291.071     0.997656       847944       426.67
     293.887     0.998047       848264       512.00
     295.679     0.998242       848430       568.89
     297.471     0.998437       848589       640.00
     299.775     0.998633       848768       731.43
     302.079     0.998828       848938       853.33
     304.639     0.999023       849089      1024.00
     306.175     0.999121       849175      1137.78
     307.711     0.999219       849262      1280.00
     309.247     0.999316       849344      1462.86
     311.039     0.999414       849427      1706.67
     313.343     0.999512       849506      2048.00
     314.623     0.999561       849548      2275.56
     315.903     0.999609       849595      2560.00
     316.927     0.999658       849633      2925.71
     318.207     0.999707       849673      3413.33
     319.231     0.999756       849714      4096.00
     319.999     0.999780       849733      4551.11
     320.511     0.999805       849755      5120.00
     321.279     0.999829       849774      5851.43
     322.303     0.999854       849800      6826.67
     323.071     0.999878       849817      8192.00
     323.583     0.999890       849828      9102.22
     324.095     0.999902       849834     10240.00
     324.607     0.999915       849845     11702.86
     325.119     0.999927       849862     13653.33
     325.375     0.999939       849868     16384.00
     325.631     0.999945       849872     18204.44
     325.887     0.999951       849878     20480.00
     326.399     0.999957       849888     23405.71
     326.399     0.999963       849888     27306.67
     326.655     0.999969       849893     32768.00
     326.655     0.999973       849893     36408.89
     327.167     0.999976       849899     40960.00
     327.167     0.999979       849899     46811.43
     327.423     0.999982       849903     54613.33
     327.679     0.999985       849904     65536.00
     327.935     0.999986       849906     72817.78
     327.935     0.999988       849906     81920.00
     328.191     0.999989       849907     93622.86
     329.215     0.999991       849909    109226.67
     330.751     0.999992       849910    131072.00
     331.007     0.999993       849911    145635.56
     331.007     0.999994       849911    163840.00
     331.263     0.999995       849913    187245.71
     331.263     0.999995       849913    218453.33
     331.263     0.999996       849913    262144.00
     333.055     0.999997       849914    291271.11
     333.055     0.999997       849914    327680.00
     333.055     0.999997       849914    374491.43
     333.311     0.999998       849915    436906.67
     333.311     0.999998       849915    524288.00
     333.311     0.999998       849915    582542.22
     333.311     0.999998       849915    655360.00
     333.311     0.999999       849915    748982.86
     342.271     0.999999       849916    873813.33
     342.271     1.000000       849916          inf
#[Mean    =       85.650, StdDeviation   =       65.046]
#[Max     =      342.016, Total count    =       849916]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079043 requests in 2.00m, 180.08MB read
Requests/sec:   8974.79
Transfer/sec:      1.50MB
cpv-framework / 2 cores / 100 connections with 1000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.942ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 1.041ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.95ms  583.98us  13.40ms   83.00%
    Req/Sec   520.02    138.48     1.33k    72.41%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.91ms
 75.000%    1.23ms
 90.000%    1.49ms
 99.000%    2.02ms
 99.900%    9.38ms
 99.990%   11.69ms
 99.999%   13.41ms
100.000%   13.41ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.099     0.000000            1         1.00
       0.377     0.100000         4975         1.11
       0.508     0.200000         9964         1.25
       0.642     0.300000        14955         1.43
       0.779     0.400000        19927         1.67
       0.912     0.500000        24874         2.00
       0.977     0.550000        27389         2.22
       1.040     0.600000        29875         2.50
       1.104     0.650000        32365         2.86
       1.167     0.700000        34847         3.33
       1.227     0.750000        37316         4.00
       1.258     0.775000        38560         4.44
       1.290     0.800000        39811         5.00
       1.323     0.825000        41058         5.71
       1.367     0.850000        42283         6.67
       1.427     0.875000        43529         8.00
       1.460     0.887500        44164         8.89
       1.489     0.900000        44769        10.00
       1.520     0.912500        45402        11.43
       1.552     0.925000        46028        13.33
       1.596     0.937500        46637        16.00
       1.625     0.943750        46948        17.78
       1.657     0.950000        47263        20.00
       1.693     0.956250        47570        22.86
       1.736     0.962500        47877        26.67
       1.786     0.968750        48187        32.00
       1.808     0.971875        48344        35.56
       1.832     0.975000        48498        40.00
       1.861     0.978125        48654        45.71
       1.887     0.981250        48814        53.33
       1.921     0.984375        48968        64.00
       1.941     0.985938        49044        71.11
       1.963     0.987500        49121        80.00
       1.994     0.989062        49197        91.43
       2.029     0.990625        49275       106.67
       2.073     0.992188        49353       128.00
       2.091     0.992969        49392       142.22
       2.123     0.993750        49433       160.00
       2.153     0.994531        49469       182.86
       2.191     0.995313        49508       213.33
       2.243     0.996094        49547       256.00
       2.795     0.996484        49567       284.44
       3.907     0.996875        49586       320.00
       4.667     0.997266        49605       365.71
       5.907     0.997656        49625       426.67
       6.611     0.998047        49644       512.00
       6.995     0.998242        49654       568.89
       7.435     0.998437        49664       640.00
       8.087     0.998633        49673       731.43
       8.535     0.998828        49683       853.33
       9.439     0.999023        49693      1024.00
       9.663     0.999121        49698      1137.78
       9.879     0.999219        49703      1280.00
      10.135     0.999316        49707      1462.86
      10.319     0.999414        49712      1706.67
      10.663     0.999512        49717      2048.00
      10.823     0.999561        49720      2275.56
      10.863     0.999609        49722      2560.00
      10.959     0.999658        49724      2925.71
      11.015     0.999707        49727      3413.33
      11.079     0.999756        49729      4096.00
      11.207     0.999780        49731      4551.11
      11.455     0.999805        49732      5120.00
      11.527     0.999829        49733      5851.43
      11.631     0.999854        49734      6826.67
      11.663     0.999878        49735      8192.00
      11.687     0.999890        49736      9102.22
      11.823     0.999902        49737     10240.00
      11.823     0.999915        49737     11702.86
      11.967     0.999927        49738     13653.33
      11.967     0.999939        49738     16384.00
      12.967     0.999945        49739     18204.44
      12.967     0.999951        49739     20480.00
      12.967     0.999957        49739     23405.71
      13.215     0.999963        49740     27306.67
      13.215     0.999969        49740     32768.00
      13.215     0.999973        49740     36408.89
      13.215     0.999976        49740     40960.00
      13.215     0.999979        49740     46811.43
      13.407     0.999982        49741     54613.33
      13.407     1.000000        49741          inf
#[Mean    =        0.946, StdDeviation   =        0.584]
#[Max     =       13.400, Total count    =        49741]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59925 requests in 1.00m, 10.00MB read
Requests/sec:    998.73
Transfer/sec:    170.68KB
cpv-framework / 2 cores / 10000 connections with 5000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.203ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.208ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    3.56ms  39.84ms   94.15%
    Req/Sec     2.68k     1.47k   22.33k    96.35%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.61ms
 75.000%    2.49ms
 90.000%    3.56ms
 99.000%   21.61ms
 99.900%   31.23ms
 99.990%   35.71ms
 99.999%   37.57ms
100.000%   39.87ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.311     0.000000            2         1.00
       0.815     0.100000        42623         1.11
       1.067     0.200000        85149         1.25
       1.269     0.300000       127593         1.43
       1.431     0.400000       170169         1.67
       1.607     0.500000       212609         2.00
       1.724     0.550000       233931         2.22
       1.905     0.600000       255109         2.50
       2.113     0.650000       276466         2.86
       2.301     0.700000       297805         3.33
       2.491     0.750000       318907         4.00
       2.601     0.775000       329624         4.44
       2.731     0.800000       340143         5.00
       2.919     0.825000       350855         5.71
       3.151     0.850000       361398         6.67
       3.355     0.875000       372056         8.00
       3.455     0.887500       377432         8.89
       3.563     0.900000       382698        10.00
       3.727     0.912500       387973        11.43
       4.155     0.925000       393294        13.33
       5.343     0.937500       398594        16.00
       6.535     0.943750       401249        17.78
       7.779     0.950000       403908        20.00
       9.135     0.956250       406575        22.86
      10.655     0.962500       409224        26.67
      12.423     0.968750       411881        32.00
      13.463     0.971875       413219        35.56
      14.655     0.975000       414534        40.00
      15.903     0.978125       415866        45.71
      17.215     0.981250       417195        53.33
      18.623     0.984375       418521        64.00
      19.375     0.985938       419192        71.11
      20.207     0.987500       419857        80.00
      21.071     0.989062       420526        91.43
      21.999     0.990625       421178       106.67
      23.135     0.992188       421848       128.00
      23.807     0.992969       422177       142.22
      24.495     0.993750       422510       160.00
      25.263     0.994531       422842       182.86
      26.047     0.995313       423175       213.33
      26.895     0.996094       423507       256.00
      27.311     0.996484       423671       284.44
      27.807     0.996875       423840       320.00
      28.255     0.997266       424002       365.71
      28.831     0.997656       424167       426.67
      29.391     0.998047       424336       512.00
      29.743     0.998242       424418       568.89
      30.047     0.998437       424501       640.00
      30.399     0.998633       424587       731.43
      30.831     0.998828       424670       853.33
      31.279     0.999023       424751      1024.00
      31.487     0.999121       424792      1137.78
      31.743     0.999219       424833      1280.00
      32.031     0.999316       424874      1462.86
      32.351     0.999414       424915      1706.67
      32.735     0.999512       424956      2048.00
      33.055     0.999561       424978      2275.56
      33.279     0.999609       424997      2560.00
      33.599     0.999658       425021      2925.71
      33.951     0.999707       425042      3413.33
      34.271     0.999756       425063      4096.00
      34.495     0.999780       425070      4551.11
      34.751     0.999805       425080      5120.00
      35.007     0.999829       425092      5851.43
      35.231     0.999854       425103      6826.67
      35.455     0.999878       425112      8192.00
      35.615     0.999890       425117      9102.22
      35.775     0.999902       425123     10240.00
      36.031     0.999915       425128     11702.86
      36.191     0.999927       425132     13653.33
      36.287     0.999939       425138     16384.00
      36.447     0.999945       425141     18204.44
      36.479     0.999951       425144     20480.00
      36.511     0.999957       425145     23405.71
      36.735     0.999963       425149     27306.67
      36.863     0.999969       425151     32768.00
      37.087     0.999973       425152     36408.89
      37.119     0.999976       425153     40960.00
      37.311     0.999979       425154     46811.43
      37.375     0.999982       425156     54613.33
      37.439     0.999985       425157     65536.00
      37.503     0.999986       425158     72817.78
      37.503     0.999988       425158     81920.00
      37.567     0.999989       425159     93622.86
      38.207     0.999991       425160    109226.67
      38.207     0.999992       425160    131072.00
      38.303     0.999993       425161    145635.56
      38.303     0.999994       425161    163840.00
      38.303     0.999995       425161    187245.71
      38.527     0.999995       425162    218453.33
      38.527     0.999996       425162    262144.00
      38.527     0.999997       425162    291271.11
      38.527     0.999997       425162    327680.00
      38.527     0.999997       425162    374491.43
      39.871     0.999998       425163    436906.67
      39.871     1.000000       425163          inf
#[Mean    =        2.547, StdDeviation   =        3.555]
#[Max     =       39.840, Total count    =       425163]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542380 requests in 2.00m, 90.52MB read
Requests/sec:   4519.68
Transfer/sec:    772.41KB
cpv-framework / 2 cores / 10000 connections with 10000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 31.029ms, rate sampling interval: 206ms
  Thread calibration: mean lat.: 34.125ms, rate sampling interval: 229ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    87.21ms   64.97ms 343.81ms   70.98%
    Req/Sec     5.23k     2.67k   12.12k    63.57%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   69.12ms
 75.000%  124.93ms
 90.000%  185.60ms
 99.000%  267.01ms
 99.900%  306.17ms
 99.990%  329.21ms
 99.999%  337.66ms
100.000%  344.06ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.945     0.000000            1         1.00
      19.775     0.100000        85203         1.11
      30.207     0.200000       170244         1.25
      40.767     0.300000       255375         1.43
      53.407     0.400000       340519         1.67
      69.119     0.500000       425701         2.00
      78.079     0.550000       468410         2.22
      87.935     0.600000       510906         2.50
      98.943     0.650000       553392         2.86
     111.167     0.700000       595823         3.33
     124.927     0.750000       638529         4.00
     132.351     0.775000       659750         4.44
     140.415     0.800000       681077         5.00
     149.631     0.825000       702533         5.71
     159.871     0.850000       723699         6.67
     171.519     0.875000       744971         8.00
     178.303     0.887500       755579         8.89
     185.599     0.900000       766099        10.00
     193.663     0.912500       776787        11.43
     202.495     0.925000       787435        13.33
     212.479     0.937500       798029        16.00
     217.727     0.943750       803292        17.78
     223.231     0.950000       808629        20.00
     229.119     0.956250       813989        22.86
     235.135     0.962500       819297        26.67
     241.407     0.968750       824635        32.00
     244.607     0.971875       827278        35.56
     247.935     0.975000       829933        40.00
     251.263     0.978125       832553        45.71
     254.847     0.981250       835289        53.33
     258.559     0.984375       837920        64.00
     260.479     0.985938       839214        71.11
     262.911     0.987500       840615        80.00
     265.215     0.989062       841872        91.43
     268.287     0.990625       843296       106.67
     271.359     0.992188       844560       128.00
     273.151     0.992969       845209       142.22
     275.199     0.993750       845909       160.00
     277.503     0.994531       846559       182.86
     280.063     0.995313       847199       213.33
     283.135     0.996094       847863       256.00
     284.927     0.996484       848189       284.44
     287.231     0.996875       848541       320.00
     289.791     0.997266       848870       365.71
     292.863     0.997656       849199       426.67
     295.679     0.998047       849510       512.00
     297.727     0.998242       849684       568.89
     299.775     0.998437       849853       640.00
     301.567     0.998633       850012       731.43
     303.871     0.998828       850174       853.33
     306.431     0.999023       850342      1024.00
     307.967     0.999121       850432      1137.78
     309.247     0.999219       850507      1280.00
     310.783     0.999316       850594      1462.86
     312.575     0.999414       850672      1706.67
     314.623     0.999512       850764      2048.00
     315.903     0.999561       850801      2275.56
     317.183     0.999609       850844      2560.00
     318.719     0.999658       850889      2925.71
     319.743     0.999707       850923      3413.33
     321.535     0.999756       850966      4096.00
     322.303     0.999780       850985      4551.11
     323.583     0.999805       851006      5120.00
     324.351     0.999829       851027      5851.43
     325.119     0.999854       851046      6826.67
     327.679     0.999878       851066      8192.00
     328.703     0.999890       851079      9102.22
     329.471     0.999902       851086     10240.00
     330.239     0.999915       851097     11702.86
     331.775     0.999927       851107     13653.33
     332.799     0.999939       851118     16384.00
     333.567     0.999945       851126     18204.44
     333.823     0.999951       851130     20480.00
     334.079     0.999957       851133     23405.71
     334.847     0.999963       851142     27306.67
     335.103     0.999969       851144     32768.00
     335.359     0.999973       851148     36408.89
     335.615     0.999976       851149     40960.00
     335.871     0.999979       851151     46811.43
     336.383     0.999982       851155     54613.33
     336.639     0.999985       851157     65536.00
     337.407     0.999986       851158     72817.78
     337.663     0.999988       851160     81920.00
     337.663     0.999989       851160     93622.86
     338.431     0.999991       851162    109226.67
     341.503     0.999992       851164    131072.00
     341.503     0.999993       851164    145635.56
     341.503     0.999994       851164    163840.00
     343.807     0.999995       851167    187245.71
     343.807     0.999995       851167    218453.33
     343.807     0.999996       851167    262144.00
     343.807     0.999997       851167    291271.11
     343.807     0.999997       851167    327680.00
     343.807     0.999997       851167    374491.43
     344.063     0.999998       851169    436906.67
     344.063     1.000000       851169          inf
#[Mean    =       87.211, StdDeviation   =       64.968]
#[Max     =      343.808, Total count    =       851169]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079407 requests in 2.00m, 180.15MB read
Requests/sec:   8977.60
Transfer/sec:      1.50MB

hyper

version: 0.13.1

hyper / 1 core / 100 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.63ms    6.59ms  68.05ms   83.63%
    Req/Sec    32.55k     0.88k   40.31k    72.33%
  Latency Distribution
     50%  846.00us
     75%    7.17ms
     90%   15.37ms
     99%   24.97ms
  3886233 requests in 1.00m, 422.51MB read
Requests/sec:  64745.90
Transfer/sec:      7.04MB
hyper / 1 core / 10000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09s     1.50s   19.85s    82.31%
    Req/Sec    29.71k     2.90k   55.60k    82.68%
  Latency Distribution
     50%   31.42ms
     75%    1.98s
     90%    3.38s
     99%    5.64s
  7083398 requests in 2.00m, 770.10MB read
Requests/sec:  59014.57
Transfer/sec:      6.42MB
hyper / 1 core / 20000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.05s     2.72s   36.37s    79.94%
    Req/Sec    31.33k     7.93k   63.56k    74.42%
  Latency Distribution
     50%   30.82ms
     75%    3.98s
     90%    6.45s
     99%    9.17s
  10678989 requests in 3.00m, 1.13GB read
Requests/sec:  59307.57
Transfer/sec:      6.45MB
hyper / 2 cores / 100 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.97ms  44.78ms   92.09%
    Req/Sec    66.00k     1.46k   69.60k    84.50%
  Latency Distribution
     50%  681.00us
     75%    0.87ms
     90%    2.12ms
     99%   11.02ms
  7883297 requests in 1.00m, 857.06MB read
Requests/sec: 131338.68
Transfer/sec:     14.28MB
hyper / 2 cores / 10000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   551.03ms  734.55ms   4.24s    80.91%
    Req/Sec    61.33k     4.83k   81.16k    71.83%
  Latency Distribution
     50%   18.05ms
     75%    1.04s
     90%    1.73s
     99%    2.61s
  14621333 requests in 2.00m, 1.55GB read
Requests/sec: 121779.69
Transfer/sec:     13.24MB
hyper / 2 cores / 20000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11s     1.47s    6.45s    80.20%
    Req/Sec    62.18k     7.31k  103.93k    73.49%
  Latency Distribution
     50%   16.30ms
     75%    2.12s
     90%    3.50s
     99%    5.06s
  21160531 requests in 3.00m, 2.25GB read
Requests/sec: 117529.36
Transfer/sec:     12.78MB
hyper / 1 core / 100 connections with 1000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 1.002ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.965ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.93ms  470.21us  12.94ms   69.41%
    Req/Sec   523.99    132.76     1.00k    71.96%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.90ms
 75.000%    1.24ms
 90.000%    1.51ms
 99.000%    1.94ms
 99.900%    2.23ms
 99.990%   10.30ms
 99.999%   12.95ms
100.000%   12.95ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.094     0.000000            1         1.00
       0.384     0.100000         4987         1.11
       0.503     0.200000         9975         1.25
       0.624     0.300000        14938         1.43
       0.760     0.400000        19933         1.67
       0.896     0.500000        24907         2.00
       0.967     0.550000        27357         2.22
       1.040     0.600000        29847         2.50
       1.114     0.650000        32335         2.86
       1.180     0.700000        34848         3.33
       1.243     0.750000        37335         4.00
       1.273     0.775000        38559         4.44
       1.305     0.800000        39802         5.00
       1.342     0.825000        41046         5.71
       1.388     0.850000        42301         6.67
       1.449     0.875000        43527         8.00
       1.481     0.887500        44160         8.89
       1.513     0.900000        44767        10.00
       1.545     0.912500        45398        11.43
       1.579     0.925000        46026        13.33
       1.628     0.937500        46644        16.00
       1.656     0.943750        46955        17.78
       1.684     0.950000        47260        20.00
       1.715     0.956250        47570        22.86
       1.748     0.962500        47879        26.67
       1.783     0.968750        48186        32.00
       1.802     0.971875        48344        35.56
       1.820     0.975000        48506        40.00
       1.837     0.978125        48658        45.71
       1.859     0.981250        48808        53.33
       1.888     0.984375        48967        64.00
       1.904     0.985938        49050        71.11
       1.918     0.987500        49122        80.00
       1.934     0.989062        49197        91.43
       1.948     0.990625        49278       106.67
       1.969     0.992188        49355       128.00
       1.980     0.992969        49392       142.22
       1.992     0.993750        49430       160.00
       2.010     0.994531        49470       182.86
       2.024     0.995313        49507       213.33
       2.051     0.996094        49546       256.00
       2.065     0.996484        49566       284.44
       2.079     0.996875        49586       320.00
       2.093     0.997266        49604       365.71
       2.121     0.997656        49624       426.67
       2.143     0.998047        49644       512.00
       2.149     0.998242        49653       568.89
       2.157     0.998437        49665       640.00
       2.165     0.998633        49672       731.43
       2.205     0.998828        49682       853.33
       2.251     0.999023        49692      1024.00
       2.299     0.999121        49697      1137.78
       2.803     0.999219        49702      1280.00
       4.155     0.999316        49706      1462.86
       4.507     0.999414        49711      1706.67
       6.891     0.999512        49716      2048.00
       7.215     0.999561        49719      2275.56
       7.247     0.999609        49721      2560.00
       7.555     0.999658        49723      2925.71
       8.847     0.999707        49726      3413.33
       8.911     0.999756        49728      4096.00
       8.999     0.999780        49730      4551.11
       9.527     0.999805        49731      5120.00
       9.967     0.999829        49732      5851.43
      10.119     0.999854        49733      6826.67
      10.239     0.999878        49734      8192.00
      10.303     0.999890        49735      9102.22
      10.343     0.999902        49736     10240.00
      10.343     0.999915        49736     11702.86
      12.543     0.999927        49737     13653.33
      12.543     0.999939        49737     16384.00
      12.647     0.999945        49738     18204.44
      12.647     0.999951        49738     20480.00
      12.647     0.999957        49738     23405.71
      12.879     0.999963        49739     27306.67
      12.879     0.999969        49739     32768.00
      12.879     0.999973        49739     36408.89
      12.879     0.999976        49739     40960.00
      12.879     0.999979        49739     46811.43
      12.951     0.999982        49740     54613.33
      12.951     1.000000        49740          inf
#[Mean    =        0.931, StdDeviation   =        0.470]
#[Max     =       12.944, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59922 requests in 1.00m, 6.51MB read
Requests/sec:    998.67
Transfer/sec:    111.18KB
hyper / 1 core / 10000 connections with 5000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.182ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.186ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.50ms    3.32ms  36.35ms   93.85%
    Req/Sec     2.67k     1.42k   20.33k    96.31%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.61ms
 75.000%    2.50ms
 90.000%    3.55ms
 99.000%   19.97ms
 99.900%   28.53ms
 99.990%   31.79ms
 99.999%   34.08ms
100.000%   36.38ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.311     0.000000            1         1.00
       0.790     0.100000        42671         1.11
       1.045     0.200000        85154         1.25
       1.257     0.300000       127763         1.43
       1.425     0.400000       170309         1.67
       1.608     0.500000       212748         2.00
       1.728     0.550000       233932         2.22
       1.911     0.600000       255187         2.50
       2.117     0.650000       276577         2.86
       2.301     0.700000       297791         3.33
       2.497     0.750000       319026         4.00
       2.607     0.775000       329625         4.44
       2.737     0.800000       340216         5.00
       2.921     0.825000       350794         5.71
       3.149     0.850000       361477         6.67
       3.345     0.875000       372062         8.00
       3.443     0.887500       377407         8.89
       3.551     0.900000       382676        10.00
       3.695     0.912500       388015        11.43
       4.115     0.925000       393312        13.33
       5.591     0.937500       398622        16.00
       6.915     0.943750       401281        17.78
       8.071     0.950000       403931        20.00
       9.191     0.956250       406595        22.86
      10.383     0.962500       409243        26.67
      11.863     0.968750       411906        32.00
      12.759     0.971875       413233        35.56
      13.791     0.975000       414567        40.00
      14.943     0.978125       415889        45.71
      16.103     0.981250       417220        53.33
      17.359     0.984375       418558        64.00
      17.999     0.985938       419210        71.11
      18.719     0.987500       419886        80.00
      19.471     0.989062       420553        91.43
      20.367     0.990625       421207       106.67
      21.375     0.992188       421871       128.00
      21.967     0.992969       422202       142.22
      22.607     0.993750       422535       160.00
      23.279     0.994531       422866       182.86
      23.999     0.995313       423196       213.33
      24.783     0.996094       423527       256.00
      25.199     0.996484       423694       284.44
      25.583     0.996875       423864       320.00
      25.951     0.997266       424029       365.71
      26.415     0.997656       424199       426.67
      26.911     0.998047       424357       512.00
      27.167     0.998242       424442       568.89
      27.423     0.998437       424527       640.00
      27.759     0.998633       424610       731.43
      28.111     0.998828       424690       853.33
      28.575     0.999023       424772      1024.00
      28.799     0.999121       424814      1137.78
      29.039     0.999219       424856      1280.00
      29.343     0.999316       424897      1462.86
      29.615     0.999414       424938      1706.67
      29.951     0.999512       424982      2048.00
      30.095     0.999561       425001      2275.56
      30.255     0.999609       425021      2560.00
      30.463     0.999658       425042      2925.71
      30.751     0.999707       425064      3413.33
      31.007     0.999756       425089      4096.00
      31.087     0.999780       425097      4551.11
      31.151     0.999805       425105      5120.00
      31.263     0.999829       425118      5851.43
      31.391     0.999854       425126      6826.67
      31.663     0.999878       425137      8192.00
      31.727     0.999890       425141      9102.22
      31.839     0.999902       425146     10240.00
      31.919     0.999915       425151     11702.86
      32.095     0.999927       425156     13653.33
      32.335     0.999939       425162     16384.00
      32.383     0.999945       425164     18204.44
      32.575     0.999951       425167     20480.00
      32.703     0.999957       425170     23405.71
      32.751     0.999963       425173     27306.67
      33.279     0.999969       425175     32768.00
      33.343     0.999973       425177     36408.89
      33.343     0.999976       425177     40960.00
      33.407     0.999979       425178     46811.43
      33.471     0.999982       425180     54613.33
      33.535     0.999985       425181     65536.00
      34.047     0.999986       425182     72817.78
      34.047     0.999988       425182     81920.00
      34.079     0.999989       425183     93622.86
      34.847     0.999991       425184    109226.67
      34.847     0.999992       425184    131072.00
      34.879     0.999993       425185    145635.56
      34.879     0.999994       425185    163840.00
      34.879     0.999995       425185    187245.71
      35.999     0.999995       425186    218453.33
      35.999     0.999996       425186    262144.00
      35.999     0.999997       425186    291271.11
      35.999     0.999997       425186    327680.00
      35.999     0.999997       425186    374491.43
      36.383     0.999998       425187    436906.67
      36.383     1.000000       425187          inf
#[Mean    =        2.498, StdDeviation   =        3.321]
#[Max     =       36.352, Total count    =       425187]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542379 requests in 2.00m, 58.97MB read
Requests/sec:   4519.73
Transfer/sec:    503.17KB
hyper / 1 core / 10000 connections with 10000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 28.082ms, rate sampling interval: 186ms
  Thread calibration: mean lat.: 35.909ms, rate sampling interval: 229ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    90.68ms   65.77ms 327.68ms   68.82%
    Req/Sec     5.24k     2.72k   12.95k    67.71%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   74.18ms
 75.000%  130.94ms
 90.000%  190.98ms
 99.000%  266.75ms
 99.900%  299.77ms
 99.990%  315.90ms
 99.999%  326.91ms
100.000%  327.93ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       1.001     0.000000            1         1.00
      20.447     0.100000        85069         1.11
      31.087     0.200000       170008         1.25
      42.559     0.300000       255199         1.43
      56.607     0.400000       340047         1.67
      74.175     0.500000       425183         2.00
      83.839     0.550000       467581         2.22
      94.271     0.600000       510170         2.50
     105.791     0.650000       552737         2.86
     118.015     0.700000       595017         3.33
     130.943     0.750000       637496         4.00
     138.367     0.775000       659024         4.44
     146.303     0.800000       680196         5.00
     155.263     0.825000       701497         5.71
     165.503     0.850000       722638         6.67
     177.407     0.875000       743784         8.00
     183.935     0.887500       754370         8.89
     190.975     0.900000       765113        10.00
     198.399     0.912500       775625        11.43
     206.335     0.925000       786328        13.33
     215.039     0.937500       796872        16.00
     219.775     0.943750       802210        17.78
     224.639     0.950000       807587        20.00
     229.503     0.956250       812836        22.86
     234.879     0.962500       818166        26.67
     240.511     0.968750       823449        32.00
     243.583     0.971875       826178        35.56
     246.527     0.975000       828736        40.00
     249.855     0.978125       831500        45.71
     253.439     0.981250       834034        53.33
     257.791     0.984375       836764        64.00
     259.967     0.985938       838054        71.11
     262.655     0.987500       839424        80.00
     265.215     0.989062       840795        91.43
     268.031     0.990625       842035       106.67
     271.359     0.992188       843394       128.00
     273.151     0.992969       844018       142.22
     275.199     0.993750       844697       160.00
     277.759     0.994531       845377       182.86
     279.807     0.995313       846009       213.33
     282.623     0.996094       846691       256.00
     283.903     0.996484       847007       284.44
     285.439     0.996875       847316       320.00
     287.487     0.997266       847652       365.71
     289.535     0.997656       847985       426.67
     292.095     0.998047       848320       512.00
     293.375     0.998242       848473       568.89
     294.911     0.998437       848657       640.00
     296.191     0.998633       848804       731.43
     298.239     0.998828       848992       853.33
     300.031     0.999023       849158      1024.00
     300.799     0.999121       849223      1137.78
     302.079     0.999219       849309      1280.00
     303.359     0.999316       849400      1462.86
     304.383     0.999414       849473      1706.67
     305.407     0.999512       849552      2048.00
     306.175     0.999561       849597      2275.56
     307.199     0.999609       849639      2560.00
     307.967     0.999658       849676      2925.71
     308.991     0.999707       849717      3413.33
     310.271     0.999756       849758      4096.00
     311.039     0.999780       849788      4551.11
     311.551     0.999805       849800      5120.00
     312.575     0.999829       849819      5851.43
     313.599     0.999854       849842      6826.67
     314.879     0.999878       849864      8192.00
     315.391     0.999890       849874      9102.22
     316.159     0.999902       849882     10240.00
     316.927     0.999915       849894     11702.86
     317.951     0.999927       849904     13653.33
     319.231     0.999939       849914     16384.00
     319.743     0.999945       849918     18204.44
     320.511     0.999951       849923     20480.00
     321.791     0.999957       849929     23405.71
     322.559     0.999963       849933     27306.67
     323.839     0.999969       849939     32768.00
     324.095     0.999973       849942     36408.89
     324.607     0.999976       849946     40960.00
     324.607     0.999979       849946     46811.43
     325.375     0.999982       849950     54613.33
     326.143     0.999985       849954     65536.00
     326.143     0.999986       849954     72817.78
     326.143     0.999988       849954     81920.00
     326.399     0.999989       849955     93622.86
     326.911     0.999991       849958    109226.67
     326.911     0.999992       849958    131072.00
     327.167     0.999993       849960    145635.56
     327.167     0.999994       849960    163840.00
     327.167     0.999995       849960    187245.71
     327.423     0.999995       849961    218453.33
     327.423     0.999996       849961    262144.00
     327.679     0.999997       849962    291271.11
     327.679     0.999997       849962    327680.00
     327.679     0.999997       849962    374491.43
     327.935     0.999998       849964    436906.67
     327.935     1.000000       849964          inf
#[Mean    =       90.680, StdDeviation   =       65.769]
#[Max     =      327.680, Total count    =       849964]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1078999 requests in 2.00m, 117.31MB read
Requests/sec:   8975.97
Transfer/sec:      0.98MB
hyper / 2 cores / 100 connections with 1000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.934ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.942ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.92ms  436.57us  10.94ms   63.54%
    Req/Sec   524.65    142.16     1.20k    79.92%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.90ms
 75.000%    1.25ms
 90.000%    1.49ms
 99.000%    1.88ms
 99.900%    2.19ms
 99.990%    6.05ms
 99.999%   10.95ms
100.000%   10.95ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.126     0.000000            1         1.00
       0.372     0.100000         4996         1.11
       0.487     0.200000         9950         1.25
       0.619     0.300000        14933         1.43
       0.753     0.400000        19908         1.67
       0.901     0.500000        24870         2.00
       0.978     0.550000        27364         2.22
       1.052     0.600000        29867         2.50
       1.120     0.650000        32364         2.86
       1.185     0.700000        34829         3.33
       1.245     0.750000        37309         4.00
       1.278     0.775000        38583         4.44
       1.311     0.800000        39826         5.00
       1.348     0.825000        41046         5.71
       1.391     0.850000        42292         6.67
       1.438     0.875000        43544         8.00
       1.464     0.887500        44145         8.89
       1.489     0.900000        44774        10.00
       1.514     0.912500        45393        11.43
       1.540     0.925000        46017        13.33
       1.571     0.937500        46646        16.00
       1.590     0.943750        46946        17.78
       1.611     0.950000        47257        20.00
       1.639     0.956250        47574        22.86
       1.670     0.962500        47886        26.67
       1.704     0.968750        48195        32.00
       1.721     0.971875        48345        35.56
       1.743     0.975000        48501        40.00
       1.765     0.978125        48652        45.71
       1.790     0.981250        48810        53.33
       1.820     0.984375        48967        64.00
       1.832     0.985938        49045        71.11
       1.848     0.987500        49120        80.00
       1.869     0.989062        49198        91.43
       1.892     0.990625        49275       106.67
       1.922     0.992188        49355       128.00
       1.936     0.992969        49391       142.22
       1.953     0.993750        49432       160.00
       1.966     0.994531        49468       182.86
       1.990     0.995313        49507       213.33
       2.020     0.996094        49546       256.00
       2.037     0.996484        49566       284.44
       2.059     0.996875        49588       320.00
       2.077     0.997266        49605       365.71
       2.097     0.997656        49626       426.67
       2.117     0.998047        49645       512.00
       2.135     0.998242        49654       568.89
       2.153     0.998437        49663       640.00
       2.167     0.998633        49672       731.43
       2.187     0.998828        49682       853.33
       2.197     0.999023        49692      1024.00
       2.205     0.999121        49697      1137.78
       2.213     0.999219        49702      1280.00
       2.225     0.999316        49707      1462.86
       2.231     0.999414        49711      1706.67
       2.241     0.999512        49716      2048.00
       2.243     0.999561        49719      2275.56
       2.247     0.999609        49721      2560.00
       2.253     0.999658        49723      2925.71
       2.267     0.999707        49726      3413.33
       2.331     0.999756        49728      4096.00
       5.199     0.999780        49730      4551.11
       5.423     0.999805        49731      5120.00
       5.823     0.999829        49732      5851.43
       6.007     0.999854        49733      6826.67
       6.031     0.999878        49734      8192.00
       6.055     0.999890        49735      9102.22
      10.311     0.999902        49736     10240.00
      10.311     0.999915        49736     11702.86
      10.543     0.999927        49737     13653.33
      10.543     0.999939        49737     16384.00
      10.807     0.999945        49738     18204.44
      10.807     0.999951        49738     20480.00
      10.807     0.999957        49738     23405.71
      10.871     0.999963        49739     27306.67
      10.871     0.999969        49739     32768.00
      10.871     0.999973        49739     36408.89
      10.871     0.999976        49739     40960.00
      10.871     0.999979        49739     46811.43
      10.951     0.999982        49740     54613.33
      10.951     1.000000        49740          inf
#[Mean    =        0.921, StdDeviation   =        0.437]
#[Max     =       10.944, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59923 requests in 1.00m, 6.51MB read
Requests/sec:    998.71
Transfer/sec:    111.19KB
hyper / 2 cores / 10000 connections with 5000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.175ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.209ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    3.56ms  35.07ms   94.05%
    Req/Sec     2.68k     1.47k   20.33k    96.12%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.60ms
 75.000%    2.51ms
 90.000%    3.57ms
 99.000%   21.82ms
 99.900%   29.39ms
 99.990%   32.48ms
 99.999%   34.14ms
100.000%   35.10ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.313     0.000000            2         1.00
       0.797     0.100000        42535         1.11
       1.060     0.200000        85048         1.25
       1.273     0.300000       127752         1.43
       1.431     0.400000       170176         1.67
       1.597     0.500000       212546         2.00
       1.711     0.550000       233886         2.22
       1.891     0.600000       255125         2.50
       2.119     0.650000       276318         2.86
       2.315     0.700000       297765         3.33
       2.505     0.750000       318979         4.00
       2.613     0.775000       329518         4.44
       2.743     0.800000       340104         5.00
       2.931     0.825000       350693         5.71
       3.163     0.850000       361406         6.67
       3.359     0.875000       371946         8.00
       3.455     0.887500       377291         8.89
       3.565     0.900000       382656        10.00
       3.707     0.912500       387919        11.43
       4.135     0.925000       393206        13.33
       5.519     0.937500       398516        16.00
       6.795     0.943750       401174        17.78
       8.043     0.950000       403831        20.00
       9.399     0.956250       406488        22.86
      10.895     0.962500       409151        26.67
      12.855     0.968750       411798        32.00
      14.031     0.971875       413132        35.56
      15.327     0.975000       414461        40.00
      16.623     0.978125       415789        45.71
      17.871     0.981250       417121        53.33
      19.151     0.984375       418448        64.00
      19.855     0.985938       419119        71.11
      20.575     0.987500       419772        80.00
      21.327     0.989062       420433        91.43
      22.159     0.990625       421103       106.67
      23.103     0.992188       421768       128.00
      23.599     0.992969       422095       142.22
      24.111     0.993750       422428       160.00
      24.671     0.994531       422758       182.86
      25.247     0.995313       423090       213.33
      25.871     0.996094       423426       256.00
      26.223     0.996484       423587       284.44
      26.575     0.996875       423753       320.00
      27.007     0.997266       423921       365.71
      27.439     0.997656       424088       426.67
      27.887     0.998047       424255       512.00
      28.127     0.998242       424334       568.89
      28.447     0.998437       424418       640.00
      28.783     0.998633       424503       731.43
      29.103     0.998828       424583       853.33
      29.455     0.999023       424667      1024.00
      29.647     0.999121       424708      1137.78
      29.839     0.999219       424749      1280.00
      30.111     0.999316       424797      1462.86
      30.367     0.999414       424834      1706.67
      30.687     0.999512       424875      2048.00
      30.895     0.999561       424895      2275.56
      31.087     0.999609       424915      2560.00
      31.247     0.999658       424936      2925.71
      31.423     0.999707       424958      3413.33
      31.663     0.999756       424978      4096.00
      31.823     0.999780       424988      4551.11
      31.967     0.999805       424998      5120.00
      32.111     0.999829       425009      5851.43
      32.239     0.999854       425019      6826.67
      32.335     0.999878       425030      8192.00
      32.415     0.999890       425035      9102.22
      32.511     0.999902       425041     10240.00
      32.655     0.999915       425045     11702.86
      32.751     0.999927       425050     13653.33
      32.863     0.999939       425057     16384.00
      32.927     0.999945       425058     18204.44
      33.119     0.999951       425062     20480.00
      33.183     0.999957       425063     23405.71
      33.407     0.999963       425066     27306.67
      33.631     0.999969       425069     32768.00
      33.663     0.999973       425070     36408.89
      33.695     0.999976       425072     40960.00
      33.695     0.999979       425072     46811.43
      33.951     0.999982       425074     54613.33
      33.983     0.999985       425076     65536.00
      33.983     0.999986       425076     72817.78
      33.983     0.999988       425076     81920.00
      34.143     0.999989       425077     93622.86
      34.463     0.999991       425078    109226.67
      34.463     0.999992       425078    131072.00
      34.591     0.999993       425079    145635.56
      34.591     0.999994       425079    163840.00
      34.591     0.999995       425079    187245.71
      34.815     0.999995       425080    218453.33
      34.815     0.999996       425080    262144.00
      34.815     0.999997       425080    291271.11
      34.815     0.999997       425080    327680.00
      34.815     0.999997       425080    374491.43
      35.103     0.999998       425081    436906.67
      35.103     1.000000       425081          inf
#[Mean    =        2.557, StdDeviation   =        3.559]
#[Max     =       35.072, Total count    =       425081]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542382 requests in 2.00m, 58.97MB read
Requests/sec:   4519.69
Transfer/sec:    503.17KB
hyper / 2 cores / 10000 connections with 10000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 33.193ms, rate sampling interval: 214ms
  Thread calibration: mean lat.: 33.962ms, rate sampling interval: 216ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    87.87ms   66.49ms 336.13ms   69.77%
    Req/Sec     5.23k     2.68k   11.85k    63.17%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   69.31ms
 75.000%  127.04ms
 90.000%  190.21ms
 99.000%  268.54ms
 99.900%  298.49ms
 99.990%  318.72ms
 99.999%  330.24ms
100.000%  336.38ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.804     0.000000            1         1.00
      18.303     0.100000        85029         1.11
      28.863     0.200000       170058         1.25
      39.967     0.300000       255106         1.43
      53.151     0.400000       340000         1.67
      69.311     0.500000       425130         2.00
      78.655     0.550000       467641         2.22
      89.087     0.600000       510125         2.50
     100.607     0.650000       552644         2.86
     113.023     0.700000       595039         3.33
     127.039     0.750000       637510         4.00
     135.039     0.775000       658970         4.44
     143.743     0.800000       680180         5.00
     153.471     0.825000       701248         5.71
     164.351     0.850000       722568         6.67
     176.383     0.875000       743813         8.00
     183.039     0.887500       754465         8.89
     190.207     0.900000       765005        10.00
     198.143     0.912500       775763        11.43
     206.463     0.925000       786302        13.33
     215.807     0.937500       796959        16.00
     220.799     0.943750       802273        17.78
     225.791     0.950000       807570        20.00
     230.911     0.956250       812803        22.86
     236.415     0.962500       818178        26.67
     242.175     0.968750       823520        32.00
     245.247     0.971875       826134        35.56
     248.575     0.975000       828776        40.00
     252.159     0.978125       831457        45.71
     255.743     0.981250       834079        53.33
     259.839     0.984375       836755        64.00
     262.015     0.985938       838063        71.11
     264.447     0.987500       839444        80.00
     267.007     0.989062       840743        91.43
     269.567     0.990625       842028       106.67
     272.895     0.992188       843437       128.00
     274.431     0.992969       844055       142.22
     276.223     0.993750       844699       160.00
     278.271     0.994531       845392       182.86
     280.319     0.995313       846051       213.33
     282.623     0.996094       846693       256.00
     283.903     0.996484       847049       284.44
     285.439     0.996875       847376       320.00
     286.719     0.997266       847667       365.71
     288.511     0.997656       848023       426.67
     290.559     0.998047       848344       512.00
     291.839     0.998242       848504       568.89
     293.375     0.998437       848663       640.00
     295.167     0.998633       848838       731.43
     296.959     0.998828       849003       853.33
     298.751     0.999023       849153      1024.00
     300.031     0.999121       849235      1137.78
     301.567     0.999219       849328      1280.00
     302.847     0.999316       849406      1462.86
     304.639     0.999414       849485      1706.67
     306.687     0.999512       849566      2048.00
     307.967     0.999561       849616      2275.56
     308.991     0.999609       849653      2560.00
     310.015     0.999658       849693      2925.71
     311.295     0.999707       849738      3413.33
     312.319     0.999756       849777      4096.00
     313.343     0.999780       849801      4551.11
     314.111     0.999805       849818      5120.00
     315.135     0.999829       849834      5851.43
     316.415     0.999854       849857      6826.67
     317.951     0.999878       849882      8192.00
     318.207     0.999890       849891      9102.22
     318.719     0.999902       849896     10240.00
     320.255     0.999915       849909     11702.86
     321.279     0.999927       849918     13653.33
     322.047     0.999939       849929     16384.00
     322.559     0.999945       849933     18204.44
     323.839     0.999951       849938     20480.00
     324.863     0.999957       849945     23405.71
     325.631     0.999963       849948     27306.67
     326.399     0.999969       849955     32768.00
     326.655     0.999973       849956     36408.89
     327.679     0.999976       849959     40960.00
     328.191     0.999979       849962     46811.43
     328.447     0.999982       849964     54613.33
     328.703     0.999985       849967     65536.00
     328.959     0.999986       849968     72817.78
     329.215     0.999988       849969     81920.00
     330.239     0.999989       849971     93622.86
     333.055     0.999991       849972    109226.67
     333.311     0.999992       849973    131072.00
     333.823     0.999993       849974    145635.56
     333.823     0.999994       849974    163840.00
     334.335     0.999995       849977    187245.71
     334.335     0.999995       849977    218453.33
     334.335     0.999996       849977    262144.00
     334.335     0.999997       849977    291271.11
     334.335     0.999997       849977    327680.00
     334.335     0.999997       849977    374491.43
     336.127     0.999998       849978    436906.67
     336.127     0.999998       849978    524288.00
     336.127     0.999998       849978    582542.22
     336.127     0.999998       849978    655360.00
     336.127     0.999999       849978    748982.86
     336.383     0.999999       849979    873813.33
     336.383     1.000000       849979          inf
#[Mean    =       87.865, StdDeviation   =       66.489]
#[Max     =      336.128, Total count    =       849979]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079471 requests in 2.00m, 117.36MB read
Requests/sec:   8976.21
Transfer/sec:      0.98MB

seastar-httpd

version: 20191017.1

seastar-httpd / 1 core / 100 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.04ms  222.05us   4.14ms   92.52%
    Req/Sec    48.08k   551.42    50.07k    72.17%
  Latency Distribution
     50%    0.98ms
     75%    1.01ms
     90%    1.08ms
     99%    1.99ms
  5743209 requests in 1.00m, 766.80MB read
Requests/sec:  95675.42
Transfer/sec:     12.77MB
seastar-httpd / 1 core / 10000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   119.98ms    2.23ms 137.67ms   97.81%
    Req/Sec    41.83k   554.00    44.49k    89.26%
  Latency Distribution
     50%  120.07ms
     75%  120.40ms
     90%  120.89ms
     99%  121.79ms
  9965396 requests in 2.00m, 1.30GB read
Requests/sec:  83029.63
Transfer/sec:     11.09MB
seastar-httpd / 1 core / 20000 connections

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   249.68ms    6.89ms 290.77ms   99.50%
    Req/Sec    40.19k    10.01k   75.48k    54.23%
  Latency Distribution
     50%  250.29ms
     75%  250.97ms
     90%  251.51ms
     99%  252.59ms
  13568055 requests in 3.00m, 1.77GB read
Requests/sec:  75335.79
Transfer/sec:     10.06MB
seastar-httpd / 2 cores / 100 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 100 -t 2 -d 60s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   525.05us  256.50us   7.48ms   99.11%
    Req/Sec    92.75k     1.40k   95.16k    90.92%
  Latency Distribution
     50%  580.00us
     75%  680.00us
     90%  702.00us
     99%  763.00us
  11075986 requests in 1.00m, 1.44GB read
Requests/sec: 184507.45
Transfer/sec:     24.63MB
seastar-httpd / 2 cores / 10000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 10000 -t 2 -d 120s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    63.65ms    3.29ms 114.72ms   76.84%
    Req/Sec    70.45k     1.71k   80.49k    78.84%
  Latency Distribution
     50%   63.18ms
     75%   64.72ms
     90%   69.28ms
     99%   71.79ms
  16806400 requests in 2.00m, 2.19GB read
Requests/sec: 139933.35
Transfer/sec:     18.68MB
seastar-httpd / 2 cores / 20000 connections

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk -c 20000 -t 2 -d 180s --latency --timeout 100s http://127.0.0.1:8000

output:

Running 3m test @ http://127.0.0.1:8000
  2 threads and 20000 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   138.20ms   10.73ms 215.85ms   71.91%
    Req/Sec    65.93k     3.06k   98.04k    73.51%
  Latency Distribution
     50%  140.91ms
     75%  145.77ms
     90%  149.25ms
     99%  154.39ms
  22388453 requests in 3.00m, 2.92GB read
Requests/sec: 124311.56
Transfer/sec:     16.60MB
seastar-httpd / 1 core / 100 connections with 1000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.954ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.964ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.95ms  427.66us   2.30ms   64.18%
    Req/Sec   524.39    133.51     1.00k    71.39%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.94ms
 75.000%    1.26ms
 90.000%    1.53ms
 99.000%    1.96ms
 99.900%    2.17ms
 99.990%    2.25ms
 99.999%    2.30ms
100.000%    2.30ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.082     0.000000            1         1.00
       0.379     0.100000         4980         1.11
       0.532     0.200000         9959         1.25
       0.676     0.300000        14958         1.43
       0.813     0.400000        19906         1.67
       0.942     0.500000        24888         2.00
       1.006     0.550000        27373         2.22
       1.068     0.600000        29859         2.50
       1.128     0.650000        32353         2.86
       1.192     0.700000        34830         3.33
       1.258     0.750000        37316         4.00
       1.291     0.775000        38553         4.44
       1.325     0.800000        39828         5.00
       1.363     0.825000        41054         5.71
       1.410     0.850000        42279         6.67
       1.468     0.875000        43531         8.00
       1.498     0.887500        44155         8.89
       1.527     0.900000        44778        10.00
       1.557     0.912500        45396        11.43
       1.589     0.925000        46021        13.33
       1.631     0.937500        46645        16.00
       1.657     0.943750        46946        17.78
       1.686     0.950000        47260        20.00
       1.717     0.956250        47567        22.86
       1.749     0.962500        47875        26.67
       1.788     0.968750        48189        32.00
       1.807     0.971875        48343        35.56
       1.830     0.975000        48498        40.00
       1.854     0.978125        48661        45.71
       1.877     0.981250        48809        53.33
       1.902     0.984375        48965        64.00
       1.915     0.985938        49047        71.11
       1.933     0.987500        49124        80.00
       1.949     0.989062        49196        91.43
       1.972     0.990625        49280       106.67
       1.990     0.992188        49353       128.00
       2.004     0.992969        49394       142.22
       2.018     0.993750        49430       160.00
       2.031     0.994531        49468       182.86
       2.053     0.995313        49511       213.33
       2.071     0.996094        49552       256.00
       2.083     0.996484        49570       284.44
       2.095     0.996875        49587       320.00
       2.105     0.997266        49606       365.71
       2.119     0.997656        49626       426.67
       2.139     0.998047        49648       512.00
       2.143     0.998242        49653       568.89
       2.153     0.998437        49664       640.00
       2.159     0.998633        49673       731.43
       2.165     0.998828        49684       853.33
       2.171     0.999023        49694      1024.00
       2.173     0.999121        49697      1137.78
       2.181     0.999219        49702      1280.00
       2.189     0.999316        49706      1462.86
       2.203     0.999414        49711      1706.67
       2.209     0.999512        49716      2048.00
       2.213     0.999561        49719      2275.56
       2.215     0.999609        49722      2560.00
       2.219     0.999658        49723      2925.71
       2.231     0.999707        49726      3413.33
       2.235     0.999756        49728      4096.00
       2.239     0.999780        49730      4551.11
       2.241     0.999805        49732      5120.00
       2.241     0.999829        49732      5851.43
       2.245     0.999854        49733      6826.67
       2.247     0.999878        49734      8192.00
       2.249     0.999890        49735      9102.22
       2.257     0.999902        49736     10240.00
       2.257     0.999915        49736     11702.86
       2.265     0.999927        49737     13653.33
       2.265     0.999939        49737     16384.00
       2.273     0.999945        49738     18204.44
       2.273     0.999951        49738     20480.00
       2.273     0.999957        49738     23405.71
       2.289     0.999963        49739     27306.67
       2.289     0.999969        49739     32768.00
       2.289     0.999973        49739     36408.89
       2.289     0.999976        49739     40960.00
       2.289     0.999979        49739     46811.43
       2.303     0.999982        49740     54613.33
       2.303     1.000000        49740          inf
#[Mean    =        0.951, StdDeviation   =        0.428]
#[Max     =        2.302, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59924 requests in 1.00m, 8.00MB read
Requests/sec:    998.70
Transfer/sec:    136.54KB
seastar-httpd / 1 core / 10000 connections with 5000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.272ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.246ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    3.56ms  39.07ms   93.88%
    Req/Sec     2.68k     1.48k   22.00k    96.14%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.60ms
 75.000%    2.51ms
 90.000%    3.56ms
 99.000%   21.39ms
 99.900%   30.75ms
 99.990%   34.85ms
 99.999%   36.93ms
100.000%   39.10ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.312     0.000000            2         1.00
       0.789     0.100000        42547         1.11
       1.041     0.200000        85195         1.25
       1.255     0.300000       127774         1.43
       1.423     0.400000       170229         1.67
       1.599     0.500000       212741         2.00
       1.716     0.550000       233981         2.22
       1.902     0.600000       255131         2.50
       2.117     0.650000       276392         2.86
       2.309     0.700000       297818         3.33
       2.505     0.750000       319099         4.00
       2.613     0.775000       329614         4.44
       2.747     0.800000       340238         5.00
       2.937     0.825000       350801         5.71
       3.157     0.850000       361457         6.67
       3.351     0.875000       372156         8.00
       3.447     0.887500       377362         8.89
       3.559     0.900000       382670        10.00
       3.719     0.912500       387987        11.43
       4.175     0.925000       393323        13.33
       5.831     0.937500       398612        16.00
       7.203     0.943750       401274        17.78
       8.447     0.950000       403938        20.00
       9.727     0.956250       406587        22.86
      11.095     0.962500       409245        26.67
      12.751     0.968750       411910        32.00
      13.751     0.971875       413237        35.56
      14.839     0.975000       414568        40.00
      15.959     0.978125       415894        45.71
      17.151     0.981250       417232        53.33
      18.383     0.984375       418544        64.00
      19.119     0.985938       419210        71.11
      19.903     0.987500       419873        80.00
      20.815     0.989062       420543        91.43
      21.807     0.990625       421201       106.67
      22.959     0.992188       421868       128.00
      23.503     0.992969       422198       142.22
      24.159     0.993750       422529       160.00
      24.863     0.994531       422862       182.86
      25.567     0.995313       423194       213.33
      26.319     0.996094       423529       256.00
      26.735     0.996484       423695       284.44
      27.231     0.996875       423858       320.00
      27.759     0.997266       424025       365.71
      28.255     0.997656       424194       426.67
      28.815     0.998047       424355       512.00
      29.183     0.998242       424440       568.89
      29.551     0.998437       424526       640.00
      29.951     0.998633       424606       731.43
      30.303     0.998828       424687       853.33
      30.831     0.999023       424770      1024.00
      31.071     0.999121       424814      1137.78
      31.359     0.999219       424854      1280.00
      31.663     0.999316       424896      1462.86
      31.919     0.999414       424938      1706.67
      32.303     0.999512       424978      2048.00
      32.607     0.999561       424999      2275.56
      32.863     0.999609       425019      2560.00
      33.119     0.999658       425040      2925.71
      33.311     0.999707       425062      3413.33
      33.599     0.999756       425082      4096.00
      33.759     0.999780       425092      4551.11
      34.047     0.999805       425102      5120.00
      34.303     0.999829       425116      5851.43
      34.463     0.999854       425123      6826.67
      34.655     0.999878       425135      8192.00
      34.751     0.999890       425140      9102.22
      34.911     0.999902       425145     10240.00
      34.943     0.999915       425149     11702.86
      35.295     0.999927       425155     13653.33
      35.455     0.999939       425160     16384.00
      35.519     0.999945       425163     18204.44
      35.551     0.999951       425165     20480.00
      35.583     0.999957       425167     23405.71
      35.679     0.999963       425170     27306.67
      35.967     0.999969       425173     32768.00
      36.479     0.999973       425174     36408.89
      36.575     0.999976       425176     40960.00
      36.575     0.999979       425176     46811.43
      36.767     0.999982       425178     54613.33
      36.831     0.999985       425179     65536.00
      36.895     0.999986       425180     72817.78
      36.895     0.999988       425180     81920.00
      36.927     0.999989       425182     93622.86
      36.927     0.999991       425182    109226.67
      36.927     0.999992       425182    131072.00
      36.959     0.999993       425183    145635.56
      36.959     0.999994       425183    163840.00
      36.959     0.999995       425183    187245.71
      37.375     0.999995       425184    218453.33
      37.375     0.999996       425184    262144.00
      37.375     0.999997       425184    291271.11
      37.375     0.999997       425184    327680.00
      37.375     0.999997       425184    374491.43
      39.103     0.999998       425185    436906.67
      39.103     1.000000       425185          inf
#[Mean    =        2.555, StdDeviation   =        3.559]
#[Max     =       39.072, Total count    =       425185]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542374 requests in 2.00m, 72.41MB read
Requests/sec:   4519.66
Transfer/sec:    617.92KB
seastar-httpd / 1 core / 10000 connections with 10000 rps

run server with: taskset -c 0 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 32.390ms, rate sampling interval: 212ms
  Thread calibration: mean lat.: 31.008ms, rate sampling interval: 194ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    83.93ms   64.44ms 327.94ms   70.82%
    Req/Sec     5.24k     2.71k   11.99k    67.01%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   65.66ms
 75.000%  121.21ms
 90.000%  182.40ms
 99.000%  264.45ms
 99.900%  292.86ms
 99.990%  309.76ms
 99.999%  318.72ms
100.000%  328.19ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.829     0.000000            1         1.00
      16.943     0.100000        85054         1.11
      27.455     0.200000       170151         1.25
      38.175     0.300000       255064         1.43
      50.495     0.400000       340196         1.67
      65.663     0.500000       425122         2.00
      74.687     0.550000       467865         2.22
      84.415     0.600000       510372         2.50
      95.295     0.650000       552868         2.86
     107.391     0.700000       595192         3.33
     121.215     0.750000       637854         4.00
     128.767     0.775000       658924         4.44
     136.959     0.800000       680305         5.00
     146.175     0.825000       701661         5.71
     156.671     0.850000       722828         6.67
     168.447     0.875000       743933         8.00
     175.231     0.887500       754712         8.89
     182.399     0.900000       765314        10.00
     190.079     0.912500       775851        11.43
     198.271     0.925000       786551        13.33
     207.359     0.937500       797124        16.00
     212.479     0.943750       802399        17.78
     217.855     0.950000       807710        20.00
     223.743     0.956250       813052        22.86
     229.631     0.962500       818400        26.67
     235.775     0.968750       823672        32.00
     239.103     0.971875       826312        35.56
     242.687     0.975000       828987        40.00
     246.527     0.978125       831666        45.71
     250.495     0.981250       834278        53.33
     254.847     0.984375       836947        64.00
     257.279     0.985938       838258        71.11
     259.839     0.987500       839591        80.00
     262.655     0.989062       840941        91.43
     265.727     0.990625       842316       106.67
     269.055     0.992188       843638       128.00
     270.591     0.992969       844249       142.22
     272.383     0.993750       844907       160.00
     274.431     0.994531       845617       182.86
     276.479     0.995313       846245       213.33
     279.295     0.996094       846938       256.00
     280.575     0.996484       847217       284.44
     282.367     0.996875       847581       320.00
     283.903     0.997266       847885       365.71
     285.695     0.997656       848252       426.67
     287.487     0.998047       848559       512.00
     288.511     0.998242       848735       568.89
     289.535     0.998437       848907       640.00
     290.559     0.998633       849080       731.43
     291.583     0.998828       849214       853.33
     292.863     0.999023       849380      1024.00
     293.887     0.999121       849479      1137.78
     294.655     0.999219       849555      1280.00
     295.935     0.999316       849636      1462.86
     297.215     0.999414       849711      1706.67
     298.751     0.999512       849797      2048.00
     299.519     0.999561       849843      2275.56
     300.031     0.999609       849872      2560.00
     301.311     0.999658       849928      2925.71
     302.079     0.999707       849960      3413.33
     303.359     0.999756       850005      4096.00
     304.127     0.999780       850021      4551.11
     304.895     0.999805       850043      5120.00
     305.407     0.999829       850059      5851.43
     306.943     0.999854       850083      6826.67
     308.223     0.999878       850103      8192.00
     308.991     0.999890       850113      9102.22
     310.015     0.999902       850122     10240.00
     311.039     0.999915       850132     11702.86
     312.063     0.999927       850143     13653.33
     312.831     0.999939       850153     16384.00
     313.599     0.999945       850161     18204.44
     313.855     0.999951       850166     20480.00
     314.367     0.999957       850169     23405.71
     315.135     0.999963       850173     27306.67
     315.903     0.999969       850179     32768.00
     316.671     0.999973       850184     36408.89
     316.671     0.999976       850184     40960.00
     317.183     0.999979       850187     46811.43
     317.439     0.999982       850191     54613.33
     317.695     0.999985       850192     65536.00
     318.207     0.999986       850193     72817.78
     318.463     0.999988       850194     81920.00
     318.719     0.999989       850196     93622.86
     319.231     0.999991       850197    109226.67
     319.743     0.999992       850198    131072.00
     327.167     0.999993       850199    145635.56
     327.167     0.999994       850199    163840.00
     327.423     0.999995       850200    187245.71
     327.679     0.999995       850202    218453.33
     327.679     0.999996       850202    262144.00
     327.679     0.999997       850202    291271.11
     327.679     0.999997       850202    327680.00
     327.679     0.999997       850202    374491.43
     327.935     0.999998       850203    436906.67
     327.935     0.999998       850203    524288.00
     327.935     0.999998       850203    582542.22
     327.935     0.999998       850203    655360.00
     327.935     0.999999       850203    748982.86
     328.191     0.999999       850204    873813.33
     328.191     1.000000       850204          inf
#[Mean    =       83.930, StdDeviation   =       64.440]
#[Max     =      327.936, Total count    =       850204]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1079337 requests in 2.00m, 144.11MB read
Requests/sec:   8975.55
Transfer/sec:      1.20MB
seastar-httpd / 2 cores / 100 connections with 1000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 100 -t 2 -d 60s -R 1000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 1m test @ http://127.0.0.1:8000
  2 threads and 100 connections
  Thread calibration: mean lat.: 0.959ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 0.964ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     0.95ms  542.43us  12.23ms   77.75%
    Req/Sec   525.23    164.68     1.22k    72.85%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    0.91ms
 75.000%    1.26ms
 90.000%    1.51ms
 99.000%    1.96ms
 99.900%    7.96ms
 99.990%   11.84ms
 99.999%   12.24ms
100.000%   12.24ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.104     0.000000            1         1.00
       0.383     0.100000         4977         1.11
       0.507     0.200000         9973         1.25
       0.635     0.300000        14927         1.43
       0.767     0.400000        19908         1.67
       0.908     0.500000        24904         2.00
       0.982     0.550000        27378         2.22
       1.061     0.600000        29880         2.50
       1.134     0.650000        32361         2.86
       1.198     0.700000        34827         3.33
       1.258     0.750000        37324         4.00
       1.288     0.775000        38577         4.44
       1.317     0.800000        39793         5.00
       1.350     0.825000        41042         5.71
       1.391     0.850000        42303         6.67
       1.447     0.875000        43532         8.00
       1.479     0.887500        44158         8.89
       1.508     0.900000        44773        10.00
       1.537     0.912500        45396        11.43
       1.566     0.925000        46023        13.33
       1.598     0.937500        46644        16.00
       1.616     0.943750        46943        17.78
       1.641     0.950000        47262        20.00
       1.669     0.956250        47568        22.86
       1.702     0.962500        47876        26.67
       1.739     0.968750        48192        32.00
       1.761     0.971875        48345        35.56
       1.783     0.975000        48498        40.00
       1.810     0.978125        48654        45.71
       1.836     0.981250        48809        53.33
       1.871     0.984375        48966        64.00
       1.890     0.985938        49042        71.11
       1.912     0.987500        49121        80.00
       1.937     0.989062        49200        91.43
       1.974     0.990625        49276       106.67
       2.010     0.992188        49353       128.00
       2.027     0.992969        49391       142.22
       2.051     0.993750        49434       160.00
       2.081     0.994531        49468       182.86
       2.115     0.995313        49507       213.33
       2.153     0.996094        49547       256.00
       2.171     0.996484        49567       284.44
       2.209     0.996875        49585       320.00
       2.275     0.997266        49604       365.71
       3.183     0.997656        49624       426.67
       4.483     0.998047        49643       512.00
       5.347     0.998242        49653       568.89
       5.911     0.998437        49663       640.00
       6.731     0.998633        49672       731.43
       7.359     0.998828        49682       853.33
       8.059     0.999023        49692      1024.00
       8.399     0.999121        49697      1137.78
       8.671     0.999219        49702      1280.00
       9.039     0.999316        49706      1462.86
       9.279     0.999414        49711      1706.67
       9.983     0.999512        49716      2048.00
      10.095     0.999561        49719      2275.56
      10.375     0.999609        49721      2560.00
      10.463     0.999658        49723      2925.71
      11.215     0.999707        49726      3413.33
      11.239     0.999756        49728      4096.00
      11.559     0.999780        49730      4551.11
      11.687     0.999805        49731      5120.00
      11.727     0.999829        49732      5851.43
      11.791     0.999854        49733      6826.67
      11.823     0.999878        49734      8192.00
      11.839     0.999890        49735      9102.22
      11.895     0.999902        49736     10240.00
      11.895     0.999915        49736     11702.86
      11.951     0.999927        49737     13653.33
      11.951     0.999939        49737     16384.00
      11.975     0.999945        49738     18204.44
      11.975     0.999951        49738     20480.00
      11.975     0.999957        49738     23405.71
      12.023     0.999963        49739     27306.67
      12.023     0.999969        49739     32768.00
      12.023     0.999973        49739     36408.89
      12.023     0.999976        49739     40960.00
      12.023     0.999979        49739     46811.43
      12.239     0.999982        49740     54613.33
      12.239     1.000000        49740          inf
#[Mean    =        0.946, StdDeviation   =        0.542]
#[Max     =       12.232, Total count    =        49740]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  59924 requests in 1.00m, 8.00MB read
Requests/sec:    998.70
Transfer/sec:    136.54KB
seastar-httpd / 2 cores / 10000 connections with 5000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 5000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 2.239ms, rate sampling interval: 10ms
  Thread calibration: mean lat.: 2.225ms, rate sampling interval: 10ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    3.48ms  39.94ms   94.12%
    Req/Sec     2.67k     1.40k   21.44k    96.45%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%    1.61ms
 75.000%    2.50ms
 90.000%    3.59ms
 99.000%   21.07ms
 99.900%   30.51ms
 99.990%   35.71ms
 99.999%   38.05ms
100.000%   39.97ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.312     0.000000            1         1.00
       0.822     0.100000        42681         1.11
       1.070     0.200000        85062         1.25
       1.273     0.300000       127609         1.43
       1.438     0.400000       170150         1.67
       1.614     0.500000       212791         2.00
       1.731     0.550000       233967         2.22
       1.905     0.600000       255186         2.50
       2.111     0.650000       276380         2.86
       2.305     0.700000       297685         3.33
       2.501     0.750000       319064         4.00
       2.609     0.775000       329580         4.44
       2.739     0.800000       340177         5.00
       2.927     0.825000       350842         5.71
       3.163     0.850000       361479         6.67
       3.371     0.875000       372085         8.00
       3.473     0.887500       377369         8.89
       3.589     0.900000       382687        10.00
       3.765     0.912500       388014        11.43
       4.179     0.925000       393318        13.33
       5.335     0.937500       398617        16.00
       6.575     0.943750       401264        17.78
       7.887     0.950000       403935        20.00
       9.231     0.956250       406584        22.86
      10.783     0.962500       409250        26.67
      12.551     0.968750       411905        32.00
      13.519     0.971875       413221        35.56
      14.591     0.975000       414559        40.00
      15.767     0.978125       415883        45.71
      16.975     0.981250       417207        53.33
      18.319     0.984375       418544        64.00
      19.039     0.985938       419208        71.11
      19.775     0.987500       419871        80.00
      20.559     0.989062       420540        91.43
      21.455     0.990625       421205       106.67
      22.447     0.992188       421870       128.00
      22.959     0.992969       422200       142.22
      23.503     0.993750       422523       160.00
      24.095     0.994531       422859       182.86
      24.847     0.995313       423189       213.33
      25.567     0.996094       423523       256.00
      25.983     0.996484       423695       284.44
      26.447     0.996875       423855       320.00
      26.975     0.997266       424020       365.71
      27.583     0.997656       424183       426.67
      28.287     0.998047       424351       512.00
      28.655     0.998242       424433       568.89
      29.071     0.998437       424515       640.00
      29.487     0.998633       424602       731.43
      29.983     0.998828       424681       853.33
      30.575     0.999023       424766      1024.00
      30.879     0.999121       424806      1137.78
      31.279     0.999219       424848      1280.00
      31.615     0.999316       424889      1462.86
      31.999     0.999414       424930      1706.67
      32.479     0.999512       424972      2048.00
      32.799     0.999561       424993      2275.56
      33.087     0.999609       425014      2560.00
      33.439     0.999658       425036      2925.71
      33.855     0.999707       425056      3413.33
      34.303     0.999756       425077      4096.00
      34.431     0.999780       425086      4551.11
      34.623     0.999805       425097      5120.00
      34.911     0.999829       425107      5851.43
      35.199     0.999854       425117      6826.67
      35.487     0.999878       425128      8192.00
      35.615     0.999890       425133      9102.22
      35.743     0.999902       425138     10240.00
      35.935     0.999915       425145     11702.86
      36.159     0.999927       425148     13653.33
      36.319     0.999939       425154     16384.00
      36.511     0.999945       425157     18204.44
      36.575     0.999951       425159     20480.00
      36.735     0.999957       425163     23405.71
      36.863     0.999963       425164     27306.67
      37.087     0.999969       425167     32768.00
      37.119     0.999973       425170     36408.89
      37.119     0.999976       425170     40960.00
      37.119     0.999979       425170     46811.43
      37.535     0.999982       425172     54613.33
      37.631     0.999985       425173     65536.00
      37.983     0.999986       425174     72817.78
      37.983     0.999988       425174     81920.00
      38.047     0.999989       425175     93622.86
      38.207     0.999991       425176    109226.67
      38.207     0.999992       425176    131072.00
      38.527     0.999993       425177    145635.56
      38.527     0.999994       425177    163840.00
      38.527     0.999995       425177    187245.71
      39.935     0.999995       425178    218453.33
      39.935     0.999996       425178    262144.00
      39.935     0.999997       425178    291271.11
      39.935     0.999997       425178    327680.00
      39.935     0.999997       425178    374491.43
      39.967     0.999998       425179    436906.67
      39.967     1.000000       425179          inf
#[Mean    =        2.542, StdDeviation   =        3.482]
#[Max     =       39.936, Total count    =       425179]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  542376 requests in 2.00m, 72.42MB read
Requests/sec:   4519.68
Transfer/sec:    617.92KB
seastar-httpd / 2 cores / 10000 connections with 10000 rps

run server with: taskset -c 0,1 sh run.sh

run client with: taskset -c 2,3 wrk2 -c 10000 -t 2 -d 120s -R 10000 --latency --timeout 100s http://127.0.0.1:8000

output:

Running 2m test @ http://127.0.0.1:8000
  2 threads and 10000 connections
  Thread calibration: mean lat.: 31.049ms, rate sampling interval: 203ms
  Thread calibration: mean lat.: 29.923ms, rate sampling interval: 190ms
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    86.90ms   64.40ms 314.88ms   69.96%
    Req/Sec     5.30k     2.74k   12.50k    66.33%
  Latency Distribution (HdrHistogram - Recorded Latency)
 50.000%   69.12ms
 75.000%  124.86ms
 90.000%  186.62ms
 99.000%  260.48ms
 99.900%  288.00ms
 99.990%  304.89ms
 99.999%  311.30ms
100.000%  315.14ms

  Detailed Percentile spectrum:
       Value   Percentile   TotalCount 1/(1-Percentile)

       0.768     0.000000            1         1.00
      19.311     0.100000        85029         1.11
      29.903     0.200000       170082         1.25
      40.767     0.300000       255122         1.43
      53.567     0.400000       340104         1.67
      69.119     0.500000       425089         2.00
      78.015     0.550000       467650         2.22
      87.871     0.600000       510205         2.50
      98.879     0.650000       552718         2.86
     111.103     0.700000       595129         3.33
     124.863     0.750000       637542         4.00
     132.607     0.775000       658851         4.44
     141.055     0.800000       680268         5.00
     150.399     0.825000       701441         5.71
     160.639     0.850000       722523         6.67
     172.671     0.875000       743871         8.00
     179.455     0.887500       754447         8.89
     186.623     0.900000       765125        10.00
     194.303     0.912500       775789        11.43
     202.495     0.925000       786354        13.33
     211.455     0.937500       796902        16.00
     216.191     0.943750       802179        17.78
     221.183     0.950000       807599        20.00
     226.175     0.956250       812907        22.86
     231.167     0.962500       818221        26.67
     236.543     0.968750       823429        32.00
     239.615     0.971875       826159        35.56
     242.815     0.975000       828818        40.00
     246.015     0.978125       831434        45.71
     249.343     0.981250       834083        53.33
     252.927     0.984375       836757        64.00
     254.847     0.985938       838063        71.11
     256.895     0.987500       839411        80.00
     259.071     0.989062       840711        91.43
     261.503     0.990625       842024       106.67
     264.191     0.992188       843383       128.00
     265.471     0.992969       844004       142.22
     267.263     0.993750       844729       160.00
     268.799     0.994531       845330       182.86
     270.847     0.995313       846050       213.33
     273.151     0.996094       846676       256.00
     274.431     0.996484       847024       284.44
     275.711     0.996875       847354       320.00
     277.247     0.997266       847674       365.71
     279.039     0.997656       848037       426.67
     280.831     0.998047       848358       512.00
     281.855     0.998242       848502       568.89
     283.135     0.998437       848665       640.00
     284.671     0.998633       848832       731.43
     286.207     0.998828       848998       853.33
     288.255     0.999023       849165      1024.00
     289.279     0.999121       849236      1137.78
     290.303     0.999219       849315      1280.00
     291.583     0.999316       849396      1462.86
     292.863     0.999414       849484      1706.67
     294.655     0.999512       849569      2048.00
     295.167     0.999561       849605      2275.56
     296.191     0.999609       849656      2560.00
     296.959     0.999658       849687      2925.71
     298.495     0.999707       849737      3413.33
     299.775     0.999756       849773      4096.00
     300.543     0.999780       849796      4551.11
     301.311     0.999805       849817      5120.00
     302.079     0.999829       849839      5851.43
     302.847     0.999854       849854      6826.67
     304.127     0.999878       849878      8192.00
     304.639     0.999890       849888      9102.22
     305.151     0.999902       849901     10240.00
     305.663     0.999915       849911     11702.86
     306.175     0.999927       849915     13653.33
     307.199     0.999939       849926     16384.00
     307.455     0.999945       849933     18204.44
     307.711     0.999951       849937     20480.00
     308.223     0.999957       849944     23405.71
     308.479     0.999963       849948     27306.67
     309.503     0.999969       849953     32768.00
     309.759     0.999973       849960     36408.89
     309.759     0.999976       849960     40960.00
     309.759     0.999979       849960     46811.43
     310.015     0.999982       849964     54613.33
     310.271     0.999985       849966     65536.00
     310.271     0.999986       849966     72817.78
     310.783     0.999988       849968     81920.00
     310.783     0.999989       849968     93622.86
     311.295     0.999991       849970    109226.67
     311.551     0.999992       849973    131072.00
     311.551     0.999993       849973    145635.56
     311.551     0.999994       849973    163840.00
     311.551     0.999995       849973    187245.71
     311.807     0.999995       849974    218453.33
     311.807     0.999996       849974    262144.00
     315.135     0.999997       849977    291271.11
     315.135     1.000000       849977          inf
#[Mean    =       86.902, StdDeviation   =       64.405]
#[Max     =      314.880, Total count    =       849977]
#[Buckets =           27, SubBuckets     =         2048]
----------------------------------------------------------
  1078919 requests in 2.00m, 144.05MB read
Requests/sec:   8975.60
Transfer/sec:      1.20MB

Charts

Chart for throughput

original data:

[
  {
    "target": "actix-web",
    "name": "1 core / 100 connections",
    "result": 80516.92
  },
  {
    "target": "actix-web",
    "name": "1 core / 10000 connections",
    "result": 71222.78
  },
  {
    "target": "actix-web",
    "name": "1 core / 20000 connections",
    "result": 58860.81
  },
  {
    "target": "actix-web",
    "name": "2 cores / 100 connections",
    "result": 149625.67
  },
  {
    "target": "actix-web",
    "name": "2 cores / 10000 connections",
    "result": 141524.73
  },
  {
    "target": "actix-web",
    "name": "2 cores / 20000 connections",
    "result": 61898.53
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 100 connections",
    "result": 39288.56
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 10000 connections",
    "result": 29116.29
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 20000 connections",
    "result": 27372.5
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 100 connections",
    "result": 72735.1
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 10000 connections",
    "result": 61305.56
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 20000 connections",
    "result": 56666.43
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 100 connections",
    "result": 84691.95
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 10000 connections",
    "result": 76556.09
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 20000 connections",
    "result": 72151.32
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 100 connections",
    "result": 170555.82
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 10000 connections",
    "result": 136694.89
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 20000 connections",
    "result": 123234.96
  },
  {
    "target": "hyper",
    "name": "1 core / 100 connections",
    "result": 64745.9
  },
  {
    "target": "hyper",
    "name": "1 core / 10000 connections",
    "result": 59014.57
  },
  {
    "target": "hyper",
    "name": "1 core / 20000 connections",
    "result": 59307.57
  },
  {
    "target": "hyper",
    "name": "2 cores / 100 connections",
    "result": 131338.68
  },
  {
    "target": "hyper",
    "name": "2 cores / 10000 connections",
    "result": 121779.69
  },
  {
    "target": "hyper",
    "name": "2 cores / 20000 connections",
    "result": 117529.36
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 100 connections",
    "result": 95675.42
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 10000 connections",
    "result": 83029.63
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 20000 connections",
    "result": 75335.79
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 100 connections",
    "result": 184507.45
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 10000 connections",
    "result": 139933.35
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 20000 connections",
    "result": 124311.56
  }
]

Chart for latency

original data:

[
  {
    "target": "actix-web",
    "name": "1 core / 100 connections with 1000 rps",
    "result": 1.92
  },
  {
    "target": "actix-web",
    "name": "1 core / 10000 connections with 5000 rps",
    "result": 22.06
  },
  {
    "target": "actix-web",
    "name": "1 core / 10000 connections with 10000 rps",
    "result": 264.7
  },
  {
    "target": "actix-web",
    "name": "2 cores / 100 connections with 1000 rps",
    "result": 1.93
  },
  {
    "target": "actix-web",
    "name": "2 cores / 10000 connections with 5000 rps",
    "result": 21.68
  },
  {
    "target": "actix-web",
    "name": "2 cores / 10000 connections with 10000 rps",
    "result": 262.4
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 100 connections with 1000 rps",
    "result": 2.06
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 10000 connections with 5000 rps",
    "result": 49.76
  },
  {
    "target": "aspnetcore",
    "name": "1 core / 10000 connections with 10000 rps",
    "result": 277.76
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 100 connections with 1000 rps",
    "result": 2.0
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 10000 connections with 5000 rps",
    "result": 23.17
  },
  {
    "target": "aspnetcore",
    "name": "2 cores / 10000 connections with 10000 rps",
    "result": 262.4
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 100 connections with 1000 rps",
    "result": 1.91
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 10000 connections with 5000 rps",
    "result": 20.72
  },
  {
    "target": "cpv-framework",
    "name": "1 core / 10000 connections with 10000 rps",
    "result": 265.73
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 100 connections with 1000 rps",
    "result": 2.02
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 10000 connections with 5000 rps",
    "result": 21.61
  },
  {
    "target": "cpv-framework",
    "name": "2 cores / 10000 connections with 10000 rps",
    "result": 267.01
  },
  {
    "target": "hyper",
    "name": "1 core / 100 connections with 1000 rps",
    "result": 1.94
  },
  {
    "target": "hyper",
    "name": "1 core / 10000 connections with 5000 rps",
    "result": 19.97
  },
  {
    "target": "hyper",
    "name": "1 core / 10000 connections with 10000 rps",
    "result": 266.75
  },
  {
    "target": "hyper",
    "name": "2 cores / 100 connections with 1000 rps",
    "result": 1.88
  },
  {
    "target": "hyper",
    "name": "2 cores / 10000 connections with 5000 rps",
    "result": 21.82
  },
  {
    "target": "hyper",
    "name": "2 cores / 10000 connections with 10000 rps",
    "result": 268.54
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 100 connections with 1000 rps",
    "result": 1.96
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 10000 connections with 5000 rps",
    "result": 21.39
  },
  {
    "target": "seastar-httpd",
    "name": "1 core / 10000 connections with 10000 rps",
    "result": 264.45
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 100 connections with 1000 rps",
    "result": 1.96
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 10000 connections with 5000 rps",
    "result": 21.07
  },
  {
    "target": "seastar-httpd",
    "name": "2 cores / 10000 connections with 10000 rps",
    "result": 260.48
  }
]

Clone this wiki locally