Optional cncf conformance integration tests

[maci3jka]

This pr adds to the standard suite of integration test availability to trigger CNCF conformance tests when pr contains label

[github-actions]

Benchmark Result

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │      Before       │                 After                  │
                                        │      sec/op       │      sec/op       vs base              │
Compaction/sqlite-4                        19.93µ ±      9%   19.14µ ±      6%       ~ (p=0.259 n=7)
Compaction/dqlite-4                        41.14µ ±      9%   40.33µ ±      9%       ~ (p=0.318 n=7)
Create/sqlite/1-workers-4                  488.0µ ±      1%   489.0µ ±      8%       ~ (p=1.000 n=7)
Create/sqlite/4-workers-4                  466.9µ ±      4%   461.1µ ±     14%       ~ (p=0.383 n=7)
Create/sqlite/16-workers-4                 435.5µ ±     10%   417.3µ ±     13%       ~ (p=0.456 n=7)
Create/sqlite/64-workers-4                 415.3µ ±     29%   420.5µ ±     19%       ~ (p=1.000 n=7)
Create/sqlite/128-workers-4                683.4µ ±     50%   516.1µ ±     82%       ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                  1.027m ±      3%   1.048m ±      6%       ~ (p=0.383 n=7)
Create/dqlite/4-workers-4                  922.1µ ±     17%   938.7µ ±      3%       ~ (p=0.535 n=7)
Create/dqlite/16-workers-4                 953.2µ ±     10%   941.4µ ±      3%       ~ (p=0.710 n=7)
Create/dqlite/64-workers-4                 930.3µ ±      2%   936.5µ ±      3%       ~ (p=0.383 n=7)
Create/dqlite/128-workers-4                956.0µ ±      5%   936.2µ ±      4%       ~ (p=0.318 n=7)
Delete/sqlite/1-workers-4                  471.0µ ±      2%   477.4µ ±      2%  +1.36% (p=0.017 n=7)
Delete/sqlite/4-workers-4                  448.1µ ±      3%   450.6µ ±      8%       ~ (p=0.456 n=7)
Delete/sqlite/16-workers-4                 416.7µ ±      5%   419.3µ ±      5%       ~ (p=0.805 n=7)
Delete/sqlite/64-workers-4                 422.0µ ±    112%   446.6µ ±    108%       ~ (p=0.710 n=7)
Delete/sqlite/128-workers-4                576.1µ ±     25%   529.1µ ±     55%       ~ (p=0.620 n=7)
Delete/dqlite/1-workers-4                  1.083m ±      2%   1.046m ±      2%  -3.45% (p=0.001 n=7)
Delete/dqlite/4-workers-4                  936.6µ ±      4%   933.7µ ±      4%       ~ (p=0.620 n=7)
Delete/dqlite/16-workers-4                 948.7µ ±      8%   923.1µ ±      5%       ~ (p=0.620 n=7)
Delete/dqlite/64-workers-4                 935.1µ ±      2%   921.0µ ±      4%  -1.50% (p=0.026 n=7)
Delete/dqlite/128-workers-4                938.0µ ±      5%   930.2µ ±      4%       ~ (p=0.209 n=7)
Get/sqlite-4                               237.5µ ±      1%   238.2µ ±      1%       ~ (p=1.000 n=7)
Get/dqlite-4                               359.6µ ±      1%   359.8µ ±      0%       ~ (p=0.535 n=7)
List/sqlite-tiny/all-4                     3.881µ ±      9%   3.981µ ±      7%       ~ (p=0.902 n=7)
List/sqlite-tiny/pagination-4              8.358µ ±      5%   8.175µ ±      4%       ~ (p=0.053 n=7)
List/sqlite-fits-in-page/all-4             7.782µ ±      5%   7.625µ ±      5%       ~ (p=0.073 n=7)
List/sqlite-fits-in-page/pagination-4      22.08µ ±      4%   21.55µ ±      3%       ~ (p=0.535 n=7)
List/sqlite-overflows-page/all-4           16.66µ ±      2%   16.70µ ±      8%       ~ (p=0.333 n=7)
List/sqlite-overflows-page/pagination-4    41.62µ ±      5%   42.67µ ±      5%       ~ (p=0.259 n=7)
List/dqlite-tiny/all-4                     2.891µ ±      9%   2.877µ ±      4%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4              6.121µ ±      2%   6.047µ ±      1%  -1.21% (p=0.007 n=7)
List/dqlite-fits-in-page/all-4             6.569µ ±      8%   6.734µ ±      6%       ~ (p=0.710 n=7)
List/dqlite-fits-in-page/pagination-4      17.09µ ±      2%   17.09µ ±      2%       ~ (p=1.000 n=7)
List/dqlite-overflows-page/all-4           21.58µ ±      4%   20.97µ ±      4%       ~ (p=0.318 n=7)
List/dqlite-overflows-page/pagination-4    43.16µ ±      3%   44.14µ ±      3%       ~ (p=0.318 n=7)
Update/sqlite/1-workers-4                  497.5µ ±      3%   506.1µ ±      4%  +1.73% (p=0.007 n=7)
Update/sqlite/4-workers-4                  495.6µ ±     23%   477.6µ ±      4%       ~ (p=0.097 n=7)
Update/sqlite/16-workers-4                 456.1µ ±     17%   446.5µ ±      5%       ~ (p=0.805 n=7)
Update/sqlite/64-workers-4                 685.5µ ± 225610%   494.3µ ±    127%       ~ (p=0.318 n=7)
Update/sqlite/128-workers-4                622.3µ ± 171355%   690.0µ ± 153120%       ~ (p=0.535 n=7)
Update/dqlite/1-workers-4                  1.098m ±      3%   1.054m ±      9%       ~ (p=0.097 n=7)
Update/dqlite/4-workers-4                  976.1µ ±   2313%   954.2µ ±     10%       ~ (p=0.620 n=7)
Update/dqlite/16-workers-4                 968.7µ ±      8%   979.4µ ±      3%       ~ (p=0.805 n=7)
Update/dqlite/64-workers-4                1001.9µ ±     20%   970.0µ ±      4%  -3.19% (p=0.038 n=7)
Update/dqlite/128-workers-4               1050.6µ ±      8%   986.1µ ±     10%       ~ (p=0.128 n=7)
geomean                                    201.8µ             198.0µ            -1.90%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                After                 │
                                        │ page-reads/op  │ page-reads/op   vs base              │
Compaction/sqlite-4                        12.27 ±    1%    12.29 ±    2%       ~ (p=0.824 n=7)
Compaction/dqlite-4                        12.08 ±    2%    12.16 ±    1%       ~ (p=0.682 n=7)
Create/sqlite/1-workers-4                  13.89 ±    0%    13.90 ±    0%       ~ (p=0.300 n=7)
Create/sqlite/4-workers-4                  12.57 ±    3%    12.57 ±    4%       ~ (p=0.924 n=7)
Create/sqlite/16-workers-4                 10.61 ±    3%    10.54 ±    5%       ~ (p=0.594 n=7)
Create/sqlite/64-workers-4                 8.684 ±   13%    9.060 ±    5%       ~ (p=1.000 n=7)
Create/sqlite/128-workers-4                8.252 ±    5%    8.178 ±    3%       ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                  13.36 ±    3%    13.35 ±    2%       ~ (p=0.832 n=7)
Create/dqlite/4-workers-4                  10.92 ±    3%    10.95 ±    1%       ~ (p=0.592 n=7)
Create/dqlite/16-workers-4                 10.89 ±    2%    11.07 ±    1%  +1.65% (p=0.035 n=7)
Create/dqlite/64-workers-4                 10.95 ±    1%    11.00 ±    2%       ~ (p=0.972 n=7)
Create/dqlite/128-workers-4                10.97 ±    2%    11.07 ±    1%       ~ (p=0.155 n=7)
Delete/sqlite/1-workers-4                  16.22 ±    0%    16.23 ±    0%       ~ (p=0.192 n=7)
Delete/sqlite/4-workers-4                  14.55 ±    2%    14.49 ±    4%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                 11.98 ±    7%    11.96 ±    3%       ~ (p=0.136 n=7)
Delete/sqlite/64-workers-4                10.170 ±    8%    9.981 ±    8%       ~ (p=1.000 n=7)
Delete/sqlite/128-workers-4                9.403 ±    3%    9.232 ±    5%       ~ (p=0.318 n=7)
Delete/dqlite/1-workers-4                  15.76 ±    1%    15.77 ±    1%       ~ (p=0.921 n=7)
Delete/dqlite/4-workers-4                  13.42 ±    1%    13.42 ±    1%       ~ (p=0.736 n=7)
Delete/dqlite/16-workers-4                 13.38 ±    2%    13.42 ±    1%       ~ (p=0.067 n=7)
Delete/dqlite/64-workers-4                 13.27 ±    2%    13.34 ±    4%       ~ (p=0.318 n=7)
Delete/dqlite/128-workers-4                13.23 ±    3%    13.20 ±    4%       ~ (p=0.927 n=7)
Get/sqlite-4                               14.95 ±    0%    14.96 ±    0%       ~ (p=0.217 n=7)
Get/dqlite-4                               11.95 ±    0%    11.96 ±    0%       ~ (p=0.559 n=7)
List/sqlite-tiny/all-4                    191.1m ±    1%   191.8m ±    1%       ~ (p=0.598 n=7)
List/sqlite-tiny/pagination-4              1.131 ±    3%    1.131 ±    3%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4            163.8m ±    1%   164.6m ±    2%       ~ (p=0.780 n=7)
List/sqlite-fits-in-page/pagination-4     963.1m ±    0%   963.2m ±    0%       ~ (p=0.596 n=7)
List/sqlite-overflows-page/all-4          177.1m ±    0%   177.1m ±    0%       ~ (p=0.559 n=7)
List/sqlite-overflows-page/pagination-4    1.654 ±   15%    1.523 ±   24%       ~ (p=0.318 n=7)
List/dqlite-tiny/all-4                    191.4m ±    1%   191.4m ±    0%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4              1.126 ±    0%    1.126 ±    3%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4            164.1m ±   59%   164.2m ±    0%       ~ (p=0.484 n=7)
List/dqlite-fits-in-page/pagination-4     955.0m ±    3%   954.7m ±    3%       ~ (p=0.053 n=7)
List/dqlite-overflows-page/all-4          183.9m ±    0%   184.0m ±    0%       ~ (p=0.098 n=7)
List/dqlite-overflows-page/pagination-4    1.070 ±    3%    1.071 ±    3%       ~ (p=0.470 n=7)
Update/sqlite/1-workers-4                  15.83 ±    0%    15.81 ±    0%       ~ (p=0.076 n=7)
Update/sqlite/4-workers-4                  14.46 ±    3%    14.45 ±    4%       ~ (p=0.436 n=7)
Update/sqlite/16-workers-4                 12.58 ±    8%    12.59 ±    4%       ~ (p=0.644 n=7)
Update/sqlite/64-workers-4                 11.06 ± 4602%    11.17 ±   10%       ~ (p=0.805 n=7)
Update/sqlite/128-workers-4                10.33 ± 5660%    10.50 ± 4957%       ~ (p=0.710 n=7)
Update/dqlite/1-workers-4                  15.46 ±    1%    15.48 ±    1%       ~ (p=0.829 n=7)
Update/dqlite/4-workers-4                  12.68 ±   31%    12.76 ±    1%       ~ (p=0.080 n=7)
Update/dqlite/16-workers-4                 12.87 ±    1%    12.78 ±    1%       ~ (p=0.101 n=7)
Update/dqlite/64-workers-4                 13.04 ±    4%    12.91 ±    2%       ~ (p=0.646 n=7)
Update/dqlite/128-workers-4                13.49 ±    5%    13.31 ±    5%       ~ (p=0.781 n=7)
geomean                                    5.201            5.197          -0.08%

                                        │      Before       │                  After                  │
                                        │  page-writes/op   │ page-writes/op   vs base                │
Compaction/sqlite-4                       190.8m ±     1%     191.1m ±     0%       ~ (p=0.516 n=7)
Compaction/dqlite-4                       187.4m ±     1%     187.6m ±     1%       ~ (p=0.876 n=7)
Create/sqlite/1-workers-4                  4.360 ±     0%      4.360 ±     0%       ~ (p=0.771 n=7)
Create/sqlite/4-workers-4                  4.333 ±     1%      4.330 ±     1%       ~ (p=0.805 n=7)
Create/sqlite/16-workers-4                 4.313 ±     1%      4.283 ±     1%       ~ (p=0.165 n=7)
Create/sqlite/64-workers-4                 4.261 ±     1%      4.289 ±     1%       ~ (p=0.318 n=7)
Create/sqlite/128-workers-4                4.216 ±     2%      4.223 ±     2%       ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                  4.251 ±     1%      4.245 ±     2%       ~ (p=0.691 n=7)
Create/dqlite/4-workers-4                  4.300 ±     0%      4.303 ±     0%       ~ (p=0.152 n=7)
Create/dqlite/16-workers-4                 4.298 ±     3%      4.304 ±     0%       ~ (p=0.203 n=7)
Create/dqlite/64-workers-4                 4.300 ±     1%      4.301 ±     1%       ~ (p=1.000 n=7)
Create/dqlite/128-workers-4                4.291 ±     1%      4.302 ±     0%  +0.26% (p=0.026 n=7)
Delete/sqlite/1-workers-4                  4.384 ±     0%      4.391 ±     0%       ~ (p=0.328 n=7)
Delete/sqlite/4-workers-4                  4.390 ±     1%      4.394 ±     1%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                 4.368 ±     1%      4.358 ±     0%       ~ (p=0.245 n=7)
Delete/sqlite/64-workers-4                 4.349 ±     1%      4.353 ±     0%       ~ (p=0.399 n=7)
Delete/sqlite/128-workers-4                4.346 ±     1%      4.345 ±     1%       ~ (p=0.734 n=7)
Delete/dqlite/1-workers-4                  4.359 ±     1%      4.372 ±     0%       ~ (p=0.402 n=7)
Delete/dqlite/4-workers-4                  4.377 ±     0%      4.388 ±     1%       ~ (p=0.364 n=7)
Delete/dqlite/16-workers-4                 4.369 ±     0%      4.381 ±     1%       ~ (p=0.368 n=7)
Delete/dqlite/64-workers-4                 4.356 ±     1%      4.355 ±     1%       ~ (p=0.832 n=7)
Delete/dqlite/128-workers-4                4.359 ±     1%      4.349 ±     1%       ~ (p=0.535 n=7)
Get/sqlite-4                               0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±     0%      0.000 ±     0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                  4.245 ±     0%      4.241 ±     0%  -0.09% (p=0.041 n=7)
Update/sqlite/4-workers-4                  4.328 ±     0%      4.313 ±     1%       ~ (p=0.221 n=7)
Update/sqlite/16-workers-4                 4.340 ±     1%      4.314 ±     1%       ~ (p=0.158 n=7)
Update/sqlite/64-workers-4                 4.403 ±  5714%      4.374 ±     2%       ~ (p=0.259 n=7)
Update/sqlite/128-workers-4                4.420 ± 11552%      4.438 ± 11504%       ~ (p=0.934 n=7)
Update/dqlite/1-workers-4                  4.203 ±     1%      4.209 ±     0%  +0.14% (p=0.032 n=7)
Update/dqlite/4-workers-4                  4.209 ±     4%      4.205 ±     0%       ~ (p=0.736 n=7)
Update/dqlite/16-workers-4                 4.245 ±     1%      4.227 ±     1%       ~ (p=0.318 n=7)
Update/dqlite/64-workers-4                 4.316 ±     2%      4.294 ±     2%       ~ (p=0.402 n=7)
Update/dqlite/128-workers-4                4.520 ±     5%      4.501 ±     4%       ~ (p=1.000 n=7)
geomean                                                   ²                    -0.03%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │      Before      │                  After                  │
                                        │  sec-reading/op  │  sec-reading/op   vs base               │
Compaction/sqlite-4                        27.30µ ±    40%    26.60µ ±    38%        ~ (p=0.620 n=7)
Compaction/dqlite-4                        30.90µ ±    61%    30.10µ ±    76%        ~ (p=0.456 n=7)
Create/sqlite/1-workers-4                  22.00µ ±    30%    23.80µ ±    18%        ~ (p=0.176 n=7)
Create/sqlite/4-workers-4                  21.50µ ±    30%    22.90µ ±    17%        ~ (p=0.620 n=7)
Create/sqlite/16-workers-4                 22.80µ ±    31%    25.10µ ±    14%        ~ (p=0.620 n=7)
Create/sqlite/64-workers-4                 22.90µ ±    22%    25.40µ ±    31%        ~ (p=0.473 n=7)
Create/sqlite/128-workers-4                28.60µ ±    24%    21.30µ ±    40%  -25.52% (p=0.038 n=7)
Create/dqlite/1-workers-4                  9.600µ ±    57%    8.000µ ±    64%        ~ (p=0.383 n=7)
Create/dqlite/4-workers-4                  9.900µ ±    64%   11.200µ ±    30%        ~ (p=0.780 n=7)
Create/dqlite/16-workers-4                 11.10µ ±    37%    10.30µ ±    41%        ~ (p=0.709 n=7)
Create/dqlite/64-workers-4                 11.60µ ±    19%    10.50µ ±    15%        ~ (p=0.618 n=7)
Create/dqlite/128-workers-4                9.900µ ±    70%    8.900µ ±    90%        ~ (p=0.596 n=7)
Delete/sqlite/1-workers-4                  33.30µ ±    13%    32.90µ ±    18%        ~ (p=0.805 n=7)
Delete/sqlite/4-workers-4                  35.80µ ±     8%    36.80µ ±    27%        ~ (p=0.976 n=7)
Delete/sqlite/16-workers-4                 35.80µ ±    11%    38.30µ ±    16%        ~ (p=0.259 n=7)
Delete/sqlite/64-workers-4                 38.80µ ±    20%    37.40µ ±    12%        ~ (p=0.456 n=7)
Delete/sqlite/128-workers-4                41.80µ ±    27%    37.40µ ±    20%        ~ (p=0.456 n=7)
Delete/dqlite/1-workers-4                  12.20µ ±    67%    13.30µ ±    23%        ~ (p=0.151 n=7)
Delete/dqlite/4-workers-4                  13.70µ ±    21%    17.40µ ±    26%  +27.01% (p=0.026 n=7)
Delete/dqlite/16-workers-4                 13.40µ ±    56%    14.60µ ±    14%        ~ (p=0.318 n=7)
Delete/dqlite/64-workers-4                 14.50µ ±    41%    12.60µ ±    37%        ~ (p=0.735 n=7)
Delete/dqlite/128-workers-4                14.20µ ±    80%    16.20µ ±    46%        ~ (p=0.555 n=7)
Get/sqlite-4                               67.30µ ±     7%    65.40µ ±     8%        ~ (p=0.301 n=7)
Get/dqlite-4                               33.80µ ±    18%    33.20µ ±    11%        ~ (p=0.640 n=7)
List/sqlite-tiny/all-4                     6.300µ ±    24%    7.000µ ±    19%        ~ (p=0.925 n=7)
List/sqlite-tiny/pagination-4              14.80µ ±     5%    14.40µ ±     4%   -2.70% (p=0.045 n=7)
List/sqlite-fits-in-page/all-4             13.30µ ±    17%    13.90µ ±    27%        ~ (p=0.435 n=7)
List/sqlite-fits-in-page/pagination-4      35.90µ ±    11%    34.90µ ±     9%        ~ (p=0.431 n=7)
List/sqlite-overflows-page/all-4           13.00µ ±     3%    13.00µ ±    11%        ~ (p=0.417 n=7)
List/sqlite-overflows-page/pagination-4    49.20µ ±    13%    45.80µ ±    21%        ~ (p=0.477 n=7)
List/dqlite-tiny/all-4                     4.000µ ±    22%    4.000µ ±    22%        ~ (p=0.868 n=7)
List/dqlite-tiny/pagination-4              9.900µ ±    11%    9.300µ ±     9%        ~ (p=0.132 n=7)
List/dqlite-fits-in-page/all-4            10.600µ ±    17%    9.200µ ±    20%        ~ (p=0.922 n=7)
List/dqlite-fits-in-page/pagination-4      27.60µ ±    10%    25.00µ ±    10%   -9.42% (p=0.012 n=7)
List/dqlite-overflows-page/all-4           34.90µ ±     5%    34.40µ ±     5%        ~ (p=0.301 n=7)
List/dqlite-overflows-page/pagination-4    64.80µ ±    10%    65.70µ ±    11%        ~ (p=0.804 n=7)
Update/sqlite/1-workers-4                  26.70µ ±    35%    23.10µ ±    30%        ~ (p=0.620 n=7)
Update/sqlite/4-workers-4                  25.00µ ±    15%    24.00µ ±    20%        ~ (p=0.364 n=7)
Update/sqlite/16-workers-4                 25.80µ ±    21%    22.80µ ±    22%        ~ (p=0.209 n=7)
Update/sqlite/64-workers-4                 24.80µ ±      ?    25.00µ ±    31%        ~ (p=0.972 n=7)
Update/sqlite/128-workers-4                28.80µ ± 10317%    27.50µ ± 18082%        ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                  10.40µ ±    20%    10.50µ ±    70%        ~ (p=0.976 n=7)
Update/dqlite/4-workers-4                 11.100µ ±    21%    9.700µ ±    38%        ~ (p=0.079 n=7)
Update/dqlite/16-workers-4                 11.50µ ±    35%    10.90µ ±    55%        ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                 13.50µ ±    27%    12.30µ ±    33%        ~ (p=0.620 n=7)
Update/dqlite/128-workers-4                13.90µ ±    40%    10.40µ ±    51%        ~ (p=0.122 n=7)
geomean                                    19.24µ             18.73µ            -2.67%

                                        │      Before       │                  After                   │
                                        │  sec-writing/op   │ sec-writing/op   vs base                 │
Compaction/sqlite-4                       9.200µ ±    10%     8.900µ ±    27%        ~ (p=1.000 n=7)
Compaction/dqlite-4                       6.600µ ±     8%     6.800µ ±    12%        ~ (p=0.693 n=7)
Create/sqlite/1-workers-4                 250.6µ ±     3%     254.4µ ±    13%        ~ (p=0.535 n=7)
Create/sqlite/4-workers-4                 1.438m ±    11%     1.375m ±    26%        ~ (p=0.097 n=7)
Create/sqlite/16-workers-4                5.405m ±     8%     5.218m ±     9%        ~ (p=0.073 n=7)
Create/sqlite/64-workers-4                17.76m ±    11%     16.76m ±     6%        ~ (p=0.073 n=7)
Create/sqlite/128-workers-4               34.73m ±    23%     33.14m ±    14%        ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                 44.40µ ±    20%     41.50µ ±    26%        ~ (p=0.301 n=7)
Create/dqlite/4-workers-4                 45.40µ ±    27%     47.70µ ±    23%        ~ (p=0.318 n=7)
Create/dqlite/16-workers-4                44.80µ ±    21%     47.20µ ±    21%        ~ (p=0.710 n=7)
Create/dqlite/64-workers-4                49.20µ ±    29%     49.80µ ±    14%        ~ (p=0.902 n=7)
Create/dqlite/128-workers-4               48.80µ ±    32%     44.90µ ±    17%        ~ (p=0.535 n=7)
Delete/sqlite/1-workers-4                 238.9µ ±     5%     249.1µ ±     5%        ~ (p=0.097 n=7)
Delete/sqlite/4-workers-4                 1.379m ±     9%     1.390m ±    12%        ~ (p=0.620 n=7)
Delete/sqlite/16-workers-4                5.026m ±    10%     5.202m ±     7%        ~ (p=0.383 n=7)
Delete/sqlite/64-workers-4                17.69m ±    17%     17.26m ±    17%        ~ (p=0.535 n=7)
Delete/sqlite/128-workers-4               34.71m ±    12%     34.09m ±    13%        ~ (p=0.209 n=7)
Delete/dqlite/1-workers-4                 36.30µ ±    18%     37.40µ ±    15%        ~ (p=0.780 n=7)
Delete/dqlite/4-workers-4                 49.10µ ±    15%     44.20µ ±    16%        ~ (p=0.097 n=7)
Delete/dqlite/16-workers-4                45.50µ ±    28%     43.00µ ±    39%        ~ (p=0.805 n=7)
Delete/dqlite/64-workers-4                44.30µ ±    15%     45.80µ ±    15%        ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               43.30µ ±    11%     42.00µ ±    26%        ~ (p=0.871 n=7)
Get/sqlite-4                               0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±     0%      0.000 ±     0%        ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                 257.7µ ±    10%     269.3µ ±     9%        ~ (p=0.053 n=7)
Update/sqlite/4-workers-4                 1.554m ±    20%     1.408m ±    17%        ~ (p=0.073 n=7)
Update/sqlite/16-workers-4                5.626m ±    10%     5.326m ±    11%        ~ (p=0.318 n=7)
Update/sqlite/64-workers-4                20.33m ± 94981%     18.08m ±    28%        ~ (p=0.053 n=7)
Update/sqlite/128-workers-4               36.12m ± 60642%     37.88m ± 31209%        ~ (p=0.535 n=7)
Update/dqlite/1-workers-4                 38.00µ ±    34%     31.40µ ±    51%  -17.37% (p=0.017 n=7)
Update/dqlite/4-workers-4                 41.00µ ±    13%     46.30µ ±    25%        ~ (p=0.318 n=7)
Update/dqlite/16-workers-4                40.70µ ±    11%     43.40µ ±    21%        ~ (p=0.128 n=7)
Update/dqlite/64-workers-4                47.80µ ±    14%     41.20µ ±    23%        ~ (p=0.097 n=7)
Update/dqlite/128-workers-4               46.40µ ±    27%     45.20µ ±    13%        ~ (p=0.558 n=7)
geomean                                                   ²                     -1.42%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │      Before       │                 After                  │
                                        │       B/op        │       B/op        vs base              │
Compaction/sqlite-4                        2.378Ki ±    49%   2.312Ki ±    47%       ~ (p=0.383 n=7)
Compaction/dqlite-4                        5.309Ki ±    82%   5.201Ki ±    94%       ~ (p=0.456 n=7)
Create/sqlite/1-workers-4                  20.49Ki ±     0%   20.49Ki ±     0%       ~ (p=0.880 n=7)
Create/sqlite/4-workers-4                  20.49Ki ±     0%   20.50Ki ±     0%       ~ (p=0.334 n=7)
Create/sqlite/16-workers-4                 20.46Ki ±     0%   20.46Ki ±     0%       ~ (p=0.469 n=7)
Create/sqlite/64-workers-4                 20.48Ki ±     0%   20.48Ki ±     0%       ~ (p=0.591 n=7)
Create/sqlite/128-workers-4                20.64Ki ±     1%   20.58Ki ±     1%       ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                  19.74Ki ±     0%   19.75Ki ±     0%       ~ (p=0.456 n=7)
Create/dqlite/4-workers-4                  19.72Ki ±     0%   19.72Ki ±     0%       ~ (p=0.646 n=7)
Create/dqlite/16-workers-4                 19.72Ki ±     0%   19.72Ki ±     0%       ~ (p=0.478 n=7)
Create/dqlite/64-workers-4                 19.73Ki ±     0%   19.72Ki ±     4%       ~ (p=0.640 n=7)
Create/dqlite/128-workers-4                19.75Ki ±    11%   19.75Ki ±     0%       ~ (p=0.405 n=7)
Delete/sqlite/1-workers-4                  22.92Ki ±     0%   22.92Ki ±     0%       ~ (p=0.436 n=7)
Delete/sqlite/4-workers-4                  22.91Ki ±     0%   22.92Ki ±     0%       ~ (p=0.881 n=7)
Delete/sqlite/16-workers-4                 22.88Ki ±     0%   22.90Ki ±     0%       ~ (p=0.133 n=7)
Delete/sqlite/64-workers-4                 22.89Ki ±     0%   22.91Ki ±     0%       ~ (p=0.710 n=7)
Delete/sqlite/128-workers-4                23.01Ki ±     0%   23.01Ki ±     0%       ~ (p=0.436 n=7)
Delete/dqlite/1-workers-4                  22.02Ki ±     0%   22.01Ki ±     0%       ~ (p=0.223 n=7)
Delete/dqlite/4-workers-4                  21.98Ki ±     0%   21.98Ki ±     0%       ~ (p=0.560 n=7)
Delete/dqlite/16-workers-4                 21.98Ki ±    10%   21.99Ki ±     0%       ~ (p=0.686 n=7)
Delete/dqlite/64-workers-4                 22.01Ki ±    10%   21.99Ki ±    10%       ~ (p=0.173 n=7)
Delete/dqlite/128-workers-4                22.02Ki ±    10%   22.02Ki ±    10%       ~ (p=0.772 n=7)
Get/sqlite-4                               24.41Ki ±     0%   24.44Ki ±     0%  +0.12% (p=0.040 n=7)
Get/dqlite-4                               23.25Ki ±     0%   23.25Ki ±     0%       ~ (p=0.050 n=7)
List/sqlite-tiny/all-4                     1.161Ki ±     8%   1.179Ki ±     9%       ~ (p=0.805 n=7)
List/sqlite-tiny/pagination-4              1.571Ki ±     3%   1.564Ki ±     8%       ~ (p=0.804 n=7)
List/sqlite-fits-in-page/all-4             7.440Ki ±    12%   7.909Ki ±    28%       ~ (p=0.805 n=7)
List/sqlite-fits-in-page/pagination-4     10.298Ki ±    13%   9.952Ki ±    12%       ~ (p=0.805 n=7)
List/sqlite-overflows-page/all-4           20.53Ki ±     0%   20.53Ki ±     0%       ~ (p=0.917 n=7)
List/sqlite-overflows-page/pagination-4    29.80Ki ±    25%   26.63Ki ±    29%       ~ (p=0.165 n=7)
List/dqlite-tiny/all-4                     1.041Ki ±     7%   1.054Ki ±     4%       ~ (p=0.535 n=7)
List/dqlite-tiny/pagination-4                968.0 ±     4%     958.0 ±     4%       ~ (p=0.644 n=7)
List/dqlite-fits-in-page/all-4             6.057Ki ±     1%   6.073Ki ±     9%       ~ (p=0.902 n=7)
List/dqlite-fits-in-page/pagination-4      5.459Ki ±     5%   5.515Ki ±     4%       ~ (p=0.535 n=7)
List/dqlite-overflows-page/all-4           30.02Ki ±     8%   30.21Ki ±     1%  +0.63% (p=0.034 n=7)
List/dqlite-overflows-page/pagination-4    29.16Ki ±     7%   29.85Ki ±     1%       ~ (p=0.128 n=7)
Update/sqlite/1-workers-4                  22.28Ki ±     0%   22.29Ki ±     0%       ~ (p=0.270 n=7)
Update/sqlite/4-workers-4                  22.30Ki ±     0%   22.30Ki ±     0%       ~ (p=0.976 n=7)
Update/sqlite/16-workers-4                 22.36Ki ±     1%   22.36Ki ±     0%       ~ (p=0.902 n=7)
Update/sqlite/64-workers-4                 22.88Ki ±  6553%   22.79Ki ±     3%       ~ (p=0.165 n=7)
Update/sqlite/128-workers-4                23.13Ki ± 12405%   23.33Ki ± 12326%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                  21.49Ki ±     0%   21.49Ki ±     0%       ~ (p=0.684 n=7)
Update/dqlite/4-workers-4                  21.48Ki ±     6%   21.49Ki ±     0%       ~ (p=0.929 n=7)
Update/dqlite/16-workers-4                 21.67Ki ±     1%   21.54Ki ±     1%       ~ (p=0.383 n=7)
Update/dqlite/64-workers-4                 21.85Ki ±     2%   21.80Ki ±     2%       ~ (p=0.620 n=7)
Update/dqlite/128-workers-4                22.84Ki ±     5%   22.64Ki ±     4%       ~ (p=0.902 n=7)
geomean                                    14.38Ki            14.35Ki           -0.20%

                                        │     Before     │                 After                  │
                                        │   allocs/op    │   allocs/op     vs base                │
Compaction/sqlite-4                       51.00 ±    51%   50.00 ±    48%       ~ (p=0.452 n=7)
Compaction/dqlite-4                       127.0 ±    83%   125.0 ±    95%       ~ (p=0.436 n=7)
Create/sqlite/1-workers-4                 399.0 ±     0%   399.0 ±     0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                 399.0 ±     0%   399.0 ±     0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                399.0 ±     0%   399.0 ±     0%       ~ (p=1.000 n=7)
Create/sqlite/64-workers-4                399.0 ±     1%   399.0 ±     1%       ~ (p=0.759 n=7)
Create/sqlite/128-workers-4               401.0 ±     0%   400.0 ±     1%       ~ (p=0.228 n=7)
Create/dqlite/1-workers-4                 369.0 ±     0%   369.0 ±     0%       ~ (p=1.000 n=7)
Create/dqlite/4-workers-4                 369.0 ±     0%   369.0 ±     0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                369.0 ±     0%   369.0 ±     0%       ~ (p=0.462 n=7)
Create/dqlite/64-workers-4                368.0 ±     0%   368.0 ±     5%       ~ (p=1.000 n=7)
Create/dqlite/128-workers-4               368.0 ±    14%   368.0 ±     0%       ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                 431.0 ±     0%   431.0 ±     0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                 431.0 ±     0%   431.0 ±     0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                430.0 ±     0%   430.0 ±     0%       ~ (p=0.559 n=7)
Delete/sqlite/64-workers-4                430.0 ±     0%   430.0 ±     0%       ~ (p=1.000 n=7)
Delete/sqlite/128-workers-4               431.0 ±     0%   431.0 ±     0%       ~ (p=0.364 n=7)
Delete/dqlite/1-workers-4                 399.0 ±     0%   399.0 ±     0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                 399.0 ±     0%   399.0 ±     0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                399.0 ±    13%   399.0 ±     0%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                399.0 ±    13%   399.0 ±    13%       ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               399.0 ±    13%   399.0 ±    13%       ~ (p=0.731 n=7)
Get/sqlite-4                              445.0 ±     0%   445.0 ±     0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              412.0 ±     0%   412.0 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                    15.00 ±    20%   17.00 ±    18%       ~ (p=0.557 n=7)
List/sqlite-tiny/pagination-4             25.00 ±     4%   25.00 ±     8%       ~ (p=0.437 n=7)
List/sqlite-fits-in-page/all-4            21.00 ±    19%   23.00 ±    35%       ~ (p=0.863 n=7)
List/sqlite-fits-in-page/pagination-4     36.00 ±    14%   36.00 ±    14%       ~ (p=0.747 n=7)
List/sqlite-overflows-page/all-4          9.000 ±     0%   9.000 ±     0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4   20.00 ±    25%   17.00 ±    41%       ~ (p=0.222 n=7)
List/dqlite-tiny/all-4                    14.00 ±    14%   14.00 ±     7%       ~ (p=0.674 n=7)
List/dqlite-tiny/pagination-4             13.00 ±     8%   14.00 ±     7%       ~ (p=0.266 n=7)
List/dqlite-fits-in-page/all-4            19.00 ±     5%   20.00 ±     5%       ~ (p=0.592 n=7)
List/dqlite-fits-in-page/pagination-4     20.00 ±     5%   19.00 ±     5%       ~ (p=0.298 n=7)
List/dqlite-overflows-page/all-4          33.00 ±     3%   33.00 ±     3%       ~ (p=0.122 n=7)
List/dqlite-overflows-page/pagination-4   33.00 ±     6%   34.00 ±     3%       ~ (p=0.196 n=7)
Update/sqlite/1-workers-4                 412.0 ±     0%   412.0 ±     0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                 412.0 ±     0%   412.0 ±     0%       ~ (p=1.000 n=7)
Update/sqlite/16-workers-4                413.0 ±     0%   413.0 ±     0%       ~ (p=0.593 n=7)
Update/sqlite/64-workers-4                422.0 ±  6142%   421.0 ±     3%       ~ (p=0.196 n=7)
Update/sqlite/128-workers-4               427.0 ± 12182%   430.0 ± 12072%       ~ (p=0.924 n=7)
Update/dqlite/1-workers-4                 381.0 ±     0%   381.0 ±     0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                 381.0 ±     1%   382.0 ±     0%       ~ (p=0.213 n=7)
Update/dqlite/16-workers-4                384.0 ±     1%   382.0 ±     1%       ~ (p=0.369 n=7)
Update/dqlite/64-workers-4                387.0 ±     2%   387.0 ±     2%       ~ (p=0.633 n=7)
Update/dqlite/128-workers-4               405.0 ±     5%   401.0 ±     4%       ~ (p=0.878 n=7)
geomean                                   171.0            171.4           +0.24%
¹ all samples are equal

                                        │        Before         │                    After                    │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base              │
Compaction/dqlite-4                               1.919Ki ± 84%           1.879Ki ± 96%       ~ (p=0.456 n=7)
Create/dqlite/1-workers-4                           241.1 ±  0%             241.1 ±  0%       ~ (p=0.692 n=7)
Create/dqlite/4-workers-4                           241.9 ±  0%             242.3 ±  0%       ~ (p=0.098 n=7)
Create/dqlite/16-workers-4                          242.1 ±  1%             242.3 ±  0%       ~ (p=0.441 n=7)
Create/dqlite/64-workers-4                          242.0 ±  0%             242.0 ± 13%       ~ (p=0.831 n=7)
Create/dqlite/128-workers-4                         242.0 ± 35%             242.0 ±  0%       ~ (p=0.879 n=7)
Delete/dqlite/1-workers-4                           717.7 ±  0%             718.1 ±  0%       ~ (p=0.518 n=7)
Delete/dqlite/4-workers-4                           719.6 ±  0%             719.7 ±  0%       ~ (p=0.469 n=7)
Delete/dqlite/16-workers-4                          719.4 ± 12%             719.4 ±  0%       ~ (p=0.925 n=7)
Delete/dqlite/64-workers-4                          718.9 ± 11%             719.7 ± 12%       ~ (p=0.175 n=7)
Delete/dqlite/128-workers-4                         718.8 ± 12%             719.5 ± 12%       ~ (p=0.170 n=7)
Get/dqlite-4                                      1.133Ki ±  0%           1.133Ki ±  0%       ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                              208.4 ± 14%             209.3 ±  6%       ~ (p=0.805 n=7)
List/dqlite-tiny/pagination-4                       195.9 ±  2%             199.9 ±  2%       ~ (p=0.363 n=7)
List/dqlite-fits-in-page/all-4                    1.350Ki ±  2%           1.370Ki ±  5%       ~ (p=0.155 n=7)
List/dqlite-fits-in-page/pagination-4             1.398Ki ±  8%           1.310Ki ±  6%       ~ (p=0.383 n=7)
List/dqlite-overflows-page/all-4                  6.931Ki ±  3%           6.978Ki ±  2%  +0.68% (p=0.049 n=7)
List/dqlite-overflows-page/pagination-4           7.012Ki ±  8%           7.114Ki ±  4%       ~ (p=0.209 n=7)
Update/dqlite/1-workers-4                           262.8 ±  0%             262.9 ±  0%       ~ (p=0.592 n=7)
Update/dqlite/4-workers-4                           263.1 ±  5%             263.3 ±  0%       ~ (p=0.459 n=7)
Update/dqlite/16-workers-4                          265.0 ±  1%             263.5 ±  1%       ~ (p=0.517 n=7)
Update/dqlite/64-workers-4                          267.0 ±  2%             266.7 ±  2%       ~ (p=0.710 n=7)
Update/dqlite/128-workers-4                         278.8 ±  5%             276.9 ±  4%       ~ (p=0.902 n=7)
geomean                                             565.6                   564.8        -0.14%

                                        │          Before          │                     After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base              │
Compaction/dqlite-4                                    4.595 ± 16%                4.519 ±  3%       ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                              115.2 ±  1%                115.5 ±  2%       ~ (p=0.645 n=7)
Create/dqlite/4-workers-4                              117.1 ±  1%                117.5 ±  0%       ~ (p=0.246 n=7)
Create/dqlite/16-workers-4                             117.2 ±  3%                117.5 ±  1%       ~ (p=0.245 n=7)
Create/dqlite/64-workers-4                             117.1 ±  1%                116.8 ±  8%       ~ (p=0.776 n=7)
Create/dqlite/128-workers-4                            116.9 ± 24%                117.1 ±  1%       ~ (p=0.645 n=7)
Delete/dqlite/1-workers-4                              82.43 ±  1%                82.61 ±  1%       ~ (p=0.559 n=7)
Delete/dqlite/4-workers-4                              83.12 ±  1%                83.21 ±  0%       ~ (p=0.929 n=7)
Delete/dqlite/16-workers-4                             83.01 ± 34%                83.01 ±  0%       ~ (p=0.831 n=7)
Delete/dqlite/64-workers-4                             82.94 ± 33%                83.22 ± 34%       ~ (p=0.209 n=7)
Delete/dqlite/128-workers-4                            82.92 ± 34%                83.18 ± 34%       ~ (p=0.068 n=7)
Get/dqlite-4                                           80.56 ±  0%                80.57 ±  0%       ~ (p=0.254 n=7)
List/dqlite-tiny/all-4                               0.04509 ± 27%              0.04543 ± 11%       ~ (p=0.805 n=7)
List/dqlite-tiny/pagination-4                        0.04979 ±  6%              0.04902 ±  7%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4                       0.06134 ±  3%              0.06297 ±  7%       ~ (p=0.165 n=7)
List/dqlite-fits-in-page/pagination-4                0.08808 ±  7%              0.08085 ± 13%       ~ (p=0.097 n=7)
List/dqlite-overflows-page/all-4                     0.07722 ±  3%              0.07877 ±  2%       ~ (p=0.053 n=7)
List/dqlite-overflows-page/pagination-4               0.1234 ± 10%               0.1284 ± 13%       ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                              136.7 ±  0%                136.7 ±  0%       ~ (p=0.551 n=7)
Update/dqlite/4-workers-4                              136.7 ±  6%                136.6 ±  0%       ~ (p=0.396 n=7)
Update/dqlite/16-workers-4                             137.7 ±  1%                137.2 ±  1%       ~ (p=0.559 n=7)
Update/dqlite/64-workers-4                             139.1 ±  2%                138.9 ±  2%       ~ (p=0.559 n=7)
Update/dqlite/128-workers-4                            145.4 ±  5%                144.5 ±  4%       ~ (p=1.000 n=7)
geomean                                                13.88                      13.87        -0.08%

Current status

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │      After       │
                                        │      sec/op      │
Compaction/sqlite-4                       19.14µ ±      6%
Compaction/dqlite-4                       40.33µ ±      9%
Create/sqlite/1-workers-4                 489.0µ ±      8%
Create/sqlite/4-workers-4                 461.1µ ±     14%
Create/sqlite/16-workers-4                417.3µ ±     13%
Create/sqlite/64-workers-4                420.5µ ±     19%
Create/sqlite/128-workers-4               516.1µ ±     82%
Create/dqlite/1-workers-4                 1.048m ±      6%
Create/dqlite/4-workers-4                 938.7µ ±      3%
Create/dqlite/16-workers-4                941.4µ ±      3%
Create/dqlite/64-workers-4                936.5µ ±      3%
Create/dqlite/128-workers-4               936.2µ ±      4%
Delete/sqlite/1-workers-4                 477.4µ ±      2%
Delete/sqlite/4-workers-4                 450.6µ ±      8%
Delete/sqlite/16-workers-4                419.3µ ±      5%
Delete/sqlite/64-workers-4                446.6µ ±    108%
Delete/sqlite/128-workers-4               529.1µ ±     55%
Delete/dqlite/1-workers-4                 1.046m ±      2%
Delete/dqlite/4-workers-4                 933.7µ ±      4%
Delete/dqlite/16-workers-4                923.1µ ±      5%
Delete/dqlite/64-workers-4                921.0µ ±      4%
Delete/dqlite/128-workers-4               930.2µ ±      4%
Get/sqlite-4                              238.2µ ±      1%
Get/dqlite-4                              359.8µ ±      0%
List/sqlite-tiny/all-4                    3.981µ ±      7%
List/sqlite-tiny/pagination-4             8.175µ ±      4%
List/sqlite-fits-in-page/all-4            7.625µ ±      5%
List/sqlite-fits-in-page/pagination-4     21.55µ ±      3%
List/sqlite-overflows-page/all-4          16.70µ ±      8%
List/sqlite-overflows-page/pagination-4   42.67µ ±      5%
List/dqlite-tiny/all-4                    2.877µ ±      4%
List/dqlite-tiny/pagination-4             6.047µ ±      1%
List/dqlite-fits-in-page/all-4            6.734µ ±      6%
List/dqlite-fits-in-page/pagination-4     17.09µ ±      2%
List/dqlite-overflows-page/all-4          20.97µ ±      4%
List/dqlite-overflows-page/pagination-4   44.14µ ±      3%
Update/sqlite/1-workers-4                 506.1µ ±      4%
Update/sqlite/4-workers-4                 477.6µ ±      4%
Update/sqlite/16-workers-4                446.5µ ±      5%
Update/sqlite/64-workers-4                494.3µ ±    127%
Update/sqlite/128-workers-4               690.0µ ± 153120%
Update/dqlite/1-workers-4                 1.054m ±      9%
Update/dqlite/4-workers-4                 954.2µ ±     10%
Update/dqlite/16-workers-4                979.4µ ±      3%
Update/dqlite/64-workers-4                970.0µ ±      4%
Update/dqlite/128-workers-4               986.1µ ±     10%
geomean                                   198.0µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ page-reads/op  │
Compaction/sqlite-4                        12.29 ±    2%
Compaction/dqlite-4                        12.16 ±    1%
Create/sqlite/1-workers-4                  13.90 ±    0%
Create/sqlite/4-workers-4                  12.57 ±    4%
Create/sqlite/16-workers-4                 10.54 ±    5%
Create/sqlite/64-workers-4                 9.060 ±    5%
Create/sqlite/128-workers-4                8.178 ±    3%
Create/dqlite/1-workers-4                  13.35 ±    2%
Create/dqlite/4-workers-4                  10.95 ±    1%
Create/dqlite/16-workers-4                 11.07 ±    1%
Create/dqlite/64-workers-4                 11.00 ±    2%
Create/dqlite/128-workers-4                11.07 ±    1%
Delete/sqlite/1-workers-4                  16.23 ±    0%
Delete/sqlite/4-workers-4                  14.49 ±    4%
Delete/sqlite/16-workers-4                 11.96 ±    3%
Delete/sqlite/64-workers-4                 9.981 ±    8%
Delete/sqlite/128-workers-4                9.232 ±    5%
Delete/dqlite/1-workers-4                  15.77 ±    1%
Delete/dqlite/4-workers-4                  13.42 ±    1%
Delete/dqlite/16-workers-4                 13.42 ±    1%
Delete/dqlite/64-workers-4                 13.34 ±    4%
Delete/dqlite/128-workers-4                13.20 ±    4%
Get/sqlite-4                               14.96 ±    0%
Get/dqlite-4                               11.96 ±    0%
List/sqlite-tiny/all-4                    191.8m ±    1%
List/sqlite-tiny/pagination-4              1.131 ±    3%
List/sqlite-fits-in-page/all-4            164.6m ±    2%
List/sqlite-fits-in-page/pagination-4     963.2m ±    0%
List/sqlite-overflows-page/all-4          177.1m ±    0%
List/sqlite-overflows-page/pagination-4    1.523 ±   24%
List/dqlite-tiny/all-4                    191.4m ±    0%
List/dqlite-tiny/pagination-4              1.126 ±    3%
List/dqlite-fits-in-page/all-4            164.2m ±    0%
List/dqlite-fits-in-page/pagination-4     954.7m ±    3%
List/dqlite-overflows-page/all-4          184.0m ±    0%
List/dqlite-overflows-page/pagination-4    1.071 ±    3%
Update/sqlite/1-workers-4                  15.81 ±    0%
Update/sqlite/4-workers-4                  14.45 ±    4%
Update/sqlite/16-workers-4                 12.59 ±    4%
Update/sqlite/64-workers-4                 11.17 ±   10%
Update/sqlite/128-workers-4                10.50 ± 4957%
Update/dqlite/1-workers-4                  15.48 ±    1%
Update/dqlite/4-workers-4                  12.76 ±    1%
Update/dqlite/16-workers-4                 12.78 ±    1%
Update/dqlite/64-workers-4                 12.91 ±    2%
Update/dqlite/128-workers-4                13.31 ±    5%
geomean                                    5.197

                                        │       After       │
                                        │  page-writes/op   │
Compaction/sqlite-4                       191.1m ±     0%
Compaction/dqlite-4                       187.6m ±     1%
Create/sqlite/1-workers-4                  4.360 ±     0%
Create/sqlite/4-workers-4                  4.330 ±     1%
Create/sqlite/16-workers-4                 4.283 ±     1%
Create/sqlite/64-workers-4                 4.289 ±     1%
Create/sqlite/128-workers-4                4.223 ±     2%
Create/dqlite/1-workers-4                  4.245 ±     2%
Create/dqlite/4-workers-4                  4.303 ±     0%
Create/dqlite/16-workers-4                 4.304 ±     0%
Create/dqlite/64-workers-4                 4.301 ±     1%
Create/dqlite/128-workers-4                4.302 ±     0%
Delete/sqlite/1-workers-4                  4.391 ±     0%
Delete/sqlite/4-workers-4                  4.394 ±     1%
Delete/sqlite/16-workers-4                 4.358 ±     0%
Delete/sqlite/64-workers-4                 4.353 ±     0%
Delete/sqlite/128-workers-4                4.345 ±     1%
Delete/dqlite/1-workers-4                  4.372 ±     0%
Delete/dqlite/4-workers-4                  4.388 ±     1%
Delete/dqlite/16-workers-4                 4.381 ±     1%
Delete/dqlite/64-workers-4                 4.355 ±     1%
Delete/dqlite/128-workers-4                4.349 ±     1%
Get/sqlite-4                               0.000 ±     0%
Get/dqlite-4                               0.000 ±     0%
List/sqlite-tiny/all-4                     0.000 ±     0%
List/sqlite-tiny/pagination-4              0.000 ±     0%
List/sqlite-fits-in-page/all-4             0.000 ±     0%
List/sqlite-fits-in-page/pagination-4      0.000 ±     0%
List/sqlite-overflows-page/all-4           0.000 ±     0%
List/sqlite-overflows-page/pagination-4    0.000 ±     0%
List/dqlite-tiny/all-4                     0.000 ±     0%
List/dqlite-tiny/pagination-4              0.000 ±     0%
List/dqlite-fits-in-page/all-4             0.000 ±     0%
List/dqlite-fits-in-page/pagination-4      0.000 ±     0%
List/dqlite-overflows-page/all-4           0.000 ±     0%
List/dqlite-overflows-page/pagination-4    0.000 ±     0%
Update/sqlite/1-workers-4                  4.241 ±     0%
Update/sqlite/4-workers-4                  4.313 ±     1%
Update/sqlite/16-workers-4                 4.314 ±     1%
Update/sqlite/64-workers-4                 4.374 ±     2%
Update/sqlite/128-workers-4                4.438 ± 11504%
Update/dqlite/1-workers-4                  4.209 ±     0%
Update/dqlite/4-workers-4                  4.205 ±     0%
Update/dqlite/16-workers-4                 4.227 ±     1%
Update/dqlite/64-workers-4                 4.294 ±     2%
Update/dqlite/128-workers-4                4.501 ±     4%
geomean                                                   ¹
¹ summaries must be >0 to compute geomean

                                        │      After      │
                                        │ sec-reading/op  │
Compaction/sqlite-4                       26.60µ ±    38%
Compaction/dqlite-4                       30.10µ ±    76%
Create/sqlite/1-workers-4                 23.80µ ±    18%
Create/sqlite/4-workers-4                 22.90µ ±    17%
Create/sqlite/16-workers-4                25.10µ ±    14%
Create/sqlite/64-workers-4                25.40µ ±    31%
Create/sqlite/128-workers-4               21.30µ ±    40%
Create/dqlite/1-workers-4                 8.000µ ±    64%
Create/dqlite/4-workers-4                 11.20µ ±    30%
Create/dqlite/16-workers-4                10.30µ ±    41%
Create/dqlite/64-workers-4                10.50µ ±    15%
Create/dqlite/128-workers-4               8.900µ ±    90%
Delete/sqlite/1-workers-4                 32.90µ ±    18%
Delete/sqlite/4-workers-4                 36.80µ ±    27%
Delete/sqlite/16-workers-4                38.30µ ±    16%
Delete/sqlite/64-workers-4                37.40µ ±    12%
Delete/sqlite/128-workers-4               37.40µ ±    20%
Delete/dqlite/1-workers-4                 13.30µ ±    23%
Delete/dqlite/4-workers-4                 17.40µ ±    26%
Delete/dqlite/16-workers-4                14.60µ ±    14%
Delete/dqlite/64-workers-4                12.60µ ±    37%
Delete/dqlite/128-workers-4               16.20µ ±    46%
Get/sqlite-4                              65.40µ ±     8%
Get/dqlite-4                              33.20µ ±    11%
List/sqlite-tiny/all-4                    7.000µ ±    19%
List/sqlite-tiny/pagination-4             14.40µ ±     4%
List/sqlite-fits-in-page/all-4            13.90µ ±    27%
List/sqlite-fits-in-page/pagination-4     34.90µ ±     9%
List/sqlite-overflows-page/all-4          13.00µ ±    11%
List/sqlite-overflows-page/pagination-4   45.80µ ±    21%
List/dqlite-tiny/all-4                    4.000µ ±    22%
List/dqlite-tiny/pagination-4             9.300µ ±     9%
List/dqlite-fits-in-page/all-4            9.200µ ±    20%
List/dqlite-fits-in-page/pagination-4     25.00µ ±    10%
List/dqlite-overflows-page/all-4          34.40µ ±     5%
List/dqlite-overflows-page/pagination-4   65.70µ ±    11%
Update/sqlite/1-workers-4                 23.10µ ±    30%
Update/sqlite/4-workers-4                 24.00µ ±    20%
Update/sqlite/16-workers-4                22.80µ ±    22%
Update/sqlite/64-workers-4                25.00µ ±    31%
Update/sqlite/128-workers-4               27.50µ ± 18082%
Update/dqlite/1-workers-4                 10.50µ ±    70%
Update/dqlite/4-workers-4                 9.700µ ±    38%
Update/dqlite/16-workers-4                10.90µ ±    55%
Update/dqlite/64-workers-4                12.30µ ±    33%
Update/dqlite/128-workers-4               10.40µ ±    51%
geomean                                   18.73µ

                                        │       After       │
                                        │  sec-writing/op   │
Compaction/sqlite-4                       8.900µ ±    27%
Compaction/dqlite-4                       6.800µ ±    12%
Create/sqlite/1-workers-4                 254.4µ ±    13%
Create/sqlite/4-workers-4                 1.375m ±    26%
Create/sqlite/16-workers-4                5.218m ±     9%
Create/sqlite/64-workers-4                16.76m ±     6%
Create/sqlite/128-workers-4               33.14m ±    14%
Create/dqlite/1-workers-4                 41.50µ ±    26%
Create/dqlite/4-workers-4                 47.70µ ±    23%
Create/dqlite/16-workers-4                47.20µ ±    21%
Create/dqlite/64-workers-4                49.80µ ±    14%
Create/dqlite/128-workers-4               44.90µ ±    17%
Delete/sqlite/1-workers-4                 249.1µ ±     5%
Delete/sqlite/4-workers-4                 1.390m ±    12%
Delete/sqlite/16-workers-4                5.202m ±     7%
Delete/sqlite/64-workers-4                17.26m ±    17%
Delete/sqlite/128-workers-4               34.09m ±    13%
Delete/dqlite/1-workers-4                 37.40µ ±    15%
Delete/dqlite/4-workers-4                 44.20µ ±    16%
Delete/dqlite/16-workers-4                43.00µ ±    39%
Delete/dqlite/64-workers-4                45.80µ ±    15%
Delete/dqlite/128-workers-4               42.00µ ±    26%
Get/sqlite-4                               0.000 ±     0%
Get/dqlite-4                               0.000 ±     0%
List/sqlite-tiny/all-4                     0.000 ±     0%
List/sqlite-tiny/pagination-4              0.000 ±     0%
List/sqlite-fits-in-page/all-4             0.000 ±     0%
List/sqlite-fits-in-page/pagination-4      0.000 ±     0%
List/sqlite-overflows-page/all-4           0.000 ±     0%
List/sqlite-overflows-page/pagination-4    0.000 ±     0%
List/dqlite-tiny/all-4                     0.000 ±     0%
List/dqlite-tiny/pagination-4              0.000 ±     0%
List/dqlite-fits-in-page/all-4             0.000 ±     0%
List/dqlite-fits-in-page/pagination-4      0.000 ±     0%
List/dqlite-overflows-page/all-4           0.000 ±     0%
List/dqlite-overflows-page/pagination-4    0.000 ±     0%
Update/sqlite/1-workers-4                 269.3µ ±     9%
Update/sqlite/4-workers-4                 1.408m ±    17%
Update/sqlite/16-workers-4                5.326m ±    11%
Update/sqlite/64-workers-4                18.08m ±    28%
Update/sqlite/128-workers-4               37.88m ± 31209%
Update/dqlite/1-workers-4                 31.40µ ±    51%
Update/dqlite/4-workers-4                 46.30µ ±    25%
Update/dqlite/16-workers-4                43.40µ ±    21%
Update/dqlite/64-workers-4                41.20µ ±    23%
Update/dqlite/128-workers-4               45.20µ ±    13%
geomean                                                   ¹
¹ summaries must be >0 to compute geomean

                                        │      After       │
                                        │       B/op       │
Compaction/sqlite-4                       2.312Ki ±    47%
Compaction/dqlite-4                       5.201Ki ±    94%
Create/sqlite/1-workers-4                 20.49Ki ±     0%
Create/sqlite/4-workers-4                 20.50Ki ±     0%
Create/sqlite/16-workers-4                20.46Ki ±     0%
Create/sqlite/64-workers-4                20.48Ki ±     0%
Create/sqlite/128-workers-4               20.58Ki ±     1%
Create/dqlite/1-workers-4                 19.75Ki ±     0%
Create/dqlite/4-workers-4                 19.72Ki ±     0%
Create/dqlite/16-workers-4                19.72Ki ±     0%
Create/dqlite/64-workers-4                19.72Ki ±     4%
Create/dqlite/128-workers-4               19.75Ki ±     0%
Delete/sqlite/1-workers-4                 22.92Ki ±     0%
Delete/sqlite/4-workers-4                 22.92Ki ±     0%
Delete/sqlite/16-workers-4                22.90Ki ±     0%
Delete/sqlite/64-workers-4                22.91Ki ±     0%
Delete/sqlite/128-workers-4               23.01Ki ±     0%
Delete/dqlite/1-workers-4                 22.01Ki ±     0%
Delete/dqlite/4-workers-4                 21.98Ki ±     0%
Delete/dqlite/16-workers-4                21.99Ki ±     0%
Delete/dqlite/64-workers-4                21.99Ki ±    10%
Delete/dqlite/128-workers-4               22.02Ki ±    10%
Get/sqlite-4                              24.44Ki ±     0%
Get/dqlite-4                              23.25Ki ±     0%
List/sqlite-tiny/all-4                    1.179Ki ±     9%
List/sqlite-tiny/pagination-4             1.564Ki ±     8%
List/sqlite-fits-in-page/all-4            7.909Ki ±    28%
List/sqlite-fits-in-page/pagination-4     9.952Ki ±    12%
List/sqlite-overflows-page/all-4          20.53Ki ±     0%
List/sqlite-overflows-page/pagination-4   26.63Ki ±    29%
List/dqlite-tiny/all-4                    1.054Ki ±     4%
List/dqlite-tiny/pagination-4               958.0 ±     4%
List/dqlite-fits-in-page/all-4            6.073Ki ±     9%
List/dqlite-fits-in-page/pagination-4     5.515Ki ±     4%
List/dqlite-overflows-page/all-4          30.21Ki ±     1%
List/dqlite-overflows-page/pagination-4   29.85Ki ±     1%
Update/sqlite/1-workers-4                 22.29Ki ±     0%
Update/sqlite/4-workers-4                 22.30Ki ±     0%
Update/sqlite/16-workers-4                22.36Ki ±     0%
Update/sqlite/64-workers-4                22.79Ki ±     3%
Update/sqlite/128-workers-4               23.33Ki ± 12326%
Update/dqlite/1-workers-4                 21.49Ki ±     0%
Update/dqlite/4-workers-4                 21.49Ki ±     0%
Update/dqlite/16-workers-4                21.54Ki ±     1%
Update/dqlite/64-workers-4                21.80Ki ±     2%
Update/dqlite/128-workers-4               22.64Ki ±     4%
geomean                                   14.35Ki

                                        │     After      │
                                        │   allocs/op    │
Compaction/sqlite-4                       50.00 ±    48%
Compaction/dqlite-4                       125.0 ±    95%
Create/sqlite/1-workers-4                 399.0 ±     0%
Create/sqlite/4-workers-4                 399.0 ±     0%
Create/sqlite/16-workers-4                399.0 ±     0%
Create/sqlite/64-workers-4                399.0 ±     1%
Create/sqlite/128-workers-4               400.0 ±     1%
Create/dqlite/1-workers-4                 369.0 ±     0%
Create/dqlite/4-workers-4                 369.0 ±     0%
Create/dqlite/16-workers-4                369.0 ±     0%
Create/dqlite/64-workers-4                368.0 ±     5%
Create/dqlite/128-workers-4               368.0 ±     0%
Delete/sqlite/1-workers-4                 431.0 ±     0%
Delete/sqlite/4-workers-4                 431.0 ±     0%
Delete/sqlite/16-workers-4                430.0 ±     0%
Delete/sqlite/64-workers-4                430.0 ±     0%
Delete/sqlite/128-workers-4               431.0 ±     0%
Delete/dqlite/1-workers-4                 399.0 ±     0%
Delete/dqlite/4-workers-4                 399.0 ±     0%
Delete/dqlite/16-workers-4                399.0 ±     0%
Delete/dqlite/64-workers-4                399.0 ±    13%
Delete/dqlite/128-workers-4               399.0 ±    13%
Get/sqlite-4                              445.0 ±     0%
Get/dqlite-4                              412.0 ±     0%
List/sqlite-tiny/all-4                    17.00 ±    18%
List/sqlite-tiny/pagination-4             25.00 ±     8%
List/sqlite-fits-in-page/all-4            23.00 ±    35%
List/sqlite-fits-in-page/pagination-4     36.00 ±    14%
List/sqlite-overflows-page/all-4          9.000 ±     0%
List/sqlite-overflows-page/pagination-4   17.00 ±    41%
List/dqlite-tiny/all-4                    14.00 ±     7%
List/dqlite-tiny/pagination-4             14.00 ±     7%
List/dqlite-fits-in-page/all-4            20.00 ±     5%
List/dqlite-fits-in-page/pagination-4     19.00 ±     5%
List/dqlite-overflows-page/all-4          33.00 ±     3%
List/dqlite-overflows-page/pagination-4   34.00 ±     3%
Update/sqlite/1-workers-4                 412.0 ±     0%
Update/sqlite/4-workers-4                 412.0 ±     0%
Update/sqlite/16-workers-4                413.0 ±     0%
Update/sqlite/64-workers-4                421.0 ±     3%
Update/sqlite/128-workers-4               430.0 ± 12072%
Update/dqlite/1-workers-4                 381.0 ±     0%
Update/dqlite/4-workers-4                 382.0 ±     0%
Update/dqlite/16-workers-4                382.0 ±     1%
Update/dqlite/64-workers-4                387.0 ±     2%
Update/dqlite/128-workers-4               401.0 ±     4%
geomean                                   171.4

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               1.879Ki ± 96%
Create/dqlite/1-workers-4                           241.1 ±  0%
Create/dqlite/4-workers-4                           242.3 ±  0%
Create/dqlite/16-workers-4                          242.3 ±  0%
Create/dqlite/64-workers-4                          242.0 ± 13%
Create/dqlite/128-workers-4                         242.0 ±  0%
Delete/dqlite/1-workers-4                           718.1 ±  0%
Delete/dqlite/4-workers-4                           719.7 ±  0%
Delete/dqlite/16-workers-4                          719.4 ±  0%
Delete/dqlite/64-workers-4                          719.7 ± 12%
Delete/dqlite/128-workers-4                         719.5 ± 12%
Get/dqlite-4                                      1.133Ki ±  0%
List/dqlite-tiny/all-4                              209.3 ±  6%
List/dqlite-tiny/pagination-4                       199.9 ±  2%
List/dqlite-fits-in-page/all-4                    1.370Ki ±  5%
List/dqlite-fits-in-page/pagination-4             1.310Ki ±  6%
List/dqlite-overflows-page/all-4                  6.978Ki ±  2%
List/dqlite-overflows-page/pagination-4           7.114Ki ±  4%
Update/dqlite/1-workers-4                           262.9 ±  0%
Update/dqlite/4-workers-4                           263.3 ±  0%
Update/dqlite/16-workers-4                          263.5 ±  1%
Update/dqlite/64-workers-4                          266.7 ±  2%
Update/dqlite/128-workers-4                         276.9 ±  4%
geomean                                             564.8

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    4.519 ±  3%
Create/dqlite/1-workers-4                              115.5 ±  2%
Create/dqlite/4-workers-4                              117.5 ±  0%
Create/dqlite/16-workers-4                             117.5 ±  1%
Create/dqlite/64-workers-4                             116.8 ±  8%
Create/dqlite/128-workers-4                            117.1 ±  1%
Delete/dqlite/1-workers-4                              82.61 ±  1%
Delete/dqlite/4-workers-4                              83.21 ±  0%
Delete/dqlite/16-workers-4                             83.01 ±  0%
Delete/dqlite/64-workers-4                             83.22 ± 34%
Delete/dqlite/128-workers-4                            83.18 ± 34%
Get/dqlite-4                                           80.57 ±  0%
List/dqlite-tiny/all-4                               0.04543 ± 11%
List/dqlite-tiny/pagination-4                        0.04902 ±  7%
List/dqlite-fits-in-page/all-4                       0.06297 ±  7%
List/dqlite-fits-in-page/pagination-4                0.08085 ± 13%
List/dqlite-overflows-page/all-4                     0.07877 ±  2%
List/dqlite-overflows-page/pagination-4               0.1284 ± 13%
Update/dqlite/1-workers-4                              136.7 ±  0%
Update/dqlite/4-workers-4                              136.6 ±  0%
Update/dqlite/16-workers-4                             137.2 ±  1%
Update/dqlite/64-workers-4                             138.9 ±  2%
Update/dqlite/128-workers-4                            144.5 ±  4%
geomean                                                13.87

[maci3jka]

merge after merging canonical/k8s-snap#715

[louiseschmidtgen]

Thanks Mac, a few comments. Let's turn this into a draft until the k8s-snap test is ready.