Skip to content

Commit

Permalink
Remove separate callgrind please script (#800)
Browse files Browse the repository at this point in the history
  • Loading branch information
@kazimuth
kazimuth authored Feb 7, 2024
1 parent c6ae096 commit b7c8a08
Showing 1 changed file with 0 additions and 190 deletions.
190 changes: 0 additions & 190 deletions .github/workflows/callgrind_benchmarks.yml
View file

This file was deleted.

2 comments on commit b7c8a08

@github-actions
Copy link

@github-actions github-actions bot commented on b7c8a08 Feb 7, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark results

Benchmark Report

Legend:

  • load: number of rows pre-loaded into the database
  • count: number of rows touched by the transaction
  • index types:
    • unique: a single index on the id column
    • non_unique: no indexes
    • multi_index: non-unique index on every column
  • schemas:
    • person(id: u32, name: String, age: u64)
    • location(id: u32, x: u64, y: u64)

All throughputs are single-threaded.

Empty transaction

db on disk new latency old latency new throughput old throughput
sqlite 💿 431.8±1.80ns 433.1±0.62ns - -
sqlite 🧠 423.6±1.30ns 431.4±3.92ns - -
stdb_module 💿 35.3±2.54µs 34.8±2.48µs - -
stdb_module 🧠 35.6±2.50µs 34.4±2.21µs - -
stdb_raw 💿 935.5±1.81ns 933.2±2.38ns - -
stdb_raw 🧠 881.6±1.94ns 882.7±1.73ns - -

Single-row insertions

db on disk schema index type load new latency old latency new throughput old throughput
sqlite 💿 location multi_index 0 14.6±0.57µs 14.6±0.03µs 66.9 Ktx/sec 66.9 Ktx/sec
sqlite 💿 location multi_index 1000 15.6±0.13µs 15.8±0.10µs 62.4 Ktx/sec 61.7 Ktx/sec
sqlite 💿 location non_unique 0 7.1±0.44µs 7.1±0.64µs 138.0 Ktx/sec 137.2 Ktx/sec
sqlite 💿 location non_unique 1000 7.0±0.05µs 7.1±0.03µs 138.5 Ktx/sec 137.6 Ktx/sec
sqlite 💿 location unique 0 7.1±0.76µs 7.0±0.03µs 137.2 Ktx/sec 138.6 Ktx/sec
sqlite 💿 location unique 1000 7.0±0.05µs 7.0±0.04µs 138.5 Ktx/sec 138.7 Ktx/sec
sqlite 💿 person multi_index 0 14.2±0.05µs 14.2±0.03µs 68.7 Ktx/sec 68.9 Ktx/sec
sqlite 💿 person multi_index 1000 15.9±0.10µs 15.9±0.13µs 61.4 Ktx/sec 61.4 Ktx/sec
sqlite 💿 person non_unique 0 7.2±0.38µs 7.2±0.38µs 136.3 Ktx/sec 135.3 Ktx/sec
sqlite 💿 person non_unique 1000 7.2±0.06µs 7.2±0.05µs 136.5 Ktx/sec 136.5 Ktx/sec
sqlite 💿 person unique 0 7.1±0.38µs 7.2±0.28µs 137.5 Ktx/sec 136.2 Ktx/sec
sqlite 💿 person unique 1000 7.2±0.13µs 7.2±0.08µs 135.8 Ktx/sec 135.0 Ktx/sec
sqlite 🧠 location multi_index 0 4.0±0.03µs 4.0±0.01µs 242.8 Ktx/sec 241.4 Ktx/sec
sqlite 🧠 location multi_index 1000 5.3±0.05µs 5.2±0.04µs 185.9 Ktx/sec 186.8 Ktx/sec
sqlite 🧠 location non_unique 0 1861.3±7.92ns 1850.0±10.34ns 524.7 Ktx/sec 527.9 Ktx/sec
sqlite 🧠 location non_unique 1000 1901.4±9.84ns 1880.5±32.52ns 513.6 Ktx/sec 519.3 Ktx/sec
sqlite 🧠 location unique 0 1842.8±5.71ns 1845.3±6.96ns 529.9 Ktx/sec 529.2 Ktx/sec
sqlite 🧠 location unique 1000 1935.1±11.51ns 1937.8±11.08ns 504.6 Ktx/sec 504.0 Ktx/sec
sqlite 🧠 person multi_index 0 3.7±0.04µs 3.6±0.01µs 264.5 Ktx/sec 268.0 Ktx/sec
sqlite 🧠 person multi_index 1000 5.4±0.05µs 5.5±0.06µs 179.3 Ktx/sec 177.1 Ktx/sec
sqlite 🧠 person non_unique 0 1923.5±13.58ns 1914.3±5.28ns 507.7 Ktx/sec 510.1 Ktx/sec
sqlite 🧠 person non_unique 1000 1986.9±6.77ns 1998.8±11.27ns 491.5 Ktx/sec 488.6 Ktx/sec
sqlite 🧠 person unique 0 1908.8±11.60ns 1892.4±3.12ns 511.6 Ktx/sec 516.0 Ktx/sec
sqlite 🧠 person unique 1000 2.0±0.01µs 2.0±0.01µs 482.2 Ktx/sec 484.5 Ktx/sec
stdb_module 💿 location multi_index 0 68.8±9.29µs 71.1±4.66µs 14.2 Ktx/sec 13.7 Ktx/sec
stdb_module 💿 location multi_index 1000 147.0±46.23µs 105.5±7.07µs 6.6 Ktx/sec 9.3 Ktx/sec
stdb_module 💿 location non_unique 0 68.7±6.06µs 63.6±7.71µs 14.2 Ktx/sec 15.4 Ktx/sec
stdb_module 💿 location non_unique 1000 121.2±8.39µs 131.8±37.45µs 8.1 Ktx/sec 7.4 Ktx/sec
stdb_module 💿 location unique 0 69.2±7.27µs 68.0±8.17µs 14.1 Ktx/sec 14.4 Ktx/sec
stdb_module 💿 location unique 1000 203.1±7.62µs 122.0±12.94µs 4.8 Ktx/sec 8.0 Ktx/sec
stdb_module 💿 person multi_index 0 81.3±4.59µs 77.7±5.44µs 12.0 Ktx/sec 12.6 Ktx/sec
stdb_module 💿 person multi_index 1000 176.3±1.92µs 185.2±5.14µs 5.5 Ktx/sec 5.3 Ktx/sec
stdb_module 💿 person non_unique 0 76.0±5.58µs 73.1±5.82µs 12.8 Ktx/sec 13.4 Ktx/sec
stdb_module 💿 person non_unique 1000 216.3±44.17µs 165.9±4.34µs 4.5 Ktx/sec 5.9 Ktx/sec
stdb_module 💿 person unique 0 79.3±3.92µs 79.9±4.79µs 12.3 Ktx/sec 12.2 Ktx/sec
stdb_module 💿 person unique 1000 171.2±3.08µs 195.9±8.82µs 5.7 Ktx/sec 5.0 Ktx/sec
stdb_module 🧠 location multi_index 0 60.4±5.34µs 64.7±5.15µs 16.2 Ktx/sec 15.1 Ktx/sec
stdb_module 🧠 location multi_index 1000 123.4±9.38µs 85.9±8.30µs 7.9 Ktx/sec 11.4 Ktx/sec
stdb_module 🧠 location non_unique 0 52.3±4.99µs 54.5±5.17µs 18.7 Ktx/sec 17.9 Ktx/sec
stdb_module 🧠 location non_unique 1000 133.9±5.74µs 137.4±6.14µs 7.3 Ktx/sec 7.1 Ktx/sec
stdb_module 🧠 location unique 0 55.9±5.29µs 58.1±5.42µs 17.5 Ktx/sec 16.8 Ktx/sec
stdb_module 🧠 location unique 1000 119.5±4.94µs 81.6±8.56µs 8.2 Ktx/sec 12.0 Ktx/sec
stdb_module 🧠 person multi_index 0 62.2±6.67µs 67.4±5.39µs 15.7 Ktx/sec 14.5 Ktx/sec
stdb_module 🧠 person multi_index 1000 184.6±4.62µs 100.0±3.50µs 5.3 Ktx/sec 9.8 Ktx/sec
stdb_module 🧠 person non_unique 0 58.4±5.67µs 57.3±6.59µs 16.7 Ktx/sec 17.1 Ktx/sec
stdb_module 🧠 person non_unique 1000 143.7±7.19µs 173.1±6.67µs 6.8 Ktx/sec 5.6 Ktx/sec
stdb_module 🧠 person unique 0 61.4±5.85µs 56.9±7.09µs 15.9 Ktx/sec 17.2 Ktx/sec
stdb_module 🧠 person unique 1000 108.0±7.51µs 196.6±6.16µs 9.0 Ktx/sec 5.0 Ktx/sec
stdb_raw 💿 location multi_index 0 6.0±0.02µs 6.0±0.03µs 163.0 Ktx/sec 161.6 Ktx/sec
stdb_raw 💿 location multi_index 1000 8.8±0.16µs 22.9±140.09µs 111.4 Ktx/sec 42.7 Ktx/sec
stdb_raw 💿 location non_unique 0 5.3±0.01µs 5.4±0.02µs 184.1 Ktx/sec 182.2 Ktx/sec
stdb_raw 💿 location non_unique 1000 7.3±0.14µs 17.1±98.03µs 134.1 Ktx/sec 57.1 Ktx/sec
stdb_raw 💿 location unique 0 5.9±0.02µs 5.8±0.02µs 166.4 Ktx/sec 167.6 Ktx/sec
stdb_raw 💿 location unique 1000 20.2±117.21µs 8.5±0.14µs 48.4 Ktx/sec 115.0 Ktx/sec
stdb_raw 💿 person multi_index 0 7.3±0.02µs 7.4±0.93µs 133.2 Ktx/sec 131.1 Ktx/sec
stdb_raw 💿 person multi_index 1000 10.6±0.24µs 10.8±0.12µs 91.8 Ktx/sec 90.4 Ktx/sec
stdb_raw 💿 person non_unique 0 6.6±0.01µs 6.6±0.02µs 147.7 Ktx/sec 148.0 Ktx/sec
stdb_raw 💿 person non_unique 1000 25.6±167.25µs 8.9±0.13µs 38.1 Ktx/sec 109.5 Ktx/sec
stdb_raw 💿 person unique 0 7.1±0.01µs 7.1±0.03µs 136.6 Ktx/sec 137.7 Ktx/sec
stdb_raw 💿 person unique 1000 9.9±0.13µs 10.0±0.14µs 99.0 Ktx/sec 98.0 Ktx/sec
stdb_raw 🧠 location multi_index 0 3.4±0.00µs 3.4±0.01µs 289.7 Ktx/sec 288.0 Ktx/sec
stdb_raw 🧠 location multi_index 1000 4.8±0.03µs 4.8±0.03µs 202.2 Ktx/sec 201.6 Ktx/sec
stdb_raw 🧠 location non_unique 0 2.8±0.01µs 2.8±0.02µs 350.7 Ktx/sec 349.1 Ktx/sec
stdb_raw 🧠 location non_unique 1000 3.5±0.02µs 3.6±0.03µs 282.1 Ktx/sec 273.7 Ktx/sec
stdb_raw 🧠 location unique 0 3.2±0.01µs 3.3±0.02µs 301.1 Ktx/sec 299.6 Ktx/sec
stdb_raw 🧠 location unique 1000 4.4±0.03µs 4.5±0.02µs 222.1 Ktx/sec 215.5 Ktx/sec
stdb_raw 🧠 person multi_index 0 4.1±0.01µs 4.1±0.01µs 238.9 Ktx/sec 236.6 Ktx/sec
stdb_raw 🧠 person multi_index 1000 6.0±0.06µs 6.0±0.03µs 163.6 Ktx/sec 163.4 Ktx/sec
stdb_raw 🧠 person non_unique 0 3.4±0.01µs 3.5±0.01µs 285.8 Ktx/sec 282.1 Ktx/sec
stdb_raw 🧠 person non_unique 1000 4.3±0.03µs 4.4±0.04µs 225.0 Ktx/sec 223.1 Ktx/sec
stdb_raw 🧠 person unique 0 3.9±0.01µs 3.9±0.03µs 249.1 Ktx/sec 250.6 Ktx/sec
stdb_raw 🧠 person unique 1000 5.2±0.04µs 5.3±0.03µs 187.8 Ktx/sec 184.8 Ktx/sec

Multi-row insertions

db on disk schema index type load count new latency old latency new throughput old throughput
sqlite 💿 location multi_index 0 100 131.7±0.40µs 131.6±3.49µs 7.4 Ktx/sec 7.4 Ktx/sec
sqlite 💿 location multi_index 1000 100 203.2±1.18µs 201.3±1.49µs 4.8 Ktx/sec 4.9 Ktx/sec
sqlite 💿 location non_unique 0 100 49.3±3.74µs 49.8±0.24µs 19.8 Ktx/sec 19.6 Ktx/sec
sqlite 💿 location non_unique 1000 100 53.1±0.25µs 52.4±0.28µs 18.4 Ktx/sec 18.6 Ktx/sec
sqlite 💿 location unique 0 100 51.4±6.41µs 51.6±0.31µs 19.0 Ktx/sec 18.9 Ktx/sec
sqlite 💿 location unique 1000 100 68.7±131.76µs 55.7±0.28µs 14.2 Ktx/sec 17.5 Ktx/sec
sqlite 💿 person multi_index 0 100 118.0±0.40µs 117.7±2.45µs 8.3 Ktx/sec 8.3 Ktx/sec
sqlite 💿 person multi_index 1000 100 232.0±2.02µs 229.6±0.39µs 4.2 Ktx/sec 4.3 Ktx/sec
sqlite 💿 person non_unique 0 100 47.4±1.34µs 47.6±0.98µs 20.6 Ktx/sec 20.5 Ktx/sec
sqlite 💿 person non_unique 1000 100 59.1±0.31µs 59.1±0.43µs 16.5 Ktx/sec 16.5 Ktx/sec
sqlite 💿 person unique 0 100 48.9±1.69µs 49.7±0.67µs 20.0 Ktx/sec 19.6 Ktx/sec
sqlite 💿 person unique 1000 100 55.8±0.24µs 54.6±0.36µs 17.5 Ktx/sec 17.9 Ktx/sec
sqlite 🧠 location multi_index 0 100 119.4±0.27µs 118.0±0.35µs 8.2 Ktx/sec 8.3 Ktx/sec
sqlite 🧠 location multi_index 1000 100 170.9±0.28µs 169.3±0.42µs 5.7 Ktx/sec 5.8 Ktx/sec
sqlite 🧠 location non_unique 0 100 42.2±0.60µs 42.1±0.43µs 23.2 Ktx/sec 23.2 Ktx/sec
sqlite 🧠 location non_unique 1000 100 44.3±0.27µs 44.1±0.30µs 22.0 Ktx/sec 22.1 Ktx/sec
sqlite 🧠 location unique 0 100 44.3±0.31µs 44.0±0.54µs 22.0 Ktx/sec 22.2 Ktx/sec
sqlite 🧠 location unique 1000 100 48.4±0.99µs 48.4±0.25µs 20.2 Ktx/sec 20.2 Ktx/sec
sqlite 🧠 person multi_index 0 100 105.6±0.51µs 106.0±0.40µs 9.2 Ktx/sec 9.2 Ktx/sec
sqlite 🧠 person multi_index 1000 100 188.2±0.62µs 189.5±0.29µs 5.2 Ktx/sec 5.2 Ktx/sec
sqlite 🧠 person non_unique 0 100 41.0±0.34µs 41.3±0.60µs 23.8 Ktx/sec 23.6 Ktx/sec
sqlite 🧠 person non_unique 1000 100 44.4±0.34µs 44.5±0.22µs 22.0 Ktx/sec 21.9 Ktx/sec
sqlite 🧠 person unique 0 100 43.1±0.76µs 42.9±0.35µs 22.6 Ktx/sec 22.8 Ktx/sec
sqlite 🧠 person unique 1000 100 47.4±0.43µs 46.8±0.32µs 20.6 Ktx/sec 20.9 Ktx/sec
stdb_module 💿 location multi_index 0 100 583.8±14.11µs 575.8±190.12µs 1712 tx/sec 1736 tx/sec
stdb_module 💿 location multi_index 1000 100 633.9±76.25µs 577.8±96.78µs 1577 tx/sec 1730 tx/sec
stdb_module 💿 location non_unique 0 100 465.3±5.00µs 446.4±32.99µs 2.1 Ktx/sec 2.2 Ktx/sec
stdb_module 💿 location non_unique 1000 100 512.7±8.19µs 458.5±2.66µs 1950 tx/sec 2.1 Ktx/sec
stdb_module 💿 location unique 0 100 569.4±89.29µs 490.7±3.13µs 1756 tx/sec 2038 tx/sec
stdb_module 💿 location unique 1000 100 662.4±28.33µs 532.6±2.85µs 1509 tx/sec 1877 tx/sec
stdb_module 💿 person multi_index 0 100 877.2±26.08µs 880.1±19.30µs 1140 tx/sec 1136 tx/sec
stdb_module 💿 person multi_index 1000 100 1040.4±44.81µs 1050.0±9.37µs 961 tx/sec 952 tx/sec
stdb_module 💿 person non_unique 0 100 724.9±8.11µs 680.4±14.16µs 1379 tx/sec 1469 tx/sec
stdb_module 💿 person non_unique 1000 100 802.6±6.68µs 735.6±8.18µs 1245 tx/sec 1359 tx/sec
stdb_module 💿 person unique 0 100 796.6±2.25µs 837.8±13.73µs 1255 tx/sec 1193 tx/sec
stdb_module 💿 person unique 1000 100 883.8±2.41µs 998.7±14.13µs 1131 tx/sec 1001 tx/sec
stdb_module 🧠 location multi_index 0 100 456.6±43.00µs 374.6±43.00µs 2.1 Ktx/sec 2.6 Ktx/sec
stdb_module 🧠 location multi_index 1000 100 566.2±8.83µs 448.9±54.23µs 1766 tx/sec 2.2 Ktx/sec
stdb_module 🧠 location non_unique 0 100 383.6±38.43µs 350.7±17.68µs 2.5 Ktx/sec 2.8 Ktx/sec
stdb_module 🧠 location non_unique 1000 100 425.4±31.92µs 337.7±34.46µs 2.3 Ktx/sec 2.9 Ktx/sec
stdb_module 🧠 location unique 0 100 425.7±31.85µs 305.9±57.16µs 2.3 Ktx/sec 3.2 Ktx/sec
stdb_module 🧠 location unique 1000 100 477.7±20.25µs 392.6±56.53µs 2.0 Ktx/sec 2.5 Ktx/sec
stdb_module 🧠 person multi_index 0 100 651.9±28.23µs 622.5±22.64µs 1533 tx/sec 1606 tx/sec
stdb_module 🧠 person multi_index 1000 100 749.2±25.62µs 696.0±4.68µs 1334 tx/sec 1436 tx/sec
stdb_module 🧠 person non_unique 0 100 473.7±63.52µs 460.9±25.18µs 2.1 Ktx/sec 2.1 Ktx/sec
stdb_module 🧠 person non_unique 1000 100 611.5±68.99µs 424.7±76.27µs 1635 tx/sec 2.3 Ktx/sec
stdb_module 🧠 person unique 0 100 532.2±13.95µs 511.7±37.90µs 1878 tx/sec 1954 tx/sec
stdb_module 🧠 person unique 1000 100 724.2±26.22µs 575.5±9.92µs 1380 tx/sec 1737 tx/sec
stdb_raw 💿 location multi_index 0 100 165.6±0.27µs 166.8±0.29µs 5.9 Ktx/sec 5.9 Ktx/sec
stdb_raw 💿 location multi_index 1000 100 179.6±1.16µs 192.2±113.03µs 5.4 Ktx/sec 5.1 Ktx/sec
stdb_raw 💿 location non_unique 0 100 125.6±0.10µs 127.1±0.14µs 7.8 Ktx/sec 7.7 Ktx/sec
stdb_raw 💿 location non_unique 1000 100 149.0±148.08µs 129.1±1.06µs 6.6 Ktx/sec 7.6 Ktx/sec
stdb_raw 💿 location unique 0 100 160.7±0.27µs 161.9±0.41µs 6.1 Ktx/sec 6.0 Ktx/sec
stdb_raw 💿 location unique 1000 100 180.4±131.27µs 167.8±0.97µs 5.4 Ktx/sec 5.8 Ktx/sec
stdb_raw 💿 person multi_index 0 100 282.0±6.63µs 282.4±10.94µs 3.5 Ktx/sec 3.5 Ktx/sec
stdb_raw 💿 person multi_index 1000 100 314.7±224.12µs 315.1±218.99µs 3.1 Ktx/sec 3.1 Ktx/sec
stdb_raw 💿 person non_unique 0 100 217.2±0.57µs 218.1±0.32µs 4.5 Ktx/sec 4.5 Ktx/sec
stdb_raw 💿 person non_unique 1000 100 218.8±0.37µs 219.4±0.26µs 4.5 Ktx/sec 4.5 Ktx/sec
stdb_raw 💿 person unique 0 100 252.7±0.21µs 253.1±0.36µs 3.9 Ktx/sec 3.9 Ktx/sec
stdb_raw 💿 person unique 1000 100 261.4±0.56µs 260.8±0.52µs 3.7 Ktx/sec 3.7 Ktx/sec
stdb_raw 🧠 location multi_index 0 100 115.7±0.37µs 116.6±0.25µs 8.4 Ktx/sec 8.4 Ktx/sec
stdb_raw 🧠 location multi_index 1000 100 129.4±0.26µs 130.5±0.21µs 7.5 Ktx/sec 7.5 Ktx/sec
stdb_raw 🧠 location non_unique 0 100 77.8±0.19µs 79.6±0.10µs 12.6 Ktx/sec 12.3 Ktx/sec
stdb_raw 🧠 location non_unique 1000 100 79.7±0.26µs 80.8±0.13µs 12.2 Ktx/sec 12.1 Ktx/sec
stdb_raw 🧠 location unique 0 100 113.4±0.17µs 115.3±0.32µs 8.6 Ktx/sec 8.5 Ktx/sec
stdb_raw 🧠 location unique 1000 100 119.7±0.26µs 120.8±0.20µs 8.2 Ktx/sec 8.1 Ktx/sec
stdb_raw 🧠 person multi_index 0 100 182.6±0.37µs 184.0±0.21µs 5.3 Ktx/sec 5.3 Ktx/sec
stdb_raw 🧠 person multi_index 1000 100 194.6±0.28µs 196.4±0.35µs 5.0 Ktx/sec 5.0 Ktx/sec
stdb_raw 🧠 person non_unique 0 100 121.7±0.09µs 122.4±0.18µs 8.0 Ktx/sec 8.0 Ktx/sec
stdb_raw 🧠 person non_unique 1000 100 123.0±0.18µs 123.3±0.14µs 7.9 Ktx/sec 7.9 Ktx/sec
stdb_raw 🧠 person unique 0 100 158.5±0.17µs 158.6±0.22µs 6.2 Ktx/sec 6.2 Ktx/sec
stdb_raw 🧠 person unique 1000 100 164.9±0.34µs 165.9±0.24µs 5.9 Ktx/sec 5.9 Ktx/sec

Full table iterate

db on disk schema index type new latency old latency new throughput old throughput
sqlite 💿 location unique 8.9±0.11µs 9.3±0.12µs 110.3 Ktx/sec 104.8 Ktx/sec
sqlite 💿 person unique 9.4±0.11µs 9.7±0.12µs 103.9 Ktx/sec 100.7 Ktx/sec
sqlite 🧠 location unique 7.7±0.11µs 8.4±0.09µs 127.6 Ktx/sec 116.3 Ktx/sec
sqlite 🧠 person unique 8.2±0.15µs 8.7±0.12µs 119.8 Ktx/sec 112.1 Ktx/sec
stdb_module 💿 location unique 71.0±11.45µs 65.2±6.82µs 13.7 Ktx/sec 15.0 Ktx/sec
stdb_module 💿 person unique 75.9±1.61µs 74.6±3.06µs 12.9 Ktx/sec 13.1 Ktx/sec
stdb_module 🧠 location unique 65.9±9.57µs 63.1±6.30µs 14.8 Ktx/sec 15.5 Ktx/sec
stdb_module 🧠 person unique 76.8±5.25µs 78.0±4.27µs 12.7 Ktx/sec 12.5 Ktx/sec
stdb_raw 💿 location unique 12.5±0.04µs 12.5±0.01µs 77.9 Ktx/sec 78.0 Ktx/sec
stdb_raw 💿 person unique 13.7±0.01µs 13.7±0.01µs 71.4 Ktx/sec 71.5 Ktx/sec
stdb_raw 🧠 location unique 12.5±0.01µs 12.5±0.00µs 78.3 Ktx/sec 78.4 Ktx/sec
stdb_raw 🧠 person unique 13.6±0.01µs 13.6±0.01µs 71.7 Ktx/sec 71.7 Ktx/sec

Find unique key

db on disk key type load new latency old latency new throughput old throughput
sqlite 💿 u32 1000 2.3±0.01µs 2.3±0.00µs 426.1 Ktx/sec 423.7 Ktx/sec
sqlite 🧠 u32 1000 1119.9±5.65ns 1129.6±4.60ns 872.0 Ktx/sec 864.5 Ktx/sec
stdb_module 💿 u32 1000 42.1±5.11µs 40.1±3.24µs 23.2 Ktx/sec 24.4 Ktx/sec
stdb_module 🧠 u32 1000 44.0±3.68µs 44.3±4.35µs 22.2 Ktx/sec 22.1 Ktx/sec
stdb_raw 💿 u32 1000 1839.3±3.38ns 1834.3±2.39ns 531.0 Ktx/sec 532.4 Ktx/sec
stdb_raw 🧠 u32 1000 1762.6±2.62ns 1750.3±4.11ns 554.1 Ktx/sec 557.9 Ktx/sec

Filter

db on disk key type index strategy load count new latency old latency new throughput old throughput
sqlite 💿 string indexed 1000 10 5.6±0.02µs 5.6±0.02µs 174.4 Ktx/sec 174.3 Ktx/sec
sqlite 💿 string non_indexed 1000 10 50.5±0.45µs 50.8±0.50µs 19.3 Ktx/sec 19.2 Ktx/sec
sqlite 💿 u64 indexed 1000 10 5.4±0.02µs 5.4±0.05µs 180.3 Ktx/sec 180.7 Ktx/sec
sqlite 💿 u64 non_indexed 1000 10 32.8±0.05µs 32.8±0.18µs 29.8 Ktx/sec 29.8 Ktx/sec
sqlite 🧠 string indexed 1000 10 4.2±0.01µs 4.2±0.02µs 232.6 Ktx/sec 232.6 Ktx/sec
sqlite 🧠 string non_indexed 1000 10 49.4±0.52µs 49.6±0.51µs 19.7 Ktx/sec 19.7 Ktx/sec
sqlite 🧠 u64 indexed 1000 10 4.0±0.02µs 4.0±0.01µs 242.1 Ktx/sec 242.5 Ktx/sec
sqlite 🧠 u64 non_indexed 1000 10 31.5±0.12µs 31.5±0.06µs 31.0 Ktx/sec 31.0 Ktx/sec
stdb_module 💿 string indexed 1000 10 51.7±4.90µs 46.3±1.83µs 18.9 Ktx/sec 21.1 Ktx/sec
stdb_module 💿 string non_indexed 1000 10 230.1±4.49µs 225.1±3.19µs 4.2 Ktx/sec 4.3 Ktx/sec
stdb_module 💿 u64 indexed 1000 10 45.2±4.64µs 48.3±3.53µs 21.6 Ktx/sec 20.2 Ktx/sec
stdb_module 💿 u64 non_indexed 1000 10 197.4±2.30µs 193.7±1.20µs 4.9 Ktx/sec 5.0 Ktx/sec
stdb_module 🧠 string indexed 1000 10 51.4±3.21µs 49.2±3.72µs 19.0 Ktx/sec 19.9 Ktx/sec
stdb_module 🧠 string non_indexed 1000 10 229.4±4.14µs 228.9±5.89µs 4.3 Ktx/sec 4.3 Ktx/sec
stdb_module 🧠 u64 indexed 1000 10 48.3±3.72µs 47.0±3.55µs 20.2 Ktx/sec 20.8 Ktx/sec
stdb_module 🧠 u64 non_indexed 1000 10 193.8±0.60µs 201.0±13.80µs 5.0 Ktx/sec 4.9 Ktx/sec
stdb_raw 💿 string indexed 1000 10 2.7±0.00µs 2.7±0.02µs 361.2 Ktx/sec 361.6 Ktx/sec
stdb_raw 💿 string non_indexed 1000 10 175.1±0.66µs 184.5±0.35µs 5.6 Ktx/sec 5.3 Ktx/sec
stdb_raw 💿 u64 indexed 1000 10 2.6±0.00µs 2.6±0.00µs 370.3 Ktx/sec 371.8 Ktx/sec
stdb_raw 💿 u64 non_indexed 1000 10 159.8±0.71µs 154.5±0.19µs 6.1 Ktx/sec 6.3 Ktx/sec
stdb_raw 🧠 string indexed 1000 10 2.6±0.01µs 2.6±0.00µs 370.7 Ktx/sec 373.9 Ktx/sec
stdb_raw 🧠 string non_indexed 1000 10 175.2±0.50µs 184.1±0.59µs 5.6 Ktx/sec 5.3 Ktx/sec
stdb_raw 🧠 u64 indexed 1000 10 2.6±0.00µs 2.6±0.02µs 380.9 Ktx/sec 382.9 Ktx/sec
stdb_raw 🧠 u64 non_indexed 1000 10 160.9±0.23µs 154.2±0.21µs 6.1 Ktx/sec 6.3 Ktx/sec

Serialize

schema format count new latency old latency new throughput old throughput
location bsatn 100 1798.7±20.20ns 1824.9±44.73ns 53.0 Mtx/sec 52.3 Mtx/sec
location json 100 3.7±0.04µs 3.2±0.03µs 25.8 Mtx/sec 29.5 Mtx/sec
location product_value 100 625.1±0.48ns 625.3±0.81ns 152.6 Mtx/sec 152.5 Mtx/sec
person bsatn 100 2.5±0.01µs 2.5±0.02µs 37.8 Mtx/sec 37.7 Mtx/sec
person json 100 5.2±0.04µs 4.9±0.05µs 18.3 Mtx/sec 19.3 Mtx/sec
person product_value 100 674.4±0.18ns 674.3±0.49ns 141.4 Mtx/sec 141.4 Mtx/sec

Module: invoke with large arguments

arg size new latency old latency new throughput old throughput
64KiB 83.4±6.49µs 79.7±8.05µs - -

Module: print bulk

line count new latency old latency new throughput old throughput
1 40.1±2.22µs 42.9±3.41µs - -
100 219.7±4.95µs 218.7±1.60µs - -
1000 1908.1±84.25µs 1899.8±120.47µs - -

Remaining benchmarks

name new latency old latency new throughput old throughput

@github-actions
Copy link

@github-actions github-actions bot commented on b7c8a08 Feb 7, 2024 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark results <title>502 Bad Gateway</title>

502 Bad Gateway

nginx

Please sign in to comment.