Test object_store 0.12.5 update

[alamb]

• Related to Release object store 0.12.5 (maintenance) - Target Dec 2025 arrow-rs-object-store#582

I am making a PR so I can run the DataFusion tests on the object store release candidate

I don't intend to merge this PR

[alamb]

run benchmarks

[alamb-ghbot]

🤖 ./gh_compare_branch.sh gh_compare_branch.sh Running
Linux aal-dev 6.14.0-1018-gcp #19~24.04.1-Ubuntu SMP Wed Sep 24 23:23:09 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Comparing alamb/test_object_store_update (88e373b) to 209a0a2 diff using: tpch_mem clickbench_partitioned clickbench_extended
Results will be posted here when complete

[alamb-ghbot]

🤖: Benchmark completed

Details

Comparing HEAD and alamb_test_object_store_update
--------------------
Benchmark clickbench_extended.json
--------------------
┏━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Query    ┃        HEAD ┃ alamb_test_object_store_update ┃    Change ┃
┡━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ QQuery 0 │  2377.60 ms │                     2360.91 ms │ no change │
│ QQuery 1 │   960.52 ms │                      920.38 ms │ no change │
│ QQuery 2 │  1915.15 ms │                     1914.24 ms │ no change │
│ QQuery 3 │  1126.38 ms │                     1118.38 ms │ no change │
│ QQuery 4 │  2209.44 ms │                     2201.84 ms │ no change │
│ QQuery 5 │ 28095.24 ms │                    28222.99 ms │ no change │
│ QQuery 6 │  4030.53 ms │                     3975.53 ms │ no change │
│ QQuery 7 │  2869.18 ms │                     2835.94 ms │ no change │
└──────────┴─────────────┴────────────────────────────────┴───────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                             ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                             │ 43584.04ms │
│ Total Time (alamb_test_object_store_update)   │ 43550.22ms │
│ Average Time (HEAD)                           │  5448.01ms │
│ Average Time (alamb_test_object_store_update) │  5443.78ms │
│ Queries Faster                                │          0 │
│ Queries Slower                                │          0 │
│ Queries with No Change                        │          8 │
│ Queries with Failure                          │          0 │
└───────────────────────────────────────────────┴────────────┘
--------------------
Benchmark clickbench_partitioned.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃        HEAD ┃ alamb_test_object_store_update ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 0  │     1.96 ms │                        1.97 ms │     no change │
│ QQuery 1  │    49.29 ms │                       48.41 ms │     no change │
│ QQuery 2  │   133.01 ms │                      132.88 ms │     no change │
│ QQuery 3  │   149.90 ms │                      153.92 ms │     no change │
│ QQuery 4  │  1071.27 ms │                     1087.47 ms │     no change │
│ QQuery 5  │  1354.41 ms │                     1351.04 ms │     no change │
│ QQuery 6  │     1.84 ms │                        1.84 ms │     no change │
│ QQuery 7  │    56.18 ms │                       53.46 ms │     no change │
│ QQuery 8  │  1421.00 ms │                     1433.67 ms │     no change │
│ QQuery 9  │  1692.79 ms │                     1778.39 ms │  1.05x slower │
│ QQuery 10 │   351.31 ms │                      347.57 ms │     no change │
│ QQuery 11 │   393.73 ms │                      399.99 ms │     no change │
│ QQuery 12 │  1256.57 ms │                     1271.11 ms │     no change │
│ QQuery 13 │  1905.94 ms │                     1972.62 ms │     no change │
│ QQuery 14 │  1218.49 ms │                     1227.70 ms │     no change │
│ QQuery 15 │  1208.26 ms │                     1200.97 ms │     no change │
│ QQuery 16 │  2535.27 ms │                     2535.89 ms │     no change │
│ QQuery 17 │  2481.19 ms │                     2495.42 ms │     no change │
│ QQuery 18 │  6042.31 ms │                     4781.91 ms │ +1.26x faster │
│ QQuery 19 │   118.94 ms │                      125.71 ms │  1.06x slower │
│ QQuery 20 │  2000.86 ms │                     1869.12 ms │ +1.07x faster │
│ QQuery 21 │  2272.69 ms │                     2185.18 ms │     no change │
│ QQuery 22 │  3857.90 ms │                     3752.26 ms │     no change │
│ QQuery 23 │ 12366.00 ms │                    12086.69 ms │     no change │
│ QQuery 24 │   215.02 ms │                      217.21 ms │     no change │
│ QQuery 25 │   473.13 ms │                      470.73 ms │     no change │
│ QQuery 26 │   218.25 ms │                      208.61 ms │     no change │
│ QQuery 27 │  2748.67 ms │                     2668.16 ms │     no change │
│ QQuery 28 │ 21958.55 ms │                    23473.01 ms │  1.07x slower │
│ QQuery 29 │   947.29 ms │                      989.06 ms │     no change │
│ QQuery 30 │  1279.82 ms │                     1259.25 ms │     no change │
│ QQuery 31 │  1338.08 ms │                     1314.96 ms │     no change │
│ QQuery 32 │  4471.19 ms │                     4405.46 ms │     no change │
│ QQuery 33 │  5741.44 ms │                     5229.43 ms │ +1.10x faster │
│ QQuery 34 │  5981.11 ms │                     5824.97 ms │     no change │
│ QQuery 35 │  1945.99 ms │                     1868.94 ms │     no change │
│ QQuery 36 │    67.77 ms │                       65.99 ms │     no change │
│ QQuery 37 │    45.34 ms │                       47.31 ms │     no change │
│ QQuery 38 │    66.52 ms │                       67.99 ms │     no change │
│ QQuery 39 │   106.28 ms │                      101.65 ms │     no change │
│ QQuery 40 │    28.87 ms │                       28.03 ms │     no change │
│ QQuery 41 │    24.12 ms │                       24.21 ms │     no change │
│ QQuery 42 │    20.97 ms │                       20.34 ms │     no change │
└───────────┴─────────────┴────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓
┃ Benchmark Summary                             ┃            ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩
│ Total Time (HEAD)                             │ 91619.53ms │
│ Total Time (alamb_test_object_store_update)   │ 90580.52ms │
│ Average Time (HEAD)                           │  2130.69ms │
│ Average Time (alamb_test_object_store_update) │  2106.52ms │
│ Queries Faster                                │          3 │
│ Queries Slower                                │          3 │
│ Queries with No Change                        │         37 │
│ Queries with Failure                          │          0 │
└───────────────────────────────────────────────┴────────────┘
--------------------
Benchmark tpch_mem_sf1.json
--------------------
┏━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓
┃ Query     ┃      HEAD ┃ alamb_test_object_store_update ┃        Change ┃
┡━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩
│ QQuery 1  │ 104.15 ms │                      104.57 ms │     no change │
│ QQuery 2  │  33.06 ms │                       33.01 ms │     no change │
│ QQuery 3  │  39.45 ms │                       39.26 ms │     no change │
│ QQuery 4  │  30.95 ms │                       30.87 ms │     no change │
│ QQuery 5  │  93.14 ms │                       91.83 ms │     no change │
│ QQuery 6  │  21.00 ms │                       20.65 ms │     no change │
│ QQuery 7  │ 160.81 ms │                      156.95 ms │     no change │
│ QQuery 8  │  41.87 ms │                       40.88 ms │     no change │
│ QQuery 9  │  97.65 ms │                      102.34 ms │     no change │
│ QQuery 10 │  68.98 ms │                       67.24 ms │     no change │
│ QQuery 11 │  18.69 ms │                       18.97 ms │     no change │
│ QQuery 12 │  53.09 ms │                       51.79 ms │     no change │
│ QQuery 13 │  49.75 ms │                       48.24 ms │     no change │
│ QQuery 14 │  15.30 ms │                       14.93 ms │     no change │
│ QQuery 15 │  30.32 ms │                       30.23 ms │     no change │
│ QQuery 16 │  29.28 ms │                       28.30 ms │     no change │
│ QQuery 17 │ 143.48 ms │                      147.63 ms │     no change │
│ QQuery 18 │ 296.51 ms │                      276.49 ms │ +1.07x faster │
│ QQuery 19 │  38.82 ms │                       41.29 ms │  1.06x slower │
│ QQuery 20 │  57.44 ms │                       56.27 ms │     no change │
│ QQuery 21 │ 188.63 ms │                      187.68 ms │     no change │
│ QQuery 22 │  22.15 ms │                       22.39 ms │     no change │
└───────────┴───────────┴────────────────────────────────┴───────────────┘
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Benchmark Summary                             ┃           ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ Total Time (HEAD)                             │ 1634.49ms │
│ Total Time (alamb_test_object_store_update)   │ 1611.82ms │
│ Average Time (HEAD)                           │   74.30ms │
│ Average Time (alamb_test_object_store_update) │   73.26ms │
│ Queries Faster                                │         1 │
│ Queries Slower                                │         1 │
│ Queries with No Change                        │        20 │
│ Queries with Failure                          │         0 │
└───────────────────────────────────────────────┴───────────┘