conbench-apache-arrow / Conbench performance report
succeeded
May 1, 2024
Found 0 regressions
After merging your PR, Conbench analyzed the 7 benchmarking runs that have been run so far on merge-commit 0ef7351.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
test-mac-arm
at 2024-04-30 19:21:56Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-04-30 19:12:57Z - Commit Run on
ursa-thinkcentre-m75q
at 2024-04-30 19:09:56Z - Commit Run on
ursa-i9-9960x
at 2024-04-30 18:25:02Z - Commit Run on
arm64-t4g-linux-compute
at 2024-04-30 19:41:57Z - Commit Run on
arm64-m6g-linux-compute
at 2024-04-30 18:27:38Z - Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-04-30 23:36:34Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
test-mac-arm
at 2024-04-30 19:21:56ZBM_RleDecoding
(C++) with params=65536/16, source=cpp-micro, suite=parquet-column-io-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_RleDecoding
(C++) with params=32768/16, source=cpp-micro, suite=parquet-column-io-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_RleDecoding
(C++) with params=4096/16, source=cpp-micro, suite=parquet-column-io-benchmarkArrayArrayKernel
(C++) with params=<Add, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkGreaterArrayScalarString
(C++) with params=65536/0, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkAllocateTouchDeallocate
(C++) with params=/size:65536/real_time/threads:4, source=cpp-micro, suite=arrow-memory-pool-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkGreaterArrayScalarString
(C++) with params=65536/100, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_RleDecoding
(C++) with params=1024/16, source=cpp-micro, suite=parquet-column-io-benchmarkGreaterArrayScalarString
(C++) with params=65536/10000, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkTouchArea
(C++) with params=size:65536/real_time/threads:4, source=cpp-micro, suite=arrow-memory-pool-benchmarkArrayArrayKernel
(C++) with params=<Add, UInt8Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
-
Commit Run on
ursa-thinkcentre-m75q
at 2024-04-30 19:09:56ZValidateSmallAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int8Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_DeltaBitPackingEncode_Int64_Wide
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkExecuteScalarExpressionOverhead
(C++) with params=simple_expression/rows_per_batch:100000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkArrayScalarKernel
(C++) with params=<Subtract, UInt64Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Add, Int8Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int32Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, UInt64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Multiply, FloatType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int64Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_DeltaBitPackingEncode_Int64_Wide
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<Multiply, UInt16Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Multiply, UInt64Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkUniqueString100bytes
(C++) with params=6, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkBM_DeltaBitPackingEncode_Int64_Wide
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<Multiply, UInt64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkUniqueString10bytes
(C++) with params=13, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Trunc, FloatType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkArrayScalarKernel
(C++) with params=<Multiply, FloatType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Add, UInt64Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Add, Int64Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, UInt16Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int8Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkUniqueString100bytes
(C++) with params=13, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkArrayScalarKernel
(C++) with params=<Add, Int64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, Int16Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int32Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Trunc, FloatType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkArrayScalarKernel
(C++) with params=<Add, Int8Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Add, UInt64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<Subtract, UInt16Type>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
-
Commit Run on
arm64-t4g-linux-compute
at 2024-04-30 19:41:57ZCheckIndexBoundsUInt32
(C++) with params=65536/1, source=cpp-micro, suite=arrow-int-util-benchmarkGreaterArrayScalarString
(C++) with params=65536/10, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkGreaterArrayScalarString
(C++) with params=65536/100, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkGreaterArrayScalarString
(C++) with params=65536/10000, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkCheckIndexBoundsUInt32
(C++) with params=65536/1000, source=cpp-micro, suite=arrow-int-util-benchmarkCheckIndexBoundsUInt32
(C++) with params=65536/0, source=cpp-micro, suite=arrow-int-util-benchmarkCheckIndexBoundsUInt32
(C++) with params=1048576/0, source=cpp-micro, suite=arrow-int-util-benchmarkDetectUIntWidthNulls
(C++) with source=cpp-micro, suite=arrow-int-util-benchmarkGreaterArrayScalarString
(C++) with params=65536/0, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkGreaterArrayScalarString
(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkGreaterArrayScalarString
(C++) with params=65536/2, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkReferenceWorkloadCost
(C++) with params=task_cost:1000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkCheckIndexBoundsUInt32
(C++) with params=1048576/1000, source=cpp-micro, suite=arrow-int-util-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading