Found 0 regressions
After merging your PR, Conbench analyzed the 8 benchmarking runs that have been run so far on merge-commit 4413110.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-06-18 02:10:32Z - Commit Run on
ec2-r5-4xlarge-us-east-2
at 2024-06-18 04:43:45Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-06-18 03:08:29Z - Commit Run on
ursa-thinkcentre-m75q
at 2024-06-18 05:40:38Z - Commit Run on
arm64-t4g-linux-compute
at 2024-06-18 10:01:45Z - Commit Run on
arm64-m6g-linux-compute
at 2024-06-18 10:23:17Z - Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-06-18 11:23:54Z - Commit Run on
test-mac-arm
at 2024-06-18 13:10:22Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-06-18 02:10:32ZBenchmarkTemporalBinary
(C++) with params=<DaysBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkCoalesceScalarStringBench
(C++) with params=6, source=cpp-micro, suite=arrow-compute-scalar-if-else-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:64, source=cpp-micro, suite=parquet-page-index-benchmarkCoalesceScalarStringBench
(C++) with params=0, source=cpp-micro, suite=arrow-compute-scalar-if-else-benchmarkBenchmarkTemporalBinary
(C++) with params=<HoursBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:512, source=cpp-micro, suite=parquet-page-index-benchmarkBenchmarkTemporalBinary
(C++) with params=<MinutesBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBenchmarkTemporalBinary
(C++) with params=<SecondsBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:64, source=cpp-micro, suite=parquet-page-index-benchmarkBenchmarkTemporalBinary
(C++) with params=<MicrosecondsBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:1024, source=cpp-micro, suite=parquet-page-index-benchmarkBenchmarkTemporalBinary
(C++) with params=<MillisecondsBetween, zoned>/524288/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:1024, source=cpp-micro, suite=parquet-page-index-benchmarkTakeChunkedChunkedStringMonotonicIndices
(C++) with params=524288/1, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:512, source=cpp-micro, suite=parquet-page-index-benchmarkExportType
(C++) with source=cpp-micro, suite=arrow-bridge-benchmark
-
Commit Run on
ursa-thinkcentre-m75q
at 2024-06-18 05:40:38Z -
Commit Run on
arm64-t4g-linux-compute
at 2024-06-18 10:01:45Z -
Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-06-18 11:23:54ZFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:1000000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkAllocateTouchDeallocate
(C++) with params=/size:1048576/real_time/threads:1, source=cpp-micro, suite=arrow-memory-pool-benchmarkBM_DeltaBitPackingDecode_Int64_Fixed
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkExecuteScalarExpressionOverhead
(C++) with params=ref_only_expression/rows_per_batch:1000000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkTouchArea
(C++) with params=size:1048576/real_time/threads:2, source=cpp-micro, suite=arrow-memory-pool-benchmarkBitRunReader
(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkBitBlockCounterFourWordsSum
(C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkArrayRangeEqualsInt32
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compare-benchmarkReferenceCompression
(C++) with params=Compression::ZSTD, source=cpp-micro, suite=arrow-compression-benchmarkRoundArrayBenchmark
(C++) with params=<Round, UInt64Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkGreaterArrayArrayString
(C++) with params=32768/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkTableSortIndicesInt64Narrow
(C++) with params=1048576/0/16/4, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBM_ByteStreamSplitDecode_Float_Generic
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkFilterStringFilterWithNulls
(C++) with params=1048576/5, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkTakeFixedSizeBinaryRandomIndicesWithNulls
(C++) with params=1048576/1/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkGrouperWithMultiTypes
(C++) with params="{int32, boolean, utf8}"/4096/100, source=cpp-micro, suite=arrow-compute-grouper-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkFilterFixedSizeBinaryFilterNoNulls
(C++) with params=1048576/8/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporalRounding
(C++) with params=<RoundTemporal, zoned, round_10_month>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterOverheadIsolated
(C++) with params=complex_expression/batch_size:1000/null_prob:0/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkCopyEmptyVector
(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkGrouperWithMultiTypes
(C++) with params="{int32, boolean, utf8}"/4096/10000, source=cpp-micro, suite=arrow-compute-grouper-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:8/batch-size:2048/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkSerialTaskGroup
(C++) with params=task_cost:1000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkArrayRankInt64Wide
(C++) with params=32768/100/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkTrimSingleAscii
(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkArrayScalarKernel
(C++) with params=<DivideChecked, UInt32Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkRoundBinaryArrayBenchmark
(C++) with params=<RoundBinary, UInt32Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkMoveEmptyVector
(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMaxElementWiseArrayScalarString
(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBM_DictEncodingInt64_literals
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkGrouperWithMultiTypes
(C++) with params="{int32}"/4096/0, source=cpp-micro, suite=arrow-compute-grouper-benchmarkTakeFixedSizeBinaryRandomIndicesWithNulls
(C++) with params=1048576/0/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:1000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkArrayArrayKernel
(C++) with params=<MultiplyChecked, Int16Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_BatchComputeHash
(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkBinaryMathOpDivide128
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkBM_RleEncodingBoolean
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkMoveEmptyVector
(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkUniqueUInt8
(C++) with params=3, source=cpp-micro, suite=arrow-compute-vector-hash-benchmarkReadUncachedFile
(C++) with params=num_cols:1/is_partial:0/real_time, source=cpp-micro, suite=arrow-ipc-read-write-benchmarkChunkedArraySortIndicesInt64Narrow
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkFilterOverhead
(C++) with params=not_null_to_is_true_multipass_benchmark/batch_size:10000/null_prob:50/bool_true_prob:50/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkRoundArrayBenchmark
(C++) with params=<Round, UInt64Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkFilterOverhead
(C++) with params=not_null_and_is_true_singlepass_benchmark/batch_size:10000/null_prob:25/bool_true_prob:33/real_time, source=cpp-micro, suite=arrow-acero-filter-benchmarkBinaryBitOp
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkReferenceStreamingCompression
(C++) with params=Compression::ZSTD, source=cpp-micro, suite=arrow-compression-benchmarkBM_DeltaBitPackingDecode_Int64_Narrow
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkCastInt64ToInt32Unsafe
(C++) with params=1048576/0, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkSelectKInt64
(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-vector-topk-benchmarkBM_RleEncodingSpacedBoolean
(C++) with params=32768/10000, source=cpp-micro, suite=parquet-encoding-benchmarkBM_RleEncodingSpacedBoolean
(C++) with params=32768/5000, source=cpp-micro, suite=parquet-encoding-benchmarkArrayArrayKernel
(C++) with params=<DivideChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkGrouperWithMultiTypes
(C++) with params="{int32, int64, boolean, utf8}"/1024/10000, source=cpp-micro, suite=arrow-compute-grouper-benchmarkBM_DeltaEncodingByteArray
(C++) with params=max-string-length:8/batch-size:2048/prefixed-percent:99, source=cpp-micro, suite=parquet-encoding-benchmarkArraySortIndicesStringNarrow
(C++) with params=32768/1, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayScalarKernel
(C++) with params=<Divide, FloatType>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBinaryBitmapReaderSum
(C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkArrayScalarKernel
(C++) with params=<SubtractChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_ArrowBinaryDict
(C++) with params=DecodeArrow_Dense/1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkArrayArrayKernel
(C++) with params=<Multiply, FloatType>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBenchmarkTemporalBinary
(C++) with params=<MicrosecondsBetween, non_zoned>/1048576/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkGrouperWithMultiTypes
(C++) with params="{int32}"/1024/10, source=cpp-micro, suite=arrow-compute-grouper-benchmarkRoundBinaryArrayBenchmark
(C++) with params=<RoundBinary, UInt32Type, RoundMode::HALF_TO_ODD>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkWriteCsvStringWithQuote
(C++) with params=0, source=cpp-micro, suite=arrow-csv-writer-benchmarkGrouperWithMultiTypes
(C++) with params="{boolean, utf8}"/4096/0, source=cpp-micro, suite=arrow-compute-grouper-benchmarkArrayScalarKernel
(C++) with params=<MultiplyChecked, Int32Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkShortVectorPushBack
(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkmemory_latency
(C++) with params=262144/repeats:1, source=cpp-micro, suite=arrow-machine-benchmarkRoundArrayBenchmark
(C++) with params=<Round, UInt64Type, RoundMode::HALF_TOWARDS_ZERO>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkProjectionOverheadIsolated
(C++) with params=complex_expression/batch_size:10000/real_time, source=cpp-micro, suite=arrow-acero-project-benchmarkArrayArrayKernel
(C++) with params=<Divide, Int64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkCastUInt32ToInt32Safe
(C++) with params=1048576/1000, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkArrayRankStringWide
(C++) with params=32768/10/tiebreaker:0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkReferenceWorkloadCost
(C++) with params=task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkCopyShortVector
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkGreaterArrayArrayString
(C++) with params=32768/0, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkArrayRangeEqualsInt32
(C++) with params=32768/10, source=cpp-micro, suite=arrow-compare-benchmarkRoundBinaryArrayBenchmark
(C++) with params=<RoundBinary, FloatType, RoundMode::HALF_TOWARDS_ZERO>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkAllocateDeallocate
(C++) with params=/size:16777216/real_time/threads:32, source=cpp-micro, suite=arrow-memory-pool-benchmarkArrayRankInt64Wide
(C++) with params=32768/100/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkCastDoubleToInt32Safe
(C++) with params=1048576/1, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkBM_DeltaBitPackingEncode_Int64_Fixed
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBitBlockCounterFourWordsSum
(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkRoundArrayBenchmark
(C++) with params=<Round, Int64Type, RoundMode::DOWN>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkGreaterArrayScalarString
(C++) with params=32768/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBM_DecodeArrowBooleanRle
(C++) with params=DecodeArrowWithNull/num_values:4096/null_in_ten_thousand:5000, source=cpp-micro, suite=parquet-encoding-benchmarkParseJSONFields
(C++) with params=ordered:1/schema:0/sparsity:90/num_fields:10, source=cpp-micro, suite=arrow-json-parser-benchmarkBM_PlainDecodingInt64
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkStrptime
(C++) with params=/1048576/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_ExecuteScalarKernelOnScalar
(C++) with source=cpp-micro, suite=arrow-compute-function-benchmarkArrayArrayKernel
(C++) with params=/1048576/10, source=cpp-micro, suite=arrow-compute-scalar-boolean-benchmarkBatchToTensorSimple
(C++) with params=/size:1048576/num_columns:3, source=cpp-micro, suite=arrow-tensor-benchmark
-
Commit Run on
test-mac-arm
at 2024-06-18 13:10:22ZCheckIndexBoundsInt32
(C++) with params=65536/0, source=cpp-micro, suite=arrow-int-util-benchmarkArrayScalarKernel
(C++) with params=<Subtract, Int16Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkCheckIndexBoundsUInt32
(C++) with params=4194304/1, source=cpp-micro, suite=arrow-int-util-benchmarkCheckIndexBoundsInt32
(C++) with params=65536/1000, source=cpp-micro, suite=arrow-int-util-benchmarkCheckIndexBoundsInt32
(C++) with params=4194304/1, source=cpp-micro, suite=arrow-int-util-benchmarkBM_PlainEncodingFloat
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkGrouperWithMultiTypes
(C++) with params="{utf8, int32, int64, fixed_size_binary(32), boolean}"/4096/1, source=cpp-micro, suite=arrow-compute-grouper-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.