conbench-apache-arrow / Conbench performance report
succeeded
Jul 8, 2024 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit e8a795b.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-07-08 10:23:39Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-07-08 10:43:09Z - Commit Run on
test-mac-arm
at 2024-07-08 10:38:20Z - Commit Run on
arm64-t4g-linux-compute
at 2024-07-08 11:48:54Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ec2-c6a-4xlarge-us-east-2
at 2024-07-08 10:23:39ZBM_ReadColumnIndex
(C++) with params=/num_pages:512, source=cpp-micro, suite=parquet-page-index-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:512, source=cpp-micro, suite=parquet-page-index-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:1024, source=cpp-micro, suite=parquet-page-index-benchmarkBM_ReadColumnIndex
(C++) with params=/num_pages:1024, source=cpp-micro, suite=parquet-page-index-benchmark
-
Commit Run on
test-mac-arm
at 2024-07-08 10:38:20ZBM_DeltaBitPackingEncode_Int64_Fixed
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt16, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_PlainDecodingSpacedByteArray
(C++) with params=max-string-length:8/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_PlainDecodingSpacedBoolean
(C++) with params=32768/1, source=cpp-micro, suite=parquet-encoding-benchmarkMaxElementWiseArrayArrayInt64
(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkThreadedTaskGroup
(C++) with params=threads:1/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkFloatRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ByteStreamSplitEncode_FLBA_Generic
(C++) with params=<16>/1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ByteStreamSplitEncode_FLBA_Generic
(C++) with params=<7>/1024, source=cpp-micro, suite=parquet-encoding-benchmarkValidateLargeNonAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkBM_ArrowBinaryDict
(C++) with params=EncodeArrow/1048576, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ByteStreamSplitDecode_Float_Scalar
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkLruCacheLookup
(C++) with params=8/1024, source=cpp-micro, suite=arrow-cache-benchmarkInt8RowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_DeltaBitPackingEncode_Int32_Narrow
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ByteStreamSplitDecode_FLBA_Generic
(C++) with params=<7>/1024, source=cpp-micro, suite=parquet-encoding-benchmarkValidateSmallNonAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkValidateLargeAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkBM_DictEncodingInt64_repeats
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkTouchArea
(C++) with params=size:65536/real_time/threads:4, source=cpp-micro, suite=arrow-memory-pool-benchmarkBM_PlainEncodingBoolean
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_PlainEncodingBoolean
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkArrayRangeEqualsBoolean
(C++) with params=65536/0, source=cpp-micro, suite=arrow-compare-benchmarkDoubleRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceDecompression
(C++) with params=Compression::BROTLI, source=cpp-micro, suite=arrow-compression-benchmarkBM_ByteStreamSplitEncode_Float_Scalar
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=EncodeDictDirectInt32/1048576, source=cpp-micro, suite=parquet-encoding-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt8, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceDecompression
(C++) with params=Compression::GZIP, source=cpp-micro, suite=arrow-compression-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ReadListOfStructColumn
(C++) with params=50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkMaxElementWiseArrayScalarInt64
(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceStreamingDecompression
(C++) with params=Compression::BROTLI, source=cpp-micro, suite=arrow-compression-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceStreamingCompression
(C++) with params=Compression::BROTLI, source=cpp-micro, suite=arrow-compression-benchmarkShortVectorPushBack
(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ByteStreamSplitEncode_Float_Generic
(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt16, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_RleEncodingBoolean
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkInt8StridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkValidateTinyAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkBM_DecodeArrowBooleanRle
(C++) with params=DecodeArrow/32768, source=cpp-micro, suite=parquet-encoding-benchmarkChunkCSVQuotedBlock
(C++) with source=cpp-micro, suite=arrow-csv-parser-benchmarkBM_ByteStreamSplitDecode_FLBA_Generic
(C++) with params=<16>/65536, source=cpp-micro, suite=parquet-encoding-benchmarkLruCacheLookup
(C++) with params=64/16, source=cpp-micro, suite=arrow-cache-benchmarkFloatRowMajorTensorConversionFixture
(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkValidateLargeAlmostAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkBM_ByteStreamSplitDecode_FLBA_Generic
(C++) with params=<16>/1024, source=cpp-micro, suite=parquet-encoding-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceCompression
(C++) with params=Compression::LZ4_FRAME, source=cpp-micro, suite=arrow-compression-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkValidateTinyNonAscii
(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkFloatRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ByteStreamSplitDecode_FLBA_Generic
(C++) with params=<2>/1024, source=cpp-micro, suite=parquet-encoding-benchmarkInt8RowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_RleEncodingBoolean
(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkLruCacheLookup
(C++) with params=8/16, source=cpp-micro, suite=arrow-cache-benchmarkBM_DeltaBitPackingEncode_Int64_Narrow
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ReadStructOfListColumn
(C++) with params=50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBM_ReadStructColumn
(C++) with params=50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBM_PlainDecodingByteArray
(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DecodeArrowBooleanPlain
(C++) with params=DecodeArrowWithNull/num_values:65536/null_in_ten_thousand:10000, source=cpp-micro, suite=parquet-encoding-benchmarkFloatStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleRowMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkDoubleColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkFloatColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkReferenceCompression
(C++) with params=Compression::BROTLI, source=cpp-micro, suite=arrow-compression-benchmarkBM_DictEncodingInt64_repeats
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ArrowBinaryDict
(C++) with params=EncodeLowLevel/1048576, source=cpp-micro, suite=parquet-encoding-benchmarkReferenceDecompression
(C++) with params=Compression::LZ4, source=cpp-micro, suite=arrow-compression-benchmarkDoubleStridedMatrixConversionFixture
(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_DictEncodingInt64_repeats
(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ReadStructOfStructColumn
(C++) with params=1, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBM_ReadStructOfStructColumn
(C++) with params=0, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBM_PlainDecodingSpacedByteArray
(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkInt8ColumnMajorMatrixConversionFixture
(C++) with params=/ConvertToSparseCSRMatrixInt8, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_DeltaBitPackingEncode_Int64_Fixed
(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmark
-
Commit Run on
arm64-t4g-linux-compute
at 2024-07-08 11:48:54ZHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkIntegerParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkIntegerParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkHexParsing
(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading