conbench-apache-arrow / Conbench performance report
failed
Mar 26, 2025 in 0s
Found 62 regressions
Thanks for your patience. Conbench analyzed the 4 benchmarking runs that have been run so far on PR commit d6fa8e4.
Benchmarks with performance regressions
There were 62 possible performance regressions, according to the lookback z-score method.
Benchmarks with regressions:
-
Pull Request Run on
amd64-m5-4xlarge-linuxat 2025-03-26 13:34:48ZBitBlockCounterBench(C++) with params=1032192, source=cpp-micro, suite=arrow-bitmap-reader-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkHexParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkConstructFromShortStdVector(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkAllocateTouchDeallocate(C++) with params=/size:1048576/real_time/threads:4, source=cpp-micro, suite=arrow-memory-pool-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBinaryMathOpAdd128(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkBitRunReaderLinear(C++) with params=60, source=cpp-micro, suite=arrow-bit-util-benchmarkErrorSchemeStatusNoInline(C++) with source=cpp-micro, suite=arrow-type-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkGenerateBitsUnrolled(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkShortVectorPushBack(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkGenerateBits(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkMoveEmptyVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkHexParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkMoveEmptyVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkErrorSchemeExceptionNoInline(C++) with source=cpp-micro, suite=arrow-type-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkReferenceNaiveBitmapWriter(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkBitRunReaderLinear(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmarkLongVectorPushBack(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkHexParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkAllocateTouchDeallocate(C++) with params=/size:16777216/real_time/threads:1, source=cpp-micro, suite=arrow-memory-pool-benchmarkMoveEmptyVector(C++) with params=<SMALL_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkAllocateTouchDeallocate(C++) with params=/size:1048576/real_time/threads:1, source=cpp-micro, suite=arrow-memory-pool-benchmarkReverseSetBitRunReader(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkAllocateTouchDeallocate(C++) with params=/size:1048576/real_time/threads:2, source=cpp-micro, suite=arrow-memory-pool-benchmark
-
Pull Request Run on
arm64-t4g-2xlarge-linuxat 2025-03-26 13:49:19ZReferenceCompression(C++) with params=Compression::LZ4_FRAME, source=cpp-micro, suite=arrow-compression-benchmarkReferenceStreamingDecompression(C++) with params=Compression::GZIP, source=cpp-micro, suite=arrow-compression-benchmarkReferenceCompression(C++) with params=Compression::SNAPPY, source=cpp-micro, suite=arrow-compression-benchmarkReferenceDecompression(C++) with params=Compression::LZ4, source=cpp-micro, suite=arrow-compression-benchmarkReferenceCompression(C++) with params=Compression::LZ4, source=cpp-micro, suite=arrow-compression-benchmarkBitRunReaderLinear(C++) with params=-1, source=cpp-micro, suite=arrow-bit-util-benchmark
-
Pull Request Run on
amd64-c6a-4xlarge-linuxat 2025-03-26 13:25:44ZMoveEmptyVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsertAtEnd(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkReverseSetBitRunReader(C++) with params=0, source=cpp-micro, suite=arrow-bit-util-benchmarkBinaryMathOpAdd128(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkValidateTinyNonAscii(C++) with source=cpp-micro, suite=arrow-utf8-util-benchmarkErrorSchemeExceptionNoInline(C++) with source=cpp-micro, suite=arrow-type-benchmarkCopyEmptyVector(C++) with params=<SMALL_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsert(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveEmptyVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorInsertAtEnd(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkMoveShortVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STD_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkBM_ByteStreamSplitEncode_Float_Scalar(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkCopyEmptyVector(C++) with params=<STD_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkHexParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkShortVectorInsertAtEnd(C++) with params=<STATIC_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkExecuteScalarExpressionBaseline(C++) with params=/rows_per_batch:1000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkCopyEmptyVector(C++) with params=<STATIC_VECTOR(std::string)>, source=cpp-micro, suite=arrow-small-vector-benchmarkConstructFromEmptyStdVector(C++) with params=<STATIC_VECTOR(std::shared_ptr)>, source=cpp-micro, suite=arrow-small-vector-benchmarkShortVectorPushBack(C++) with params=<SMALL_VECTOR(int)>, source=cpp-micro, suite=arrow-small-vector-benchmarkExecuteScalarExpressionBaseline(C++) with params=/rows_per_batch:10000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmark
All benchmark runs analyzed:
- Pull Request Run on
amd64-m5-4xlarge-linuxat 2025-03-26 13:34:48Z - Pull Request Run on
arm64-t4g-2xlarge-linuxat 2025-03-26 13:49:19Z - Pull Request Run on
amd64-c6a-4xlarge-linuxat 2025-03-26 13:25:44Z - Pull Request Run on
test-mac-armat 2025-03-26 13:48:22Z
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading