conbench-apache-arrow / Conbench performance report
succeeded
Apr 15, 2025 in 0s
Found 0 regressions
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 72c246a.
Benchmarks with performance regressions
There were 0 possible performance regressions, according to the lookback z-score method.
All benchmark runs analyzed:
- Commit Run on
amd64-c6a-4xlarge-linuxat 2025-04-14 21:19:24Z - Commit Run on
arm64-t4g-2xlarge-linuxat 2025-04-14 21:41:56Z - Commit Run on
test-mac-armat 2025-04-14 21:38:44Z - Commit Run on
amd64-m5-4xlarge-linuxat 2025-04-14 21:37:47Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
arm64-t4g-2xlarge-linuxat 2025-04-14 21:41:56ZBitBlockCounterFourWordsSum(C++) with params=512, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBitBlockCounterSumWithOffset(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBitBlockCounterSumWithOffset(C++) with params=8, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBitBlockCounterFourWordsSumWithOffset(C++) with params=32768, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBitBlockCounterFourWordsSumWithOffset(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBitBlockCounterSumWithOffset(C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmark
-
Commit Run on
amd64-m5-4xlarge-linuxat 2025-04-14 21:37:47ZArrayArrayKernel(C++) with params=<AddChecked, Int16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkIndexInInt64SmallSet(C++) with params=4, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, UInt16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt16Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/100/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesBool(C++) with params=32768/10, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBuildInlineBinaryViewArray(C++) with source=cpp-micro, suite=arrow-builder-benchmarkArrayRankInt64Narrow(C++) with params=32768/10/tiebreaker:0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayRankInt64Narrow(C++) with params=32768/100/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt32Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/10000/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBuildBinaryArray(C++) with source=cpp-micro, suite=arrow-builder-benchmarkArrayRankInt64Narrow(C++) with params=32768/0/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, Int16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankStringNarrow(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBuildStringDictionaryArray(C++) with source=cpp-micro, suite=arrow-builder-benchmarkArrayArrayKernel(C++) with params=<AddChecked, Int32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Wide(C++) with params=32768/1/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayRankInt64Narrow(C++) with params=32768/10/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, UInt64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkIsInInt8SmallSet(C++) with params=8, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, Int16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBuildFixedSizeBinaryArray(C++) with source=cpp-micro, suite=arrow-builder-benchmarkBuildAdaptiveIntNoNullsScalarAppend(C++) with source=cpp-micro, suite=arrow-builder-benchmarkIndexInInt16SmallSet(C++) with params=4, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArraySortIndicesBool(C++) with params=32768/10000, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, Int64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/10/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, Int64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkIsInInt16SmallSet(C++) with params=64, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayArrayKernel(C++) with params=<AddChecked, Int64Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/10000/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesBool(C++) with params=8388608/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, Int8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/1/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayRankInt64Wide(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt64Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkIsInInt8SmallSet(C++) with params=4, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, Int32Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, UInt32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRangeEqualsSparseUnion(C++) with params=32768/0, source=cpp-micro, suite=arrow-compare-benchmarkFieldPathGetFromWideBatch(C++) with source=cpp-micro, suite=arrow-type-benchmarkArrayArrayKernel(C++) with params=<Divide, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<AddChecked, Int32Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<AddChecked, Int8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArraySortIndicesBool(C++) with params=32768/2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<Divide, UInt32Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayDataConstructDestruct(C++) with source=cpp-micro, suite=arrow-builder-benchmarkBuildInt64DictionaryArrayRandom(C++) with source=cpp-micro, suite=arrow-builder-benchmarkBM_CastDispatchBaseline(C++) with source=cpp-micro, suite=arrow-compute-function-benchmarkArrayRankInt64Narrow(C++) with params=32768/100/tiebreaker:0, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt64Type>/size:1048576/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel(C++) with params=<SubtractChecked, UInt16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/0/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt8Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkExecuteScalarExpressionOverhead(C++) with params=ref_only_expression/rows_per_batch:1000/real_time/threads:1, source=cpp-micro, suite=arrow-acero-expression-benchmarkArrayRankStringWide(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesInt64Narrow(C++) with params=1048576/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayRankInt64Narrow(C++) with params=1048576/100/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkTypeEqualsComplex(C++) with source=cpp-micro, suite=arrow-type-benchmarkArrayRankStringNarrow(C++) with params=32768/1/tiebreaker:3, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArrayArrayKernel(C++) with params=<AddChecked, UInt16Type>/size:1048576/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayRankInt64Narrow(C++) with params=32768/1/tiebreaker:2, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkArraySortIndicesBool(C++) with params=32768/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkIsInInt8SmallSet(C++) with params=2, source=cpp-micro, suite=arrow-compute-scalar-set-lookup-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading