Repository navigation
GH-50566: [C++] Introduce simdjson and migrate ObjectParser (#50469)
conbench-apache-arrow / Conbench performance report
failed
Jul 21, 2026 in 0s
Found 1 regression
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 9ec3aca.
Benchmarks with performance regressions
There was 1 possible performance regression, according to the lookback z-score method.
Benchmarks with regressions:
- Commit Run on
test-mac-armat 2026-07-21 12:32:03Z
All benchmark runs analyzed:
- Commit Run on
amd64-c6a-4xlarge-linuxat 2026-07-21 03:00:46Z - Commit Run on
test-mac-armat 2026-07-21 12:32:03Z - Commit Run on
amd64-m5-4xlarge-linuxat 2026-07-21 04:12:38Z - Commit Run on
arm64-t4g-2xlarge-linuxat 2026-07-21 04:18:26Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
amd64-c6a-4xlarge-linuxat 2026-07-21 03:00:46ZCopyBitmapWithoutOffset(C++) with params=8192, source=cpp-micro, suite=arrow-bit-util-benchmarkBM_UnpackUint32(C++) with params=ScalarUnaligned/1/256, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint64(C++) with params=DynamicUnaligned/8/128, source=cpp-micro, suite=arrow-bpacking-benchmarkDoubleRowMajorMatrixConversionFixture(C++) with params=/ConvertToSparseCSCMatrixInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_UnpackUint64(C++) with params=DynamicUnaligned/2/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint32(C++) with params=Sse42Unaligned/8/256, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/8/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint64(C++) with params=Sse42Unaligned/8/128, source=cpp-micro, suite=arrow-bpacking-benchmarkInt8RowMajorMatrixConversionFixture(C++) with params=/ConvertToSparseCSCMatrixInt64, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBenchmarkTemporalRounding(C++) with params=<FloorTemporal, non_zoned, round_10_week>/524288/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/2/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint32(C++) with params=Sse42Unaligned/1/256, source=cpp-micro, suite=arrow-bpacking-benchmark
-
Commit Run on
test-mac-armat 2026-07-21 12:32:03ZBM_UnpackUint32(C++) with params=DynamicAligned/2/512, source=cpp-micro, suite=arrow-bpacking-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, UInt8Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkTakeFixedSizeBinaryMonotonicIndices(C++) with params=4194304/1000/8, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkTakeChunkedFlatInt64FewMonotonicIndices(C++) with params=4194304/10, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkGreaterArrayScalarInt64(C++) with params=65536/10, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkReferenceWorkloadCost(C++) with params=task_cost:1000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthDayNanoBetween, time64_type>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_RowArray_DecodeOneOfColumns(C++) with params="fixed_length_row:{boolean,int32,fixed_size_binary(64)}"/column:0, source=cpp-micro, suite=arrow-acero-hash-join-benchmarkTakeChunkedFlatInt64RandomIndicesNoNulls(C++) with params=4194304/1, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBenchmarkTemporalBinary(C++) with params=<WeeksBetween, non_zoned>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBM_PlainDecodingSpacedByteArray(C++) with params=max-string-length:64/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkBM_ReadInt64Column(C++) with params=<Repetition::OPTIONAL, Compression::SNAPPY>/65536/1024, source=cpp-micro, suite=parquet-column-io-benchmarkDoubleStridedTensorConversionFixture(C++) with params=/ConvertToSparseCOOTensorInt32, source=cpp-micro, suite=arrow-tensor-conversion-benchmarkBM_ReadColumn(C++) with params=<false,Int64Type>/-1/10, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBM_ReadInt64Column(C++) with params=<Repetition::REPEATED, Compression::LZ4>/65536/1024, source=cpp-micro, suite=parquet-column-io-benchmarkBM_UnpackUint16(C++) with params=ScalarUnaligned/13/64, source=cpp-micro, suite=arrow-bpacking-benchmarkArrayScalarKernel(C++) with params=<SubtractChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkMatchLike(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBM_UnpackUint16(C++) with params=ScalarUnaligned/2/64, source=cpp-micro, suite=arrow-bpacking-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBM_ReadInt64Column(C++) with params=<Repetition::REQUIRED, Compression::LZ4>/65536/1024, source=cpp-micro, suite=parquet-column-io-benchmarkBM_RleEncoding(C++) with params=65536/1, source=cpp-micro, suite=parquet-column-io-benchmarkTrimManyUtf8(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkTakeStringMonotonicIndices(C++) with params=4194304/10, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBM_RleEncoding(C++) with params=1024/1, source=cpp-micro, suite=parquet-column-io-benchmarkReferenceWorkloadCost(C++) with params=task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_UnpackBool(C++) with params=NeonUnaligned/0/64, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_RleEncodingBoolean(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DictEncodingInt64_repeats(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthDayNanoBetween, date64_type>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkArraySortIndicesBool(C++) with params=8388608/100, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthDayNanoBetween, date64_type>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkIntegerParsing(C++) with params=, source=cpp-micro, suite=arrow-value-parsing-benchmarkBM_DeltaBitPackingEncode_Int32_Wide(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkTrimSingleAscii(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmarkThreadedTaskGroup(C++) with params=threads:4/task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkResolveManyUInt16Sorted(C++) with params=chunked_array_length:65535/num_chunks:100/num_indices:508, source=cpp-micro, suite=arrow-chunk-resolver-benchmarkBM_DeltaDecodingByteArray(C++) with params=max-string-length:8/batch-size:512/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaBitPackingEncode_Int32_Fixed(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackBool(C++) with params=DynamicUnaligned/1/32, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint64(C++) with params=NeonUnaligned/1/256, source=cpp-micro, suite=arrow-bpacking-benchmarkBenchmarkTemporalBinary(C++) with params=<WeeksBetween, date32_type>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBitBlockCounterSum(C++) with params=65536, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBM_UnpackUint32(C++) with params=DynamicUnaligned/2/512, source=cpp-micro, suite=arrow-bpacking-benchmarkBitBlockCounterSum(C++) with params=4096, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBM_ReadInt64Column(C++) with params=<Repetition::OPTIONAL, Compression::LZ4>/65536/1024, source=cpp-micro, suite=parquet-column-io-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/8/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_HashJoinBasic_ProbeParallelism(C++) with params=Threads:1/HashTable krows:4096/process_time, source=cpp-micro, suite=arrow-acero-hash-join-benchmarkTableSortIndicesInt64Wide(C++) with params=1048576/4/1/1, source=cpp-micro, suite=arrow-compute-vector-sort-benchmarkThreadedTaskGroup(C++) with params=threads:1/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_UnpackUint32(C++) with params=ScalarUnaligned/8/512, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/1/64, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_ReadColumn(C++) with params=<false,Int64Type>/-1/50, source=cpp-micro, suite=parquet-arrow-reader-writer-benchmarkBenchmarkTemporalBinary(C++) with params=<MonthDayNanoBetween, time64_type>/4194304/0, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkFilterStringFilterNoNulls(C++) with params=4194304/6, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkBM_PlainDecodingSpacedByteArray(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/1/32, source=cpp-micro, suite=arrow-bpacking-benchmarkGreaterArrayScalarInt64(C++) with params=65536/100, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkGreaterArrayScalarInt64(C++) with params=65536/2, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBM_DeltaBitPackingEncode_Int64_Fixed(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkFilterStringFilterNoNulls(C++) with params=4194304/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkGrouperWithMultiTypes(C++) with params="{boolean}"/4096/10, source=cpp-micro, suite=arrow-compute-grouper-benchmarkTakeChunkedChunkedFSBMonotonicIndices(C++) with params=4194304/0/9, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkResolveManyUInt32Sorted(C++) with params=chunked_array_length:65535/num_chunks:100/num_indices:32764, source=cpp-micro, suite=arrow-chunk-resolver-benchmarkBM_DictEncodingInt64_repeats(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkThreadedTaskGroup(C++) with params=threads:2/task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_UnpackBool(C++) with params=NeonUnaligned/1/64, source=cpp-micro, suite=arrow-bpacking-benchmarkGreaterArrayScalarString(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkThreadedTaskGroup(C++) with params=threads:1/task_cost:1000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/2/128, source=cpp-micro, suite=arrow-bpacking-benchmarkCastInt64ToInt32Safe(C++) with params=4194304/10, source=cpp-micro, suite=arrow-compute-scalar-cast-benchmarkBM_UnpackBool(C++) with params=NeonUnaligned/1/32, source=cpp-micro, suite=arrow-bpacking-benchmarkAsOfJoinOverhead(C++) with params=left_freq:400/left_cols:20/left_ids:1000/batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:1000/real_time, source=cpp-micro, suite=arrow-acero-asof-join-benchmarkBenchmarkTemporalBinary(C++) with params=<WeeksBetween, date64_type>/4194304/100, source=cpp-micro, suite=arrow-compute-scalar-temporal-benchmarkBM_UnpackBool(C++) with params=NeonUnaligned/1/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBitBlockCounterSum(C++) with params=8, source=cpp-micro, suite=arrow-bit-block-counter-benchmarkBM_HashJoinBasic_ProbeParallelism(C++) with params=Threads:2/HashTable krows:4096/process_time, source=cpp-micro, suite=arrow-acero-hash-join-benchmarkArrayArrayKernel(C++) with params=<MultiplyChecked, Int8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkThreadPoolSpawn(C++) with params=threads:4/task_cost:100000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_UnpackUint64(C++) with params=DynamicUnaligned/1/256, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_DictEncodingInt64_repeats(C++) with params=1024, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackBool(C++) with params=NeonUnaligned/1/512, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_PlainDecodingSpacedByteArray(C++) with params=max-string-length:64/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_PlainDecodingSpacedByteArray(C++) with params=max-string-length:8/batch-size:512, source=cpp-micro, suite=parquet-encoding-benchmarkBM_DeltaEncodingByteArray(C++) with params=max-string-length:8/batch-size:512/prefixed-percent:90, source=cpp-micro, suite=parquet-encoding-benchmarkGreaterArrayScalarInt64(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBM_RleDecodingBoolean(C++) with params=4096, source=cpp-micro, suite=parquet-encoding-benchmarkMaxElementWiseArrayScalarInt64(C++) with params=65536/1, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkThreadedTaskGroup(C++) with params=threads:1/task_cost:10000/real_time, source=cpp-micro, suite=arrow-thread-pool-benchmarkBM_DictDecodingInt64_literals(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackUint64(C++) with params=DynamicAligned/1/128, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_RleEncodingSpacedBoolean(C++) with params=32768/10000, source=cpp-micro, suite=parquet-encoding-benchmarkBM_RleEncodingBoolean(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_BatchComputeHash(C++) with params=, source=cpp-micro, suite=parquet-bloom-filter-benchmarkBM_DictEncodingInt64_repeats(C++) with params=32768, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackUint8(C++) with params=NeonUnaligned/8/32, source=cpp-micro, suite=arrow-bpacking-benchmarkGreaterArrayScalarInt64(C++) with params=65536/0, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkTakeFSLInt64RandomIndicesNoNulls(C++) with params=4194304/2, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkGrouperWithMultiTypes(C++) with params="{boolean}"/4096/100, source=cpp-micro, suite=arrow-compute-grouper-benchmarkGreaterArrayScalarInt64(C++) with params=65536/10000, source=cpp-micro, suite=arrow-compute-scalar-compare-benchmarkBM_RleEncodingBoolean(C++) with params=65536, source=cpp-micro, suite=parquet-encoding-benchmarkFilterStringFilterWithNulls(C++) with params=4194304/0, source=cpp-micro, suite=arrow-compute-vector-selection-benchmarkArrayScalarKernel(C++) with params=<Divide, UInt32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBM_UnpackUint32(C++) with params=DynamicUnaligned/1/512, source=cpp-micro, suite=arrow-bpacking-benchmarkBM_PlainDecodingByteArray(C++) with params=max-string-length:8/batch-size:2048, source=cpp-micro, suite=parquet-encoding-benchmarkBM_UnpackUint64(C++) with params=DynamicUnaligned/2/256, source=cpp-micro, suite=arrow-bpacking-benchmarkTrimManyAscii(C++) with source=cpp-micro, suite=arrow-compute-scalar-string-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading