Skip to content

perf(compute): tile checked lane kernels consistently - #10299

Closed
connortsui20 wants to merge 1 commit into
developfrom
ct/checked-lane-chunks
Closed

perf(compute): tile checked lane kernels consistently#10299
connortsui20 wants to merge 1 commit into
developfrom
ct/checked-lane-chunks

Conversation

@connortsui20

@connortsui20 connortsui20 commented Oct 5, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Summary

Edit: Once I'm done with other work I am going to go dive into LLVM to see if there is something there that can be updated instead of us doing this hack

Adding Narrow changed LLVM's unrolling of the existing checked 64-bit multiplication loop on Linux ARM, even though the loop's source was unchanged. Chunking map_checked_into gives LLVM a fixed trip count for the checked loop, as the other unmasked lane kernels already do.

Known limitation: chunking also regresses other benchmarks, particularly unsigned multiplication on AVX2 and AVX512. Making the chunk length const generic and removing forced inlining made the regressions worse, so that experiment was reverted.

Changes

Uses the same chunk size as the other unmasked lane kernels, with a runtime count and an #[inline(always)] helper. Failure evidence combines across full chunks and the remainder.

@connortsui20 connortsui20 added the changelog/performance A performance improvement label Oct 5, 2026
@connortsui20
connortsui20 added this pull request to stack #10300 October 5, 2026 10:34
@codspeed

codspeed Bot commented Oct 5, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will degrade performance by 1.27%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 25 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

ℹ️ 40 benchmarks have no flame graph

The flamegraph could not be generated because we failed to resolve the symbols in the profiling trace. This happens when we fail to harvest information about language frames.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 19 improved benchmarks
❌ 19 regressed benchmarks
✅ 2370 untouched benchmarks
⏩ 12 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime mul_u16_nonnull_avx2 11.1 µs 21 µs -46.88%
❌ WallTime mul_u16_nonnull_avx512 11.1 µs 19.1 µs -41.7%
❌ WallTime threshold_neon[8] 1.4 µs 2.3 µs -40.25%
❌ WallTime filter_neon[8] 900 ns 1,394 ns -35.44%
❌ WallTime mul_u8_nonnull_avx2 20.3 µs 27.8 µs -26.98%
❌ WallTime mul_u8_nonnull_avx512 22.3 µs 29.4 µs -24.07%
❌ WallTime mul_u32_nonnull_avx2 12.7 µs 16.6 µs -23.73%
❌ WallTime threshold_neon[64] 2.5 µs 3.3 µs -23.31%
❌ WallTime filter_neon[80] 2.5 µs 3.2 µs -22.31%
❌ ⚠️ Simulation random_i128[0.01] 3.8 µs 4.8 µs -20.62%
❌ WallTime filter_neon[64] 1.8 µs 2.2 µs -19.24%
❌ ⚠️ Simulation test_scan_filter[int] 3 ms 3.8 ms -19.08%
❌ WallTime threshold_neon[80] 3.6 µs 4.4 µs -18.41%
❌ WallTime add_u32_nonnull_avx2 12.7 µs 14.9 µs -14.54%
❌ Simulation sum_v2_i64 194.2 µs 224.6 µs -13.54%
❌ Simulation sum_i64 194.7 µs 224.7 µs -13.36%
❌ WallTime scalar_subtract_neon 10.9 µs 12.4 µs -12.68%
❌ WallTime mul_u32_nonnull_avx512 11.8 µs 13.5 µs -12.55%
❌ WallTime bitpack_blocked_compress_avx2 6.8 µs 7.7 µs -11.78%
⚡ WallTime mul_u64_nonnull_avx512 52.2 µs 28.9 µs +80.74%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ct/checked-lane-chunks (91e10a8) with develop (18903b1)

Open in CodSpeed

Footnotes

  1. 12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@connortsui20
connortsui20 marked this pull request as ready for review October 5, 2026 11:21
@connortsui20 connortsui20 mentioned this pull request Oct 5, 2026
Closed
@connortsui20
connortsui20 removed this pull request from stack #10300 October 5, 2026 15:21
@connortsui20 connortsui20 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 6, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 6, 2026
@github-actions

github-actions Bot commented Oct 6, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 47db41a clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 47db41a statpopgen 1 Explore Profiling Data
🟢 Done 47db41a tpch-nvme-10 1 Explore Profiling Data
🟢 Done 47db41a fineweb-s3 1 Explore Profiling Data
🟢 Done 47db41a fineweb 1 Explore Profiling Data
🟢 Done 47db41a clickbench-nvme 1 Explore Profiling Data
🟢 Done 47db41a tpcds-nvme 1 Explore Profiling Data
🟢 Done 47db41a polarsignals 1 Explore Profiling Data
🟢 Done 47db41a tpch-nvme 1 Explore Profiling Data
🟢 Done 47db41a tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 47db41a1 vs base c07196e5
Vortex (geomean): hot 1.000x ➖ · cold 1.020x ➖

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57763678 / 57478791 / +0.5% 101513176 / 99978056 / +1.5% 0.57 / 0.57 / -1.0%
polarsignals_q01/datafusion:vortex-file-compressed 63694016 / 63341951 / +0.6% 123648330 / 122957729 / +0.6% 0.52 / 0.52 / -0.0%
polarsignals_q02/datafusion:vortex-file-compressed 64398995 / 64339924 / +0.1% 107559258 / 98916563 / +8.7% 0.60 / 0.65 / -8.0%
polarsignals_q03/datafusion:vortex-file-compressed 80148525 / 79656358 / +0.6% 140024626 / 135974873 / +3.0% 0.57 / 0.59 / -2.3%
polarsignals_q04/datafusion:vortex-file-compressed 9511724 / 9437312 / +0.8% 46314457 / 46480713 / -0.4% 0.21 / 0.20 / +1.2%
polarsignals_q05/datafusion:vortex-file-compressed 23875188 / 24726438 / -3.4% 63024211 / 62060026 / +1.6% 0.38 / 0.40 / -4.9%
polarsignals_q06/datafusion:vortex-file-compressed 21520263 / 21011025 / +2.4% 62248028 / 60620295 / +2.7% 0.35 / 0.35 / -0.3%
polarsignals_q07/datafusion:vortex-file-compressed 39846564 / 39660432 / +0.5% 77591661 / 76414960 / +1.5% 0.51 / 0.52 / -1.1%
polarsignals_q08/datafusion:vortex-file-compressed 98394976 / 97843496 / +0.6% 160541269 / 157671435 / +1.8% 0.61 / 0.62 / -1.2%
polarsignals_q09/datafusion:vortex-file-compressed 9990283 / 10209591 / -2.1% 45291239 / 45465756 / -0.4% 0.22 / 0.22 / -1.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+1.8%, low confidence) · DuckDB No clear signal (-3.0%, medium confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.962x ➖
Shifts: Parquet (control) +0.5% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.012x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6862782 / 6806945 / +0.8% 20331681 / 19425241 / +4.7% 0.34 / 0.35 / -3.7%
fineweb_q01/datafusion:vortex-file-compressed 12179854 / 12133634 / +0.4% 48222633 / 50198225 / -3.9% 0.25 / 0.24 / +4.5%
fineweb_q02/datafusion:vortex-file-compressed 12544142 / 12517692 / +0.2% 50587277 / 54451926 / -7.1% 0.25 / 0.23 / +7.9%
fineweb_q03/datafusion:vortex-file-compressed 20234614 / 20141926 / +0.5% 99420007 / 110856414 / -10.3% 🟢 0.20 / 0.18 / +12.0%
fineweb_q04/datafusion:vortex-file-compressed 78319795 / 75942867 / +3.1% 155786668 / 160337608 / -2.8% 0.50 / 0.47 / +6.1%
fineweb_q05/datafusion:vortex-file-compressed 60437956 / 60408012 / +0.0% 136519546 / 146197549 / -6.6% 0.44 / 0.41 / +7.1%
fineweb_q06/datafusion:vortex-file-compressed 19075582 / 18869238 / +1.1% 100016384 / 111685247 / -10.4% 🟢 0.19 / 0.17 / +12.9%
fineweb_q07/datafusion:vortex-file-compressed 17658380 / 19423042 / -9.1% 99331153 / 104623572 / -5.1% 0.18 / 0.19 / -4.2%
fineweb_q08/datafusion:vortex-file-compressed 11440746 / 9920346 / +15.3% 🔴 47063064 / 48727253 / -3.4% 0.24 / 0.20 / +19.4%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9299378 / 9469006 / -1.8% 33847292 / 33261866 / +1.8% 0.27 / 0.28 / -3.5%
fineweb_q01/datafusion:parquet 74890060 / 74183394 / +1.0% 150012722 / 167844730 / -10.6% 🟢 0.50 / 0.44 / +13.0%
fineweb_q02/datafusion:parquet 75770243 / 74110903 / +2.2% 151607669 / 166031156 / -8.7% 0.50 / 0.45 / +12.0%
fineweb_q03/datafusion:parquet 74092538 / 75880930 / -2.4% 141425839 / 165465810 / -14.5% 🟢 0.52 / 0.46 / +14.2%
fineweb_q04/datafusion:parquet 81589380 / 83952908 / -2.8% 147074453 / 161606581 / -9.0% 0.55 / 0.52 / +6.8%
fineweb_q05/datafusion:parquet 79814151 / 80809048 / -1.2% 147925595 / 167944581 / -11.9% 🟢 0.54 / 0.48 / +12.1%
fineweb_q06/datafusion:parquet 75667566 / 75080502 / +0.8% 142886561 / 175593280 / -18.6% 🟢 0.53 / 0.43 / +23.9%
fineweb_q07/datafusion:parquet 73826944 / 73798724 / +0.0% 141114041 / 156265853 / -9.7% 0.52 / 0.47 / +10.8%
fineweb_q08/datafusion:parquet 72924104 / 73837294 / -1.2% 142824494 / 162977884 / -12.4% 🟢 0.51 / 0.45 / +12.7%
duckdb / vortex-file-compressed / ns (0.987x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2346224 / 3506822 / -33.1% 🟢 4812575 / 6729408 / -28.5% 🟢 0.49 / 0.52 / -6.4%
fineweb_q01/duckdb:vortex-file-compressed 18714049 / 18600058 / +0.6% 65067786 / 48297814 / +34.7% 🔴 0.29 / 0.39 / -25.3%
fineweb_q02/duckdb:vortex-file-compressed 17875328 / 25158686 / -28.9% 🟢 64042881 / 64961140 / -1.4% 0.28 / 0.39 / -27.9%
fineweb_q03/duckdb:vortex-file-compressed 25603548 / 27605414 / -7.3% 104560538 / 124204623 / -15.8% 🟢 0.24 / 0.22 / +10.2%
fineweb_q04/duckdb:vortex-file-compressed 105546524 / 77173652 / +36.8% 🔴 223022217 / 152377110 / +46.4% 🔴 0.47 / 0.51 / -6.6%
fineweb_q05/duckdb:vortex-file-compressed 90892636 / 59853570 / +51.9% 🔴 201798479 / 97872796 / +106.2% 🔴 0.45 / 0.61 / -26.3%
fineweb_q06/duckdb:vortex-file-compressed 36453090 / 43106972 / -15.4% 🟢 136449691 / 148558319 / -8.2% 0.27 / 0.29 / -7.9%
fineweb_q07/duckdb:vortex-file-compressed 26218349 / 23614436 / +11.0% 🔴 97253017 / 87666327 / +10.9% 🔴 0.27 / 0.27 / +0.1%
fineweb_q08/duckdb:vortex-file-compressed 6822925 / 6644142 / +2.7% 13984299 / 16881125 / -17.2% 🟢 0.49 / 0.39 / +24.0%
duckdb / parquet / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23841157 / 21172152 / +12.6% 🔴 25199772 / 23283438 / +8.2% 0.95 / 0.91 / +4.0%
fineweb_q01/duckdb:parquet 45388230 / 44040849 / +3.1% 53051819 / 53165621 / -0.2% 0.86 / 0.83 / +3.3%
fineweb_q02/duckdb:parquet 43725679 / 43763405 / -0.1% 59912107 / 53610126 / +11.8% 🔴 0.73 / 0.82 / -10.6%
fineweb_q03/duckdb:parquet 95806950 / 94563137 / +1.3% 189639362 / 183176739 / +3.5% 0.51 / 0.52 / -2.1%
fineweb_q04/duckdb:parquet 150885240 / 151016430 / -0.1% 231728088 / 216096083 / +7.2% 0.65 / 0.70 / -6.8%
fineweb_q05/duckdb:parquet 142837966 / 146250557 / -2.3% 193409022 / 193234553 / +0.1% 0.74 / 0.76 / -2.4%
fineweb_q06/duckdb:parquet 70795818 / 70705263 / +0.1% 116669657 / 117540586 / -0.7% 0.61 / 0.60 / +0.9%
fineweb_q07/duckdb:parquet 71895624 / 73226590 / -1.8% 155691509 / 153712896 / +1.3% 0.46 / 0.48 / -3.1%
fineweb_q08/duckdb:parquet 26093911 / 25281666 / +3.2% 24384963 / 24077724 / +1.3% 1.07 / 1.05 / +1.9%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.054x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.018x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16592318 / 16559264 / +0.2% 46795173 / 43547538 / +7.5% 0.35 / 0.38 / -6.8%
tpch_q02/datafusion:vortex-file-compressed 17558891 / 17481203 / +0.4% 38047213 / 35552906 / +7.0% 0.46 / 0.49 / -6.1%
tpch_q03/datafusion:vortex-file-compressed 19306586 / 19123001 / +1.0% 50980040 / 47894410 / +6.4% 0.38 / 0.40 / -5.2%
tpch_q04/datafusion:vortex-file-compressed 10442260 / 10069256 / +3.7% 35943872 / 32232611 / +11.5% 🔴 0.29 / 0.31 / -7.0%
tpch_q05/datafusion:vortex-file-compressed 37620668 / 38026144 / -1.1% 68324209 / 63429426 / +7.7% 0.55 / 0.60 / -8.2%
tpch_q06/datafusion:vortex-file-compressed 6368959 / 6163330 / +3.3% 32779238 / 27268441 / +20.2% 🔴 0.19 / 0.23 / -14.0%
tpch_q07/datafusion:vortex-file-compressed 52174026 / 51445551 / +1.4% 88047619 / 81678495 / +7.8% 0.59 / 0.63 / -5.9%
tpch_q08/datafusion:vortex-file-compressed 51571322 / 51808797 / -0.5% 86640199 / 82691367 / +4.8% 0.60 / 0.63 / -5.0%
tpch_q09/datafusion:vortex-file-compressed 49926654 / 50103346 / -0.4% 80346303 / 77608833 / +3.5% 0.62 / 0.65 / -3.7%
tpch_q10/datafusion:vortex-file-compressed 17499394 / 16907412 / +3.5% 53444620 / 47490800 / +12.5% 🔴 0.33 / 0.36 / -8.0%
tpch_q11/datafusion:vortex-file-compressed 15014234 / 15283936 / -1.8% 35734478 / 32940140 / +8.5% 0.42 / 0.46 / -9.4%
tpch_q12/datafusion:vortex-file-compressed 22189362 / 22913803 / -3.2% 51863512 / 45229680 / +14.7% 🔴 0.43 / 0.51 / -15.5%
tpch_q13/datafusion:vortex-file-compressed 20134688 / 20258840 / -0.6% 44595445 / 39818595 / +12.0% 🔴 0.45 / 0.51 / -11.3%
tpch_q14/datafusion:vortex-file-compressed 15331749 / 15162196 / +1.1% 43783304 / 37801493 / +15.8% 🔴 0.35 / 0.40 / -12.7%
tpch_q15/datafusion:vortex-file-compressed 18868925 / 18474523 / +2.1% 48486923 / 42728291 / +13.5% 🔴 0.39 / 0.43 / -10.0%
tpch_q16/datafusion:vortex-file-compressed 18508341 / 18423820 / +0.5% 39858490 / 36290380 / +9.8% 0.46 / 0.51 / -8.5%
tpch_q17/datafusion:vortex-file-compressed 28474297 / 28458320 / +0.1% 59013650 / 58278289 / +1.3% 0.48 / 0.49 / -1.2%
tpch_q18/datafusion:vortex-file-compressed 36572945 / 36614156 / -0.1% 61439367 / 56036101 / +9.6% 0.60 / 0.65 / -8.9%
tpch_q19/datafusion:vortex-file-compressed 13722629 / 13686319 / +0.3% 41252550 / 36313884 / +13.6% 🔴 0.33 / 0.38 / -11.7%
tpch_q20/datafusion:vortex-file-compressed 20910979 / 20762551 / +0.7% 49814790 / 43130307 / +15.5% 🔴 0.42 / 0.48 / -12.8%
tpch_q21/datafusion:vortex-file-compressed 39521960 / 39003573 / +1.3% 72247245 / 64836321 / +11.4% 🔴 0.55 / 0.60 / -9.1%
tpch_q22/datafusion:vortex-file-compressed 11355299 / 11325148 / +0.3% 33530434 / 29562605 / +13.4% 🔴 0.34 / 0.38 / -11.6%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72793370 / 72681113 / +0.2% 93665017 / 89598876 / +4.5% 0.78 / 0.81 / -4.2%
tpch_q02/datafusion:parquet 58155422 / 57435601 / +1.3% 78727901 / 73794880 / +6.7% 0.74 / 0.78 / -5.1%
tpch_q03/datafusion:parquet 84900741 / 84059305 / +1.0% 107238344 / 106419602 / +0.8% 0.79 / 0.79 / +0.2%
tpch_q04/datafusion:parquet 46840286 / 46943407 / -0.2% 68754954 / 64941962 / +5.9% 0.68 / 0.72 / -5.8%
tpch_q05/datafusion:parquet 99443261 / 99361762 / +0.1% 129532786 / 126258308 / +2.6% 0.77 / 0.79 / -2.4%
tpch_q06/datafusion:parquet 32183051 / 32076822 / +0.3% 53653776 / 48864603 / +9.8% 0.60 / 0.66 / -8.6%
tpch_q07/datafusion:parquet 106075564 / 105741299 / +0.3% 137047362 / 129635421 / +5.7% 0.77 / 0.82 / -5.1%
tpch_q08/datafusion:parquet 112019403 / 114049103 / -1.8% 139777979 / 139833184 / -0.0% 0.80 / 0.82 / -1.7%
tpch_q09/datafusion:parquet 131650190 / 130756716 / +0.7% 164396894 / 159997838 / +2.7% 0.80 / 0.82 / -2.0%
tpch_q10/datafusion:parquet 104544872 / 104206808 / +0.3% 133711277 / 131686587 / +1.5% 0.78 / 0.79 / -1.2%
tpch_q11/datafusion:parquet 41918794 / 41817878 / +0.2% 66899908 / 60878027 / +9.9% 0.63 / 0.69 / -8.8%
tpch_q12/datafusion:parquet 68783333 / 69090198 / -0.4% 96343113 / 94078266 / +2.4% 0.71 / 0.73 / -2.8%
tpch_q13/datafusion:parquet 185334286 / 185267076 / +0.0% 209331308 / 204636010 / +2.3% 0.89 / 0.91 / -2.2%
tpch_q14/datafusion:parquet 47914821 / 47878935 / +0.1% 75919928 / 72705362 / +4.4% 0.63 / 0.66 / -4.2%
tpch_q15/datafusion:parquet 53993070 / 54170792 / -0.3% 76244888 / 73720485 / +3.4% 0.71 / 0.73 / -3.6%
tpch_q16/datafusion:parquet 40876254 / 40901378 / -0.1% 61811818 / 57212383 / +8.0% 0.66 / 0.71 / -7.5%
tpch_q17/datafusion:parquet 129977490 / 127914471 / +1.6% 154871583 / 151164656 / +2.5% 0.84 / 0.85 / -0.8%
tpch_q18/datafusion:parquet 130115565 / 130953503 / -0.6% 154091740 / 149910282 / +2.8% 0.84 / 0.87 / -3.3%
tpch_q19/datafusion:parquet 59112842 / 59187186 / -0.1% 89453284 / 84772307 / +5.5% 0.66 / 0.70 / -5.4%
tpch_q20/datafusion:parquet 68245370 / 67964870 / +0.4% 95328658 / 90411334 / +5.4% 0.72 / 0.75 / -4.8%
tpch_q21/datafusion:parquet 108575948 / 108427816 / +0.1% 133173147 / 128490848 / +3.6% 0.82 / 0.84 / -3.4%
tpch_q22/datafusion:parquet 47056244 / 47032871 / +0.0% 69678331 / 62653555 / +11.2% 🔴 0.68 / 0.75 / -10.0%
duckdb / vortex-file-compressed / ns (0.981x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11259244 / 11784997 / -4.5% 21527001 / 23127196 / -6.9% 0.52 / 0.51 / +2.6%
tpch_q02/duckdb:vortex-file-compressed 17393773 / 17151806 / +1.4% 26625087 / 26945255 / -1.2% 0.65 / 0.64 / +2.6%
tpch_q03/duckdb:vortex-file-compressed 17688581 / 18248443 / -3.1% 34804491 / 36300175 / -4.1% 0.51 / 0.50 / +1.1%
tpch_q04/duckdb:vortex-file-compressed 17453033 / 16994439 / +2.7% 33092880 / 31208838 / +6.0% 0.53 / 0.54 / -3.1%
tpch_q05/duckdb:vortex-file-compressed 22004230 / 22492247 / -2.2% 37254696 / 35491250 / +5.0% 0.59 / 0.63 / -6.8%
tpch_q06/duckdb:vortex-file-compressed 5493508 / 6338531 / -13.3% 🟢 14307705 / 16458160 / -13.1% 🟢 0.38 / 0.39 / -0.3%
tpch_q07/duckdb:vortex-file-compressed 20133449 / 20968041 / -4.0% 39725283 / 41649526 / -4.6% 0.51 / 0.50 / +0.7%
tpch_q08/duckdb:vortex-file-compressed 22992730 / 23207222 / -0.9% 41168616 / 38756895 / +6.2% 0.56 / 0.60 / -6.7%
tpch_q09/duckdb:vortex-file-compressed 29223230 / 29577865 / -1.2% 52326907 / 51052038 / +2.5% 0.56 / 0.58 / -3.6%
tpch_q10/duckdb:vortex-file-compressed 28491531 / 28052985 / +1.6% 47216389 / 43403033 / +8.8% 0.60 / 0.65 / -6.6%
tpch_q11/duckdb:vortex-file-compressed 8764672 / 8762797 / +0.0% 15962769 / 15351809 / +4.0% 0.55 / 0.57 / -3.8%
tpch_q12/duckdb:vortex-file-compressed 15576902 / 16844703 / -7.5% 30432667 / 32542852 / -6.5% 0.51 / 0.52 / -1.1%
tpch_q13/duckdb:vortex-file-compressed 22011828 / 22382822 / -1.7% 41705406 / 39335912 / +6.0% 0.53 / 0.57 / -7.2%
tpch_q14/duckdb:vortex-file-compressed 12929905 / 12995850 / -0.5% 25157524 / 24073779 / +4.5% 0.51 / 0.54 / -4.8%
tpch_q15/duckdb:vortex-file-compressed 8881510 / 9165851 / -3.1% 18821315 / 23318666 / -19.3% 🟢 0.47 / 0.39 / +20.1%
tpch_q16/duckdb:vortex-file-compressed 18612588 / 18388502 / +1.2% 24726971 / 23946754 / +3.3% 0.75 / 0.77 / -2.0%
tpch_q17/duckdb:vortex-file-compressed 15348266 / 15950818 / -3.8% 34152069 / 32100875 / +6.4% 0.45 / 0.50 / -9.6%
tpch_q18/duckdb:vortex-file-compressed 24821150 / 25442389 / -2.4% 38506991 / 33929773 / +13.5% 🔴 0.64 / 0.75 / -14.0%
tpch_q19/duckdb:vortex-file-compressed 23063390 / 23825483 / -3.2% 34327143 / 36562014 / -6.1% 0.67 / 0.65 / +3.1%
tpch_q20/duckdb:vortex-file-compressed 17379238 / 16885717 / +2.9% 39354902 / 34490696 / +14.1% 🔴 0.44 / 0.49 / -9.8%
tpch_q21/duckdb:vortex-file-compressed 66609119 / 66226622 / +0.6% 84256472 / 84796950 / -0.6% 0.79 / 0.78 / +1.2%
tpch_q22/duckdb:vortex-file-compressed 12146678 / 12120165 / +0.2% 21204256 / 19984031 / +6.1% 0.57 / 0.61 / -5.5%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62844682 / 62984629 / -0.2% 69207072 / 69284709 / -0.1% 0.91 / 0.91 / -0.1%
tpch_q02/duckdb:parquet 37454917 / 37677006 / -0.6% 44831834 / 46711438 / -4.0% 0.84 / 0.81 / +3.6%
tpch_q03/duckdb:parquet 67448064 / 67438674 / +0.0% 78602748 / 77843802 / +1.0% 0.86 / 0.87 / -1.0%
tpch_q04/duckdb:parquet 46568146 / 46697090 / -0.3% 56108854 / 55709347 / +0.7% 0.83 / 0.84 / -1.0%
tpch_q05/duckdb:parquet 65754633 / 65704048 / +0.1% 76476697 / 76865107 / -0.5% 0.86 / 0.85 / +0.6%
tpch_q06/duckdb:parquet 21889547 / 22035584 / -0.7% 26617766 / 26180765 / +1.7% 0.82 / 0.84 / -2.3%
tpch_q07/duckdb:parquet 64761138 / 65061333 / -0.5% 75590689 / 75657164 / -0.1% 0.86 / 0.86 / -0.4%
tpch_q08/duckdb:parquet 79767886 / 80080948 / -0.4% 93285181 / 92413675 / +0.9% 0.86 / 0.87 / -1.3%
tpch_q09/duckdb:parquet 118811297 / 119149618 / -0.3% 131964467 / 133631672 / -1.2% 0.90 / 0.89 / +1.0%
tpch_q10/duckdb:parquet 119057074 / 118936912 / +0.1% 130670743 / 133936475 / -2.4% 0.91 / 0.89 / +2.6%
tpch_q11/duckdb:parquet 21282002 / 21328186 / -0.2% 24717201 / 25993847 / -4.9% 0.86 / 0.82 / +4.9%
tpch_q12/duckdb:parquet 44200453 / 44223271 / -0.1% 51246941 / 51409445 / -0.3% 0.86 / 0.86 / +0.3%
tpch_q13/duckdb:parquet 242870726 / 242437343 / +0.2% 250719703 / 250667065 / +0.0% 0.97 / 0.97 / +0.2%
tpch_q14/duckdb:parquet 47076791 / 47158769 / -0.2% 56272313 / 55645874 / +1.1% 0.84 / 0.85 / -1.3%
tpch_q15/duckdb:parquet 26423375 / 26366871 / +0.2% 33417056 / 35822686 / -6.7% 0.79 / 0.74 / +7.4%
tpch_q16/duckdb:parquet 51289750 / 52371680 / -2.1% 57582565 / 59423775 / -3.1% 0.89 / 0.88 / +1.1%
tpch_q17/duckdb:parquet 49040500 / 49109401 / -0.1% 58817315 / 58536487 / +0.5% 0.83 / 0.84 / -0.6%
tpch_q18/duckdb:parquet 95737716 / 95501859 / +0.2% 104063823 / 103697752 / +0.4% 0.92 / 0.92 / -0.1%
tpch_q19/duckdb:parquet 64887420 / 64980471 / -0.1% 74288777 / 75279414 / -1.3% 0.87 / 0.86 / +1.2%
tpch_q20/duckdb:parquet 61585686 / 61446223 / +0.2% 73092511 / 73202774 / -0.2% 0.84 / 0.84 / +0.4%
tpch_q21/duckdb:parquet 141867755 / 142201125 / -0.2% 152611067 / 152807070 / -0.1% 0.93 / 0.93 / -0.1%
tpch_q22/duckdb:parquet 51150856 / 51563333 / -0.8% 58547864 / 59238832 / -1.2% 0.87 / 0.87 / +0.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.0%
Engines: DataFusion No clear signal (-10.4%, environment too noisy confidence) · DuckDB No clear signal (-3.5%, environment too noisy confidence)
Vortex (geomean): hot 1.099x ➖ · cold 1.110x ➖
Parquet (geomean): hot 1.181x ➖ · cold 1.129x ➖
Shifts: Parquet (control) +18.1% · Median polish +15.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.092x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 61039998 / 37319498 / +63.6% 🔴 116235512 / 191500161 / -39.3% 🟢 0.53 / 0.19 / +169.5%
fineweb_q01/datafusion:vortex-file-compressed 609226682 / 429081048 / +42.0% 🔴 896434382 / 774427854 / +15.8% 0.68 / 0.55 / +22.7%
fineweb_q02/datafusion:vortex-file-compressed 385611522 / 382248014 / +0.9% 740191710 / 500254153 / +48.0% 🔴 0.52 / 0.76 / -31.8%
fineweb_q03/datafusion:vortex-file-compressed 664522164 / 546910257 / +21.5% 847110518 / 677248744 / +25.1% 0.78 / 0.81 / -2.9%
fineweb_q04/datafusion:vortex-file-compressed 463824006 / 430179336 / +7.8% 480918093 / 474331452 / +1.4% 0.96 / 0.91 / +6.3%
fineweb_q05/datafusion:vortex-file-compressed 459954746 / 417456950 / +10.2% 500190247 / 446737651 / +12.0% 0.92 / 0.93 / -1.6%
fineweb_q06/datafusion:vortex-file-compressed 920862516 / 775931808 / +18.7% 871874882 / 1022279666 / -14.7% 1.06 / 0.76 / +39.2%
fineweb_q07/datafusion:vortex-file-compressed 517780064 / 501151270 / +3.3% 643281003 / 488884247 / +31.6% 🔴 0.80 / 1.03 / -21.5%
fineweb_q08/datafusion:vortex-file-compressed 175457670 / 330071988 / -46.8% 🟢 238356348 / 246153723 / -3.2% 0.74 / 1.34 / -45.1%
datafusion / parquet / ns (1.218x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 537185650 / 661411086 / -18.8% 850043131 / 916970328 / -7.3% 0.63 / 0.72 / -12.4%
fineweb_q01/datafusion:parquet 1199474058 / 839553868 / +42.9% 🔴 1039172937 / 810576185 / +28.2% 1.15 / 1.04 / +11.4%
fineweb_q02/datafusion:parquet 990326850 / 802702548 / +23.4% 961332430 / 699051807 / +37.5% 🔴 1.03 / 1.15 / -10.3%
fineweb_q03/datafusion:parquet 1019410268 / 809671030 / +25.9% 1224000785 / 930332829 / +31.6% 🔴 0.83 / 0.87 / -4.3%
fineweb_q04/datafusion:parquet 1143650034 / 973959911 / +17.4% 1076219630 / 1033304428 / +4.2% 1.06 / 0.94 / +12.7%
fineweb_q05/datafusion:parquet 1035897092 / 709506726 / +46.0% 🔴 831688028 / 764007919 / +8.9% 1.25 / 0.93 / +34.1%
fineweb_q06/datafusion:parquet 968018235 / 898888200 / +7.7% 934266921 / 960408646 / -2.7% 1.04 / 0.94 / +10.7%
fineweb_q07/datafusion:parquet 931070642 / 703081614 / +32.4% 🔴 838044656 / 766365092 / +9.4% 1.11 / 0.92 / +21.1%
fineweb_q08/datafusion:parquet 1063939662 / 794797218 / +33.9% 🔴 1040023535 / 972469133 / +6.9% 1.02 / 0.82 / +25.2%
duckdb / vortex-file-compressed / ns (1.105x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 83839804 / 62465183 / +34.2% 🔴 71688799 / 48936022 / +46.5% 🔴 1.17 / 1.28 / -8.4%
fineweb_q01/duckdb:vortex-file-compressed 533780854 / 417751860 / +27.8% 568105377 / 425878251 / +33.4% 🔴 0.94 / 0.98 / -4.2%
fineweb_q02/duckdb:vortex-file-compressed 627473546 / 598444820 / +4.9% 1031790974 / 604361221 / +70.7% 🔴 0.61 / 0.99 / -38.6%
fineweb_q03/duckdb:vortex-file-compressed 1059467482 / 1030537682 / +2.8% 1236110643 / 1076921517 / +14.8% 0.86 / 0.96 / -10.4%
fineweb_q04/duckdb:vortex-file-compressed 1020867212 / 1010247264 / +1.1% 1081845791 / 984356430 / +9.9% 0.94 / 1.03 / -8.1%
fineweb_q05/duckdb:vortex-file-compressed 908710094 / 918311718 / -1.0% 966914453 / 1028254977 / -6.0% 0.94 / 0.89 / +5.2%
fineweb_q06/duckdb:vortex-file-compressed 1511635270 / 1201705576 / +25.8% 1342013666 / 1230113393 / +9.1% 1.13 / 0.98 / +15.3%
fineweb_q07/duckdb:vortex-file-compressed 1045017354 / 1034786096 / +1.0% 1039881098 / 1200581261 / -13.4% 1.00 / 0.86 / +16.6%
fineweb_q08/duckdb:vortex-file-compressed 432284710 / 411831292 / +5.0% 509133121 / 466750138 / +9.1% 0.85 / 0.88 / -3.8%
duckdb / parquet / ns (1.145x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 584512438 / 522774690 / +11.8% 738038920 / 524763321 / +40.6% 🔴 0.79 / 1.00 / -20.5%
fineweb_q01/duckdb:parquet 800592836 / 748190191 / +7.0% 684123400 / 804942807 / -15.0% 1.17 / 0.93 / +25.9%
fineweb_q02/duckdb:parquet 677573338 / 607215449 / +11.6% 689207265 / 618943999 / +11.4% 0.98 / 0.98 / +0.2%
fineweb_q03/duckdb:parquet 1745041103 / 1401999998 / +24.5% 1826445498 / 1402610737 / +30.2% 🔴 0.96 / 1.00 / -4.4%
fineweb_q04/duckdb:parquet 878944670 / 733778950 / +19.8% 943855763 / 777678052 / +21.4% 0.93 / 0.94 / -1.3%
fineweb_q05/duckdb:parquet 1014681475 / 842018484 / +20.5% 1036383272 / 958406922 / +8.1% 0.98 / 0.88 / +11.4%
fineweb_q06/duckdb:parquet 1786392908 / 1788532511 / -0.1% 1914680090 / 2065467463 / -7.3% 0.93 / 0.87 / +7.7%
fineweb_q07/duckdb:parquet 1167894992 / 1130346597 / +3.3% 1198551452 / 1121391674 / +6.9% 0.97 / 1.01 / -3.3%
fineweb_q08/duckdb:parquet 662440474 / 483574422 / +37.0% 🔴 732410605 / 512113140 / +43.0% 🔴 0.90 / 0.94 / -4.2%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 47db41a1 vs base 4187c186
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.037x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.047x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1270025 / 1220744 / +4.0% 22958435 / 20634121 / +11.3% 🔴 0.06 / 0.06 / -6.5%
clickbench_q01/datafusion:vortex-file-compressed 5570528 / 5796258 / -3.9% 37530961 / 33620101 / +11.6% 🔴 0.15 / 0.17 / -13.9%
clickbench_q02/datafusion:vortex-file-compressed 10182856 / 10729288 / -5.1% 40812971 / 41945885 / -2.7% 0.25 / 0.26 / -2.5%
clickbench_q03/datafusion:vortex-file-compressed 12414765 / 12019426 / +3.3% 55906995 / 50452451 / +10.8% 🔴 0.22 / 0.24 / -6.8%
clickbench_q04/datafusion:vortex-file-compressed 56508944 / 55622802 / +1.6% 91321456 / 92002247 / -0.7% 0.62 / 0.60 / +2.4%
clickbench_q05/datafusion:vortex-file-compressed 76038959 / 74049610 / +2.7% 122226819 / 122009242 / +0.2% 0.62 / 0.61 / +2.5%
clickbench_q06/datafusion:vortex-file-compressed 1220340 / 1245532 / -2.0% 23495987 / 20297338 / +15.8% 🔴 0.05 / 0.06 / -15.4%
clickbench_q07/datafusion:vortex-file-compressed 9447952 / 9470978 / -0.2% 35523505 / 33047039 / +7.5% 0.27 / 0.29 / -7.2%
clickbench_q08/datafusion:vortex-file-compressed 74444854 / 77207254 / -3.6% 116025641 / 115596357 / +0.4% 0.64 / 0.67 / -3.9%
clickbench_q09/datafusion:vortex-file-compressed 173357947 / 168908326 / +2.6% 208818726 / 208161766 / +0.3% 0.83 / 0.81 / +2.3%
clickbench_q10/datafusion:vortex-file-compressed 23662914 / 23971735 / -1.3% 69538774 / 67059167 / +3.7% 0.34 / 0.36 / -4.8%
clickbench_q11/datafusion:vortex-file-compressed 27116131 / 27008602 / +0.4% 71417918 / 67926822 / +5.1% 0.38 / 0.40 / -4.5%
clickbench_q12/datafusion:vortex-file-compressed 71885125 / 71582716 / +0.4% 121675452 / 118808461 / +2.4% 0.59 / 0.60 / -1.9%
clickbench_q13/datafusion:vortex-file-compressed 118384116 / 120265016 / -1.6% 180253942 / 177862398 / +1.3% 0.66 / 0.68 / -2.9%
clickbench_q14/datafusion:vortex-file-compressed 75303317 / 73878338 / +1.9% 125510978 / 120821596 / +3.9% 0.60 / 0.61 / -1.9%
clickbench_q15/datafusion:vortex-file-compressed 61608211 / 60964418 / +1.1% 98431661 / 99562692 / -1.1% 0.63 / 0.61 / +2.2%
clickbench_q16/datafusion:vortex-file-compressed 154696850 / 149608716 / +3.4% 207324741 / 209044160 / -0.8% 0.75 / 0.72 / +4.3%
clickbench_q17/datafusion:vortex-file-compressed 146641827 / 148505814 / -1.3% 216770357 / 214375589 / +1.1% 0.68 / 0.69 / -2.3%
clickbench_q18/datafusion:vortex-file-compressed 301912645 / 296925155 / +1.7% 373390906 / 378924245 / -1.5% 0.81 / 0.78 / +3.2%
clickbench_q19/datafusion:vortex-file-compressed 7809846 / 7615700 / +2.5% 52911315 / 46062894 / +14.9% 🔴 0.15 / 0.17 / -10.7%
clickbench_q20/datafusion:vortex-file-compressed 61445547 / 62022502 / -0.9% 231094228 / 231278889 / -0.1% 0.27 / 0.27 / -0.9%
clickbench_q21/datafusion:vortex-file-compressed 90915960 / 89068920 / +2.1% 275686043 / 269993605 / +2.1% 0.33 / 0.33 / -0.0%
clickbench_q22/datafusion:vortex-file-compressed 100417275 / 102360326 / -1.9% 344323660 / 346209963 / -0.5% 0.29 / 0.30 / -1.4%
clickbench_q23/datafusion:vortex-file-compressed 214599333 / 212488510 / +1.0% 540825634 / 516903245 / +4.6% 0.40 / 0.41 / -3.5%
clickbench_q24/datafusion:vortex-file-compressed 15922742 / 15482760 / +2.8% 66597250 / 63198814 / +5.4% 0.24 / 0.24 / -2.4%
clickbench_q25/datafusion:vortex-file-compressed 17614144 / 18681999 / -5.7% 58337307 / 58196309 / +0.2% 0.30 / 0.32 / -5.9%
clickbench_q26/datafusion:vortex-file-compressed 15923853 / 16652624 / -4.4% 67526861 / 62194384 / +8.6% 0.24 / 0.27 / -11.9%
clickbench_q27/datafusion:vortex-file-compressed 96499274 / 98231937 / -1.8% 244908475 / 242234709 / +1.1% 0.39 / 0.41 / -2.8%
clickbench_q28/datafusion:vortex-file-compressed 564520551 / 570629584 / -1.1% 633733571 / 611119106 / +3.7% 0.89 / 0.93 / -4.6%
clickbench_q29/datafusion:vortex-file-compressed 22859992 / 23786223 / -3.9% 53088091 / 49501145 / +7.2% 0.43 / 0.48 / -10.4%
clickbench_q30/datafusion:vortex-file-compressed 58984890 / 60268770 / -2.1% 106974656 / 106183188 / +0.7% 0.55 / 0.57 / -2.9%
clickbench_q31/datafusion:vortex-file-compressed 69547739 / 70812560 / -1.8% 156277442 / 150965873 / +3.5% 0.45 / 0.47 / -5.1%
clickbench_q32/datafusion:vortex-file-compressed 295563584 / 295847378 / -0.1% 387622472 / 382517491 / +1.3% 0.76 / 0.77 / -1.4%
clickbench_q33/datafusion:vortex-file-compressed 327968807 / 326168614 / +0.6% 447344717 / 431356202 / +3.7% 0.73 / 0.76 / -3.0%
clickbench_q34/datafusion:vortex-file-compressed 329583778 / 327656547 / +0.6% 429237966 / 415546458 / +3.3% 0.77 / 0.79 / -2.6%
clickbench_q35/datafusion:vortex-file-compressed 56023202 / 56296181 / -0.5% 89341381 / 84693642 / +5.5% 0.63 / 0.66 / -5.7%
clickbench_q36/datafusion:vortex-file-compressed 37396726 / 37561499 / -0.4% 67445774 / 65615858 / +2.8% 0.55 / 0.57 / -3.1%
clickbench_q37/datafusion:vortex-file-compressed 21554248 / 21466120 / +0.4% 48978964 / 47422636 / +3.3% 0.44 / 0.45 / -2.8%
clickbench_q38/datafusion:vortex-file-compressed 11531740 / 11758956 / -1.9% 40141641 / 37313735 / +7.6% 0.29 / 0.32 / -8.8%
clickbench_q39/datafusion:vortex-file-compressed 78264309 / 77788762 / +0.6% 111859333 / 109491733 / +2.2% 0.70 / 0.71 / -1.5%
clickbench_q40/datafusion:vortex-file-compressed 10965551 / 11058066 / -0.8% 42108292 / 36987583 / +13.8% 🔴 0.26 / 0.30 / -12.9%
clickbench_q41/datafusion:vortex-file-compressed 10485652 / 10619366 / -1.3% 39127399 / 35287109 / +10.9% 🔴 0.27 / 0.30 / -11.0%
clickbench_q42/datafusion:vortex-file-compressed 10678034 / 10984478 / -2.8% 39484623 / 35575863 / +11.0% 🔴 0.27 / 0.31 / -12.4%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1258127 / 1243400 / +1.2% 52341113 / 47427919 / +10.4% 🔴 0.02 / 0.03 / -8.3%
clickbench_q01/datafusion:parquet 16229163 / 15912944 / +2.0% 75545790 / 68586804 / +10.1% 🔴 0.21 / 0.23 / -7.4%
clickbench_q02/datafusion:parquet 18627060 / 18702288 / -0.4% 84642311 / 79576065 / +6.4% 0.22 / 0.24 / -6.4%
clickbench_q03/datafusion:parquet 17940800 / 17071991 / +5.1% 85779800 / 79873500 / +7.4% 0.21 / 0.21 / -2.1%
clickbench_q04/datafusion:parquet 63995378 / 62425790 / +2.5% 135248450 / 127363780 / +6.2% 0.47 / 0.49 / -3.5%
clickbench_q05/datafusion:parquet 88145805 / 88512174 / -0.4% 163684400 / 155254370 / +5.4% 0.54 / 0.57 / -5.5%
clickbench_q06/datafusion:parquet 1285516 / 1270921 / +1.1% 52087241 / 48380783 / +7.7% 0.02 / 0.03 / -6.0%
clickbench_q07/datafusion:parquet 16882621 / 16565041 / +1.9% 73031793 / 69036347 / +5.8% 0.23 / 0.24 / -3.7%
clickbench_q08/datafusion:parquet 86553400 / 86912752 / -0.4% 165277809 / 157751762 / +4.8% 0.52 / 0.55 / -4.9%
clickbench_q09/datafusion:parquet 182817840 / 191212858 / -4.4% 275924378 / 259688396 / +6.3% 0.66 / 0.74 / -10.0%
clickbench_q10/datafusion:parquet 37844224 / 35839602 / +5.6% 107778601 / 100400005 / +7.3% 0.35 / 0.36 / -1.6%
clickbench_q11/datafusion:parquet 43455664 / 42826834 / +1.5% 115412267 / 110319945 / +4.6% 0.38 / 0.39 / -3.0%
clickbench_q12/datafusion:parquet 96988284 / 96613722 / +0.4% 168241639 / 158843585 / +5.9% 0.58 / 0.61 / -5.2%
clickbench_q13/datafusion:parquet 148921651 / 146510748 / +1.6% 229485329 / 224324470 / +2.3% 0.65 / 0.65 / -0.6%
clickbench_q14/datafusion:parquet 102373080 / 101705540 / +0.7% 179002925 / 170545871 / +5.0% 0.57 / 0.60 / -4.1%
clickbench_q15/datafusion:parquet 69785696 / 70421084 / -0.9% 137831120 / 129776455 / +6.2% 0.51 / 0.54 / -6.7%
clickbench_q16/datafusion:parquet 156882582 / 156029931 / +0.5% 239584765 / 238038157 / +0.6% 0.65 / 0.66 / -0.1%
clickbench_q17/datafusion:parquet 157023730 / 157065184 / -0.0% 240768615 / 238352261 / +1.0% 0.65 / 0.66 / -1.0%
clickbench_q18/datafusion:parquet 316777698 / 317807318 / -0.3% 416692526 / 416310227 / +0.1% 0.76 / 0.76 / -0.4%
clickbench_q19/datafusion:parquet 19145012 / 19400706 / -1.3% 78452938 / 75619711 / +3.7% 0.24 / 0.26 / -4.9%
clickbench_q20/datafusion:parquet 178646034 / 180360512 / -1.0% 286175985 / 279282101 / +2.5% 0.62 / 0.65 / -3.3%
clickbench_q21/datafusion:parquet 173129200 / 173588408 / -0.3% 303953382 / 292691618 / +3.8% 0.57 / 0.59 / -4.0%
clickbench_q22/datafusion:parquet 262061867 / 258275286 / +1.5% 433366051 / 413223091 / +4.9% 0.60 / 0.63 / -3.3%
clickbench_q23/datafusion:parquet 1186624846 / 1174869430 / +1.0% 1260333946 / 1223599558 / +3.0% 0.94 / 0.96 / -1.9%
clickbench_q24/datafusion:parquet 29891464 / 30314158 / -1.4% 93137381 / 86655140 / +7.5% 0.32 / 0.35 / -8.3%
clickbench_q25/datafusion:parquet 36282400 / 37058153 / -2.1% 105188701 / 101966514 / +3.2% 0.34 / 0.36 / -5.1%
clickbench_q26/datafusion:parquet 30493236 / 30582119 / -0.3% 91938961 / 89530897 / +2.7% 0.33 / 0.34 / -2.9%
clickbench_q27/datafusion:parquet 194892537 / 194772300 / +0.1% 297518380 / 285708315 / +4.1% 0.66 / 0.68 / -3.9%
clickbench_q28/datafusion:parquet 627468469 / 626372374 / +0.2% 710633047 / 716805829 / -0.9% 0.88 / 0.87 / +1.0%
clickbench_q29/datafusion:parquet 29916770 / 29440358 / +1.6% 94980086 / 90253101 / +5.2% 0.31 / 0.33 / -3.4%
clickbench_q30/datafusion:parquet 91944941 / 91119463 / +0.9% 178339213 / 167587732 / +6.4% 0.52 / 0.54 / -5.2%
clickbench_q31/datafusion:parquet 103296368 / 103915515 / -0.6% 200723938 / 192324961 / +4.4% 0.51 / 0.54 / -4.8%
clickbench_q32/datafusion:parquet 330046504 / 326933136 / +1.0% 432664874 / 434624459 / -0.5% 0.76 / 0.75 / +1.4%
clickbench_q33/datafusion:parquet 385046568 / 383176408 / +0.5% 483820591 / 475856155 / +1.7% 0.80 / 0.81 / -1.2%
clickbench_q34/datafusion:parquet 383120675 / 383074155 / +0.0% 484000768 / 476707279 / +1.5% 0.79 / 0.80 / -1.5%
clickbench_q35/datafusion:parquet 63130936 / 63905602 / -1.2% 127033280 / 130946315 / -3.0% 0.50 / 0.49 / +1.8%
clickbench_q36/datafusion:parquet 73098430 / 73610906 / -0.7% 139236243 / 136190417 / +2.2% 0.52 / 0.54 / -2.9%
clickbench_q37/datafusion:parquet 35595486 / 35543840 / +0.1% 93700272 / 92373336 / +1.4% 0.38 / 0.38 / -1.3%
clickbench_q38/datafusion:parquet 47814872 / 47710312 / +0.2% 112973255 / 106532675 / +6.0% 0.42 / 0.45 / -5.5%
clickbench_q39/datafusion:parquet 144096480 / 143331494 / +0.5% 214789960 / 207417303 / +3.6% 0.67 / 0.69 / -2.9%
clickbench_q40/datafusion:parquet 20156062 / 19820530 / +1.7% 81477206 / 77805600 / +4.7% 0.25 / 0.25 / -2.9%
clickbench_q41/datafusion:parquet 18938954 / 18820805 / +0.6% 78566870 / 76897500 / +2.2% 0.24 / 0.24 / -1.5%
clickbench_q42/datafusion:parquet 19624726 / 19234504 / +2.0% 80292566 / 76164100 / +5.4% 0.24 / 0.25 / -3.2%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1580122 / 1535127 / +2.9% 23996844 / 23708008 / +1.2% 0.07 / 0.06 / +1.7%
clickbench_q01/duckdb:vortex-file-compressed 12466519 / 12287902 / +1.5% 28947916 / 31367045 / -7.7% 0.43 / 0.39 / +9.9%
clickbench_q02/duckdb:vortex-file-compressed 13349910 / 12774542 / +4.5% 36893106 / 34837490 / +5.9% 0.36 / 0.37 / -1.3%
clickbench_q03/duckdb:vortex-file-compressed 16998529 / 18603948 / -8.6% 50417527 / 44674255 / +12.9% 🔴 0.34 / 0.42 / -19.0%
clickbench_q04/duckdb:vortex-file-compressed 67768556 / 68407436 / -0.9% 102292553 / 105962289 / -3.5% 0.66 / 0.65 / +2.6%
clickbench_q05/duckdb:vortex-file-compressed 67285188 / 66692103 / +0.9% 92843755 / 97129991 / -4.4% 0.72 / 0.69 / +5.5%
clickbench_q06/duckdb:vortex-file-compressed 1879346 / 1781044 / +5.5% 31201673 / 28756892 / +8.5% 0.06 / 0.06 / -2.7%
clickbench_q07/duckdb:vortex-file-compressed 13953843 / 13972052 / -0.1% 29991020 / 32561511 / -7.9% 0.47 / 0.43 / +8.4%
clickbench_q08/duckdb:vortex-file-compressed 83619506 / 82963426 / +0.8% 126167887 / 120307582 / +4.9% 0.66 / 0.69 / -3.9%
clickbench_q09/duckdb:vortex-file-compressed 105298166 / 105620211 / -0.3% 149009814 / 144958387 / +2.8% 0.71 / 0.73 / -3.0%
clickbench_q10/duckdb:vortex-file-compressed 34255663 / 33560760 / +2.1% 70904592 / 66413644 / +6.8% 0.48 / 0.51 / -4.4%
clickbench_q11/duckdb:vortex-file-compressed 35482141 / 38901212 / -8.8% 75169946 / 69069957 / +8.8% 0.47 / 0.56 / -16.2%
clickbench_q12/duckdb:vortex-file-compressed 73839500 / 73184212 / +0.9% 107379635 / 104593938 / +2.7% 0.69 / 0.70 / -1.7%
clickbench_q13/duckdb:vortex-file-compressed 133734467 / 136905883 / -2.3% 178392823 / 170409420 / +4.7% 0.75 / 0.80 / -6.7%
clickbench_q14/duckdb:vortex-file-compressed 82045535 / 77246400 / +6.2% 113524393 / 108124599 / +5.0% 0.72 / 0.71 / +1.2%
clickbench_q15/duckdb:vortex-file-compressed 90846994 / 90831576 / +0.0% 130179547 / 128892667 / +1.0% 0.70 / 0.70 / -1.0%
clickbench_q16/duckdb:vortex-file-compressed 165073116 / 164117466 / +0.6% 214755000 / 236326097 / -9.1% 0.77 / 0.69 / +10.7%
clickbench_q17/duckdb:vortex-file-compressed 165158758 / 162514868 / +1.6% 215193183 / 209754216 / +2.6% 0.77 / 0.77 / -0.9%
clickbench_q18/duckdb:vortex-file-compressed 311701651 / 312610556 / -0.3% 411939207 / 377911126 / +9.0% 0.76 / 0.83 / -8.5%
clickbench_q19/duckdb:vortex-file-compressed 17213280 / 16134671 / +6.7% 45601807 / 39907846 / +14.3% 🔴 0.38 / 0.40 / -6.6%
clickbench_q20/duckdb:vortex-file-compressed 112130068 / 110591172 / +1.4% 195168492 / 191022070 / +2.2% 0.57 / 0.58 / -0.8%
clickbench_q21/duckdb:vortex-file-compressed 158308059 / 156567083 / +1.1% 302728008 / 281710736 / +7.5% 0.52 / 0.56 / -5.9%
clickbench_q22/duckdb:vortex-file-compressed 238064496 / 238504625 / -0.2% 467248217 / 423318939 / +10.4% 🔴 0.51 / 0.56 / -9.6%
clickbench_q23/duckdb:vortex-file-compressed 57660422 / 61802827 / -6.7% 96261872 / 95647177 / +0.6% 0.60 / 0.65 / -7.3%
clickbench_q24/duckdb:vortex-file-compressed 26813344 / 26946126 / -0.5% 48962092 / 41919923 / +16.8% 🔴 0.55 / 0.64 / -14.8%
clickbench_q25/duckdb:vortex-file-compressed 35118523 / 33313454 / +5.4% 51740903 / 58265767 / -11.2% 🟢 0.68 / 0.57 / +18.7%
clickbench_q26/duckdb:vortex-file-compressed 20877967 / 20702329 / +0.8% 38312475 / 35451805 / +8.1% 0.54 / 0.58 / -6.7%
clickbench_q27/duckdb:vortex-file-compressed 145190293 / 145730897 / -0.4% 261965091 / 248281287 / +5.5% 0.55 / 0.59 / -5.6%
clickbench_q28/duckdb:vortex-file-compressed 586537229 / 610971317 / -4.0% 681307259 / 673331311 / +1.2% 0.86 / 0.91 / -5.1%
clickbench_q29/duckdb:vortex-file-compressed 18784244 / 20193699 / -7.0% 40193259 / 33254654 / +20.9% 🔴 0.47 / 0.61 / -23.0%
clickbench_q30/duckdb:vortex-file-compressed 67630938 / 67390820 / +0.4% 117314819 / 110349133 / +6.3% 0.58 / 0.61 / -5.6%
clickbench_q31/duckdb:vortex-file-compressed 124406178 / 124437252 / -0.0% 208917005 / 193986435 / +7.7% 0.60 / 0.64 / -7.2%
clickbench_q32/duckdb:vortex-file-compressed 437334688 / 447289328 / -2.2% 489927117 / 497746349 / -1.6% 0.89 / 0.90 / -0.7%
clickbench_q33/duckdb:vortex-file-compressed 397330196 / 393104450 / +1.1% 509177658 / 504963620 / +0.8% 0.78 / 0.78 / +0.2%
clickbench_q34/duckdb:vortex-file-compressed 400488664 / 399536196 / +0.2% 527829953 / 523539995 / +0.8% 0.76 / 0.76 / -0.6%
clickbench_q35/duckdb:vortex-file-compressed 103211258 / 103857712 / -0.6% 138409683 / 134821112 / +2.7% 0.75 / 0.77 / -3.2%
clickbench_q36/duckdb:vortex-file-compressed 15915321 / 15717928 / +1.3% 35336394 / 32492785 / +8.8% 0.45 / 0.48 / -6.9%
clickbench_q37/duckdb:vortex-file-compressed 12024123 / 12042325 / -0.2% 27888787 / 28099703 / -0.8% 0.43 / 0.43 / +0.6%
clickbench_q38/duckdb:vortex-file-compressed 15090786 / 12646462 / +19.3% 🔴 28640375 / 30716438 / -6.8% 0.53 / 0.41 / +28.0%
clickbench_q39/duckdb:vortex-file-compressed 23420554 / 22731357 / +3.0% 39544506 / 37920558 / +4.3% 0.59 / 0.60 / -1.2%
clickbench_q40/duckdb:vortex-file-compressed 11195078 / 10368833 / +8.0% 30070314 / 29809381 / +0.9% 0.37 / 0.35 / +7.0%
clickbench_q41/duckdb:vortex-file-compressed 12302456 / 10934370 / +12.5% 🔴 27615083 / 27656022 / -0.1% 0.45 / 0.40 / +12.7%
clickbench_q42/duckdb:vortex-file-compressed 11332830 / 10995582 / +3.1% 28577280 / 27606232 / +3.5% 0.40 / 0.40 / -0.4%
duckdb / parquet / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 7959092 / 7780850 / +2.3% 23144258 / 18888255 / +22.5% 🔴 0.34 / 0.41 / -16.5%
clickbench_q01/duckdb:parquet 9774033 / 10695762 / -8.6% 22543348 / 20134342 / +12.0% 🔴 0.43 / 0.53 / -18.4%
clickbench_q02/duckdb:parquet 15417590 / 15450844 / -0.2% 35091329 / 31213463 / +12.4% 🔴 0.44 / 0.50 / -11.2%
clickbench_q03/duckdb:parquet 16880813 / 19906996 / -15.2% 🟢 62542951 / 52439292 / +19.3% 🔴 0.27 / 0.38 / -28.9%
clickbench_q04/duckdb:parquet 69456256 / 70276870 / -1.2% 94692836 / 98485246 / -3.9% 0.73 / 0.71 / +2.8%
clickbench_q05/duckdb:parquet 80401608 / 78879088 / +1.9% 124304147 / 118096126 / +5.3% 0.65 / 0.67 / -3.2%
clickbench_q06/duckdb:parquet 15524602 / 14871291 / +4.4% 28265953 / 23520352 / +20.2% 🔴 0.55 / 0.63 / -13.1%
clickbench_q07/duckdb:parquet 10586819 / 11260412 / -6.0% 22294207 / 21193608 / +5.2% 0.47 / 0.53 / -10.6%
clickbench_q08/duckdb:parquet 83022387 / 83131931 / -0.1% 131464180 / 119360263 / +10.1% 🔴 0.63 / 0.70 / -9.3%
clickbench_q09/duckdb:parquet 117769652 / 115267577 / +2.2% 170307856 / 154865025 / +10.0% 0.69 / 0.74 / -7.1%
clickbench_q10/duckdb:parquet 32429376 / 31662921 / +2.4% 74510833 / 66593452 / +11.9% 🔴 0.44 / 0.48 / -8.5%
clickbench_q11/duckdb:parquet 36384010 / 36217800 / +0.5% 84592933 / 73585949 / +15.0% 🔴 0.43 / 0.49 / -12.6%
clickbench_q12/duckdb:parquet 90835782 / 92668022 / -2.0% 135598616 / 127222567 / +6.6% 0.67 / 0.73 / -8.0%
clickbench_q13/duckdb:parquet 154847289 / 142902493 / +8.4% 223058339 / 203503717 / +9.6% 0.69 / 0.70 / -1.1%
clickbench_q14/duckdb:parquet 95746554 / 100931010 / -5.1% 140395385 / 142578856 / -1.5% 0.68 / 0.71 / -3.7%
clickbench_q15/duckdb:parquet 94876078 / 94424042 / +0.5% 127090773 / 126545252 / +0.4% 0.75 / 0.75 / +0.0%
clickbench_q16/duckdb:parquet 169337520 / 169802936 / -0.3% 236505822 / 228721765 / +3.4% 0.72 / 0.74 / -3.6%
clickbench_q17/duckdb:parquet 179557771 / 178084182 / +0.8% 233013869 / 223767530 / +4.1% 0.77 / 0.80 / -3.2%
clickbench_q18/duckdb:parquet 321020238 / 317561518 / +1.1% 410021437 / 409600597 / +0.1% 0.78 / 0.78 / +1.0%
clickbench_q19/duckdb:parquet 13155768 / 13354478 / -1.5% 45290935 / 40603604 / +11.5% 🔴 0.29 / 0.33 / -11.7%
clickbench_q20/duckdb:parquet 133633226 / 133217734 / +0.3% 268608324 / 245767513 / +9.3% 0.50 / 0.54 / -8.2%
clickbench_q21/duckdb:parquet 182076380 / 179336073 / +1.5% 334238744 / 323294596 / +3.4% 0.54 / 0.55 / -1.8%
clickbench_q22/duckdb:parquet 240006901 / 246793442 / -2.7% 430896038 / 402408001 / +7.1% 0.56 / 0.61 / -9.2%
clickbench_q23/duckdb:parquet 148899415 / 145752246 / +2.2% 161741148 / 165812139 / -2.5% 0.92 / 0.88 / +4.7%
clickbench_q24/duckdb:parquet 42761390 / 43011690 / -0.6% 63461893 / 61088944 / +3.9% 0.67 / 0.70 / -4.3%
clickbench_q25/duckdb:parquet 39345060 / 41474574 / -5.1% 98479991 / 90239472 / +9.1% 0.40 / 0.46 / -13.1%
clickbench_q26/duckdb:parquet 29528020 / 29538496 / -0.0% 48758551 / 45304858 / +7.6% 0.61 / 0.65 / -7.1%
clickbench_q27/duckdb:parquet 144216582 / 144031302 / +0.1% 277359094 / 256407141 / +8.2% 0.52 / 0.56 / -7.4%
clickbench_q28/duckdb:parquet 898757526 / 899536288 / -0.1% 988665334 / 1008486709 / -2.0% 0.91 / 0.89 / +1.9%
clickbench_q29/duckdb:parquet 17424710 / 17733423 / -1.7% 33937749 / 30347518 / +11.8% 🔴 0.51 / 0.58 / -12.1%
clickbench_q30/duckdb:parquet 91843466 / 92657892 / -0.9% 187289371 / 171059179 / +9.5% 0.49 / 0.54 / -9.5%
clickbench_q31/duckdb:parquet 146979025 / 152698216 / -3.7% 286023997 / 289063380 / -1.1% 0.51 / 0.53 / -2.7%
clickbench_q32/duckdb:parquet 439178986 / 475882554 / -7.7% 485164346 / 512052613 / -5.3% 0.91 / 0.93 / -2.6%
clickbench_q33/duckdb:parquet 437395562 / 448593868 / -2.5% 480794690 / 482334422 / -0.3% 0.91 / 0.93 / -2.2%
clickbench_q34/duckdb:parquet 460768310 / 448335022 / +2.8% 493714273 / 479449796 / +3.0% 0.93 / 0.94 / -0.2%
clickbench_q35/duckdb:parquet 100937214 / 100032940 / +0.9% 127507613 / 120079770 / +6.2% 0.79 / 0.83 / -5.0%
clickbench_q36/duckdb:parquet 30733544 / 31133700 / -1.3% 42372862 / 40998399 / +3.4% 0.73 / 0.76 / -4.5%
clickbench_q37/duckdb:parquet 22869254 / 22967350 / -0.4% 31344523 / 32082520 / -2.3% 0.73 / 0.72 / +1.9%
clickbench_q38/duckdb:parquet 24341742 / 23603792 / +3.1% 33972677 / 34104155 / -0.4% 0.72 / 0.69 / +3.5%
clickbench_q39/duckdb:parquet 56192984 / 56355491 / -0.3% 66548749 / 66837546 / -0.4% 0.84 / 0.84 / +0.1%
clickbench_q40/duckdb:parquet 12755278 / 12898720 / -1.1% 22020819 / 23409984 / -5.9% 0.58 / 0.55 / +5.1%
clickbench_q41/duckdb:parquet 12696788 / 12711978 / -0.1% 22332509 / 21491253 / +3.9% 0.57 / 0.59 / -3.9%
clickbench_q42/duckdb:parquet 14299558 / 14105888 / +1.4% 23576669 / 25067224 / -5.9% 0.61 / 0.56 / +7.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.8%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.988x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.997x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24239141 / 24743421 / -2.0% 44179907 / 44767111 / -1.3% 0.55 / 0.55 / -0.7%
tpcds_q02/datafusion:vortex-file-compressed 44968374 / 45654037 / -1.5% 63900032 / 63024461 / +1.4% 0.70 / 0.72 / -2.9%
tpcds_q03/datafusion:vortex-file-compressed 11708723 / 11931000 / -1.9% 30354234 / 30684389 / -1.1% 0.39 / 0.39 / -0.8%
tpcds_q04/datafusion:vortex-file-compressed 113003798 / 112581409 / +0.4% 148577065 / 139511476 / +6.5% 0.76 / 0.81 / -5.7%
tpcds_q05/datafusion:vortex-file-compressed 60334121 / 60244708 / +0.1% 82755674 / 85358875 / -3.0% 0.73 / 0.71 / +3.3%
tpcds_q06/datafusion:vortex-file-compressed 23986788 / 23711737 / +1.2% 47028065 / 47533673 / -1.1% 0.51 / 0.50 / +2.2%
tpcds_q07/datafusion:vortex-file-compressed 32955966 / 32786014 / +0.5% 57443725 / 57169638 / +0.5% 0.57 / 0.57 / +0.0%
tpcds_q08/datafusion:vortex-file-compressed 25544680 / 25782736 / -0.9% 43966083 / 45222565 / -2.8% 0.58 / 0.57 / +1.9%
tpcds_q09/datafusion:vortex-file-compressed 16965315 / 17362689 / -2.3% 35817895 / 35813546 / +0.0% 0.47 / 0.48 / -2.3%
tpcds_q10/datafusion:vortex-file-compressed 29377855 / 28906960 / +1.6% 50144228 / 48046061 / +4.4% 0.59 / 0.60 / -2.6%
tpcds_q11/datafusion:vortex-file-compressed 63080826 / 63336746 / -0.4% 89760253 / 89083560 / +0.8% 0.70 / 0.71 / -1.2%
tpcds_q12/datafusion:vortex-file-compressed 16207037 / 16503446 / -1.8% 32717568 / 32331839 / +1.2% 0.50 / 0.51 / -3.0%
tpcds_q13/datafusion:vortex-file-compressed 34329146 / 34093193 / +0.7% 53402150 / 55110668 / -3.1% 0.64 / 0.62 / +3.9%
tpcds_q14/datafusion:vortex-file-compressed 92958140 / 92325329 / +0.7% 119818685 / 118736065 / +0.9% 0.78 / 0.78 / -0.2%
tpcds_q15/datafusion:vortex-file-compressed 24138687 / 24015689 / +0.5% 44883938 / 45154221 / -0.6% 0.54 / 0.53 / +1.1%
tpcds_q16/datafusion:vortex-file-compressed 21550396 / 20463126 / +5.3% 42568531 / 41302326 / +3.1% 0.51 / 0.50 / +2.2%
tpcds_q17/datafusion:vortex-file-compressed 55000117 / 61143162 / -10.0% 🟢 85563291 / 75490208 / +13.3% 🔴 0.64 / 0.81 / -20.6%
tpcds_q18/datafusion:vortex-file-compressed 68022600 / 68759050 / -1.1% 96045274 / 94364833 / +1.8% 0.71 / 0.73 / -2.8%
tpcds_q19/datafusion:vortex-file-compressed 18021466 / 18360324 / -1.8% 41456256 / 42313541 / -2.0% 0.43 / 0.43 / +0.2%
tpcds_q20/datafusion:vortex-file-compressed 17647286 / 17535445 / +0.6% 35608856 / 35209552 / +1.1% 0.50 / 0.50 / -0.5%
tpcds_q21/datafusion:vortex-file-compressed 17137856 / 18059388 / -5.1% 39484983 / 41038682 / -3.8% 0.43 / 0.44 / -1.4%
tpcds_q22/datafusion:vortex-file-compressed 49847386 / 50320286 / -0.9% 71040378 / 71773348 / -1.0% 0.70 / 0.70 / +0.1%
tpcds_q23/datafusion:vortex-file-compressed 73030424 / 76121899 / -4.1% 100355436 / 100740958 / -0.4% 0.73 / 0.76 / -3.7%
tpcds_q24/datafusion:vortex-file-compressed 71089568 / 71050890 / +0.1% 94936519 / 95093258 / -0.2% 0.75 / 0.75 / +0.2%
tpcds_q25/datafusion:vortex-file-compressed 48713766 / 56355602 / -13.6% 🟢 73570712 / 76635512 / -4.0% 0.66 / 0.74 / -10.0%
tpcds_q26/datafusion:vortex-file-compressed 29816136 / 30169208 / -1.2% 50369466 / 53147844 / -5.2% 0.59 / 0.57 / +4.3%
tpcds_q27/datafusion:vortex-file-compressed 63488146 / 62269197 / +2.0% 88631359 / 89935516 / -1.5% 0.72 / 0.69 / +3.5%
tpcds_q28/datafusion:vortex-file-compressed 18311076 / 18222565 / +0.5% 38959559 / 37886769 / +2.8% 0.47 / 0.48 / -2.3%
tpcds_q29/datafusion:vortex-file-compressed 61783416 / 61540754 / +0.4% 86404422 / 84108925 / +2.7% 0.72 / 0.73 / -2.3%
tpcds_q30/datafusion:vortex-file-compressed 27408545 / 27244742 / +0.6% 45974598 / 47943163 / -4.1% 0.60 / 0.57 / +4.9%
tpcds_q31/datafusion:vortex-file-compressed 64943220 / 64780354 / +0.3% 92200156 / 92791885 / -0.6% 0.70 / 0.70 / +0.9%
tpcds_q32/datafusion:vortex-file-compressed 13471272 / 13798203 / -2.4% 31174023 / 30869287 / +1.0% 0.43 / 0.45 / -3.3%
tpcds_q33/datafusion:vortex-file-compressed 26770506 / 26735210 / +0.1% 49521259 / 51077495 / -3.0% 0.54 / 0.52 / +3.3%
tpcds_q34/datafusion:vortex-file-compressed 18513040 / 19000272 / -2.6% 38583061 / 36845011 / +4.7% 0.48 / 0.52 / -7.0%
tpcds_q35/datafusion:vortex-file-compressed 36240430 / 37792840 / -4.1% 59013187 / 58181789 / +1.4% 0.61 / 0.65 / -5.5%
tpcds_q36/datafusion:vortex-file-compressed 48912492 / 48463504 / +0.9% 73523052 / 74556088 / -1.4% 0.67 / 0.65 / +2.3%
tpcds_q37/datafusion:vortex-file-compressed 13322949 / 14302206 / -6.8% 34624728 / 35639707 / -2.8% 0.38 / 0.40 / -4.1%
tpcds_q38/datafusion:vortex-file-compressed 29869397 / 29866442 / +0.0% 52349371 / 53020036 / -1.3% 0.57 / 0.56 / +1.3%
tpcds_q39/datafusion:vortex-file-compressed 65537475 / 65037561 / +0.8% 91662907 / 90091434 / +1.7% 0.71 / 0.72 / -1.0%
tpcds_q40/datafusion:vortex-file-compressed 25332837 / 25183410 / +0.6% 45215692 / 46536543 / -2.8% 0.56 / 0.54 / +3.5%
tpcds_q41/datafusion:vortex-file-compressed 16425106 / 16407965 / +0.1% 31538056 / 30728886 / +2.6% 0.52 / 0.53 / -2.5%
tpcds_q42/datafusion:vortex-file-compressed 11607261 / 11353061 / +2.2% 28337259 / 28999180 / -2.3% 0.41 / 0.39 / +4.6%
tpcds_q43/datafusion:vortex-file-compressed 13241336 / 13562835 / -2.4% 32127334 / 32223254 / -0.3% 0.41 / 0.42 / -2.1%
tpcds_q44/datafusion:vortex-file-compressed 25886151 / 26282588 / -1.5% 50980894 / 50193253 / +1.6% 0.51 / 0.52 / -3.0%
tpcds_q45/datafusion:vortex-file-compressed 27702706 / 27547160 / +0.6% 48963616 / 49088510 / -0.3% 0.57 / 0.56 / +0.8%
tpcds_q46/datafusion:vortex-file-compressed 24345332 / 24125814 / +0.9% 49000836 / 47609145 / +2.9% 0.50 / 0.51 / -2.0%
tpcds_q47/datafusion:vortex-file-compressed 78175600 / 78632440 / -0.6% 108846549 / 109034441 / -0.2% 0.72 / 0.72 / -0.4%
tpcds_q48/datafusion:vortex-file-compressed 31127647 / 31537764 / -1.3% 51888513 / 52381916 / -0.9% 0.60 / 0.60 / -0.4%
tpcds_q49/datafusion:vortex-file-compressed 60067535 / 60270401 / -0.3% 83471543 / 87444835 / -4.5% 0.72 / 0.69 / +4.4%
tpcds_q50/datafusion:vortex-file-compressed 35246430 / 34224602 / +3.0% 53774353 / 54814323 / -1.9% 0.66 / 0.62 / +5.0%
tpcds_q51/datafusion:vortex-file-compressed 61115796 / 61377919 / -0.4% 84799947 / 86751917 / -2.3% 0.72 / 0.71 / +1.9%
tpcds_q52/datafusion:vortex-file-compressed 11901022 / 11745622 / +1.3% 28917958 / 28733649 / +0.6% 0.41 / 0.41 / +0.7%
tpcds_q53/datafusion:vortex-file-compressed 18686422 / 18351810 / +1.8% 38335687 / 38232007 / +0.3% 0.49 / 0.48 / +1.5%
tpcds_q54/datafusion:vortex-file-compressed 33756770 / 34905964 / -3.3% 60403074 / 62390425 / -3.2% 0.56 / 0.56 / -0.1%
tpcds_q55/datafusion:vortex-file-compressed 11478944 / 11143762 / +3.0% 28076035 / 28516778 / -1.5% 0.41 / 0.39 / +4.6%
tpcds_q56/datafusion:vortex-file-compressed 27324079 / 26656184 / +2.5% 48675975 / 50495307 / -3.6% 0.56 / 0.53 / +6.3%
tpcds_q57/datafusion:vortex-file-compressed 73320490 / 73793768 / -0.6% 99939692 / 100578784 / -0.6% 0.73 / 0.73 / -0.0%
tpcds_q58/datafusion:vortex-file-compressed 40729800 / 40622953 / +0.3% 66690820 / 67356325 / -1.0% 0.61 / 0.60 / +1.3%
tpcds_q59/datafusion:vortex-file-compressed 32708338 / 31951048 / +2.4% 53571986 / 54211352 / -1.2% 0.61 / 0.59 / +3.6%
tpcds_q60/datafusion:vortex-file-compressed 28012155 / 26474416 / +5.8% 49687968 / 49303914 / +0.8% 0.56 / 0.54 / +5.0%
tpcds_q61/datafusion:vortex-file-compressed 24950632 / 25070194 / -0.5% 48401689 / 48725664 / -0.7% 0.52 / 0.51 / +0.2%
tpcds_q62/datafusion:vortex-file-compressed 17430208 / 17385512 / +0.3% 36204748 / 37263726 / -2.8% 0.48 / 0.47 / +3.2%
tpcds_q63/datafusion:vortex-file-compressed 18276952 / 18410504 / -0.7% 39445900 / 38764218 / +1.8% 0.46 / 0.47 / -2.4%
tpcds_q64/datafusion:vortex-file-compressed 320139668 / 321232989 / -0.3% 355792358 / 358753354 / -0.8% 0.90 / 0.90 / +0.5%
tpcds_q65/datafusion:vortex-file-compressed 76296711 / 76701812 / -0.5% 95132476 / 97165896 / -2.1% 0.80 / 0.79 / +1.6%
tpcds_q66/datafusion:vortex-file-compressed 52980800 / 53628338 / -1.2% 74601637 / 77804844 / -4.1% 0.71 / 0.69 / +3.0%
tpcds_q67/datafusion:vortex-file-compressed 56173448 / 56685410 / -0.9% 85513303 / 85569312 / -0.1% 0.66 / 0.66 / -0.8%
tpcds_q68/datafusion:vortex-file-compressed 23691760 / 24329306 / -2.6% 47911733 / 48270453 / -0.7% 0.49 / 0.50 / -1.9%
tpcds_q69/datafusion:vortex-file-compressed 29078202 / 28561158 / +1.8% 48692642 / 50443000 / -3.5% 0.60 / 0.57 / +5.5%
tpcds_q70/datafusion:vortex-file-compressed 70974866 / 72009396 / -1.4% 94937918 / 93629816 / +1.4% 0.75 / 0.77 / -2.8%
tpcds_q71/datafusion:vortex-file-compressed 18320716 / 19951656 / -8.2% 40048128 / 39229222 / +2.1% 0.46 / 0.51 / -10.1%
tpcds_q72/datafusion:vortex-file-compressed 500020478 / 478911026 / +4.4% 504836102 / 502886600 / +0.4% 0.99 / 0.95 / +4.0%
tpcds_q73/datafusion:vortex-file-compressed 17152552 / 17340740 / -1.1% 37875562 / 39090977 / -3.1% 0.45 / 0.44 / +2.1%
tpcds_q74/datafusion:vortex-file-compressed 46322843 / 45643538 / +1.5% 70716297 / 71461191 / -1.0% 0.66 / 0.64 / +2.6%
tpcds_q75/datafusion:vortex-file-compressed 132309724 / 130030788 / +1.8% 158629601 / 163428401 / -2.9% 0.83 / 0.80 / +4.8%
tpcds_q76/datafusion:vortex-file-compressed 42532966 / 42199296 / +0.8% 64544288 / 65776752 / -1.9% 0.66 / 0.64 / +2.7%
tpcds_q77/datafusion:vortex-file-compressed 35094175 / 34986012 / +0.3% 62055905 / 59538229 / +4.2% 0.57 / 0.59 / -3.8%
tpcds_q78/datafusion:vortex-file-compressed 81022853 / 80636714 / +0.5% 109563479 / 110986079 / -1.3% 0.74 / 0.73 / +1.8%
tpcds_q79/datafusion:vortex-file-compressed 21182044 / 21180484 / +0.0% 43140297 / 42237642 / +2.1% 0.49 / 0.50 / -2.1%
tpcds_q80/datafusion:vortex-file-compressed 76869954 / 77690949 / -1.1% 109442616 / 114898836 / -4.7% 0.70 / 0.68 / +3.9%
tpcds_q81/datafusion:vortex-file-compressed 28514500 / 27271557 / +4.6% 45485251 / 46533264 / -2.3% 0.63 / 0.59 / +7.0%
tpcds_q82/datafusion:vortex-file-compressed 14130153 / 13281345 / +6.4% 35690265 / 36673771 / -2.7% 0.40 / 0.36 / +9.3%
tpcds_q83/datafusion:vortex-file-compressed 36087985 / 36487148 / -1.1% 59367325 / 57973211 / +2.4% 0.61 / 0.63 / -3.4%
tpcds_q84/datafusion:vortex-file-compressed 11984254 / 11752378 / +2.0% 27971924 / 28506246 / -1.9% 0.43 / 0.41 / +3.9%
tpcds_q85/datafusion:vortex-file-compressed 59915048 / 60438884 / -0.9% 85768588 / 86101633 / -0.4% 0.70 / 0.70 / -0.5%
tpcds_q86/datafusion:vortex-file-compressed 16461196 / 16491536 / -0.2% 33776593 / 32730307 / +3.2% 0.49 / 0.50 / -3.3%
tpcds_q87/datafusion:vortex-file-compressed 29742044 / 30031900 / -1.0% 53473567 / 50935867 / +5.0% 0.56 / 0.59 / -5.7%
tpcds_q88/datafusion:vortex-file-compressed 34795158 / 34379623 / +1.2% 60609096 / 62957513 / -3.7% 0.57 / 0.55 / +5.1%
tpcds_q89/datafusion:vortex-file-compressed 21299704 / 21515268 / -1.0% 41895113 / 43479736 / -3.6% 0.51 / 0.49 / +2.7%
tpcds_q90/datafusion:vortex-file-compressed 10519586 / 10466258 / +0.5% 25591787 / 26027209 / -1.7% 0.41 / 0.40 / +2.2%
tpcds_q91/datafusion:vortex-file-compressed 16393490 / 16633890 / -1.4% 36865185 / 35403298 / +4.1% 0.44 / 0.47 / -5.4%
tpcds_q92/datafusion:vortex-file-compressed 13745322 / 13829034 / -0.6% 32408261 / 31430346 / +3.1% 0.42 / 0.44 / -3.6%
tpcds_q93/datafusion:vortex-file-compressed 24050121 / 24283596 / -1.0% 46423041 / 45732926 / +1.5% 0.52 / 0.53 / -2.4%
tpcds_q94/datafusion:vortex-file-compressed 19882888 / 19551623 / +1.7% 39932995 / 40487391 / -1.4% 0.50 / 0.48 / +3.1%
tpcds_q95/datafusion:vortex-file-compressed 46143650 / 46213448 / -0.2% 69401298 / 68988220 / +0.6% 0.66 / 0.67 / -0.7%
tpcds_q96/datafusion:vortex-file-compressed 9529153 / 9338437 / +2.0% 25884366 / 26409391 / -2.0% 0.37 / 0.35 / +4.1%
tpcds_q97/datafusion:vortex-file-compressed 21427599 / 21109724 / +1.5% 43539136 / 43444599 / +0.2% 0.49 / 0.49 / +1.3%
tpcds_q98/datafusion:vortex-file-compressed 16983450 / 16859008 / +0.7% 36585555 / 37494621 / -2.4% 0.46 / 0.45 / +3.2%
tpcds_q99/datafusion:vortex-file-compressed 19382662 / 19485123 / -0.5% 38391587 / 39167464 / -2.0% 0.50 / 0.50 / +1.5%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30828877 / 31244232 / -1.3% 53137517 / 51021573 / +4.1% 0.58 / 0.61 / -5.3%
tpcds_q02/datafusion:parquet 39965286 / 40018910 / -0.1% 58242260 / 58312395 / -0.1% 0.69 / 0.69 / -0.0%
tpcds_q03/datafusion:parquet 16347772 / 16554970 / -1.3% 31028030 / 32456787 / -4.4% 0.53 / 0.51 / +3.3%
tpcds_q04/datafusion:parquet 200360200 / 200980194 / -0.3% 229705251 / 233330133 / -1.6% 0.87 / 0.86 / +1.3%
tpcds_q05/datafusion:parquet 72481102 / 71735606 / +1.0% 97308739 / 95769889 / +1.6% 0.74 / 0.75 / -0.6%
tpcds_q06/datafusion:parquet 28502212 / 28577850 / -0.3% 50556081 / 49331794 / +2.5% 0.56 / 0.58 / -2.7%
tpcds_q07/datafusion:parquet 46871878 / 47161014 / -0.6% 68377233 / 68754817 / -0.5% 0.69 / 0.69 / -0.1%
tpcds_q08/datafusion:parquet 31845575 / 30510004 / +4.4% 49790416 / 51555850 / -3.4% 0.64 / 0.59 / +8.1%
tpcds_q09/datafusion:parquet 29911801 / 31018792 / -3.6% 45218534 / 46193156 / -2.1% 0.66 / 0.67 / -1.5%
tpcds_q10/datafusion:parquet 42290978 / 42332572 / -0.1% 61182385 / 62242213 / -1.7% 0.69 / 0.68 / +1.6%
tpcds_q11/datafusion:parquet 94961950 / 96910958 / -2.0% 120005540 / 122939095 / -2.4% 0.79 / 0.79 / +0.4%
tpcds_q12/datafusion:parquet 21772936 / 21976188 / -0.9% 35966258 / 36639872 / -1.8% 0.61 / 0.60 / +0.9%
tpcds_q13/datafusion:parquet 42643488 / 43569315 / -2.1% 66755250 / 69490769 / -3.9% 0.64 / 0.63 / +1.9%
tpcds_q14/datafusion:parquet 124618532 / 129194064 / -3.5% 151520121 / 152623498 / -0.7% 0.82 / 0.85 / -2.8%
tpcds_q15/datafusion:parquet 32982051 / 33072862 / -0.3% 50346389 / 51823461 / -2.9% 0.66 / 0.64 / +2.7%
tpcds_q16/datafusion:parquet 37361912 / 36691004 / +1.8% 54297236 / 54689049 / -0.7% 0.69 / 0.67 / +2.6%
tpcds_q17/datafusion:parquet 77053100 / 80013206 / -3.7% 102337132 / 109328044 / -6.4% 0.75 / 0.73 / +2.9%
tpcds_q18/datafusion:parquet 60948213 / 59979316 / +1.6% 80620966 / 79694177 / +1.2% 0.76 / 0.75 / +0.4%
tpcds_q19/datafusion:parquet 26589207 / 25998368 / +2.3% 47453594 / 46940167 / +1.1% 0.56 / 0.55 / +1.2%
tpcds_q20/datafusion:parquet 23328372 / 22703418 / +2.8% 36644584 / 37546968 / -2.4% 0.64 / 0.60 / +5.3%
tpcds_q21/datafusion:parquet 18029221 / 18440244 / -2.2% 33090261 / 32818653 / +0.8% 0.54 / 0.56 / -3.0%
tpcds_q22/datafusion:parquet 75008109 / 75156337 / -0.2% 89343560 / 89757574 / -0.5% 0.84 / 0.84 / +0.3%
tpcds_q23/datafusion:parquet 108089964 / 106702432 / +1.3% 140868546 / 137722656 / +2.3% 0.77 / 0.77 / -1.0%
tpcds_q24/datafusion:parquet 96395547 / 97675110 / -1.3% 123077185 / 125280851 / -1.8% 0.78 / 0.78 / +0.5%
tpcds_q25/datafusion:parquet 79688612 / 80030112 / -0.4% 106086989 / 105063679 / +1.0% 0.75 / 0.76 / -1.4%
tpcds_q26/datafusion:parquet 44480668 / 43432561 / +2.4% 65073983 / 64952406 / +0.2% 0.68 / 0.67 / +2.2%
tpcds_q27/datafusion:parquet 75164843 / 75552932 / -0.5% 100344745 / 98677724 / +1.7% 0.75 / 0.77 / -2.2%
tpcds_q28/datafusion:parquet 27868334 / 27588590 / +1.0% 45008636 / 48365474 / -6.9% 0.62 / 0.57 / +8.5%
tpcds_q29/datafusion:parquet 77992536 / 79513464 / -1.9% 104868550 / 105244676 / -0.4% 0.74 / 0.76 / -1.6%
tpcds_q30/datafusion:parquet 44735546 / 43811370 / +2.1% 63448950 / 70377654 / -9.8% 0.71 / 0.62 / +13.3%
tpcds_q31/datafusion:parquet 80940272 / 80528115 / +0.5% 102910541 / 104606168 / -1.6% 0.79 / 0.77 / +2.2%
tpcds_q32/datafusion:parquet 23348522 / 23755925 / -1.7% 41472033 / 40615744 / +2.1% 0.56 / 0.58 / -3.7%
tpcds_q33/datafusion:parquet 32565862 / 33302891 / -2.2% 51712594 / 53669010 / -3.6% 0.63 / 0.62 / +1.5%
tpcds_q34/datafusion:parquet 23436776 / 23423446 / +0.1% 39092918 / 39540306 / -1.1% 0.60 / 0.59 / +1.2%
tpcds_q35/datafusion:parquet 49222046 / 49231942 / -0.0% 66005820 / 71044030 / -7.1% 0.75 / 0.69 / +7.6%
tpcds_q36/datafusion:parquet 53600074 / 53564891 / +0.1% 73780237 / 76131571 / -3.1% 0.73 / 0.70 / +3.3%
tpcds_q37/datafusion:parquet 23376858 / 22798383 / +2.5% 38127358 / 38858920 / -1.9% 0.61 / 0.59 / +4.5%
tpcds_q38/datafusion:parquet 43500820 / 44032064 / -1.2% 64327035 / 63751318 / +0.9% 0.68 / 0.69 / -2.1%
tpcds_q39/datafusion:parquet 72556860 / 71861774 / +1.0% 90178641 / 90424100 / -0.3% 0.80 / 0.79 / +1.2%
tpcds_q40/datafusion:parquet 31161734 / 29743845 / +4.8% 51482640 / 51800896 / -0.6% 0.61 / 0.57 / +5.4%
tpcds_q41/datafusion:parquet 17424141 / 17700334 / -1.6% 30024023 / 29799695 / +0.8% 0.58 / 0.59 / -2.3%
tpcds_q42/datafusion:parquet 15588414 / 15555538 / +0.2% 29684474 / 30447331 / -2.5% 0.53 / 0.51 / +2.8%
tpcds_q43/datafusion:parquet 17274864 / 17768372 / -2.8% 32221118 / 33595633 / -4.1% 0.54 / 0.53 / +1.4%
tpcds_q44/datafusion:parquet 33321928 / 32823153 / +1.5% 52952406 / 53342735 / -0.7% 0.63 / 0.62 / +2.3%
tpcds_q45/datafusion:parquet 37136908 / 37430048 / -0.8% 55080418 / 56775465 / -3.0% 0.67 / 0.66 / +2.3%
tpcds_q46/datafusion:parquet 29118134 / 29133674 / -0.1% 49988127 / 50378538 / -0.8% 0.58 / 0.58 / +0.7%
tpcds_q47/datafusion:parquet 95583674 / 96676464 / -1.1% 124431387 / 123291452 / +0.9% 0.77 / 0.78 / -2.0%
tpcds_q48/datafusion:parquet 38295380 / 38869823 / -1.5% 60980739 / 60766492 / +0.4% 0.63 / 0.64 / -1.8%
tpcds_q49/datafusion:parquet 78093583 / 73996931 / +5.5% 101219976 / 99949977 / +1.3% 0.77 / 0.74 / +4.2%
tpcds_q50/datafusion:parquet 49254470 / 49338931 / -0.2% 72207110 / 72447386 / -0.3% 0.68 / 0.68 / +0.2%
tpcds_q51/datafusion:parquet 67444736 / 67647312 / -0.3% 91864074 / 91427824 / +0.5% 0.73 / 0.74 / -0.8%
tpcds_q52/datafusion:parquet 16074958 / 16093068 / -0.1% 30315144 / 31271703 / -3.1% 0.53 / 0.51 / +3.0%
tpcds_q53/datafusion:parquet 22156334 / 22340787 / -0.8% 39196494 / 40288716 / -2.7% 0.57 / 0.55 / +1.9%
tpcds_q54/datafusion:parquet 45411897 / 45822666 / -0.9% 69297867 / 70315326 / -1.4% 0.66 / 0.65 / +0.6%
tpcds_q55/datafusion:parquet 15487870 / 15542844 / -0.4% 28870912 / 30229980 / -4.5% 0.54 / 0.51 / +4.3%
tpcds_q56/datafusion:parquet 31540378 / 31612888 / -0.2% 53340924 / 54316665 / -1.8% 0.59 / 0.58 / +1.6%
tpcds_q57/datafusion:parquet 99465167 / 98922431 / +0.5% 122956295 / 123926867 / -0.8% 0.81 / 0.80 / +1.3%
tpcds_q58/datafusion:parquet 65179841 / 64392668 / +1.2% 88713441 / 88785427 / -0.1% 0.73 / 0.73 / +1.3%
tpcds_q59/datafusion:parquet 43082352 / 43179086 / -0.2% 63090576 / 63010227 / +0.1% 0.68 / 0.69 / -0.4%
tpcds_q60/datafusion:parquet 31903729 / 31548074 / +1.1% 54441695 / 54258278 / +0.3% 0.59 / 0.58 / +0.8%
tpcds_q61/datafusion:parquet 34250583 / 34724996 / -1.4% 54435036 / 56935681 / -4.4% 0.63 / 0.61 / +3.2%
tpcds_q62/datafusion:parquet 23906849 / 24219820 / -1.3% 37852043 / 38470206 / -1.6% 0.63 / 0.63 / +0.3%
tpcds_q63/datafusion:parquet 21975340 / 21948080 / +0.1% 38474462 / 39024793 / -1.4% 0.57 / 0.56 / +1.6%
tpcds_q64/datafusion:parquet 205872900 / 204772782 / +0.5% 239090509 / 245155103 / -2.5% 0.86 / 0.84 / +3.1%
tpcds_q65/datafusion:parquet 39196232 / 38775129 / +1.1% 60124585 / 60638398 / -0.8% 0.65 / 0.64 / +1.9%
tpcds_q66/datafusion:parquet 61912704 / 61814225 / +0.2% 82658491 / 82035407 / +0.8% 0.75 / 0.75 / -0.6%
tpcds_q67/datafusion:parquet 70568272 / 70102366 / +0.7% 96646989 / 97164073 / -0.5% 0.73 / 0.72 / +1.2%
tpcds_q68/datafusion:parquet 29489580 / 28700237 / +2.8% 52339547 / 51933709 / +0.8% 0.56 / 0.55 / +2.0%
tpcds_q69/datafusion:parquet 42637222 / 41863850 / +1.8% 59516676 / 60525652 / -1.7% 0.72 / 0.69 / +3.6%
tpcds_q70/datafusion:parquet 33100859 / 32745947 / +1.1% 55900159 / 55394295 / +0.9% 0.59 / 0.59 / +0.2%
tpcds_q71/datafusion:parquet 22912580 / 24466028 / -6.3% 38782963 / 39524551 / -1.9% 0.59 / 0.62 / -4.6%
tpcds_q72/datafusion:parquet 549801797 / 555633202 / -1.0% 575819804 / 585241065 / -1.6% 0.95 / 0.95 / +0.6%
tpcds_q73/datafusion:parquet 22484324 / 22047952 / +2.0% 38742415 / 38508724 / +0.6% 0.58 / 0.57 / +1.4%
tpcds_q74/datafusion:parquet 66250066 / 67023290 / -1.2% 89443522 / 87119232 / +2.7% 0.74 / 0.77 / -3.7%
tpcds_q75/datafusion:parquet 149887850 / 150083580 / -0.1% 177251325 / 180689544 / -1.9% 0.85 / 0.83 / +1.8%
tpcds_q76/datafusion:parquet 47426954 / 49075047 / -3.4% 63629248 / 66627358 / -4.5% 0.75 / 0.74 / +1.2%
tpcds_q77/datafusion:parquet 52522854 / 52150816 / +0.7% 75441781 / 74305045 / +1.5% 0.70 / 0.70 / -0.8%
tpcds_q78/datafusion:parquet 92586219 / 93369350 / -0.8% 128568599 / 128144983 / +0.3% 0.72 / 0.73 / -1.2%
tpcds_q79/datafusion:parquet 25962688 / 25805780 / +0.6% 45228185 / 45313789 / -0.2% 0.57 / 0.57 / +0.8%
tpcds_q80/datafusion:parquet 81977786 / 81984135 / -0.0% 114437758 / 111201131 / +2.9% 0.72 / 0.74 / -2.8%
tpcds_q81/datafusion:parquet 38597624 / 39759168 / -2.9% 62191052 / 58899610 / +5.6% 0.62 / 0.68 / -8.1%
tpcds_q82/datafusion:parquet 25236821 / 24937416 / +1.2% 40544381 / 39389680 / +2.9% 0.62 / 0.63 / -1.7%
tpcds_q83/datafusion:parquet 48078870 / 48632592 / -1.1% 68506842 / 66750900 / +2.6% 0.70 / 0.73 / -3.7%
tpcds_q84/datafusion:parquet 29390286 / 29399004 / -0.0% 46569921 / 45012119 / +3.5% 0.63 / 0.65 / -3.4%
tpcds_q85/datafusion:parquet 87363277 / 85707486 / +1.9% 111438844 / 109936436 / +1.4% 0.78 / 0.78 / +0.6%
tpcds_q86/datafusion:parquet 20677350 / 20928932 / -1.2% 33474242 / 34159778 / -2.0% 0.62 / 0.61 / +0.8%
tpcds_q87/datafusion:parquet 43609612 / 43369470 / +0.6% 62158611 / 62107959 / +0.1% 0.70 / 0.70 / +0.5%
tpcds_q88/datafusion:parquet 39343301 / 38467722 / +2.3% 55967393 / 57791151 / -3.2% 0.70 / 0.67 / +5.6%
tpcds_q89/datafusion:parquet 25233796 / 25491954 / -1.0% 42954408 / 42423345 / +1.3% 0.59 / 0.60 / -2.2%
tpcds_q90/datafusion:parquet 15354265 / 15414907 / -0.4% 31930400 / 30075043 / +6.2% 0.48 / 0.51 / -6.2%
tpcds_q91/datafusion:parquet 31706782 / 32773140 / -3.3% 50019463 / 49605387 / +0.8% 0.63 / 0.66 / -4.1%
tpcds_q92/datafusion:parquet 24020688 / 23719498 / +1.3% 40973401 / 41022543 / -0.1% 0.59 / 0.58 / +1.4%
tpcds_q93/datafusion:parquet 28021064 / 27758616 / +0.9% 48520586 / 50348090 / -3.6% 0.58 / 0.55 / +4.7%
tpcds_q94/datafusion:parquet 32005828 / 32186656 / -0.6% 50746994 / 49331914 / +2.9% 0.63 / 0.65 / -3.3%
tpcds_q95/datafusion:parquet 65861586 / 65926329 / -0.1% 84656368 / 80911659 / +4.6% 0.78 / 0.81 / -4.5%
tpcds_q96/datafusion:parquet 13025080 / 13154838 / -1.0% 28350058 / 28449878 / -0.4% 0.46 / 0.46 / -0.6%
tpcds_q97/datafusion:parquet 31953702 / 32064861 / -0.3% 52901944 / 52669111 / +0.4% 0.60 / 0.61 / -0.8%
tpcds_q98/datafusion:parquet 22671988 / 22906354 / -1.0% 38915964 / 39260607 / -0.9% 0.58 / 0.58 / -0.1%
tpcds_q99/datafusion:parquet 28538248 / 28472993 / +0.2% 42603223 / 43127017 / -1.2% 0.67 / 0.66 / +1.5%
duckdb / vortex-file-compressed / ns (1.012x ➖, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 14955830 / 15197538 / -1.6% 22666614 / 23212528 / -2.4% 0.66 / 0.65 / +0.8%
tpcds_q02/duckdb:vortex-file-compressed 14971284 / 14944378 / +0.2% 19645890 / 20473842 / -4.0% 0.76 / 0.73 / +4.4%
tpcds_q03/duckdb:vortex-file-compressed 13001922 / 12534316 / +3.7% 19507638 / 20712813 / -5.8% 0.67 / 0.61 / +10.1%
tpcds_q04/duckdb:vortex-file-compressed 50452650 / 50321690 / +0.3% 60477804 / 61867284 / -2.2% 0.83 / 0.81 / +2.6%
tpcds_q05/duckdb:vortex-file-compressed 18891134 / 18475728 / +2.2% 25612411 / 25097813 / +2.1% 0.74 / 0.74 / +0.2%
tpcds_q06/duckdb:vortex-file-compressed 26637888 / 26850750 / -0.8% 40995153 / 43107802 / -4.9% 0.65 / 0.62 / +4.3%
tpcds_q07/duckdb:vortex-file-compressed 15724790 / 16119155 / -2.4% 28304291 / 32378427 / -12.6% 🟢 0.56 / 0.50 / +11.6%
tpcds_q08/duckdb:vortex-file-compressed 18921496 / 18878757 / +0.2% 27012214 / 28153383 / -4.1% 0.70 / 0.67 / +4.5%
tpcds_q09/duckdb:vortex-file-compressed 13650068 / 13660899 / -0.1% 21482732 / 23169909 / -7.3% 0.64 / 0.59 / +7.8%
tpcds_q10/duckdb:vortex-file-compressed 27620506 / 27539388 / +0.3% 41931824 / 43141834 / -2.8% 0.66 / 0.64 / +3.2%
tpcds_q11/duckdb:vortex-file-compressed 40415024 / 40361173 / +0.1% 51577652 / 52149878 / -1.1% 0.78 / 0.77 / +1.2%
tpcds_q12/duckdb:vortex-file-compressed 10245864 / 10251686 / -0.1% 16164950 / 16463045 / -1.8% 0.63 / 0.62 / +1.8%
tpcds_q13/duckdb:vortex-file-compressed 23279680 / 21410924 / +8.7% 37244604 / 35076117 / +6.2% 0.63 / 0.61 / +2.4%
tpcds_q14/duckdb:vortex-file-compressed 58789790 / 57783175 / +1.7% 73248742 / 69970380 / +4.7% 0.80 / 0.83 / -2.8%
tpcds_q15/duckdb:vortex-file-compressed 20816759 / 20779843 / +0.2% 34286301 / 26789773 / +28.0% 🔴 0.61 / 0.78 / -21.7%
tpcds_q16/duckdb:vortex-file-compressed 17765218 / 17322760 / +2.6% 26386110 / 27704428 / -4.8% 0.67 / 0.63 / +7.7%
tpcds_q17/duckdb:vortex-file-compressed 29865254 / 29993978 / -0.4% 45572138 / 44343857 / +2.8% 0.66 / 0.68 / -3.1%
tpcds_q18/duckdb:vortex-file-compressed 28669673 / 28782876 / -0.4% 39244133 / 39953581 / -1.8% 0.73 / 0.72 / +1.4%
tpcds_q19/duckdb:vortex-file-compressed 23871650 / 23374331 / +2.1% 36351476 / 35157705 / +3.4% 0.66 / 0.66 / -1.2%
tpcds_q20/duckdb:vortex-file-compressed 10413118 / 10526106 / -1.1% 17326353 / 16648085 / +4.1% 0.60 / 0.63 / -4.9%
tpcds_q21/duckdb:vortex-file-compressed 9700548 / 11458172 / -15.3% 🟢 17792540 / 18596734 / -4.3% 0.55 / 0.62 / -11.5%
tpcds_q22/duckdb:vortex-file-compressed 28436208 / 28890352 / -1.6% 40627637 / 38456611 / +5.6% 0.70 / 0.75 / -6.8%
tpcds_q23/duckdb:vortex-file-compressed 37735888 / 36623632 / +3.0% 53061777 / 48753904 / +8.8% 0.71 / 0.75 / -5.3%
tpcds_q24/duckdb:vortex-file-compressed 28013432 / 28131446 / -0.4% 41648994 / 41234495 / +1.0% 0.67 / 0.68 / -1.4%
tpcds_q25/duckdb:vortex-file-compressed 25935178 / 25952166 / -0.1% 40370126 / 40759961 / -1.0% 0.64 / 0.64 / +0.9%
tpcds_q26/duckdb:vortex-file-compressed 14738217 / 13348598 / +10.4% 🔴 20006396 / 20899165 / -4.3% 0.74 / 0.64 / +15.3%
tpcds_q27/duckdb:vortex-file-compressed 17495108 / 17478048 / +0.1% 33290526 / 31850763 / +4.5% 0.53 / 0.55 / -4.2%
tpcds_q28/duckdb:vortex-file-compressed 12739304 / 12043484 / +5.8% 19571419 / 18772376 / +4.3% 0.65 / 0.64 / +1.5%
tpcds_q29/duckdb:vortex-file-compressed 28451185 / 28777578 / -1.1% 47532082 / 47644052 / -0.2% 0.60 / 0.60 / -0.9%
tpcds_q30/duckdb:vortex-file-compressed 19423700 / 19163732 / +1.4% 28330504 / 28617494 / -1.0% 0.69 / 0.67 / +2.4%
tpcds_q31/duckdb:vortex-file-compressed 19134985 / 19126442 / +0.0% 28859235 / 26560304 / +8.7% 0.66 / 0.72 / -7.9%
tpcds_q32/duckdb:vortex-file-compressed 9809388 / 10113176 / -3.0% 17687748 / 19908083 / -11.2% 🟢 0.55 / 0.51 / +9.2%
tpcds_q33/duckdb:vortex-file-compressed 16580480 / 16541424 / +0.2% 26427288 / 28363504 / -6.8% 0.63 / 0.58 / +7.6%
tpcds_q34/duckdb:vortex-file-compressed 15649748 / 15725962 / -0.5% 23465648 / 24505301 / -4.2% 0.67 / 0.64 / +3.9%
tpcds_q35/duckdb:vortex-file-compressed 45858940 / 45975124 / -0.3% 60341510 / 59410782 / +1.6% 0.76 / 0.77 / -1.8%
tpcds_q36/duckdb:vortex-file-compressed 14915971 / 15427356 / -3.3% 27993711 / 27535071 / +1.7% 0.53 / 0.56 / -4.9%
tpcds_q37/duckdb:vortex-file-compressed 15833762 / 14036666 / +12.8% 🔴 25981351 / 22893636 / +13.5% 🔴 0.61 / 0.61 / -0.6%
tpcds_q38/duckdb:vortex-file-compressed 22514830 / 22164682 / +1.6% 29432427 / 28586309 / +3.0% 0.76 / 0.78 / -1.3%
tpcds_q39/duckdb:vortex-file-compressed 18463398 / 18246504 / +1.2% 30046068 / 28131769 / +6.8% 0.61 / 0.65 / -5.3%
tpcds_q40/duckdb:vortex-file-compressed 15317428 / 13221850 / +15.8% 🔴 24397604 / 20165326 / +21.0% 🔴 0.63 / 0.66 / -4.2%
tpcds_q41/duckdb:vortex-file-compressed 6551824 / 6502304 / +0.8% 9195030 / 9185209 / +0.1% 0.71 / 0.71 / +0.7%
tpcds_q42/duckdb:vortex-file-compressed 8230100 / 8217445 / +0.2% 15941050 / 18094071 / -11.9% 🟢 0.52 / 0.45 / +13.7%
tpcds_q43/duckdb:vortex-file-compressed 9991878 / 10223202 / -2.3% 17238447 / 18490438 / -6.8% 0.58 / 0.55 / +4.8%
tpcds_q44/duckdb:vortex-file-compressed 14950799 / 15933796 / -6.2% 26765121 / 27305389 / -2.0% 0.56 / 0.58 / -4.3%
tpcds_q45/duckdb:vortex-file-compressed 22556447 / 22300658 / +1.1% 28885497 / 32273709 / -10.5% 🟢 0.78 / 0.69 / +13.0%
tpcds_q46/duckdb:vortex-file-compressed 18773370 / 18588664 / +1.0% 30382679 / 30604522 / -0.7% 0.62 / 0.61 / +1.7%
tpcds_q47/duckdb:vortex-file-compressed 31205008 / 30455240 / +2.5% 42038837 / 43216683 / -2.7% 0.74 / 0.70 / +5.3%
tpcds_q48/duckdb:vortex-file-compressed 20065508 / 19643408 / +2.1% 31618676 / 31312106 / +1.0% 0.63 / 0.63 / +1.2%
tpcds_q49/duckdb:vortex-file-compressed 17036800 / 16209724 / +5.1% 29326773 / 30800437 / -4.8% 0.58 / 0.53 / +10.4%
tpcds_q50/duckdb:vortex-file-compressed 16447730 / 16787093 / -2.0% 26656225 / 28559431 / -6.7% 0.62 / 0.59 / +5.0%
tpcds_q51/duckdb:vortex-file-compressed 76224886 / 77594960 / -1.8% 62035770 / 61469880 / +0.9% 1.23 / 1.26 / -2.7%
tpcds_q52/duckdb:vortex-file-compressed 8525308 / 8470638 / +0.6% 16736725 / 19963863 / -16.2% 🟢 0.51 / 0.42 / +20.1%
tpcds_q53/duckdb:vortex-file-compressed 14268980 / 14709882 / -3.0% 27975748 / 26279715 / +6.5% 0.51 / 0.56 / -8.9%
tpcds_q54/duckdb:vortex-file-compressed 20551839 / 20086760 / +2.3% 28901069 / 28512044 / +1.4% 0.71 / 0.70 / +0.9%
tpcds_q55/duckdb:vortex-file-compressed 11251838 / 8606170 / +30.7% 🔴 16090310 / 18173900 / -11.5% 🟢 0.70 / 0.47 / +47.7%
tpcds_q56/duckdb:vortex-file-compressed 18783446 / 17415892 / +7.9% 29278113 / 30572935 / -4.2% 0.64 / 0.57 / +12.6%
tpcds_q57/duckdb:vortex-file-compressed 24454750 / 24662846 / -0.8% 30884820 / 34394667 / -10.2% 🟢 0.79 / 0.72 / +10.4%
tpcds_q58/duckdb:vortex-file-compressed 18334350 / 17707476 / +3.5% 27447715 / 28140555 / -2.5% 0.67 / 0.63 / +6.2%
tpcds_q59/duckdb:vortex-file-compressed 18613112 / 18366940 / +1.3% 24329088 / 25672524 / -5.2% 0.77 / 0.72 / +6.9%
tpcds_q60/duckdb:vortex-file-compressed 18077756 / 17828469 / +1.4% 30207499 / 28939493 / +4.4% 0.60 / 0.62 / -2.9%
tpcds_q61/duckdb:vortex-file-compressed 19686222 / 19615868 / +0.4% 31456148 / 31233573 / +0.7% 0.63 / 0.63 / -0.4%
tpcds_q62/duckdb:vortex-file-compressed 10291482 / 10181168 / +1.1% 18307334 / 16006575 / +14.4% 🔴 0.56 / 0.64 / -11.6%
tpcds_q63/duckdb:vortex-file-compressed 13679192 / 13630025 / +0.4% 23091280 / 23714232 / -2.6% 0.59 / 0.57 / +3.1%
tpcds_q64/duckdb:vortex-file-compressed 62881838 / 63272741 / -0.6% 76519043 / 80823326 / -5.3% 0.82 / 0.78 / +5.0%
tpcds_q65/duckdb:vortex-file-compressed 16232197 / 14910811 / +8.9% 25482995 / 29125800 / -12.5% 🟢 0.64 / 0.51 / +24.4%
tpcds_q66/duckdb:vortex-file-compressed 20932959 / 20965818 / -0.2% 26316630 / 29023964 / -9.3% 0.80 / 0.72 / +10.1%
tpcds_q67/duckdb:vortex-file-compressed 65685034 / 67603331 / -2.8% 80135483 / 81715989 / -1.9% 0.82 / 0.83 / -0.9%
tpcds_q68/duckdb:vortex-file-compressed 18105866 / 18246389 / -0.8% 33409125 / 30538139 / +9.4% 0.54 / 0.60 / -9.3%
tpcds_q69/duckdb:vortex-file-compressed 28640300 / 29033996 / -1.4% 42549219 / 42655176 / -0.2% 0.67 / 0.68 / -1.1%
tpcds_q70/duckdb:vortex-file-compressed 19059046 / 18915028 / +0.8% 31862406 / 31610199 / +0.8% 0.60 / 0.60 / -0.0%
tpcds_q71/duckdb:vortex-file-compressed 12960688 / 12976305 / -0.1% 21182440 / 23271032 / -9.0% 0.61 / 0.56 / +9.7%
tpcds_q72/duckdb:vortex-file-compressed 61550600 / 62242520 / -1.1% 76501487 / 80761959 / -5.3% 0.80 / 0.77 / +4.4%
tpcds_q73/duckdb:vortex-file-compressed 14862742 / 14956299 / -0.6% 22272363 / 23030032 / -3.3% 0.67 / 0.65 / +2.8%
tpcds_q74/duckdb:vortex-file-compressed 27745114 / 27496888 / +0.9% 36073321 / 37967556 / -5.0% 0.77 / 0.72 / +6.2%
tpcds_q75/duckdb:vortex-file-compressed 28233054 / 28280988 / -0.2% 41184603 / 39918546 / +3.2% 0.69 / 0.71 / -3.2%
tpcds_q76/duckdb:vortex-file-compressed 12392780 / 12327313 / +0.5% 25526958 / 23704851 / +7.7% 0.49 / 0.52 / -6.6%
tpcds_q77/duckdb:vortex-file-compressed 15797762 / 15890048 / -0.6% 23348183 / 27553050 / -15.3% 🟢 0.68 / 0.58 / +17.3%
tpcds_q78/duckdb:vortex-file-compressed 37101169 / 37789896 / -1.8% 47747529 / 49253315 / -3.1% 0.78 / 0.77 / +1.3%
tpcds_q79/duckdb:vortex-file-compressed 16570296 / 14309723 / +15.8% 🔴 25693188 / 24460900 / +5.0% 0.64 / 0.59 / +10.2%
tpcds_q80/duckdb:vortex-file-compressed 27205881 / 29010788 / -6.2% 38441142 / 46610739 / -17.5% 🟢 0.71 / 0.62 / +13.7%
tpcds_q81/duckdb:vortex-file-compressed 22307234 / 22498062 / -0.8% 30702303 / 30804000 / -0.3% 0.73 / 0.73 / -0.5%
tpcds_q82/duckdb:vortex-file-compressed 34117308 / 32229560 / +5.9% 39957243 / 40911462 / -2.3% 0.85 / 0.79 / +8.4%
tpcds_q83/duckdb:vortex-file-compressed 19941054 / 19991327 / -0.3% 25805191 / 25972593 / -0.6% 0.77 / 0.77 / +0.4%
tpcds_q84/duckdb:vortex-file-compressed 15422708 / 12671788 / +21.7% 🔴 22526909 / 22738918 / -0.9% 0.68 / 0.56 / +22.9%
tpcds_q85/duckdb:vortex-file-compressed 31297738 / 30985262 / +1.0% 40053389 / 42057548 / -4.8% 0.78 / 0.74 / +6.1%
tpcds_q86/duckdb:vortex-file-compressed 11055942 / 10670236 / +3.6% 17262110 / 17727239 / -2.6% 0.64 / 0.60 / +6.4%
tpcds_q87/duckdb:vortex-file-compressed 24011411 / 23960360 / +0.2% 31395021 / 32951278 / -4.7% 0.76 / 0.73 / +5.2%
tpcds_q88/duckdb:vortex-file-compressed 32582112 / 31934145 / +2.0% 45955587 / 44970715 / +2.2% 0.71 / 0.71 / -0.2%
tpcds_q89/duckdb:vortex-file-compressed 14035414 / 13806250 / +1.7% 22737581 / 24684415 / -7.9% 0.62 / 0.56 / +10.4%
tpcds_q90/duckdb:vortex-file-compressed 8145910 / 8042714 / +1.3% 13132009 / 15079982 / -12.9% 🟢 0.62 / 0.53 / +16.3%
tpcds_q91/duckdb:vortex-file-compressed 15403270 / 15216330 / +1.2% 21319102 / 21725660 / -1.9% 0.72 / 0.70 / +3.2%
tpcds_q92/duckdb:vortex-file-compressed 13145152 / 13046194 / +0.8% 22468810 / 24600127 / -8.7% 0.59 / 0.53 / +10.3%
tpcds_q93/duckdb:vortex-file-compressed 17076234 / 17138670 / -0.4% 24177838 / 22745927 / +6.3% 0.71 / 0.75 / -6.3%
tpcds_q94/duckdb:vortex-file-compressed 16166439 / 16258642 / -0.6% 25283371 / 26053149 / -3.0% 0.64 / 0.62 / +2.5%
tpcds_q95/duckdb:vortex-file-compressed 45098907 / 44862974 / +0.5% 53735942 / 53179378 / +1.0% 0.84 / 0.84 / -0.5%
tpcds_q96/duckdb:vortex-file-compressed 7266529 / 7406168 / -1.9% 14371968 / 16888260 / -14.9% 🟢 0.51 / 0.44 / +15.3%
tpcds_q97/duckdb:vortex-file-compressed 21948878 / 22223150 / -1.2% 29252792 / 29439747 / -0.6% 0.75 / 0.75 / -0.6%
tpcds_q98/duckdb:vortex-file-compressed 13186390 / 13227881 / -0.3% 23844359 / 25060984 / -4.9% 0.55 / 0.53 / +4.8%
tpcds_q99/duckdb:vortex-file-compressed 13546661 / 13447540 / +0.7% 19209641 / 22631899 / -15.1% 🟢 0.71 / 0.59 / +18.7%
duckdb / parquet / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24760998 / 26793874 / -7.6% 32365375 / 31992119 / +1.2% 0.77 / 0.84 / -8.7%
tpcds_q02/duckdb:parquet 17084550 / 15928572 / +7.3% 20063747 / 21291995 / -5.8% 0.85 / 0.75 / +13.8%
tpcds_q03/duckdb:parquet 9203145 / 9276660 / -0.8% 15841151 / 15947051 / -0.7% 0.58 / 0.58 / -0.1%
tpcds_q04/duckdb:parquet 129903182 / 130255080 / -0.3% 137260316 / 135523347 / +1.3% 0.95 / 0.96 / -1.5%
tpcds_q05/duckdb:parquet 21876545 / 22003833 / -0.6% 28848987 / 29204009 / -1.2% 0.76 / 0.75 / +0.6%
tpcds_q06/duckdb:parquet 27141476 / 27437318 / -1.1% 38006931 / 36697881 / +3.6% 0.71 / 0.75 / -4.5%
tpcds_q07/duckdb:parquet 15584442 / 15623792 / -0.3% 24784025 / 24872237 / -0.4% 0.63 / 0.63 / +0.1%
tpcds_q08/duckdb:parquet 27588565 / 26771060 / +3.1% 33508681 / 33095980 / +1.2% 0.82 / 0.81 / +1.8%
tpcds_q09/duckdb:parquet 19613172 / 19232758 / +2.0% 23090837 / 22720694 / +1.6% 0.85 / 0.85 / +0.3%
tpcds_q10/duckdb:parquet 28053688 / 31072954 / -9.7% 39087328 / 37902244 / +3.1% 0.72 / 0.82 / -12.5%
tpcds_q11/duckdb:parquet 73024234 / 73300388 / -0.4% 77929758 / 78565445 / -0.8% 0.94 / 0.93 / +0.4%
tpcds_q12/duckdb:parquet 12920000 / 13133048 / -1.6% 18095433 / 18830012 / -3.9% 0.71 / 0.70 / +2.4%
tpcds_q13/duckdb:parquet 24760079 / 24355294 / +1.7% 30918888 / 30819165 / +0.3% 0.80 / 0.79 / +1.3%
tpcds_q14/duckdb:parquet 61979656 / 61107936 / +1.4% 67352070 / 67354475 / -0.0% 0.92 / 0.91 / +1.4%
tpcds_q15/duckdb:parquet 25658260 / 25487626 / +0.7% 30930520 / 30576419 / +1.2% 0.83 / 0.83 / -0.5%
tpcds_q16/duckdb:parquet 20902896 / 21107682 / -1.0% 29984973 / 29191140 / +2.7% 0.70 / 0.72 / -3.6%
tpcds_q17/duckdb:parquet 32618942 / 32817552 / -0.6% 40698830 / 40654159 / +0.1% 0.80 / 0.81 / -0.7%
tpcds_q18/duckdb:parquet 40770576 / 40544057 / +0.6% 52131229 / 49735880 / +4.8% 0.78 / 0.82 / -4.1%
tpcds_q19/duckdb:parquet 25195355 / 25154158 / +0.2% 33863025 / 32851060 / +3.1% 0.74 / 0.77 / -2.8%
tpcds_q20/duckdb:parquet 13923880 / 13846782 / +0.6% 18882485 / 18834961 / +0.3% 0.74 / 0.74 / +0.3%
tpcds_q21/duckdb:parquet 9444368 / 9530270 / -0.9% 12461679 / 12645603 / -1.5% 0.76 / 0.75 / +0.6%
tpcds_q22/duckdb:parquet 35402068 / 35273875 / +0.4% 39466180 / 39197804 / +0.7% 0.90 / 0.90 / -0.3%
tpcds_q23/duckdb:parquet 41347705 / 41238483 / +0.3% 50546153 / 48808394 / +3.6% 0.82 / 0.84 / -3.2%
tpcds_q24/duckdb:parquet 34322047 / 33912383 / +1.2% 42679536 / 41700565 / +2.3% 0.80 / 0.81 / -1.1%
tpcds_q25/duckdb:parquet 31627428 / 31329318 / +1.0% 39810675 / 39706250 / +0.3% 0.79 / 0.79 / +0.7%
tpcds_q26/duckdb:parquet 33063308 / 31490334 / +5.0% 40302258 / 38239845 / +5.4% 0.82 / 0.82 / -0.4%
tpcds_q27/duckdb:parquet 32118111 / 32538754 / -1.3% 39583530 / 39800811 / -0.5% 0.81 / 0.82 / -0.8%
tpcds_q28/duckdb:parquet 17437334 / 18966304 / -8.1% 21963122 / 28814320 / -23.8% 🟢 0.79 / 0.66 / +20.6%
tpcds_q29/duckdb:parquet 31186096 / 31651589 / -1.5% 38899263 / 39164405 / -0.7% 0.80 / 0.81 / -0.8%
tpcds_q30/duckdb:parquet 36112098 / 35600810 / +1.4% 43632887 / 42593828 / +2.4% 0.83 / 0.84 / -1.0%
tpcds_q31/duckdb:parquet 20684383 / 20971660 / -1.4% 26004548 / 28781766 / -9.6% 0.80 / 0.73 / +9.2%
tpcds_q32/duckdb:parquet 12135608 / 12235414 / -0.8% 19524345 / 18268967 / +6.9% 0.62 / 0.67 / -7.2%
tpcds_q33/duckdb:parquet 16249029 / 16400182 / -0.9% 23533042 / 23583721 / -0.2% 0.69 / 0.70 / -0.7%
tpcds_q34/duckdb:parquet 16297170 / 16468720 / -1.0% 22337907 / 22083905 / +1.2% 0.73 / 0.75 / -2.2%
tpcds_q35/duckdb:parquet 47719572 / 47466822 / +0.5% 56331715 / 55686201 / +1.2% 0.85 / 0.85 / -0.6%
tpcds_q36/duckdb:parquet 15919086 / 16184120 / -1.6% 23290474 / 27131334 / -14.2% 🟢 0.68 / 0.60 / +14.6%
tpcds_q37/duckdb:parquet 11555901 / 11614403 / -0.5% 17749020 / 16529978 / +7.4% 0.65 / 0.70 / -7.3%
tpcds_q38/duckdb:parquet 26888070 / 26838623 / +0.2% 30796955 / 31838932 / -3.3% 0.87 / 0.84 / +3.6%
tpcds_q39/duckdb:parquet 24437399 / 25584988 / -4.5% 30451061 / 28589608 / +6.5% 0.80 / 0.89 / -10.3%
tpcds_q40/duckdb:parquet 16488666 / 16485695 / +0.0% 22225999 / 21840148 / +1.8% 0.74 / 0.75 / -1.7%
tpcds_q41/duckdb:parquet 7779408 / 7878178 / -1.3% 13788890 / 13826912 / -0.3% 0.56 / 0.57 / -1.0%
tpcds_q42/duckdb:parquet 8635124 / 8763403 / -1.5% 15158376 / 15621595 / -3.0% 0.57 / 0.56 / +1.5%
tpcds_q43/duckdb:parquet 10683067 / 10666602 / +0.2% 15220998 / 14710790 / +3.5% 0.70 / 0.73 / -3.2%
tpcds_q44/duckdb:parquet 18129817 / 17041164 / +6.4% 21284876 / 21604531 / -1.5% 0.85 / 0.79 / +8.0%
tpcds_q45/duckdb:parquet 23739794 / 23468232 / +1.2% 28547599 / 29550992 / -3.4% 0.83 / 0.79 / +4.7%
tpcds_q46/duckdb:parquet 36941853 / 36861266 / +0.2% 45659417 / 46493360 / -1.8% 0.81 / 0.79 / +2.0%
tpcds_q47/duckdb:parquet 31237041 / 34540644 / -9.6% 37010702 / 36851564 / +0.4% 0.84 / 0.94 / -10.0%
tpcds_q48/duckdb:parquet 21213536 / 21259442 / -0.2% 27081350 / 27897788 / -2.9% 0.78 / 0.76 / +2.8%
tpcds_q49/duckdb:parquet 20151958 / 20290648 / -0.7% 27792957 / 28442155 / -2.3% 0.73 / 0.71 / +1.6%
tpcds_q50/duckdb:parquet 17673094 / 17716349 / -0.2% 23643798 / 23575961 / +0.3% 0.75 / 0.75 / -0.5%
tpcds_q51/duckdb:parquet 54520000 / 53886580 / +1.2% 61100041 / 86354341 / -29.2% 🟢 0.89 / 0.62 / +43.0%
tpcds_q52/duckdb:parquet 8937768 / 8929976 / +0.1% 16161657 / 15661573 / +3.2% 0.55 / 0.57 / -3.0%
tpcds_q53/duckdb:parquet 11861054 / 11963120 / -0.9% 16725598 / 17533667 / -4.6% 0.71 / 0.68 / +3.9%
tpcds_q54/duckdb:parquet 20812452 / 20610576 / +1.0% 30146985 / 29383745 / +2.6% 0.69 / 0.70 / -1.6%
tpcds_q55/duckdb:parquet 8859457 / 8790286 / +0.8% 15996416 / 15588128 / +2.6% 0.55 / 0.56 / -1.8%
tpcds_q56/duckdb:parquet 18799169 / 16785695 / +12.0% 🔴 24257118 / 23771168 / +2.0% 0.77 / 0.71 / +9.8%
tpcds_q57/duckdb:parquet 29051218 / 29145382 / -0.3% 34604731 / 37479422 / -7.7% 0.84 / 0.78 / +8.0%
tpcds_q58/duckdb:parquet 19268914 / 19223975 / +0.2% 26772429 / 26815064 / -0.2% 0.72 / 0.72 / +0.4%
tpcds_q59/duckdb:parquet 20126692 / 20011324 / +0.6% 24806033 / 24706109 / +0.4% 0.81 / 0.81 / +0.2%
tpcds_q60/duckdb:parquet 17760301 / 17553199 / +1.2% 24349390 / 24434794 / -0.3% 0.73 / 0.72 / +1.5%
tpcds_q61/duckdb:parquet 22499928 / 22213696 / +1.3% 28114660 / 28591953 / -1.7% 0.80 / 0.78 / +3.0%
tpcds_q62/duckdb:parquet 10706348 / 10950000 / -2.2% 15041316 / 14816135 / +1.5% 0.71 / 0.74 / -3.7%
tpcds_q63/duckdb:parquet 11235073 / 11034265 / +1.8% 16645040 / 16562634 / +0.5% 0.67 / 0.67 / +1.3%
tpcds_q64/duckdb:parquet 53170002 / 55522178 / -4.2% 63462023 / 69549144 / -8.8% 0.84 / 0.80 / +4.9%
tpcds_q65/duckdb:parquet 14725394 / 14762440 / -0.3% 20470070 / 24015969 / -14.8% 🟢 0.72 / 0.61 / +17.0%
tpcds_q66/duckdb:parquet 25025179 / 24948636 / +0.3% 31262579 / 32008783 / -2.3% 0.80 / 0.78 / +2.7%
tpcds_q67/duckdb:parquet 77275118 / 77244326 / +0.0% 83773789 / 84329556 / -0.7% 0.92 / 0.92 / +0.7%
tpcds_q68/duckdb:parquet 30136834 / 30328331 / -0.6% 39515712 / 45370185 / -12.9% 🟢 0.76 / 0.67 / +14.1%
tpcds_q69/duckdb:parquet 28990213 / 29201606 / -0.7% 39245492 / 39032584 / +0.5% 0.74 / 0.75 / -1.3%
tpcds_q70/duckdb:parquet 17526974 / 17693030 / -0.9% 25447620 / 25705547 / -1.0% 0.69 / 0.69 / +0.1%
tpcds_q71/duckdb:parquet 14983900 / 15014564 / -0.2% 20962314 / 21615001 / -3.0% 0.71 / 0.69 / +2.9%
tpcds_q72/duckdb:parquet 81535459 / 82063650 / -0.6% 86509436 / 88914149 / -2.7% 0.94 / 0.92 / +2.1%
tpcds_q73/duckdb:parquet 13754626 / 13733748 / +0.2% 19969308 / 19191433 / +4.1% 0.69 / 0.72 / -3.7%
tpcds_q74/duckdb:parquet 100357952 / 99670766 / +0.7% 111368495 / 110479232 / +0.8% 0.90 / 0.90 / -0.1%
tpcds_q75/duckdb:parquet 40839944 / 41903574 / -2.5% 51312644 / 51629602 / -0.6% 0.80 / 0.81 / -1.9%
tpcds_q76/duckdb:parquet 13757254 / 13705620 / +0.4% 21836946 / 21274900 / +2.6% 0.63 / 0.64 / -2.2%
tpcds_q77/duckdb:parquet 17183857 / 17788071 / -3.4% 25016544 / 25391421 / -1.5% 0.69 / 0.70 / -1.9%
tpcds_q78/duckdb:parquet 48690864 / 48872492 / -0.4% 55961317 / 54285870 / +3.1% 0.87 / 0.90 / -3.4%
tpcds_q79/duckdb:parquet 21125088 / 21298440 / -0.8% 29002161 / 28662392 / +1.2% 0.73 / 0.74 / -2.0%
tpcds_q80/duckdb:parquet 32681127 / 33007836 / -1.0% 40137453 / 40145697 / -0.0% 0.81 / 0.82 / -1.0%
tpcds_q81/duckdb:parquet 31352803 / 31658392 / -1.0% 40917498 / 39634255 / +3.2% 0.77 / 0.80 / -4.1%
tpcds_q82/duckdb:parquet 13454981 / 13132765 / +2.5% 19834727 / 18744841 / +5.8% 0.68 / 0.70 / -3.2%
tpcds_q83/duckdb:parquet 16605708 / 16680514 / -0.4% 21410366 / 22188994 / -3.5% 0.78 / 0.75 / +3.2%
tpcds_q84/duckdb:parquet 18774542 / 18477654 / +1.6% 24685435 / 23805098 / +3.7% 0.76 / 0.78 / -2.0%
tpcds_q85/duckdb:parquet 35760937 / 35319094 / +1.3% 44526941 / 45070978 / -1.2% 0.80 / 0.78 / +2.5%
tpcds_q86/duckdb:parquet 11493654 / 11475038 / +0.2% 16307087 / 16683910 / -2.3% 0.70 / 0.69 / +2.5%
tpcds_q87/duckdb:parquet 28750396 / 28829709 / -0.3% 32808473 / 32870177 / -0.2% 0.88 / 0.88 / -0.1%
tpcds_q88/duckdb:parquet 26867486 / 29092654 / -7.6% 30955935 / 36161475 / -14.4% 🟢 0.87 / 0.80 / +7.9%
tpcds_q89/duckdb:parquet 12974715 / 13103355 / -1.0% 18218163 / 18540767 / -1.7% 0.71 / 0.71 / +0.8%
tpcds_q90/duckdb:parquet 6928850 / 7953640 / -12.9% 🟢 11436672 / 11110717 / +2.9% 0.61 / 0.72 / -15.4%
tpcds_q91/duckdb:parquet 21572643 / 21621698 / -0.2% 29659979 / 28724706 / +3.3% 0.73 / 0.75 / -3.4%
tpcds_q92/duckdb:parquet 12600218 / 12471104 / +1.0% 19070699 / 19594618 / -2.7% 0.66 / 0.64 / +3.8%
tpcds_q93/duckdb:parquet 21601155 / 21943039 / -1.6% 26447191 / 27257609 / -3.0% 0.82 / 0.81 / +1.5%
tpcds_q94/duckdb:parquet 17061666 / 18821098 / -9.3% 25807991 / 26952859 / -4.2% 0.66 / 0.70 / -5.3%
tpcds_q95/duckdb:parquet 93285994 / 91146238 / +2.3% 97733869 / 99181739 / -1.5% 0.95 / 0.92 / +3.9%
tpcds_q96/duckdb:parquet 7011451 / 7056950 / -0.6% 10596442 / 13102785 / -19.1% 🟢 0.66 / 0.54 / +22.9%
tpcds_q97/duckdb:parquet 25884726 / 26150238 / -1.0% 31942667 / 31740664 / +0.6% 0.81 / 0.82 / -1.6%
tpcds_q98/duckdb:parquet 15167122 / 15252294 / -0.6% 22360690 / 22851612 / -2.1% 0.68 / 0.67 / +1.6%
tpcds_q99/duckdb:parquet 17304442 / 17366211 / -0.4% 21935420 / 21183377 / +3.6% 0.79 / 0.82 / -3.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.035x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.026x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 97148263 / 97601792 / -0.5% 173306213 / 165573862 / +4.7% 0.56 / 0.59 / -4.9%
tpch_q02/datafusion:vortex-file-compressed 65026257 / 65501842 / -0.7% 97065164 / 97115250 / -0.1% 0.67 / 0.67 / -0.7%
tpch_q03/datafusion:vortex-file-compressed 64664755 / 64763540 / -0.2% 119819420 / 117223317 / +2.2% 0.54 / 0.55 / -2.3%
tpch_q04/datafusion:vortex-file-compressed 35062410 / 35664465 / -1.7% 82861343 / 78691428 / +5.3% 0.42 / 0.45 / -6.6%
tpch_q05/datafusion:vortex-file-compressed 115345634 / 117602990 / -1.9% 185794756 / 183025828 / +1.5% 0.62 / 0.64 / -3.4%
tpch_q06/datafusion:vortex-file-compressed 14049033 / 14381997 / -2.3% 73341651 / 67580885 / +8.5% 0.19 / 0.21 / -10.0%
tpch_q07/datafusion:vortex-file-compressed 138729961 / 140959030 / -1.6% 203756673 / 187856341 / +8.5% 0.68 / 0.75 / -9.3%
tpch_q08/datafusion:vortex-file-compressed 145010291 / 143674580 / +0.9% 223746192 / 209701160 / +6.7% 0.65 / 0.69 / -5.4%
tpch_q09/datafusion:vortex-file-compressed 187169384 / 183007337 / +2.3% 258057307 / 258086310 / -0.0% 0.73 / 0.71 / +2.3%
tpch_q10/datafusion:vortex-file-compressed 74223494 / 72596859 / +2.2% 139046516 / 140043351 / -0.7% 0.53 / 0.52 / +3.0%
tpch_q11/datafusion:vortex-file-compressed 43094733 / 43074939 / +0.0% 68809885 / 66655449 / +3.2% 0.63 / 0.65 / -3.1%
tpch_q12/datafusion:vortex-file-compressed 43363941 / 44433285 / -2.4% 98205591 / 97020571 / +1.2% 0.44 / 0.46 / -3.6%
tpch_q13/datafusion:vortex-file-compressed 46133910 / 46608178 / -1.0% 80101604 / 82282084 / -2.7% 0.58 / 0.57 / +1.7%
tpch_q14/datafusion:vortex-file-compressed 25125430 / 24919168 / +0.8% 99733199 / 99018437 / +0.7% 0.25 / 0.25 / +0.1%
tpch_q15/datafusion:vortex-file-compressed 36530559 / 36579899 / -0.1% 102491575 / 98094846 / +4.5% 0.36 / 0.37 / -4.4%
tpch_q16/datafusion:vortex-file-compressed 37839929 / 37328002 / +1.4% 68075439 / 67145244 / +1.4% 0.56 / 0.56 / -0.0%
tpch_q17/datafusion:vortex-file-compressed 176257149 / 174715724 / +0.9% 226659452 / 221256870 / +2.4% 0.78 / 0.79 / -1.5%
tpch_q18/datafusion:vortex-file-compressed 202915539 / 200161780 / +1.4% 267002651 / 273304973 / -2.3% 0.76 / 0.73 / +3.8%
tpch_q19/datafusion:vortex-file-compressed 35206421 / 34018525 / +3.5% 97078532 / 96141828 / +1.0% 0.36 / 0.35 / +2.5%
tpch_q20/datafusion:vortex-file-compressed 62638184 / 62995504 / -0.6% 125324566 / 122785271 / +2.1% 0.50 / 0.51 / -2.6%
tpch_q21/datafusion:vortex-file-compressed 187112822 / 182401199 / +2.6% 249758877 / 236092208 / +5.8% 0.75 / 0.77 / -3.0%
tpch_q22/datafusion:vortex-file-compressed 25321099 / 25547023 / -0.9% 56445211 / 56475490 / -0.1% 0.45 / 0.45 / -0.8%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87302528 / 86660774 / +0.7% 131432157 / 126999368 / +3.5% 0.66 / 0.68 / -2.7%
tpch_q02/datafusion:parquet 159472421 / 157058873 / +1.5% 186361807 / 180482873 / +3.3% 0.86 / 0.87 / -1.7%
tpch_q03/datafusion:parquet 144408175 / 142985576 / +1.0% 194775622 / 187712043 / +3.8% 0.74 / 0.76 / -2.7%
tpch_q04/datafusion:parquet 59918935 / 59278102 / +1.1% 96673986 / 91865371 / +5.2% 0.62 / 0.65 / -3.9%
tpch_q05/datafusion:parquet 182303660 / 181798113 / +0.3% 239668417 / 232372942 / +3.1% 0.76 / 0.78 / -2.8%
tpch_q06/datafusion:parquet 35465204 / 35335024 / +0.4% 78253707 / 76073138 / +2.9% 0.45 / 0.46 / -2.4%
tpch_q07/datafusion:parquet 231516110 / 230242923 / +0.6% 300070300 / 288992965 / +3.8% 0.77 / 0.80 / -3.2%
tpch_q08/datafusion:parquet 235341671 / 233081206 / +1.0% 306959451 / 295010164 / +4.1% 0.77 / 0.79 / -3.0%
tpch_q09/datafusion:parquet 313649223 / 313400681 / +0.1% 386879011 / 380467030 / +1.7% 0.81 / 0.82 / -1.6%
tpch_q10/datafusion:parquet 407807455 / 405767385 / +0.5% 464860377 / 454147584 / +2.4% 0.88 / 0.89 / -1.8%
tpch_q11/datafusion:parquet 105878790 / 105903926 / -0.0% 130500766 / 126152339 / +3.4% 0.81 / 0.84 / -3.4%
tpch_q12/datafusion:parquet 85505307 / 85359933 / +0.2% 131103793 / 123095314 / +6.5% 0.65 / 0.69 / -5.9%
tpch_q13/datafusion:parquet 227599181 / 228291031 / -0.3% 256004319 / 254098809 / +0.7% 0.89 / 0.90 / -1.0%
tpch_q14/datafusion:parquet 86931460 / 88520682 / -1.8% 197802240 / 192068138 / +3.0% 0.44 / 0.46 / -4.6%
tpch_q15/datafusion:parquet 90605574 / 89504603 / +1.2% 143732861 / 140853355 / +2.0% 0.63 / 0.64 / -0.8%
tpch_q16/datafusion:parquet 95502455 / 94832961 / +0.7% 124523968 / 119546250 / +4.2% 0.77 / 0.79 / -3.3%
tpch_q17/datafusion:parquet 215042763 / 217786532 / -1.3% 274069224 / 264569602 / +3.6% 0.78 / 0.82 / -4.7%
tpch_q18/datafusion:parquet 293401106 / 290413224 / +1.0% 331401732 / 338120834 / -2.0% 0.89 / 0.86 / +3.1%
tpch_q19/datafusion:parquet 110746420 / 110529455 / +0.2% 176933456 / 171956084 / +2.9% 0.63 / 0.64 / -2.6%
tpch_q20/datafusion:parquet 182956595 / 183144130 / -0.1% 242629568 / 240532064 / +0.9% 0.75 / 0.76 / -1.0%
tpch_q21/datafusion:parquet 247026347 / 243380938 / +1.5% 315762639 / 312500463 / +1.0% 0.78 / 0.78 / +0.4%
tpch_q22/datafusion:parquet 200482743 / 199821813 / +0.3% 225543040 / 221311840 / +1.9% 0.89 / 0.90 / -1.6%
duckdb / vortex-file-compressed / ns (0.997x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54436948 / 53603892 / +1.6% 105670823 / 93187645 / +13.4% 🔴 0.52 / 0.58 / -10.4%
tpch_q02/duckdb:vortex-file-compressed 31474261 / 32073188 / -1.9% 48415579 / 48174004 / +0.5% 0.65 / 0.67 / -2.4%
tpch_q03/duckdb:vortex-file-compressed 57218652 / 59596099 / -4.0% 112222111 / 110733199 / +1.3% 0.51 / 0.54 / -5.3%
tpch_q04/duckdb:vortex-file-compressed 80843822 / 79653736 / +1.5% 119897889 / 120586985 / -0.6% 0.67 / 0.66 / +2.1%
tpch_q05/duckdb:vortex-file-compressed 64845453 / 62630686 / +3.5% 127577495 / 115154951 / +10.8% 🔴 0.51 / 0.54 / -6.5%
tpch_q06/duckdb:vortex-file-compressed 22276243 / 20404164 / +9.2% 67569430 / 58494648 / +15.5% 🔴 0.33 / 0.35 / -5.5%
tpch_q07/duckdb:vortex-file-compressed 59672450 / 60018835 / -0.6% 132091712 / 129818103 / +1.8% 0.45 / 0.46 / -2.3%
tpch_q08/duckdb:vortex-file-compressed 84895385 / 85380303 / -0.6% 157482977 / 146014244 / +7.9% 0.54 / 0.58 / -7.8%
tpch_q09/duckdb:vortex-file-compressed 165678899 / 165922126 / -0.1% 245047766 / 247910460 / -1.2% 0.68 / 0.67 / +1.0%
tpch_q10/duckdb:vortex-file-compressed 107263479 / 109413059 / -2.0% 177565384 / 168644140 / +5.3% 0.60 / 0.65 / -6.9%
tpch_q11/duckdb:vortex-file-compressed 17295067 / 17687719 / -2.2% 34848816 / 32200641 / +8.2% 0.50 / 0.55 / -9.7%
tpch_q12/duckdb:vortex-file-compressed 56084386 / 67894267 / -17.4% 🟢 112801174 / 132504071 / -14.9% 🟢 0.50 / 0.51 / -3.0%
tpch_q13/duckdb:vortex-file-compressed 91815704 / 91723595 / +0.1% 146321432 / 133642317 / +9.5% 0.63 / 0.69 / -8.6%
tpch_q14/duckdb:vortex-file-compressed 29823427 / 31206458 / -4.4% 76097488 / 78409719 / -2.9% 0.39 / 0.40 / -1.5%
tpch_q15/duckdb:vortex-file-compressed 37627007 / 40302156 / -6.6% 89542790 / 86115829 / +4.0% 0.42 / 0.47 / -10.2%
tpch_q16/duckdb:vortex-file-compressed 42544974 / 42439202 / +0.2% 54031558 / 54901413 / -1.6% 0.79 / 0.77 / +1.9%
tpch_q17/duckdb:vortex-file-compressed 72370281 / 62333811 / +16.1% 🔴 159096539 / 128131124 / +24.2% 🔴 0.45 / 0.49 / -6.5%
tpch_q18/duckdb:vortex-file-compressed 142033510 / 130250355 / +9.0% 169333402 / 161172400 / +5.1% 0.84 / 0.81 / +3.8%
tpch_q19/duckdb:vortex-file-compressed 42636146 / 44004323 / -3.1% 98235119 / 94920359 / +3.5% 0.43 / 0.46 / -6.4%
tpch_q20/duckdb:vortex-file-compressed 59478759 / 61504993 / -3.3% 126538046 / 113111680 / +11.9% 🔴 0.47 / 0.54 / -13.6%
tpch_q21/duckdb:vortex-file-compressed 240050792 / 236951421 / +1.3% 284443624 / 280247590 / +1.5% 0.84 / 0.85 / -0.2%
tpch_q22/duckdb:vortex-file-compressed 42213606 / 41859308 / +0.8% 63345567 / 59649405 / +6.2% 0.67 / 0.70 / -5.0%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72120583 / 71873400 / +0.3% 88725195 / 85505188 / +3.8% 0.81 / 0.84 / -3.3%
tpch_q02/duckdb:parquet 79882955 / 80618002 / -0.9% 91066148 / 91201876 / -0.1% 0.88 / 0.88 / -0.8%
tpch_q03/duckdb:parquet 118405342 / 122376265 / -3.2% 162515213 / 144132070 / +12.8% 🔴 0.73 / 0.85 / -14.2%
tpch_q04/duckdb:parquet 75792842 / 75981079 / -0.2% 96069251 / 94170178 / +2.0% 0.79 / 0.81 / -2.2%
tpch_q05/duckdb:parquet 129652543 / 129524845 / +0.1% 171780291 / 160073704 / +7.3% 0.75 / 0.81 / -6.7%
tpch_q06/duckdb:parquet 33081467 / 33848169 / -2.3% 50975845 / 52526729 / -3.0% 0.65 / 0.64 / +0.7%
tpch_q07/duckdb:parquet 93302389 / 93046592 / +0.3% 148669300 / 128024279 / +16.1% 🔴 0.63 / 0.73 / -13.6%
tpch_q08/duckdb:parquet 150475248 / 150141013 / +0.2% 191032922 / 195040624 / -2.1% 0.79 / 0.77 / +2.3%
tpch_q09/duckdb:parquet 228617204 / 229623432 / -0.4% 266169028 / 261185397 / +1.9% 0.86 / 0.88 / -2.3%
tpch_q10/duckdb:parquet 513670808 / 515364461 / -0.3% 551959769 / 540214167 / +2.2% 0.93 / 0.95 / -2.4%
tpch_q11/duckdb:parquet 33423071 / 33486485 / -0.2% 38726914 / 38620112 / +0.3% 0.86 / 0.87 / -0.5%
tpch_q12/duckdb:parquet 77337536 / 79830312 / -3.1% 90440752 / 87487372 / +3.4% 0.86 / 0.91 / -6.3%
tpch_q13/duckdb:parquet 321742164 / 323662064 / -0.6% 335980803 / 333370774 / +0.8% 0.96 / 0.97 / -1.4%
tpch_q14/duckdb:parquet 111804400 / 111008481 / +0.7% 135298449 / 135777257 / -0.4% 0.83 / 0.82 / +1.1%
tpch_q15/duckdb:parquet 42976607 / 43529136 / -1.3% 81453249 / 83837998 / -2.8% 0.53 / 0.52 / +1.6%
tpch_q16/duckdb:parquet 118170585 / 118665179 / -0.4% 128023401 / 129184948 / -0.9% 0.92 / 0.92 / +0.5%
tpch_q17/duckdb:parquet 80182799 / 80145310 / +0.0% 108447164 / 105587646 / +2.7% 0.74 / 0.76 / -2.6%
tpch_q18/duckdb:parquet 215906840 / 216077573 / -0.1% 170370706 / 176856152 / -3.7% 1.27 / 1.22 / +3.7%
tpch_q19/duckdb:parquet 164936287 / 165214197 / -0.2% 196987230 / 194743184 / +1.2% 0.84 / 0.85 / -1.3%
tpch_q20/duckdb:parquet 135507213 / 135390627 / +0.1% 171466179 / 167374587 / +2.4% 0.79 / 0.81 / -2.3%
tpch_q21/duckdb:parquet 273779753 / 283494102 / -3.4% 296640864 / 284684343 / +4.2% 0.92 / 1.00 / -7.3%
tpch_q22/duckdb:parquet 266696519 / 267623144 / -0.3% 291668577 / 277910657 / +5.0% 0.91 / 0.96 / -5.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.018x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1838983 / 1800430 / +2.1% 6887237 / 6671662 / +3.2% 0.27 / 0.27 / -1.1%
statpopgen_q01/datafusion:vortex-file-compressed 6899362 / 7133194 / -3.3% 19479712 / 17147970 / +13.6% 🔴 0.35 / 0.42 / -14.9%
statpopgen_q02/datafusion:vortex-file-compressed 109987600 / 109585508 / +0.4% 140897917 / 139996990 / +0.6% 0.78 / 0.78 / -0.3%
statpopgen_q03/datafusion:vortex-file-compressed 354994970 / 353459901 / +0.4% 390854859 / 392358510 / -0.4% 0.91 / 0.90 / +0.8%
statpopgen_q04/datafusion:vortex-file-compressed 349486828 / 351279180 / -0.5% 385520096 / 380641848 / +1.3% 0.91 / 0.92 / -1.8%
statpopgen_q05/datafusion:vortex-file-compressed 218142408 / 208320542 / +4.7% 262428592 / 257828667 / +1.8% 0.83 / 0.81 / +2.9%
statpopgen_q06/datafusion:vortex-file-compressed 759450468 / 758263093 / +0.2% 875998448 / 784263190 / +11.7% 🔴 0.87 / 0.97 / -10.3%
statpopgen_q07/datafusion:vortex-file-compressed 293479332 / 292055156 / +0.5% 309345214 / 311394960 / -0.7% 0.95 / 0.94 / +1.2%
statpopgen_q08/datafusion:vortex-file-compressed 298540320 / 297954078 / +0.2% 323111177 / 325217831 / -0.6% 0.92 / 0.92 / +0.9%
statpopgen_q09/datafusion:vortex-file-compressed 245763970 / 252403380 / -2.6% 289106034 / 290265274 / -0.4% 0.85 / 0.87 / -2.2%
statpopgen_q10/datafusion:vortex-file-compressed 749928158 / 750053774 / -0.0% 804851443 / 781870262 / +2.9% 0.93 / 0.96 / -2.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 2010379 / 1966974 / +2.2% 90320486 / 90646597 / -0.4% 0.02 / 0.02 / +2.6%
statpopgen_q01/datafusion:parquet 165124460 / 164696309 / +0.3% 174777442 / 175354225 / -0.3% 0.94 / 0.94 / +0.6%
statpopgen_q02/datafusion:parquet 293273733 / 282826711 / +3.7% 428007143 / 418210550 / +2.3% 0.69 / 0.68 / +1.3%
statpopgen_q03/datafusion:parquet 379463172 / 384399880 / -1.3% 526673587 / 521261450 / +1.0% 0.72 / 0.74 / -2.3%
statpopgen_q04/datafusion:parquet 391879088 / 404729442 / -3.2% 526079969 / 521448698 / +0.9% 0.74 / 0.78 / -4.0%
statpopgen_q05/datafusion:parquet 325178008 / 322469475 / +0.8% 454947825 / 454704531 / +0.1% 0.71 / 0.71 / +0.8%
statpopgen_q06/datafusion:parquet 487392656 / 513959276 / -5.2% 633312369 / 610304604 / +3.8% 0.77 / 0.84 / -8.6%
statpopgen_q07/datafusion:parquet 442486670 / 434508447 / +1.8% 546650188 / 540439505 / +1.1% 0.81 / 0.80 / +0.7%
statpopgen_q08/datafusion:parquet 438886333 / 438505768 / +0.1% 630795954 / 553358772 / +14.0% 🔴 0.70 / 0.79 / -12.2%
statpopgen_q09/datafusion:parquet 363557664 / 366692408 / -0.9% 455123894 / 490759867 / -7.3% 0.80 / 0.75 / +6.9%
statpopgen_q10/datafusion:parquet 577355109 / 585972033 / -1.5% 679603086 / 659352722 / +3.1% 0.85 / 0.89 / -4.4%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9028711 / 9048291 / -0.2% 9448884 / 9355243 / +1.0% 0.96 / 0.97 / -1.2%
statpopgen_q01/duckdb:vortex-file-compressed 10324094 / 10319674 / +0.0% 14183665 / 13955759 / +1.6% 0.73 / 0.74 / -1.6%
statpopgen_q02/duckdb:vortex-file-compressed 308275055 / 309242358 / -0.3% 353445546 / 337760787 / +4.6% 0.87 / 0.92 / -4.7%
statpopgen_q03/duckdb:vortex-file-compressed 806079510 / 807181513 / -0.1% 830228924 / 820167769 / +1.2% 0.97 / 0.98 / -1.3%
statpopgen_q04/duckdb:vortex-file-compressed 823248762 / 804737082 / +2.3% 819204997 / 818172274 / +0.1% 1.00 / 0.98 / +2.2%
statpopgen_q05/duckdb:vortex-file-compressed 320303766 / 322739849 / -0.8% 365982695 / 370606692 / -1.2% 0.88 / 0.87 / +0.5%
statpopgen_q06/duckdb:vortex-file-compressed 1140917451 / 1143025322 / -0.2% 1149111995 / 1150928459 / -0.2% 0.99 / 0.99 / -0.0%
statpopgen_q07/duckdb:vortex-file-compressed 113438126 / 112496838 / +0.8% 165199953 / 174823691 / -5.5% 0.69 / 0.64 / +6.7%
statpopgen_q08/duckdb:vortex-file-compressed 131899656 / 133665073 / -1.3% 186954860 / 181846184 / +2.8% 0.71 / 0.74 / -4.0%
statpopgen_q09/duckdb:vortex-file-compressed 635207490 / 606238556 / +4.8% 642264580 / 618868437 / +3.8% 0.99 / 0.98 / +1.0%
statpopgen_q10/duckdb:vortex-file-compressed 1908924052 / 1926312250 / -0.9% 1900962919 / 1887729331 / +0.7% 1.00 / 1.02 / -1.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 243319882 / 245031950 / -0.7% 242565697 / 245205976 / -1.1% 1.00 / 1.00 / +0.4%
statpopgen_q01/duckdb:parquet 301843815 / 303894650 / -0.7% 303517383 / 304539483 / -0.3% 0.99 / 1.00 / -0.3%
statpopgen_q02/duckdb:parquet 540519929 / 551085519 / -1.9% 560750058 / 569117941 / -1.5% 0.96 / 0.97 / -0.5%
statpopgen_q03/duckdb:parquet 882938040 / 892990548 / -1.1% 902428817 / 888262264 / +1.6% 0.98 / 1.01 / -2.7%
statpopgen_q04/duckdb:parquet 880305747 / 827495556 / +6.4% 895169438 / 832647890 / +7.5% 0.98 / 0.99 / -1.0%
statpopgen_q05/duckdb:parquet 596025792 / 592243730 / +0.6% 596040082 / 596447208 / -0.1% 1.00 / 0.99 / +0.7%
statpopgen_q06/duckdb:parquet 698926117 / 709027904 / -1.4% 688479582 / 708234211 / -2.8% 1.02 / 1.00 / +1.4%
statpopgen_q07/duckdb:parquet 612305136 / 609642114 / +0.4% 709685381 / 652945875 / +8.7% 0.86 / 0.93 / -7.6%
statpopgen_q08/duckdb:parquet 617889012 / 612857987 / +0.8% 723491196 / 695555573 / +4.0% 0.85 / 0.88 / -3.1%
statpopgen_q09/duckdb:parquet 784381676 / 801475761 / -2.1% 796301758 / 806478290 / -1.3% 0.99 / 0.99 / -0.9%
statpopgen_q10/duckdb:parquet 1467341181 / 1419157834 / +3.4% 1225526182 / 1285924216 / -4.7% 1.20 / 1.10 / +8.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +9.9%
Engines: DataFusion No clear signal (+9.9%, environment too noisy confidence) · DuckDB No clear signal (+9.9%, environment too noisy confidence)
Vortex (geomean): hot 1.148x ➖ · cold 1.062x ➖
Parquet (geomean): hot 1.045x ➖ · cold 1.043x ➖
Shifts: Parquet (control) +4.5% · Median polish +10.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.124x ➖, 1↑ 5↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 212024047 / 216466009 / -2.1% 888523040 / 979084536 / -9.2% 0.24 / 0.22 / +7.9%
tpch_q02/datafusion:vortex-file-compressed 326045186 / 329904971 / -1.2% 749539416 / 700176010 / +7.1% 0.43 / 0.47 / -7.7%
tpch_q03/datafusion:vortex-file-compressed 397066033 / 346169727 / +14.7% 1007942530 / 1028754009 / -2.0% 0.39 / 0.34 / +17.1%
tpch_q04/datafusion:vortex-file-compressed 220677636 / 181326555 / +21.7% 436494199 / 402982905 / +8.3% 0.51 / 0.45 / +12.4%
tpch_q05/datafusion:vortex-file-compressed 585350103 / 422445422 / +38.6% 🔴 736756397 / 620408199 / +18.8% 0.79 / 0.68 / +16.7%
tpch_q06/datafusion:vortex-file-compressed 448017180 / 513936369 / -12.8% 469161790 / 493307459 / -4.9% 0.95 / 1.04 / -8.3%
tpch_q07/datafusion:vortex-file-compressed 426375369 / 360209112 / +18.4% 560746026 / 501717238 / +11.8% 0.76 / 0.72 / +5.9%
tpch_q08/datafusion:vortex-file-compressed 757784870 / 560868815 / +35.1% 🔴 698745811 / 715320587 / -2.3% 1.08 / 0.78 / +38.3%
tpch_q09/datafusion:vortex-file-compressed 423878281 / 449613034 / -5.7% 506831363 / 504964402 / +0.4% 0.84 / 0.89 / -6.1%
tpch_q10/datafusion:vortex-file-compressed 435247218 / 371712247 / +17.1% 596297299 / 559290087 / +6.6% 0.73 / 0.66 / +9.8%
tpch_q11/datafusion:vortex-file-compressed 282298527 / 292524761 / -3.5% 408063813 / 438538724 / -6.9% 0.69 / 0.67 / +3.7%
tpch_q12/datafusion:vortex-file-compressed 550616143 / 363899528 / +51.3% 🔴 556779492 / 704859338 / -21.0% 0.99 / 0.52 / +91.6%
tpch_q13/datafusion:vortex-file-compressed 137818371 / 145470670 / -5.3% 403220965 / 384821273 / +4.8% 0.34 / 0.38 / -9.6%
tpch_q14/datafusion:vortex-file-compressed 208749896 / 173700852 / +20.2% 429269309 / 336703041 / +27.5% 0.49 / 0.52 / -5.7%
tpch_q15/datafusion:vortex-file-compressed 411619465 / 339299499 / +21.3% 557916342 / 463215412 / +20.4% 0.74 / 0.73 / +0.7%
tpch_q16/datafusion:vortex-file-compressed 171948417 / 150858179 / +14.0% 290261134 / 306897143 / -5.4% 0.59 / 0.49 / +20.5%
tpch_q17/datafusion:vortex-file-compressed 565269968 / 452871751 / +24.8% 754807999 / 734565091 / +2.8% 0.75 / 0.62 / +21.5%
tpch_q18/datafusion:vortex-file-compressed 338917713 / 253656813 / +33.6% 🔴 476294700 / 464457105 / +2.5% 0.71 / 0.55 / +30.3%
tpch_q19/datafusion:vortex-file-compressed 549907424 / 358016837 / +53.6% 🔴 775151817 / 431517062 / +79.6% 🔴 0.71 / 0.83 / -14.5%
tpch_q20/datafusion:vortex-file-compressed 286764221 / 273157854 / +5.0% 434940210 / 399897459 / +8.8% 0.66 / 0.68 / -3.5%
tpch_q21/datafusion:vortex-file-compressed 564041209 / 901253505 / -37.4% 🟢 803077106 / 1167595185 / -31.2% 🟢 0.70 / 0.77 / -9.0%
tpch_q22/datafusion:vortex-file-compressed 218896991 / 188174317 / +16.3% 432850630 / 397093939 / +9.0% 0.51 / 0.47 / +6.7%
datafusion / parquet / ns (1.022x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 162460910 / 182052269 / -10.8% 518754451 / 473988269 / +9.4% 0.31 / 0.38 / -18.5%
tpch_q02/datafusion:parquet 289124115 / 295051082 / -2.0% 509371301 / 511508588 / -0.4% 0.57 / 0.58 / -1.6%
tpch_q03/datafusion:parquet 277106384 / 233675459 / +18.6% 832619723 / 855702203 / -2.7% 0.33 / 0.27 / +21.9%
tpch_q04/datafusion:parquet 146097045 / 171085071 / -14.6% 441317409 / 397209592 / +11.1% 0.33 / 0.43 / -23.1%
tpch_q05/datafusion:parquet 327850942 / 412246392 / -20.5% 467643214 / 651332808 / -28.2% 0.70 / 0.63 / +10.8%
tpch_q06/datafusion:parquet 132225818 / 115489613 / +14.5% 263224111 / 220975720 / +19.1% 0.50 / 0.52 / -3.9%
tpch_q07/datafusion:parquet 333810218 / 368170964 / -9.3% 443403838 / 646843086 / -31.5% 🟢 0.75 / 0.57 / +32.3%
tpch_q08/datafusion:parquet 523029022 / 464215044 / +12.7% 721014739 / 589421763 / +22.3% 0.73 / 0.79 / -7.9%
tpch_q09/datafusion:parquet 400884990 / 384061345 / +4.4% 575803268 / 570578654 / +0.9% 0.70 / 0.67 / +3.4%
tpch_q10/datafusion:parquet 326153180 / 324719144 / +0.4% 517694376 / 436376627 / +18.6% 0.63 / 0.74 / -15.3%
tpch_q11/datafusion:parquet 266845631 / 251062292 / +6.3% 460770895 / 374346606 / +23.1% 0.58 / 0.67 / -13.6%
tpch_q12/datafusion:parquet 188390193 / 180005927 / +4.7% 371493102 / 369527522 / +0.5% 0.51 / 0.49 / +4.1%
tpch_q13/datafusion:parquet 361105054 / 364264175 / -0.9% 516155999 / 547909190 / -5.8% 0.70 / 0.66 / +5.2%
tpch_q14/datafusion:parquet 171745899 / 158778887 / +8.2% 302093626 / 307267556 / -1.7% 0.57 / 0.52 / +10.0%
tpch_q15/datafusion:parquet 329932133 / 363564949 / -9.3% 461447069 / 456932180 / +1.0% 0.71 / 0.80 / -10.1%
tpch_q16/datafusion:parquet 126930179 / 110657308 / +14.7% 291752107 / 242325578 / +20.4% 0.44 / 0.46 / -4.7%
tpch_q17/datafusion:parquet 320889113 / 288453231 / +11.2% 449517168 / 409509709 / +9.8% 0.71 / 0.70 / +1.3%
tpch_q18/datafusion:parquet 367052505 / 373116744 / -1.6% 483135777 / 468915254 / +3.0% 0.76 / 0.80 / -4.5%
tpch_q19/datafusion:parquet 173207153 / 176286485 / -1.7% 303054063 / 336822042 / -10.0% 0.57 / 0.52 / +9.2%
tpch_q20/datafusion:parquet 259383601 / 232617247 / +11.5% 418279840 / 408603455 / +2.4% 0.62 / 0.57 / +8.9%
tpch_q21/datafusion:parquet 359787484 / 300196130 / +19.9% 522093874 / 380018180 / +37.4% 🔴 0.69 / 0.79 / -12.8%
tpch_q22/datafusion:parquet 152592052 / 144257326 / +5.8% 338204246 / 320192869 / +5.6% 0.45 / 0.45 / +0.1%
duckdb / vortex-file-compressed / ns (1.173x ➖, 1↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 211849159 / 203943013 / +3.9% 359486250 / 318861028 / +12.7% 0.59 / 0.64 / -7.9%
tpch_q02/duckdb:vortex-file-compressed 393029278 / 412275290 / -4.7% 376865405 / 459840678 / -18.0% 1.04 / 0.90 / +16.3%
tpch_q03/duckdb:vortex-file-compressed 642399963 / 422017357 / +52.2% 🔴 827774131 / 483743838 / +71.1% 🔴 0.78 / 0.87 / -11.0%
tpch_q04/duckdb:vortex-file-compressed 402867395 / 266820598 / +51.0% 🔴 554899867 / 352531990 / +57.4% 🔴 0.73 / 0.76 / -4.1%
tpch_q05/duckdb:vortex-file-compressed 473026311 / 402443628 / +17.5% 490515918 / 448414957 / +9.4% 0.96 / 0.90 / +7.5%
tpch_q06/duckdb:vortex-file-compressed 350696629 / 268299421 / +30.7% 🔴 333645366 / 308673019 / +8.1% 1.05 / 0.87 / +20.9%
tpch_q07/duckdb:vortex-file-compressed 623725641 / 439886400 / +41.8% 🔴 640927892 / 509551430 / +25.8% 0.97 / 0.86 / +12.7%
tpch_q08/duckdb:vortex-file-compressed 678165693 / 637409109 / +6.4% 727302233 / 719628380 / +1.1% 0.93 / 0.89 / +5.3%
tpch_q09/duckdb:vortex-file-compressed 487668845 / 438482491 / +11.2% 565878299 / 434367379 / +30.3% 🔴 0.86 / 1.01 / -14.6%
tpch_q10/duckdb:vortex-file-compressed 554982195 / 437757877 / +26.8% 547389926 / 515318542 / +6.2% 1.01 / 0.85 / +19.4%
tpch_q11/duckdb:vortex-file-compressed 180013861 / 189325245 / -4.9% 212537094 / 212928258 / -0.2% 0.85 / 0.89 / -4.7%
tpch_q12/duckdb:vortex-file-compressed 539992691 / 542440773 / -0.5% 664905869 / 665448101 / -0.1% 0.81 / 0.82 / -0.4%
tpch_q13/duckdb:vortex-file-compressed 336017102 / 504570256 / -33.4% 🟢 416125168 / 449752455 / -7.5% 0.81 / 1.12 / -28.0%
tpch_q14/duckdb:vortex-file-compressed 266328458 / 232363207 / +14.6% 338629407 / 577015791 / -41.3% 🟢 0.79 / 0.40 / +95.3%
tpch_q15/duckdb:vortex-file-compressed 221786130 / 140814345 / +57.5% 🔴 229287070 / 198773806 / +15.4% 0.97 / 0.71 / +36.5%
tpch_q16/duckdb:vortex-file-compressed 185492151 / 172995952 / +7.2% 200502977 / 194143579 / +3.3% 0.93 / 0.89 / +3.8%
tpch_q17/duckdb:vortex-file-compressed 514341880 / 403364654 / +27.5% 514305757 / 752310488 / -31.6% 🟢 1.00 / 0.54 / +86.5%
tpch_q18/duckdb:vortex-file-compressed 352743560 / 341590309 / +3.3% 420791413 / 352813056 / +19.3% 0.84 / 0.97 / -13.4%
tpch_q19/duckdb:vortex-file-compressed 544225001 / 341165866 / +59.5% 🔴 579989453 / 379810554 / +52.7% 🔴 0.94 / 0.90 / +4.5%
tpch_q20/duckdb:vortex-file-compressed 424527454 / 349567200 / +21.4% 468538623 / 427925215 / +9.5% 0.91 / 0.82 / +10.9%
tpch_q21/duckdb:vortex-file-compressed 726493890 / 544932461 / +33.3% 🔴 768948000 / 580157523 / +32.5% 🔴 0.94 / 0.94 / +0.6%
tpch_q22/duckdb:vortex-file-compressed 194570529 / 178260200 / +9.1% 200773734 / 203896798 / -1.5% 0.97 / 0.87 / +10.8%
duckdb / parquet / ns (1.068x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 286777123 / 268671680 / +6.7% 274256888 / 300255127 / -8.7% 1.05 / 0.89 / +16.9%
tpch_q02/duckdb:parquet 695177644 / 628568647 / +10.6% 653753460 / 643911433 / +1.5% 1.06 / 0.98 / +8.9%
tpch_q03/duckdb:parquet 760124765 / 693899355 / +9.5% 803550118 / 705218728 / +13.9% 0.95 / 0.98 / -3.9%
tpch_q04/duckdb:parquet 519677178 / 431067209 / +20.6% 597041480 / 461822928 / +29.3% 0.87 / 0.93 / -6.7%
tpch_q05/duckdb:parquet 1006710150 / 887305396 / +13.5% 944645035 / 952334172 / -0.8% 1.07 / 0.93 / +14.4%
tpch_q06/duckdb:parquet 299303478 / 307690996 / -2.7% 314987762 / 267981669 / +17.5% 0.95 / 1.15 / -17.2%
tpch_q07/duckdb:parquet 830965527 / 838571058 / -0.9% 735138164 / 860725978 / -14.6% 1.13 / 0.97 / +16.0%
tpch_q08/duckdb:parquet 1008826453 / 992045207 / +1.7% 1126466280 / 1014904716 / +11.0% 0.90 / 0.98 / -8.4%
tpch_q09/duckdb:parquet 1148132089 / 942235711 / +21.9% 1042830045 / 917797494 / +13.6% 1.10 / 1.03 / +7.2%
tpch_q10/duckdb:parquet 924471545 / 849673348 / +8.8% 904893208 / 823307007 / +9.9% 1.02 / 1.03 / -1.0%
tpch_q11/duckdb:parquet 444171903 / 450904927 / -1.5% 459962596 / 424954285 / +8.2% 0.97 / 1.06 / -9.0%
tpch_q12/duckdb:parquet 561228049 / 519106287 / +8.1% 626088313 / 631211237 / -0.8% 0.90 / 0.82 / +9.0%
tpch_q13/duckdb:parquet 713697234 / 699446808 / +2.0% 773745566 / 831099659 / -6.9% 0.92 / 0.84 / +9.6%
tpch_q14/duckdb:parquet 564259823 / 451449810 / +25.0% 570878192 / 467180297 / +22.2% 0.99 / 0.97 / +2.3%
tpch_q15/duckdb:parquet 380998854 / 352092647 / +8.2% 403098570 / 377375011 / +6.8% 0.95 / 0.93 / +1.3%
tpch_q16/duckdb:parquet 516173065 / 472007338 / +9.4% 495365883 / 467069604 / +6.1% 1.04 / 1.01 / +3.1%
tpch_q17/duckdb:parquet 473878797 / 457165070 / +3.7% 389699846 / 450729639 / -13.5% 1.22 / 1.01 / +19.9%
tpch_q18/duckdb:parquet 619182082 / 614624380 / +0.7% 592658053 / 598175532 / -0.9% 1.04 / 1.03 / +1.7%
tpch_q19/duckdb:parquet 516018548 / 514349878 / +0.3% 493425276 / 552861862 / -10.8% 1.05 / 0.93 / +12.4%
tpch_q20/duckdb:parquet 837781201 / 782269835 / +7.1% 1135754225 / 927615715 / +22.4% 0.74 / 0.84 / -12.5%
tpch_q21/duckdb:parquet 726911213 / 683590061 / +6.3% 751223140 / 665631861 / +12.9% 0.97 / 1.03 / -5.8%
tpch_q22/duckdb:parquet 408893266 / 426111234 / -4.0% 453117640 / 415077323 / +9.2% 0.90 / 1.03 / -12.1%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 47db41a1 vs base c07196e5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.0%
Engines: DataFusion No clear signal (+2.3%, low confidence) · DuckDB No clear signal (-2.2%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.089x ➖
Parquet (geomean): hot 1.007x ➖ · cold 1.104x ❌
Shifts: Parquet (control) +0.7% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 206586116 / 164546648 / +25.5% 🔴 691304369 / 579025811 / +19.4% 🔴 0.30 / 0.28 / +5.2%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10799386 / 10670889 / +1.2% 49464946 / 46862346 / +5.6% 0.22 / 0.23 / -4.1%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11049334 / 11587594 / -4.6% 50615021 / 47678509 / +6.2% 0.22 / 0.24 / -10.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22722190 / 23142629 / -1.8% 73349463 / 66948814 / +9.6% 0.31 / 0.35 / -10.4%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18019638 / 18696542 / -3.6% 62373482 / 56814430 / +9.8% 0.29 / 0.33 / -12.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17681913 / 17506880 / +1.0% 67619750 / 59887756 / +12.9% 🔴 0.26 / 0.29 / -10.5%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40552389 / 40317940 / +0.6% 98554274 / 89898311 / +9.6% 0.41 / 0.45 / -8.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12186322 / 11852155 / +2.8% 47242001 / 42363473 / +11.5% 🔴 0.26 / 0.28 / -7.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12064644 / 12380659 / -2.6% 49361070 / 40607099 / +21.6% 🔴 0.24 / 0.30 / -19.8%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9848006 / 10015629 / -1.7% 40808918 / 36053712 / +13.2% 🔴 0.24 / 0.28 / -13.1%
datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 762668980 / 766699001 / -0.5% 978809281 / 940812733 / +4.0% 0.78 / 0.81 / -4.4%
clickbench-sorted_q24/datafusion:parquet 9160604 / 9505212 / -3.6% 75396027 / 70933454 / +6.3% 0.12 / 0.13 / -9.3%
clickbench-sorted_q26/datafusion:parquet 8680152 / 9483370 / -8.5% 75523995 / 71297269 / +5.9% 0.11 / 0.13 / -13.6%
clickbench-sorted_q36/datafusion:parquet 94512223 / 93734337 / +0.8% 174781266 / 163732228 / +6.7% 0.54 / 0.57 / -5.5%
clickbench-sorted_q37/datafusion:parquet 64601139 / 64391501 / +0.3% 134331092 / 130337029 / +3.1% 0.48 / 0.49 / -2.7%
clickbench-sorted_q38/datafusion:parquet 88046168 / 87298512 / +0.9% 167375242 / 156276495 / +7.1% 0.53 / 0.56 / -5.8%
clickbench-sorted_q39/datafusion:parquet 160346895 / 159226758 / +0.7% 239520305 / 229226991 / +4.5% 0.67 / 0.69 / -3.6%
clickbench-sorted_q40/datafusion:parquet 44805653 / 44482711 / +0.7% 119563423 / 109134137 / +9.6% 0.37 / 0.41 / -8.1%
clickbench-sorted_q41/datafusion:parquet 42690067 / 42026184 / +1.6% 115077245 / 107566470 / +7.0% 0.37 / 0.39 / -5.1%
clickbench-sorted_q42/datafusion:parquet 25947274 / 26289550 / -1.3% 89900463 / 87444473 / +2.8% 0.29 / 0.30 / -4.0%
duckdb / vortex-file-compressed / ns (1.000x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 57040086 / 49649827 / +14.9% 🔴 78612579 / 84779221 / -7.3% 0.73 / 0.59 / +23.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18087984 / 18337295 / -1.4% 31614059 / 33792656 / -6.4% 0.57 / 0.54 / +5.4%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14730548 / 17377799 / -15.2% 🟢 30371477 / 25277490 / +20.2% 🔴 0.49 / 0.69 / -29.5%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29562560 / 30036331 / -1.6% 64054339 / 61133367 / +4.8% 0.46 / 0.49 / -6.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed 25130620 / 22657815 / +10.9% 🔴 54517872 / 53404087 / +2.1% 0.46 / 0.42 / +8.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25001918 / 25829214 / -3.2% 62545275 / 55003115 / +13.7% 🔴 0.40 / 0.47 / -14.9%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48860972 / 47605606 / +2.6% 99202491 / 93759265 / +5.8% 0.49 / 0.51 / -3.0%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15823686 / 15307402 / +3.4% 41017665 / 36772778 / +11.5% 🔴 0.39 / 0.42 / -7.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15324208 / 15769757 / -2.8% 40219620 / 36297845 / +10.8% 🔴 0.38 / 0.43 / -12.3%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12134610 / 12701598 / -4.5% 33953895 / 31120919 / +9.1% 0.36 / 0.41 / -12.4%
duckdb / parquet / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126382824 / 128792644 / -1.9% 141404421 / 136032017 / +3.9% 0.89 / 0.95 / -5.6%
clickbench-sorted_q24/duckdb:parquet 18546268 / 17944498 / +3.4% 32312009 / 26726603 / +20.9% 🔴 0.57 / 0.67 / -14.5%
clickbench-sorted_q26/duckdb:parquet 13051458 / 12177454 / +7.2% 25889892 / 22763050 / +13.7% 🔴 0.50 / 0.53 / -5.8%
clickbench-sorted_q36/duckdb:parquet 41686335 / 44175164 / -5.6% 69842098 / 58651646 / +19.1% 🔴 0.60 / 0.75 / -20.8%
clickbench-sorted_q37/duckdb:parquet 31149424 / 30232612 / +3.0% 51932544 / 44944756 / +15.5% 🔴 0.60 / 0.67 / -10.8%
clickbench-sorted_q38/duckdb:parquet 42642342 / 38877390 / +9.7% 62762748 / 55594794 / +12.9% 🔴 0.68 / 0.70 / -2.8%
clickbench-sorted_q39/duckdb:parquet 70766552 / 70776448 / -0.0% 90224695 / 85428094 / +5.6% 0.78 / 0.83 / -5.3%
clickbench-sorted_q40/duckdb:parquet 17012647 / 16920206 / +0.5% 49842607 / 35282989 / +41.3% 🔴 0.34 / 0.48 / -28.8%
clickbench-sorted_q41/duckdb:parquet 17099842 / 16243935 / +5.3% 43920382 / 38074584 / +15.4% 🔴 0.39 / 0.43 / -8.7%
clickbench-sorted_q42/duckdb:parquet 11509984 / 11288724 / +2.0% 27416308 / 25252908 / +8.6% 0.42 / 0.45 / -6.1%
File Size Changes (100 files changed, -0.0% overall, 42↑ 58↓)
File Scale Format Base HEAD Change %
hits_076.vortex 1.0 vortex-file-compressed 159.47 MB 161.78 MB +2.31 MB +1.5%
hits_090.vortex 1.0 vortex-file-compressed 192.40 MB 194.44 MB +2.04 MB +1.1%
hits_085.vortex 1.0 vortex-file-compressed 199.17 MB 200.62 MB +1.45 MB +0.7%
hits_053.vortex 1.0 vortex-file-compressed 190.20 MB 190.97 MB +787.45 KB +0.4%
hits_036.vortex 1.0 vortex-file-compressed 171.92 MB 172.54 MB +631.67 KB +0.4%
hits_078.vortex 1.0 vortex-file-compressed 130.33 MB 130.74 MB +429.33 KB +0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.86 MB 163.37 MB +521.01 KB +0.3%
hits_014.vortex 1.0 vortex-file-compressed 172.78 MB 173.26 MB +487.88 KB +0.3%
hits_031.vortex 1.0 vortex-file-compressed 159.10 MB 159.51 MB +416.33 KB +0.3%
hits_069.vortex 1.0 vortex-file-compressed 142.84 MB 143.20 MB +361.43 KB +0.2%
hits_047.vortex 1.0 vortex-file-compressed 153.79 MB 154.12 MB +340.98 KB +0.2%
hits_094.vortex 1.0 vortex-file-compressed 158.49 MB 158.78 MB +289.38 KB +0.2%
hits_044.vortex 1.0 vortex-file-compressed 199.55 MB 199.89 MB +349.73 KB +0.2%
hits_082.vortex 1.0 vortex-file-compressed 139.28 MB 139.44 MB +163.08 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.09 MB 161.25 MB +162.27 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.98 MB 173.13 MB +159.07 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.02 MB 140.15 MB +128.58 KB +0.1%
hits_055.vortex 1.0 vortex-file-compressed 200.53 MB 200.70 MB +181.55 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.77 MB 159.88 MB +115.84 KB +0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.83 MB 200.96 MB +129.45 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.61 MB 180.72 MB +112.88 KB +0.1%
hits_080.vortex 1.0 vortex-file-compressed 126.99 MB 127.07 MB +77.13 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.74 MB 130.82 MB +78.98 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.07 MB 201.16 MB +97.45 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 188.99 MB 189.07 MB +88.23 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.14 MB 200.23 MB +92.06 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.63 MB 192.71 MB +80.11 KB +0.0%
hits_071.vortex 1.0 vortex-file-compressed 139.29 MB 139.34 MB +52.80 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.85 MB 159.91 MB +60.59 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.57 MB 126.62 MB +45.84 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.37 MB 161.42 MB +53.80 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.07 MB 152.12 MB +47.91 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.73 MB 126.76 MB +35.97 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.18 MB 147.21 MB +34.53 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.76 MB 192.80 MB +41.33 KB +0.0%
hits_027.vortex 1.0 vortex-file-compressed 189.48 MB 189.51 MB +36.30 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.47 MB 136.49 MB +20.58 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.09 MB 178.11 MB +19.88 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.84 MB 194.85 MB +9.52 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.83 MB 137.84 MB +5.94 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.49 MB 190.49 MB +1.15 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.02 MB 201.02 MB +88 B +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.61 MB 161.61 MB 1.41 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.58 MB 161.58 MB 7.23 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.22 MB 156.21 MB 8.47 KB -0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.76 MB 171.75 MB 12.02 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.60 MB 130.59 MB 9.55 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.65 MB 161.63 MB 20.16 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.42 MB 139.40 MB 18.29 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.22 MB 130.20 MB 17.23 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.23 MB 147.21 MB 22.11 KB -0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.41 MB 147.39 MB 22.47 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.84 MB 161.81 MB 27.69 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.09 MB 191.05 MB 32.97 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.61 MB 172.58 MB 32.98 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.57 MB 200.52 MB 44.39 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 180.10 MB 180.06 MB 40.20 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.14 MB 131.11 MB 29.35 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.39 MB 160.36 MB 36.49 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.72 MB 130.69 MB 32.98 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.84 MB 200.77 MB 73.79 KB -0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.75 MB 153.68 MB 70.83 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.83 MB 181.75 MB 84.19 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.05 MB 134.99 MB 63.05 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.66 MB 189.55 MB 104.59 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.50 MB 154.41 MB 88.36 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 171.31 MB 171.21 MB 102.65 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.20 MB 102.14 MB 63.33 KB -0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.75 MB 130.66 MB 82.80 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 201.04 MB 200.92 MB 127.43 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 200.74 MB 200.60 MB 139.56 KB -0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.73 MB 161.62 MB 113.91 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.92 MB 101.84 MB 74.03 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.08 MB 101.01 MB 74.43 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.95 MB 130.85 MB 103.40 KB -0.1%
hits_025.vortex 1.0 vortex-file-compressed 172.46 MB 172.31 MB 155.23 KB -0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.16 MB 201.96 MB 206.36 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.85 MB 153.68 MB 164.78 KB -0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.56 MB 190.33 MB 229.95 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.24 MB 154.04 MB 203.49 KB -0.1%
hits_065.vortex 1.0 vortex-file-compressed 162.05 MB 161.83 MB 217.77 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 198.84 MB 198.56 MB 284.23 KB -0.1%
hits_022.vortex 1.0 vortex-file-compressed 200.54 MB 200.26 MB 288.91 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.41 MB 130.21 MB 198.07 KB -0.1%
hits_033.vortex 1.0 vortex-file-compressed 200.05 MB 199.73 MB 329.95 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.49 MB 130.27 MB 225.30 KB -0.2%
hits_073.vortex 1.0 vortex-file-compressed 173.31 MB 173.02 MB 303.98 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.43 MB 167.13 MB 302.86 KB -0.2%
hits_084.vortex 1.0 vortex-file-compressed 154.27 MB 153.99 MB 291.63 KB -0.2%
hits_059.vortex 1.0 vortex-file-compressed 199.31 MB 198.94 MB 380.09 KB -0.2%
hits_063.vortex 1.0 vortex-file-compressed 131.09 MB 130.77 MB 323.14 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 173.37 MB 172.91 MB 465.73 KB -0.3%
hits_046.vortex 1.0 vortex-file-compressed 101.13 MB 100.86 MB 274.84 KB -0.3%
hits_067.vortex 1.0 vortex-file-compressed 131.12 MB 130.73 MB 391.91 KB -0.3%
hits_040.vortex 1.0 vortex-file-compressed 144.71 MB 144.17 MB 559.12 KB -0.4%
hits_010.vortex 1.0 vortex-file-compressed 169.47 MB 168.81 MB 678.02 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 139.85 MB 139.16 MB 706.20 KB -0.5%
hits_096.vortex 1.0 vortex-file-compressed 200.35 MB 199.32 MB 1.03 MB -0.5%
hits_086.vortex 1.0 vortex-file-compressed 192.91 MB 191.63 MB 1.27 MB -0.7%
hits_001.vortex 1.0 vortex-file-compressed 190.66 MB 188.71 MB 1.95 MB -1.0%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.96 GB (-0.0%)

@connortsui20
connortsui20 marked this pull request as draft October 7, 2026 10:10
@connortsui20 connortsui20 mentioned this pull request Oct 17, 2026
Open
5 of 15 tasks
@connortsui20
connortsui20 force-pushed the ct/checked-lane-chunks branch 2 times, most recently from 83838af to 91e10a8 Compare October 18, 2026 16:58
@connortsui20

connortsui20 commented Oct 20, 2026 •
edited
Loading

Copy link
Copy Markdown
Member Author

ok so I've been doing a bunch of LLVM investigation, and really LLVM should be the one dealing with this correctly. I'll have a few LLVM PRs that I will submit.

@connortsui20
connortsui20 deleted the ct/checked-lane-chunks branch October 20, 2026 11:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 Awaiting requested review from robert3005
@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@connortsui20