Skip to content

Simplify error types, remove kind from struct - #10080

Merged
robert3005 merged 1 commit into
developfrom
claude/affectionate-keller-4j7w5g
Oct 26, 2026
Merged

Simplify error types, remove kind from struct#10080
robert3005 merged 1 commit into
developfrom
claude/affectionate-keller-4j7w5g

Conversation

@robert3005

@robert3005 robert3005 commented Sep 26, 2026

Copy link
Copy Markdown
Contributor

Instead of error being an enum we convert an error to be a struct with message and error kind. I had followed the structure of Python errors which have couple error categories https://docs.python.org/3/builtins/exceptions.html#exception-hierarchy majority of which don't apply to this project

@robert3005 robert3005 added the changelog/break A breaking API change label Sep 26, 2026
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from e45d46e to 824bbb4 Compare September 26, 2026 21:33
@codspeed

codspeed Bot commented Sep 26, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will regress 19 benchmarks

4 warnings, 1 note

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ Unable to measure the execution of 2 benchmarks

These benchmarks measured no execution time, so their results are not comparable and count as unchanged. This usually happens when the compiler removes the code under test.

Prevent compiler optimizations

See affected benchmarks

⚠️ 17 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚠️ Base and head ran on different runner types

Some benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.

Learn more about Macro Runners

Open the report in CodSpeed to investigate

ℹ️ 40 benchmarks have no flamegraph

The flamegraph wasn't generated: the symbols of the profiling trace could not be resolved, because no information about the language frames was collected.

See affected benchmarks

⚡ 17 improved benchmarks
❌ 19 regressed benchmarks
✅ 2372 untouched benchmarks
⏩ 12 skipped benchmarks1
🗄️ 43 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation decode_bool_nullable[10000_2_alternating_mostly_valid] 357.9 µs 470 µs -23.84%
❌ CPU Simulation decode_bool_nullable[10000_10_mostly_true_mostly_valid] 88 µs 110.4 µs -20.31%
❌ CPU Simulation decode_bool_nullable[10000_10_alternating_mostly_null] 88.5 µs 111 µs -20.31%
❌ CPU Simulation decode_bool_nullable[10000_10_alternating_half_valid] 105.3 µs 127 µs -17.08%
❌ CPU Simulation decode_bool_nullable[10000_10_mostly_true_half_valid] 107.7 µs 129.2 µs -16.63%
❌ CPU Simulation decode_bool_nullable[10000_10_mostly_true_mostly_null] 107.8 µs 128.8 µs -16.29%
❌ CPU Simulation decode_bool_nullable[10000_10_alternating_mostly_valid] 116.9 µs 138.8 µs -15.83%
❌ CPU Simulation filter_powerlaw_by_mostly_true[250000] 161.2 µs 189.9 µs -15.12%
❌ CPU Simulation filter_powerlaw_by_mostly_true[100000] 62.6 µs 73.5 µs -14.78%
❌ CPU Simulation density_sweep_dense_runs[0.9] 67.2 µs 77.6 µs -13.38%
❌ CPU Simulation filter_random_by_mostly_true[250000] 197.7 µs 226.3 µs -12.62%
❌ CPU Simulation filter_powerlaw_by_random[250000] 152.8 µs 174.6 µs -12.48%
❌ CPU Simulation rank_indices[(0.05, 0.05, "self_sparse_rank_sparse")] 49.2 µs 55.9 µs -12.09%
❌ CPU Simulation density_sweep_dense_runs[0.001] 52.6 µs 59.8 µs -11.99%
❌ CPU Simulation filter_random_by_random[250000] 183.2 µs 205.1 µs -10.64%
❌ CPU Simulation split[(65536, Microseconds)] 2.1 ms 2.4 ms -10.39%
❌ CPU Simulation density_sweep_random[0.9] 93.8 µs 104.5 µs -10.25%
❌ CPU Simulation density_sweep_random[0.95] 94.3 µs 104.9 µs -10.13%
❌ CPU Simulation filter_random_by_mostly_true[100000] 93.9 µs 104.5 µs -10.13%
⚡ Walltime filter_neon[8] 1,374 ns 897 ns +53.18%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing claude/affectionate-keller-4j7w5g (be70183) with develop (e5a4e66)

Open in CodSpeed

Footnotes

  1. 12 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 43 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from 824bbb4 to a36c01c Compare September 26, 2026 22:13
@jackylee-ch jackylee-ch mentioned this pull request Sep 30, 2026
Closed
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 2 times, most recently from 2ee2c82 to 7f17feb Compare October 6, 2026 14:44
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 6, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 6, 2026
@github-actions

github-actions Bot commented Oct 6, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 803a0e9 random-access-bench 1 Explore Profiling Data
🟢 Done 803a0e9 statpopgen 1 Explore Profiling Data
🟢 Done 803a0e9 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 803a0e9 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 803a0e9 tpch-s3-10 1 Explore Profiling Data
🟢 Done 803a0e9 clickbench-nvme 1 Explore Profiling Data
🟢 Done 803a0e9 tpcds-nvme 1 Explore Profiling Data
🟢 Done 803a0e9 appian-nvme 1 Explore Profiling Data
🟢 Done 803a0e9 fineweb 1 Explore Profiling Data
🟢 Done 803a0e9 fineweb-s3 1 Explore Profiling Data
🟢 Done 803a0e9 tpch-s3 1 Explore Profiling Data
🟢 Done 803a0e9 polarsignals 1 Explore Profiling Data
🟢 Done 803a0e9 tpch-nvme 1 Explore Profiling Data
🟢 Done 803a0e9 string-bench 1 Explore Profiling Data
🟢 Done 803a0e9 compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 803a0e97 vs base d14fa267
Vortex (geomean): hot 0.995x ➖ · cold 0.953x ➖

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57521773 / 57317544 / +0.4% 99524679 / 97928868 / +1.6% 0.58 / 0.59 / -1.3%
polarsignals_q01/datafusion:vortex-file-compressed 63442686 / 63142532 / +0.5% 122528124 / 118107090 / +3.7% 0.52 / 0.53 / -3.1%
polarsignals_q02/datafusion:vortex-file-compressed 71275080 / 74991928 / -5.0% 111561998 / 110897201 / +0.6% 0.64 / 0.68 / -5.5%
polarsignals_q03/datafusion:vortex-file-compressed 78889984 / 79309482 / -0.5% 136988726 / 139390394 / -1.7% 0.58 / 0.57 / +1.2%
polarsignals_q04/datafusion:vortex-file-compressed 9529780 / 9450924 / +0.8% 43929606 / 50285914 / -12.6% 🟢 0.22 / 0.19 / +15.4%
polarsignals_q05/datafusion:vortex-file-compressed 23988265 / 24455828 / -1.9% 61632006 / 66156092 / -6.8% 0.39 / 0.37 / +5.3%
polarsignals_q06/datafusion:vortex-file-compressed 21259022 / 21618406 / -1.7% 58853774 / 64157934 / -8.3% 0.36 / 0.34 / +7.2%
polarsignals_q07/datafusion:vortex-file-compressed 40051986 / 39355384 / +1.8% 74963116 / 80330419 / -6.7% 0.53 / 0.49 / +9.1%
polarsignals_q08/datafusion:vortex-file-compressed 98490302 / 98283526 / +0.2% 160065656 / 162508232 / -1.5% 0.62 / 0.60 / +1.7%
polarsignals_q09/datafusion:vortex-file-compressed 10047554 / 10035842 / +0.1% 43936494 / 50814345 / -13.5% 🟢 0.23 / 0.20 / +15.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 803a0e97 vs base d14fa267

vortex / vortex-file-compressed / ms (0.997x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.918642 / 32.992732 / -0.2%
read/clickbench/URL/shard-0/onpair-12 21.026052 / 21.216838 / -0.9%
read/tpch/l_comment/fsst 57.587585 / 57.772318 / -0.3%
read/tpch/l_comment/onpair-12 53.143772 / 53.666464 / -1.0%
write/clickbench/URL/shard-0/fsst 590.274547 / 590.551082 / -0.0%
write/clickbench/URL/shard-0/onpair-12 964.199331 / 966.462135 / -0.2%
write/tpch/l_comment/fsst 1898.41622 / 1907.62489 / -0.5%
write/tpch/l_comment/onpair-12 2091.86152 / 2077.97297 / +0.7%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.5%
Engines: DataFusion No clear signal (-5.3%, low confidence) · DuckDB No clear signal (+10.9%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.976x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.986x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6810289 / 6877636 / -1.0% 19975354 / 20518940 / -2.6% 0.34 / 0.34 / +1.7%
fineweb_q01/datafusion:vortex-file-compressed 11694139 / 11614300 / +0.7% 48845164 / 46509928 / +5.0% 0.24 / 0.25 / -4.1%
fineweb_q02/datafusion:vortex-file-compressed 13304257 / 13579799 / -2.0% 48839280 / 52307664 / -6.6% 0.27 / 0.26 / +4.9%
fineweb_q03/datafusion:vortex-file-compressed 22363004 / 22520587 / -0.7% 109988428 / 111958005 / -1.8% 0.20 / 0.20 / +1.1%
fineweb_q04/datafusion:vortex-file-compressed 80999596 / 80821634 / +0.2% 162928651 / 176250399 / -7.6% 0.50 / 0.46 / +8.4%
fineweb_q05/datafusion:vortex-file-compressed 69559064 / 69251003 / +0.4% 150884364 / 149472847 / +0.9% 0.46 / 0.46 / -0.5%
fineweb_q06/datafusion:vortex-file-compressed 18893584 / 20024614 / -5.6% 112980497 / 113214716 / -0.2% 0.17 / 0.18 / -5.5%
fineweb_q07/datafusion:vortex-file-compressed 18641258 / 18366988 / +1.5% 109847777 / 109964816 / -0.1% 0.17 / 0.17 / +1.6%
fineweb_q08/datafusion:vortex-file-compressed 10270002 / 9488287 / +8.2% 47174717 / 51199262 / -7.9% 0.22 / 0.19 / +17.5%
datafusion / vortex-compact / ns (0.911x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7023609 / 6933958 / +1.3% 19597719 / 19216778 / +2.0% 0.36 / 0.36 / -0.7%
fineweb_q01/datafusion:vortex-compact 44600887 / 76671738 / -41.8% 🟢 76115063 / 80915414 / -5.9% 0.59 / 0.95 / -38.2%
fineweb_q02/datafusion:vortex-compact 44461360 / 75146860 / -40.8% 🟢 78238524 / 81459730 / -4.0% 0.57 / 0.92 / -38.4%
fineweb_q03/datafusion:vortex-compact 157068960 / 156861436 / +0.1% 234349012 / 229391648 / +2.2% 0.67 / 0.68 / -2.0%
fineweb_q04/datafusion:vortex-compact 190005529 / 164760918 / +15.3% 🔴 243188736 / 248840106 / -2.3% 0.78 / 0.66 / +18.0%
fineweb_q05/datafusion:vortex-compact 152976576 / 156094488 / -2.0% 229075783 / 233789180 / -2.0% 0.67 / 0.67 / +0.0%
fineweb_q06/datafusion:vortex-compact 86795716 / 87172252 / -0.4% 171685154 / 158664667 / +8.2% 0.51 / 0.55 / -8.0%
fineweb_q07/datafusion:vortex-compact 87446550 / 87955427 / -0.6% 161888840 / 154508824 / +4.8% 0.54 / 0.57 / -5.1%
fineweb_q08/datafusion:vortex-compact 9440290 / 8544773 / +10.5% 🔴 34679965 / 38295498 / -9.4% 0.27 / 0.22 / +22.0%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9356237 / 9216540 / +1.5% 34066924 / 34984218 / -2.6% 0.27 / 0.26 / +4.2%
fineweb_q01/datafusion:parquet 75321341 / 74705005 / +0.8% 166294368 / 163715212 / +1.6% 0.45 / 0.46 / -0.7%
fineweb_q02/datafusion:parquet 73989936 / 75109586 / -1.5% 162864758 / 171914108 / -5.3% 0.45 / 0.44 / +4.0%
fineweb_q03/datafusion:parquet 74156138 / 74041848 / +0.2% 161222024 / 161934348 / -0.4% 0.46 / 0.46 / +0.6%
fineweb_q04/datafusion:parquet 82972330 / 81954217 / +1.2% 163517720 / 164122823 / -0.4% 0.51 / 0.50 / +1.6%
fineweb_q05/datafusion:parquet 80359899 / 80319829 / +0.0% 161566387 / 161271505 / +0.2% 0.50 / 0.50 / -0.1%
fineweb_q06/datafusion:parquet 77481474 / 76627324 / +1.1% 166526708 / 163519557 / +1.8% 0.47 / 0.47 / -0.7%
fineweb_q07/datafusion:parquet 77989012 / 75117928 / +3.8% 164695022 / 175294568 / -6.0% 0.47 / 0.43 / +10.5%
fineweb_q08/datafusion:parquet 73457736 / 73228698 / +0.3% 159591219 / 165713482 / -3.7% 0.46 / 0.44 / +4.2%
duckdb / vortex-file-compressed / ns (1.072x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2395498 / 1996238 / +20.0% 🔴 4745807 / 8563761 / -44.6% 🟢 0.50 / 0.23 / +116.5%
fineweb_q01/duckdb:vortex-file-compressed 20578084 / 20614678 / -0.2% 59317932 / 60627423 / -2.2% 0.35 / 0.34 / +2.0%
fineweb_q02/duckdb:vortex-file-compressed 21490088 / 21433524 / +0.3% 50353940 / 62278797 / -19.1% 🟢 0.43 / 0.34 / +24.0%
fineweb_q03/duckdb:vortex-file-compressed 22539143 / 27384763 / -17.7% 🟢 90405418 / 99019023 / -8.7% 0.25 / 0.28 / -9.9%
fineweb_q04/duckdb:vortex-file-compressed 98994122 / 92563890 / +6.9% 187261156 / 205578133 / -8.9% 0.53 / 0.45 / +17.4%
fineweb_q05/duckdb:vortex-file-compressed 66463570 / 71161496 / -6.6% 112522920 / 121753589 / -7.6% 0.59 / 0.58 / +1.1%
fineweb_q06/duckdb:vortex-file-compressed 50839372 / 37521218 / +35.5% 🔴 137514143 / 118973203 / +15.6% 🔴 0.37 / 0.32 / +17.2%
fineweb_q07/duckdb:vortex-file-compressed 43312344 / 30302681 / +42.9% 🔴 120836321 / 98872508 / +22.2% 🔴 0.36 / 0.31 / +17.0%
fineweb_q08/duckdb:vortex-file-compressed 6401110 / 6532296 / -2.0% 15806817 / 14647467 / +7.9% 0.40 / 0.45 / -9.2%
duckdb / vortex-compact / ns (1.093x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 3748414 / 2203808 / +70.1% 🔴 4999846 / 5222609 / -4.3% 0.75 / 0.42 / +77.7%
fineweb_q01/duckdb:vortex-compact 56173930 / 51222292 / +9.7% 102005815 / 84297220 / +21.0% 🔴 0.55 / 0.61 / -9.4%
fineweb_q02/duckdb:vortex-compact 47173482 / 51024425 / -7.5% 71484680 / 81502346 / -12.3% 🟢 0.66 / 0.63 / +5.4%
fineweb_q03/duckdb:vortex-compact 188195326 / 183415626 / +2.6% 270354480 / 293256715 / -7.8% 0.70 / 0.63 / +11.3%
fineweb_q04/duckdb:vortex-compact 202908492 / 192641918 / +5.3% 216379298 / 219572840 / -1.5% 0.94 / 0.88 / +6.9%
fineweb_q05/duckdb:vortex-compact 189989976 / 178456040 / +6.5% 212719373 / 203997044 / +4.3% 0.89 / 0.87 / +2.1%
fineweb_q06/duckdb:vortex-compact 117276656 / 105687334 / +11.0% 🔴 211894740 / 187288006 / +13.1% 🔴 0.55 / 0.56 / -1.9%
fineweb_q07/duckdb:vortex-compact 116802202 / 106831414 / +9.3% 207913244 / 167036769 / +24.5% 🔴 0.56 / 0.64 / -12.2%
fineweb_q08/duckdb:vortex-compact 6039769 / 6508628 / -7.2% 11278156 / 13907663 / -18.9% 🟢 0.54 / 0.47 / +14.4%
duckdb / parquet / ns (0.977x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21522692 / 23909568 / -10.0% 23409326 / 23353558 / +0.2% 0.92 / 1.02 / -10.2%
fineweb_q01/duckdb:parquet 44403416 / 44907796 / -1.1% 54944654 / 54334055 / +1.1% 0.81 / 0.83 / -2.2%
fineweb_q02/duckdb:parquet 44029645 / 44407357 / -0.9% 52896076 / 56968068 / -7.1% 0.83 / 0.78 / +6.8%
fineweb_q03/duckdb:parquet 94648662 / 94195542 / +0.5% 180497705 / 187225344 / -3.6% 0.52 / 0.50 / +4.2%
fineweb_q04/duckdb:parquet 151465774 / 153598481 / -1.4% 199624246 / 213207338 / -6.4% 0.76 / 0.72 / +5.3%
fineweb_q05/duckdb:parquet 143424534 / 143199828 / +0.2% 187750843 / 192941215 / -2.7% 0.76 / 0.74 / +2.9%
fineweb_q06/duckdb:parquet 71151942 / 72442141 / -1.8% 125957442 / 122688323 / +2.7% 0.56 / 0.59 / -4.3%
fineweb_q07/duckdb:parquet 72276541 / 73003458 / -1.0% 159484975 / 152103411 / +4.9% 0.45 / 0.48 / -5.6%
fineweb_q08/duckdb:parquet 24080871 / 25382006 / -5.1% 23916590 / 23699025 / +0.9% 1.01 / 1.07 / -6.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16339184 / 16596111 / -1.5% 45714833 / 45362999 / +0.8% 0.36 / 0.37 / -2.3%
tpch_q02/datafusion:vortex-file-compressed 17285731 / 17246066 / +0.2% 35827852 / 36194628 / -1.0% 0.48 / 0.48 / +1.3%
tpch_q03/datafusion:vortex-file-compressed 19272347 / 19267747 / +0.0% 47800939 / 45834358 / +4.3% 0.40 / 0.42 / -4.1%
tpch_q04/datafusion:vortex-file-compressed 10327574 / 9941807 / +3.9% 31573267 / 30647990 / +3.0% 0.33 / 0.32 / +0.8%
tpch_q05/datafusion:vortex-file-compressed 36843357 / 37070594 / -0.6% 64567024 / 64286558 / +0.4% 0.57 / 0.58 / -1.0%
tpch_q06/datafusion:vortex-file-compressed 6362680 / 6246992 / +1.9% 28906200 / 28671378 / +0.8% 0.22 / 0.22 / +1.0%
tpch_q07/datafusion:vortex-file-compressed 51738759 / 51525410 / +0.4% 80570232 / 81460410 / -1.1% 0.64 / 0.63 / +1.5%
tpch_q08/datafusion:vortex-file-compressed 51874353 / 52712844 / -1.6% 80084344 / 82884300 / -3.4% 0.65 / 0.64 / +1.8%
tpch_q09/datafusion:vortex-file-compressed 49864859 / 48840919 / +2.1% 77973224 / 75757643 / +2.9% 0.64 / 0.64 / -0.8%
tpch_q10/datafusion:vortex-file-compressed 16876994 / 16987350 / -0.6% 50188698 / 48616738 / +3.2% 0.34 / 0.35 / -3.8%
tpch_q11/datafusion:vortex-file-compressed 15235051 / 15340333 / -0.7% 33397312 / 34291896 / -2.6% 0.46 / 0.45 / +2.0%
tpch_q12/datafusion:vortex-file-compressed 22058047 / 22016513 / +0.2% 44192405 / 45119695 / -2.1% 0.50 / 0.49 / +2.3%
tpch_q13/datafusion:vortex-file-compressed 20202965 / 20144546 / +0.3% 40755495 / 40549276 / +0.5% 0.50 / 0.50 / -0.2%
tpch_q14/datafusion:vortex-file-compressed 14913367 / 14652541 / +1.8% 38042481 / 40415630 / -5.9% 0.39 / 0.36 / +8.1%
tpch_q15/datafusion:vortex-file-compressed 18661263 / 18606073 / +0.3% 45411696 / 46720872 / -2.8% 0.41 / 0.40 / +3.2%
tpch_q16/datafusion:vortex-file-compressed 18667764 / 18656902 / +0.1% 38114730 / 37907576 / +0.5% 0.49 / 0.49 / -0.5%
tpch_q17/datafusion:vortex-file-compressed 28624531 / 28247576 / +1.3% 57299326 / 60044628 / -4.6% 0.50 / 0.47 / +6.2%
tpch_q18/datafusion:vortex-file-compressed 36495990 / 36347210 / +0.4% 57675251 / 56285511 / +2.5% 0.63 / 0.65 / -2.0%
tpch_q19/datafusion:vortex-file-compressed 13550936 / 13555612 / -0.0% 36379227 / 38696101 / -6.0% 0.37 / 0.35 / +6.3%
tpch_q20/datafusion:vortex-file-compressed 20716834 / 20769001 / -0.3% 44583553 / 44108855 / +1.1% 0.46 / 0.47 / -1.3%
tpch_q21/datafusion:vortex-file-compressed 39838130 / 39142457 / +1.8% 67288636 / 66470665 / +1.2% 0.59 / 0.59 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 11280279 / 11170710 / +1.0% 30882722 / 31768096 / -2.8% 0.37 / 0.35 / +3.9%
datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 17380703 / 17433703 / -0.3% 43405688 / 42991175 / +1.0% 0.40 / 0.41 / -1.3%
tpch_q02/datafusion:vortex-compact 19786117 / 19825696 / -0.2% 36908465 / 37369698 / -1.2% 0.54 / 0.53 / +1.0%
tpch_q03/datafusion:vortex-compact 20196510 / 20308443 / -0.6% 46290053 / 44759053 / +3.4% 0.44 / 0.45 / -3.8%
tpch_q04/datafusion:vortex-compact 11884761 / 11394410 / +4.3% 32849673 / 30792348 / +6.7% 0.36 / 0.37 / -2.2%
tpch_q05/datafusion:vortex-compact 37755272 / 38021015 / -0.7% 62706228 / 64261749 / -2.4% 0.60 / 0.59 / +1.8%
tpch_q06/datafusion:vortex-compact 6721533 / 6869516 / -2.2% 27502182 / 28827183 / -4.6% 0.24 / 0.24 / +2.6%
tpch_q07/datafusion:vortex-compact 52334216 / 52479236 / -0.3% 81186839 / 80039553 / +1.4% 0.64 / 0.66 / -1.7%
tpch_q08/datafusion:vortex-compact 52561030 / 52879198 / -0.6% 83336970 / 82398367 / +1.1% 0.63 / 0.64 / -1.7%
tpch_q09/datafusion:vortex-compact 51095909 / 51551240 / -0.9% 76634014 / 75271582 / +1.8% 0.67 / 0.68 / -2.6%
tpch_q10/datafusion:vortex-compact 18955237 / 19188621 / -1.2% 46672379 / 49344559 / -5.4% 0.41 / 0.39 / +4.4%
tpch_q11/datafusion:vortex-compact 15915617 / 16567052 / -3.9% 33780587 / 35038612 / -3.6% 0.47 / 0.47 / -0.4%
tpch_q12/datafusion:vortex-compact 24089740 / 23790837 / +1.3% 45539906 / 45343948 / +0.4% 0.53 / 0.52 / +0.8%
tpch_q13/datafusion:vortex-compact 21101334 / 20687020 / +2.0% 41265634 / 39622301 / +4.1% 0.51 / 0.52 / -2.1%
tpch_q14/datafusion:vortex-compact 16335489 / 16485717 / -0.9% 42333919 / 40345247 / +4.9% 0.39 / 0.41 / -5.6%
tpch_q15/datafusion:vortex-compact 19654657 / 19610332 / +0.2% 45795753 / 46133844 / -0.7% 0.43 / 0.43 / +1.0%
tpch_q16/datafusion:vortex-compact 19366118 / 18859009 / +2.7% 39124421 / 38812468 / +0.8% 0.49 / 0.49 / +1.9%
tpch_q17/datafusion:vortex-compact 28812203 / 28843313 / -0.1% 55927560 / 58322572 / -4.1% 0.52 / 0.49 / +4.2%
tpch_q18/datafusion:vortex-compact 38185493 / 37685147 / +1.3% 57017603 / 58750865 / -3.0% 0.67 / 0.64 / +4.4%
tpch_q19/datafusion:vortex-compact 16201513 / 16555675 / -2.1% 40705905 / 41008422 / -0.7% 0.40 / 0.40 / -1.4%
tpch_q20/datafusion:vortex-compact 21931723 / 21927610 / +0.0% 44209523 / 45778930 / -3.4% 0.50 / 0.48 / +3.6%
tpch_q21/datafusion:vortex-compact 42145663 / 41491053 / +1.6% 67934766 / 70010720 / -3.0% 0.62 / 0.59 / +4.7%
tpch_q22/datafusion:vortex-compact 11366768 / 11659635 / -2.5% 31135542 / 31792399 / -2.1% 0.37 / 0.37 / -0.5%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72158776 / 72490481 / -0.5% 89647292 / 89984748 / -0.4% 0.80 / 0.81 / -0.1%
tpch_q02/datafusion:parquet 57516829 / 57492562 / +0.0% 76818495 / 76137334 / +0.9% 0.75 / 0.76 / -0.8%
tpch_q03/datafusion:parquet 84329250 / 84151754 / +0.2% 106203074 / 107115518 / -0.9% 0.79 / 0.79 / +1.1%
tpch_q04/datafusion:parquet 46519598 / 46923988 / -0.9% 66131914 / 67076007 / -1.4% 0.70 / 0.70 / +0.6%
tpch_q05/datafusion:parquet 99722453 / 98916511 / +0.8% 128590069 / 131305903 / -2.1% 0.78 / 0.75 / +2.9%
tpch_q06/datafusion:parquet 31833220 / 31960243 / -0.4% 50033820 / 51513089 / -2.9% 0.64 / 0.62 / +2.5%
tpch_q07/datafusion:parquet 108711511 / 105231696 / +3.3% 136346784 / 134985035 / +1.0% 0.80 / 0.78 / +2.3%
tpch_q08/datafusion:parquet 112901811 / 112468236 / +0.4% 136287871 / 136874847 / -0.4% 0.83 / 0.82 / +0.8%
tpch_q09/datafusion:parquet 130110663 / 130674630 / -0.4% 158972076 / 159447190 / -0.3% 0.82 / 0.82 / -0.1%
tpch_q10/datafusion:parquet 104215837 / 103991190 / +0.2% 132190898 / 132853613 / -0.5% 0.79 / 0.78 / +0.7%
tpch_q11/datafusion:parquet 41557920 / 42303074 / -1.8% 65120583 / 65258651 / -0.2% 0.64 / 0.65 / -1.6%
tpch_q12/datafusion:parquet 68870619 / 68664940 / +0.3% 90511502 / 91557426 / -1.1% 0.76 / 0.75 / +1.5%
tpch_q13/datafusion:parquet 186906651 / 186888037 / +0.0% 209724870 / 209181913 / +0.3% 0.89 / 0.89 / -0.2%
tpch_q14/datafusion:parquet 47935462 / 47986868 / -0.1% 79277801 / 73378678 / +8.0% 0.60 / 0.65 / -7.5%
tpch_q15/datafusion:parquet 54266255 / 54301500 / -0.1% 75711452 / 76064907 / -0.5% 0.72 / 0.71 / +0.4%
tpch_q16/datafusion:parquet 40814332 / 40900391 / -0.2% 59516020 / 61115408 / -2.6% 0.69 / 0.67 / +2.5%
tpch_q17/datafusion:parquet 128759008 / 128527288 / +0.2% 152788726 / 150761137 / +1.3% 0.84 / 0.85 / -1.1%
tpch_q18/datafusion:parquet 129701299 / 131479924 / -1.4% 154050481 / 151032090 / +2.0% 0.84 / 0.87 / -3.3%
tpch_q19/datafusion:parquet 59786304 / 58705825 / +1.8% 84941242 / 85739356 / -0.9% 0.70 / 0.68 / +2.8%
tpch_q20/datafusion:parquet 67669408 / 68354339 / -1.0% 94124388 / 89852788 / +4.8% 0.72 / 0.76 / -5.5%
tpch_q21/datafusion:parquet 107747175 / 109015245 / -1.2% 131571081 / 130313995 / +1.0% 0.82 / 0.84 / -2.1%
tpch_q22/datafusion:parquet 46860430 / 47296791 / -0.9% 63430152 / 67537966 / -6.1% 0.74 / 0.70 / +5.5%
duckdb / vortex-file-compressed / ns (0.980x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11405947 / 10906572 / +4.6% 18620981 / 20413658 / -8.8% 0.61 / 0.53 / +14.6%
tpch_q02/duckdb:vortex-file-compressed 17254389 / 17264906 / -0.1% 27900379 / 26731875 / +4.4% 0.62 / 0.65 / -4.2%
tpch_q03/duckdb:vortex-file-compressed 18446664 / 18609317 / -0.9% 33940292 / 34112601 / -0.5% 0.54 / 0.55 / -0.4%
tpch_q04/duckdb:vortex-file-compressed 17160835 / 17834409 / -3.8% 30511112 / 30585262 / -0.2% 0.56 / 0.58 / -3.5%
tpch_q05/duckdb:vortex-file-compressed 22140735 / 22160205 / -0.1% 35158045 / 35572108 / -1.2% 0.63 / 0.62 / +1.1%
tpch_q06/duckdb:vortex-file-compressed 5665099 / 7640009 / -25.8% 🟢 16983792 / 14428469 / +17.7% 🔴 0.33 / 0.53 / -37.0%
tpch_q07/duckdb:vortex-file-compressed 19956205 / 20913159 / -4.6% 40387779 / 41985402 / -3.8% 0.49 / 0.50 / -0.8%
tpch_q08/duckdb:vortex-file-compressed 23044435 / 23832345 / -3.3% 38763146 / 41846014 / -7.4% 0.59 / 0.57 / +4.4%
tpch_q09/duckdb:vortex-file-compressed 30558774 / 30256866 / +1.0% 46987739 / 50302071 / -6.6% 0.65 / 0.60 / +8.1%
tpch_q10/duckdb:vortex-file-compressed 27477779 / 27471895 / +0.0% 39540150 / 46478272 / -14.9% 🟢 0.69 / 0.59 / +17.6%
tpch_q11/duckdb:vortex-file-compressed 8591376 / 8580147 / +0.1% 13315353 / 14668079 / -9.2% 0.65 / 0.58 / +10.3%
tpch_q12/duckdb:vortex-file-compressed 15906176 / 16570924 / -4.0% 29304325 / 34014973 / -13.8% 🟢 0.54 / 0.49 / +11.4%
tpch_q13/duckdb:vortex-file-compressed 21898208 / 23227058 / -5.7% 39862437 / 40556588 / -1.7% 0.55 / 0.57 / -4.1%
tpch_q14/duckdb:vortex-file-compressed 13182443 / 13085101 / +0.7% 25791953 / 26368107 / -2.2% 0.51 / 0.50 / +3.0%
tpch_q15/duckdb:vortex-file-compressed 9724043 / 9535676 / +2.0% 18483283 / 19517850 / -5.3% 0.53 / 0.49 / +7.7%
tpch_q16/duckdb:vortex-file-compressed 18360641 / 18330454 / +0.2% 25632732 / 25956170 / -1.2% 0.72 / 0.71 / +1.4%
tpch_q17/duckdb:vortex-file-compressed 16689878 / 15438035 / +8.1% 36211359 / 31627782 / +14.5% 🔴 0.46 / 0.49 / -5.6%
tpch_q18/duckdb:vortex-file-compressed 25270777 / 26131185 / -3.3% 34792080 / 34732042 / +0.2% 0.73 / 0.75 / -3.5%
tpch_q19/duckdb:vortex-file-compressed 22904877 / 23455919 / -2.3% 31059765 / 34636633 / -10.3% 🟢 0.74 / 0.68 / +8.9%
tpch_q20/duckdb:vortex-file-compressed 16854035 / 16980464 / -0.7% 34141276 / 35674941 / -4.3% 0.49 / 0.48 / +3.7%
tpch_q21/duckdb:vortex-file-compressed 66803383 / 67343025 / -0.8% 89457923 / 82191398 / +8.8% 0.75 / 0.82 / -8.9%
tpch_q22/duckdb:vortex-file-compressed 12222450 / 12270267 / -0.4% 19855726 / 22690097 / -12.5% 🟢 0.62 / 0.54 / +13.8%
duckdb / vortex-compact / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 14253767 / 13947326 / +2.2% 23246565 / 23765110 / -2.2% 0.61 / 0.59 / +4.5%
tpch_q02/duckdb:vortex-compact 20017362 / 19985865 / +0.2% 31273027 / 27492796 / +13.7% 🔴 0.64 / 0.73 / -11.9%
tpch_q03/duckdb:vortex-compact 18621378 / 19843289 / -6.2% 36833498 / 37221156 / -1.0% 0.51 / 0.53 / -5.2%
tpch_q04/duckdb:vortex-compact 17807355 / 18692772 / -4.7% 30762011 / 31358282 / -1.9% 0.58 / 0.60 / -2.9%
tpch_q05/duckdb:vortex-compact 22476583 / 23933396 / -6.1% 34667689 / 38398062 / -9.7% 0.65 / 0.62 / +4.0%
tpch_q06/duckdb:vortex-compact 6142978 / 6321427 / -2.8% 14681250 / 14887081 / -1.4% 0.42 / 0.42 / -1.5%
tpch_q07/duckdb:vortex-compact 21405576 / 21820174 / -1.9% 36462819 / 41428341 / -12.0% 🟢 0.59 / 0.53 / +11.5%
tpch_q08/duckdb:vortex-compact 26538635 / 25331366 / +4.8% 37377294 / 43291999 / -13.7% 🟢 0.71 / 0.59 / +21.3%
tpch_q09/duckdb:vortex-compact 29919558 / 31106296 / -3.8% 50682654 / 49243623 / +2.9% 0.59 / 0.63 / -6.5%
tpch_q10/duckdb:vortex-compact 29228115 / 30379711 / -3.8% 43138345 / 45514203 / -5.2% 0.68 / 0.67 / +1.5%
tpch_q11/duckdb:vortex-compact 9970852 / 9757666 / +2.2% 16489850 / 15587313 / +5.8% 0.60 / 0.63 / -3.4%
tpch_q12/duckdb:vortex-compact 17344886 / 18501496 / -6.3% 29800303 / 31315201 / -4.8% 0.58 / 0.59 / -1.5%
tpch_q13/duckdb:vortex-compact 22040993 / 23800934 / -7.4% 40750980 / 43888745 / -7.1% 0.54 / 0.54 / -0.3%
tpch_q14/duckdb:vortex-compact 14246801 / 14692385 / -3.0% 25187485 / 26487558 / -4.9% 0.57 / 0.55 / +2.0%
tpch_q15/duckdb:vortex-compact 10103096 / 9761737 / +3.5% 24208579 / 21276595 / +13.8% 🔴 0.42 / 0.46 / -9.0%
tpch_q16/duckdb:vortex-compact 20419188 / 19557895 / +4.4% 25098008 / 26479979 / -5.2% 0.81 / 0.74 / +10.2%
tpch_q17/duckdb:vortex-compact 16480536 / 16215602 / +1.6% 32956315 / 31119594 / +5.9% 0.50 / 0.52 / -4.0%
tpch_q18/duckdb:vortex-compact 26069732 / 26144818 / -0.3% 35897453 / 34147006 / +5.1% 0.73 / 0.77 / -5.1%
tpch_q19/duckdb:vortex-compact 23721636 / 23437105 / +1.2% 35664932 / 35138762 / +1.5% 0.67 / 0.67 / -0.3%
tpch_q20/duckdb:vortex-compact 18997604 / 19387090 / -2.0% 35289580 / 33617163 / +5.0% 0.54 / 0.58 / -6.7%
tpch_q21/duckdb:vortex-compact 70082577 / 68328769 / +2.6% 81890847 / 80618925 / +1.6% 0.86 / 0.85 / +1.0%
tpch_q22/duckdb:vortex-compact 12992818 / 12987189 / +0.0% 21009435 / 22384284 / -6.1% 0.62 / 0.58 / +6.6%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62868834 / 63226797 / -0.6% 69263741 / 69543769 / -0.4% 0.91 / 0.91 / -0.2%
tpch_q02/duckdb:parquet 37515840 / 37434191 / +0.2% 45030212 / 46841003 / -3.9% 0.83 / 0.80 / +4.2%
tpch_q03/duckdb:parquet 67560197 / 67414204 / +0.2% 77674604 / 78544290 / -1.1% 0.87 / 0.86 / +1.3%
tpch_q04/duckdb:parquet 46511877 / 46185848 / +0.7% 55483215 / 55256755 / +0.4% 0.84 / 0.84 / +0.3%
tpch_q05/duckdb:parquet 65730481 / 66050362 / -0.5% 76885871 / 76878291 / +0.0% 0.85 / 0.86 / -0.5%
tpch_q06/duckdb:parquet 21777281 / 21828505 / -0.2% 27753376 / 26665421 / +4.1% 0.78 / 0.82 / -4.1%
tpch_q07/duckdb:parquet 64935295 / 64991488 / -0.1% 74957786 / 74911643 / +0.1% 0.87 / 0.87 / -0.1%
tpch_q08/duckdb:parquet 79816682 / 79959028 / -0.2% 91416511 / 91832984 / -0.5% 0.87 / 0.87 / +0.3%
tpch_q09/duckdb:parquet 119621687 / 119432720 / +0.2% 131822344 / 133766433 / -1.5% 0.91 / 0.89 / +1.6%
tpch_q10/duckdb:parquet 118858853 / 119243919 / -0.3% 130212763 / 130439119 / -0.2% 0.91 / 0.91 / -0.1%
tpch_q11/duckdb:parquet 21322173 / 21297687 / +0.1% 25398851 / 28744153 / -11.6% 🟢 0.84 / 0.74 / +13.3%
tpch_q12/duckdb:parquet 44302142 / 44201856 / +0.2% 51311649 / 51616037 / -0.6% 0.86 / 0.86 / +0.8%
tpch_q13/duckdb:parquet 242431884 / 242096762 / +0.1% 254672442 / 251193763 / +1.4% 0.95 / 0.96 / -1.2%
tpch_q14/duckdb:parquet 47157237 / 47030563 / +0.3% 54803913 / 55098893 / -0.5% 0.86 / 0.85 / +0.8%
tpch_q15/duckdb:parquet 26561410 / 29275297 / -9.3% 32453050 / 32708042 / -0.8% 0.82 / 0.90 / -8.6%
tpch_q16/duckdb:parquet 51896478 / 52226118 / -0.6% 60028606 / 59870591 / +0.3% 0.86 / 0.87 / -0.9%
tpch_q17/duckdb:parquet 49095925 / 48959711 / +0.3% 58238392 / 61883237 / -5.9% 0.84 / 0.79 / +6.6%
tpch_q18/duckdb:parquet 95542195 / 95495907 / +0.0% 104568861 / 103833447 / +0.7% 0.91 / 0.92 / -0.7%
tpch_q19/duckdb:parquet 65070941 / 64917225 / +0.2% 73868269 / 74484502 / -0.8% 0.88 / 0.87 / +1.1%
tpch_q20/duckdb:parquet 61536671 / 61496849 / +0.1% 72406416 / 73055585 / -0.9% 0.85 / 0.84 / +1.0%
tpch_q21/duckdb:parquet 142063520 / 141932025 / +0.1% 152783289 / 152439847 / +0.2% 0.93 / 0.93 / -0.1%
tpch_q22/duckdb:parquet 51444242 / 51336285 / +0.2% 58548654 / 59099130 / -0.9% 0.88 / 0.87 / +1.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (+0.8%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.021x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 167655828 / 190144248 / -11.8% 🟢 629295052 / 545867244 / +15.3% 🔴 0.27 / 0.35 / -23.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10574008 / 11166129 / -5.3% 48595295 / 52353647 / -7.2% 0.22 / 0.21 / +2.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11591698 / 10835729 / +7.0% 50219610 / 51558021 / -2.6% 0.23 / 0.21 / +9.8%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22856470 / 23026188 / -0.7% 71964778 / 70075250 / +2.7% 0.32 / 0.33 / -3.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18303496 / 17966572 / +1.9% 62520987 / 61370733 / +1.9% 0.29 / 0.29 / +0.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed 18539392 / 17583128 / +5.4% 61996113 / 58428649 / +6.1% 0.30 / 0.30 / -0.6%
clickbench-sorted_q39/datafusion:vortex-file-compressed 39464068 / 39555784 / -0.2% 92695941 / 89524721 / +3.5% 0.43 / 0.44 / -3.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12112592 / 12139970 / -0.2% 46863389 / 44514296 / +5.3% 0.26 / 0.27 / -5.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12001617 / 11947370 / +0.5% 43347470 / 43189993 / +0.4% 0.28 / 0.28 / +0.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9953880 / 9985144 / -0.3% 37053689 / 36355078 / +1.9% 0.27 / 0.27 / -2.2%
datafusion / vortex-compact / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 211197805 / 189080834 / +11.7% 🔴 572220846 / 401613176 / +42.5% 🔴 0.37 / 0.47 / -21.6%
clickbench-sorted_q24/datafusion:vortex-compact 22122652 / 22733390 / -2.7% 51410464 / 51602467 / -0.4% 0.43 / 0.44 / -2.3%
clickbench-sorted_q26/datafusion:vortex-compact 23018477 / 22340106 / +3.0% 54180307 / 53106752 / +2.0% 0.42 / 0.42 / +1.0%
clickbench-sorted_q36/datafusion:vortex-compact 25522129 / 25748740 / -0.9% 70747910 / 67553424 / +4.7% 0.36 / 0.38 / -5.4%
clickbench-sorted_q37/datafusion:vortex-compact 21742205 / 21825621 / -0.4% 72269579 / 67122620 / +7.7% 0.30 / 0.33 / -7.5%
clickbench-sorted_q38/datafusion:vortex-compact 22480754 / 21449082 / +4.8% 67923741 / 66375177 / +2.3% 0.33 / 0.32 / +2.4%
clickbench-sorted_q39/datafusion:vortex-compact 43216404 / 43916824 / -1.6% 86379602 / 82779525 / +4.3% 0.50 / 0.53 / -5.7%
clickbench-sorted_q40/datafusion:vortex-compact 13400594 / 14392416 / -6.9% 44233880 / 43995419 / +0.5% 0.30 / 0.33 / -7.4%
clickbench-sorted_q41/datafusion:vortex-compact 13905818 / 14400740 / -3.4% 45553950 / 47264706 / -3.6% 0.31 / 0.30 / +0.2%
clickbench-sorted_q42/datafusion:vortex-compact 11028984 / 10960670 / +0.6% 36614532 / 37957063 / -3.5% 0.30 / 0.29 / +4.3%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 761199730 / 763306886 / -0.3% 977155011 / 957336268 / +2.1% 0.78 / 0.80 / -2.3%
clickbench-sorted_q24/datafusion:parquet 9663438 / 8916212 / +8.4% 72885997 / 71638898 / +1.7% 0.13 / 0.12 / +6.5%
clickbench-sorted_q26/datafusion:parquet 9225714 / 9270016 / -0.5% 72727746 / 71408139 / +1.8% 0.13 / 0.13 / -2.3%
clickbench-sorted_q36/datafusion:parquet 94350874 / 93997156 / +0.4% 173610727 / 170960005 / +1.6% 0.54 / 0.55 / -1.2%
clickbench-sorted_q37/datafusion:parquet 64505414 / 64309912 / +0.3% 132425585 / 131501268 / +0.7% 0.49 / 0.49 / -0.4%
clickbench-sorted_q38/datafusion:parquet 88380003 / 87995890 / +0.4% 163567476 / 160129090 / +2.1% 0.54 / 0.55 / -1.7%
clickbench-sorted_q39/datafusion:parquet 160441554 / 159826091 / +0.4% 241028137 / 235206664 / +2.5% 0.67 / 0.68 / -2.0%
clickbench-sorted_q40/datafusion:parquet 45083960 / 44349988 / +1.7% 116907972 / 113137652 / +3.3% 0.39 / 0.39 / -1.6%
clickbench-sorted_q41/datafusion:parquet 42370710 / 41957374 / +1.0% 115596961 / 108377207 / +6.7% 0.37 / 0.39 / -5.3%
clickbench-sorted_q42/datafusion:parquet 25957441 / 26205634 / -0.9% 87076442 / 84176155 / +3.4% 0.30 / 0.31 / -4.2%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 58269134 / 57733680 / +0.9% 74683380 / 77094443 / -3.1% 0.78 / 0.75 / +4.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18332684 / 19847460 / -7.6% 29358795 / 32710170 / -10.2% 🟢 0.62 / 0.61 / +2.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14635429 / 15076375 / -2.9% 26309983 / 37887060 / -30.6% 🟢 0.56 / 0.40 / +39.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed 30040812 / 29301758 / +2.5% 64265422 / 62637223 / +2.6% 0.47 / 0.47 / -0.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed 22854636 / 22744930 / +0.5% 56164920 / 54828194 / +2.4% 0.41 / 0.41 / -1.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26734899 / 26406218 / +1.2% 58658446 / 59699254 / -1.7% 0.46 / 0.44 / +3.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48460342 / 48262654 / +0.4% 100363903 / 101928390 / -1.5% 0.48 / 0.47 / +2.0%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15206593 / 14955536 / +1.7% 39670221 / 39721330 / -0.1% 0.38 / 0.38 / +1.8%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15394919 / 15108482 / +1.9% 40500530 / 38992562 / +3.9% 0.38 / 0.39 / -1.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12214416 / 12507782 / -2.3% 33566413 / 31331447 / +7.1% 0.36 / 0.40 / -8.8%
duckdb / vortex-compact / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 63833233 / 65074958 / -1.9% 84194235 / 103504549 / -18.7% 🟢 0.76 / 0.63 / +20.6%
clickbench-sorted_q24/duckdb:vortex-compact 24250160 / 23850592 / +1.7% 36602705 / 34780521 / +5.2% 0.66 / 0.69 / -3.4%
clickbench-sorted_q26/duckdb:vortex-compact 19351581 / 16657504 / +16.2% 🔴 29407101 / 33890538 / -13.2% 🟢 0.66 / 0.49 / +33.9%
clickbench-sorted_q36/duckdb:vortex-compact 36660560 / 33624626 / +9.0% 70894320 / 71244827 / -0.5% 0.52 / 0.47 / +9.6%
clickbench-sorted_q37/duckdb:vortex-compact 28684481 / 29217740 / -1.8% 64584295 / 62615931 / +3.1% 0.44 / 0.47 / -4.8%
clickbench-sorted_q38/duckdb:vortex-compact 29377582 / 28856905 / +1.8% 65729486 / 68180949 / -3.6% 0.45 / 0.42 / +5.6%
clickbench-sorted_q39/duckdb:vortex-compact 60615634 / 60171908 / +0.7% 107766347 / 104319448 / +3.3% 0.56 / 0.58 / -2.5%
clickbench-sorted_q40/duckdb:vortex-compact 17698009 / 18508974 / -4.4% 39351034 / 39409189 / -0.1% 0.45 / 0.47 / -4.2%
clickbench-sorted_q41/duckdb:vortex-compact 17546261 / 19147310 / -8.4% 39054993 / 40228829 / -2.9% 0.45 / 0.48 / -5.6%
clickbench-sorted_q42/duckdb:vortex-compact 13533866 / 13130794 / +3.1% 32095595 / 31141437 / +3.1% 0.42 / 0.42 / +0.0%
duckdb / parquet / ns (0.997x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 127658844 / 127300972 / +0.3% 139003296 / 140559406 / -1.1% 0.92 / 0.91 / +1.4%
clickbench-sorted_q24/duckdb:parquet 17701716 / 18387751 / -3.7% 30546704 / 31798887 / -3.9% 0.58 / 0.58 / +0.2%
clickbench-sorted_q26/duckdb:parquet 14881196 / 12527069 / +18.8% 🔴 20421138 / 21905045 / -6.8% 0.73 / 0.57 / +27.4%
clickbench-sorted_q36/duckdb:parquet 46706033 / 43125587 / +8.3% 65033683 / 61426834 / +5.9% 0.72 / 0.70 / +2.3%
clickbench-sorted_q37/duckdb:parquet 31465368 / 31657658 / -0.6% 49515806 / 50242276 / -1.4% 0.64 / 0.63 / +0.9%
clickbench-sorted_q38/duckdb:parquet 38305716 / 42680514 / -10.3% 🟢 62223722 / 58119542 / +7.1% 0.62 / 0.73 / -16.2%
clickbench-sorted_q39/duckdb:parquet 72287544 / 73340448 / -1.4% 86812565 / 83788327 / +3.6% 0.83 / 0.88 / -4.9%
clickbench-sorted_q40/duckdb:parquet 17127991 / 17245859 / -0.7% 47764984 / 44587199 / +7.1% 0.36 / 0.39 / -7.3%
clickbench-sorted_q41/duckdb:parquet 16434103 / 16473978 / -0.2% 44693081 / 44042419 / +1.5% 0.37 / 0.37 / -1.7%
clickbench-sorted_q42/duckdb:parquet 11292345 / 12563783 / -10.1% 🟢 23954071 / 22823678 / +5.0% 0.47 / 0.55 / -14.4%
File Size Changes (200 files changed, -0.0% overall, 99↑ 101↓)
File Scale Format Base HEAD Change %
hits_001.vortex 1.0 vortex-file-compressed 188.80 MB 193.07 MB +4.28 MB +2.3%
hits_065.vortex 1.0 vortex-compact 123.95 MB 125.42 MB +1.47 MB +1.2%
hits_087.vortex 1.0 vortex-compact 123.88 MB 125.27 MB +1.39 MB +1.1%
hits_001.vortex 1.0 vortex-compact 137.67 MB 139.19 MB +1.53 MB +1.1%
hits_039.vortex 1.0 vortex-compact 123.90 MB 125.18 MB +1.28 MB +1.0%
hits_000.vortex 1.0 vortex-compact 97.40 MB 98.39 MB +1010.80 KB +1.0%
hits_097.vortex 1.0 vortex-file-compressed 192.57 MB 194.34 MB +1.77 MB +0.9%
hits_030.vortex 1.0 vortex-compact 98.22 MB 99.08 MB +880.62 KB +0.9%
hits_004.vortex 1.0 vortex-compact 97.89 MB 98.73 MB +856.80 KB +0.9%
hits_090.vortex 1.0 vortex-compact 140.00 MB 141.15 MB +1.14 MB +0.8%
hits_006.vortex 1.0 vortex-compact 95.47 MB 96.00 MB +544.41 KB +0.6%
hits_024.vortex 1.0 vortex-compact 122.74 MB 123.42 MB +694.93 KB +0.6%
hits_034.vortex 1.0 vortex-compact 132.36 MB 133.09 MB +749.19 KB +0.6%
hits_048.vortex 1.0 vortex-file-compressed 199.57 MB 200.58 MB +1.01 MB +0.5%
hits_055.vortex 1.0 vortex-compact 152.63 MB 153.26 MB +640.45 KB +0.4%
hits_040.vortex 1.0 vortex-file-compressed 144.07 MB 144.66 MB +601.40 KB +0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.21 MB 171.81 MB +613.12 KB +0.3%
hits_081.vortex 1.0 vortex-compact 152.87 MB 153.40 MB +542.06 KB +0.3%
hits_033.vortex 1.0 vortex-file-compressed 199.91 MB 200.59 MB +692.83 KB +0.3%
hits_010.vortex 1.0 vortex-compact 123.14 MB 123.41 MB +271.98 KB +0.2%
hits_029.vortex 1.0 vortex-compact 153.22 MB 153.54 MB +323.19 KB +0.2%
hits_076.vortex 1.0 vortex-compact 124.52 MB 124.78 MB +261.80 KB +0.2%
hits_042.vortex 1.0 vortex-file-compressed 202.17 MB 202.58 MB +416.84 KB +0.2%
hits_052.vortex 1.0 vortex-compact 97.40 MB 97.59 MB +195.34 KB +0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.28 MB 160.59 MB +319.31 KB +0.2%
hits_012.vortex 1.0 vortex-compact 138.71 MB 138.95 MB +247.42 KB +0.2%
hits_008.vortex 1.0 vortex-file-compressed 139.26 MB 139.49 MB +232.82 KB +0.2%
hits_043.vortex 1.0 vortex-compact 94.04 MB 94.19 MB +150.61 KB +0.2%
hits_009.vortex 1.0 vortex-file-compressed 101.00 MB 101.15 MB +150.14 KB +0.1%
hits_067.vortex 1.0 vortex-compact 98.53 MB 98.66 MB +131.75 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.74 MB 172.96 MB +230.21 KB +0.1%
hits_074.vortex 1.0 vortex-compact 153.03 MB 153.23 MB +199.28 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.85 MB 101.98 MB +130.03 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.19 MB 200.44 MB +254.02 KB +0.1%
hits_022.vortex 1.0 vortex-compact 152.99 MB 153.17 MB +190.10 KB +0.1%
hits_079.vortex 1.0 vortex-compact 127.68 MB 127.84 MB +157.79 KB +0.1%
hits_031.vortex 1.0 vortex-compact 111.15 MB 111.29 MB +136.59 KB +0.1%
hits_074.vortex 1.0 vortex-file-compressed 200.05 MB 200.27 MB +231.13 KB +0.1%
hits_044.vortex 1.0 vortex-compact 153.52 MB 153.68 MB +169.37 KB +0.1%
hits_088.vortex 1.0 vortex-compact 134.42 MB 134.56 MB +142.77 KB +0.1%
hits_056.vortex 1.0 vortex-compact 100.73 MB 100.83 MB +99.92 KB +0.1%
hits_029.vortex 1.0 vortex-file-compressed 200.79 MB 200.98 MB +193.68 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.81 MB 130.92 MB +117.92 KB +0.1%
hits_057.vortex 1.0 vortex-compact 111.53 MB 111.62 MB +87.61 KB +0.1%
hits_007.vortex 1.0 vortex-file-compressed 199.76 MB 199.91 MB +152.98 KB +0.1%
hits_072.vortex 1.0 vortex-compact 75.54 MB 75.59 MB +55.68 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.08 MB 160.20 MB +115.08 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.24 MB 130.33 MB +86.89 KB +0.1%
hits_062.vortex 1.0 vortex-compact 132.52 MB 132.61 MB +87.84 KB +0.1%
hits_080.vortex 1.0 vortex-compact 96.04 MB 96.09 MB +55.94 KB +0.1%
hits_040.vortex 1.0 vortex-compact 109.99 MB 110.05 MB +63.11 KB +0.1%
hits_017.vortex 1.0 vortex-file-compressed 147.18 MB 147.25 MB +77.75 KB +0.1%
hits_056.vortex 1.0 vortex-file-compressed 134.99 MB 135.06 MB +68.86 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.80 MB 126.86 MB +63.93 KB +0.0%
hits_033.vortex 1.0 vortex-compact 153.49 MB 153.56 MB +77.13 KB +0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.60 MB 180.69 MB +90.38 KB +0.0%
hits_013.vortex 1.0 vortex-compact 123.89 MB 123.94 MB +56.92 KB +0.0%
hits_018.vortex 1.0 vortex-file-compressed 200.77 MB 200.85 MB +89.65 KB +0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.28 MB 130.34 MB +57.55 KB +0.0%
hits_098.vortex 1.0 vortex-compact 102.40 MB 102.44 MB +43.68 KB +0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.21 MB 130.26 MB +49.70 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.97 MB 131.02 MB +48.59 KB +0.0%
hits_045.vortex 1.0 vortex-compact 105.60 MB 105.64 MB +38.15 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.09 MB 178.16 MB +64.33 KB +0.0%
hits_085.vortex 1.0 vortex-compact 153.40 MB 153.45 MB +51.27 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.05 MB 173.10 MB +57.08 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.00 MB 102.04 MB +32.77 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.32 MB 153.37 MB +47.62 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 143.10 MB 143.14 MB +44.13 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.73 MB 181.78 MB +54.54 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.10 MB 200.16 MB +58.25 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.91 MB 75.93 MB +22.04 KB +0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.89 MB 161.93 MB +46.07 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.74 MB 159.78 MB +45.16 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.78 MB 137.81 MB +38.11 KB +0.0%
hits_053.vortex 1.0 vortex-compact 138.32 MB 138.36 MB +33.18 KB +0.0%
hits_050.vortex 1.0 vortex-compact 125.02 MB 125.04 MB +27.95 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.40 MB 147.44 MB +32.09 KB +0.0%
hits_021.vortex 1.0 vortex-compact 110.60 MB 110.62 MB +22.50 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.26 MB 172.29 MB +34.43 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.03 MB 111.05 MB +19.70 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.30 MB 147.33 MB +24.73 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.19 MB 136.21 MB +20.41 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.47 MB 189.49 MB +26.24 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.59 MB 126.61 MB +16.14 KB +0.0%
hits_071.vortex 1.0 vortex-compact 105.57 MB 105.58 MB +10.19 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.26 MB 139.27 MB +12.52 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.29 MB 192.31 MB +17.13 KB +0.0%
hits_096.vortex 1.0 vortex-file-compressed 200.37 MB 200.39 MB +17.45 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.71 MB 105.72 MB +8.20 KB +0.0%
hits_037.vortex 1.0 vortex-compact 132.16 MB 132.17 MB +10.18 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.73 MB 161.74 MB +12.45 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.09 MB 131.10 MB +5.47 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.60 MB 110.60 MB +4.30 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.76 MB 190.76 MB +5.59 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.83 MB 192.83 MB +2.63 KB +0.0%
hits_093.vortex 1.0 vortex-compact 98.13 MB 98.13 MB +824 B +0.0%
hits_091.vortex 1.0 vortex-compact 111.83 MB 111.83 MB +544 B +0.0%
hits_002.vortex 1.0 vortex-compact 123.84 MB 123.84 MB +472 B +0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.21 MB 8 B -0.0%
hits_036.vortex 1.0 vortex-file-compressed 172.06 MB 172.06 MB 4.43 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.52 MB 136.52 MB 3.70 KB -0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.89 MB 153.88 MB 11.47 KB -0.0%
hits_066.vortex 1.0 vortex-compact 117.42 MB 117.42 MB 10.09 KB -0.0%
hits_047.vortex 1.0 vortex-compact 110.46 MB 110.45 MB 10.00 KB -0.0%
hits_051.vortex 1.0 vortex-compact 133.98 MB 133.97 MB 13.00 KB -0.0%
hits_017.vortex 1.0 vortex-compact 111.83 MB 111.81 MB 15.32 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.71 MB 200.68 MB 29.97 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.65 MB 130.63 MB 19.57 KB -0.0%
hits_075.vortex 1.0 vortex-compact 137.84 MB 137.82 MB 20.70 KB -0.0%
hits_049.vortex 1.0 vortex-compact 139.32 MB 139.29 MB 22.20 KB -0.0%
hits_014.vortex 1.0 vortex-compact 133.90 MB 133.87 MB 21.44 KB -0.0%
hits_032.vortex 1.0 vortex-compact 110.61 MB 110.59 MB 18.44 KB -0.0%
hits_046.vortex 1.0 vortex-compact 74.95 MB 74.94 MB 12.68 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 173.08 MB 173.05 MB 30.04 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.09 MB 161.06 MB 30.53 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.15 MB 191.11 MB 37.59 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 201.00 MB 200.96 MB 40.70 KB -0.0%
hits_094.vortex 1.0 vortex-compact 110.71 MB 110.69 MB 23.03 KB -0.0%
hits_066.vortex 1.0 vortex-file-compressed 163.09 MB 163.05 MB 38.64 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.11 MB 127.08 MB 31.49 KB -0.0%
hits_084.vortex 1.0 vortex-compact 110.68 MB 110.65 MB 29.71 KB -0.0%
hits_028.vortex 1.0 vortex-compact 115.18 MB 115.15 MB 31.64 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.21 MB 130.17 MB 39.56 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.34 MB 156.29 MB 48.80 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.79 MB 191.72 MB 69.93 KB -0.0%
hits_038.vortex 1.0 vortex-compact 139.36 MB 139.30 MB 53.62 KB -0.0%
hits_019.vortex 1.0 vortex-compact 105.98 MB 105.94 MB 42.39 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.81 MB 161.74 MB 66.52 KB -0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.88 MB 171.81 MB 74.27 KB -0.0%
hits_097.vortex 1.0 vortex-compact 141.15 MB 141.09 MB 65.01 KB -0.0%
hits_086.vortex 1.0 vortex-compact 140.56 MB 140.49 MB 71.69 KB -0.0%
hits_083.vortex 1.0 vortex-compact 110.12 MB 110.06 MB 59.85 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.70 MB 172.60 MB 104.76 KB -0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.67 MB 161.57 MB 102.70 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.58 MB 104.51 MB 69.86 KB -0.1%
hits_016.vortex 1.0 vortex-compact 127.41 MB 127.32 MB 86.28 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.73 MB 130.65 MB 89.25 KB -0.1%
hits_020.vortex 1.0 vortex-compact 111.72 MB 111.64 MB 77.68 KB -0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.18 MB 189.06 MB 131.61 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.22 MB 201.08 MB 142.84 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.33 MB 158.22 MB 114.41 KB -0.1%
hits_025.vortex 1.0 vortex-compact 133.83 MB 133.73 MB 100.73 KB -0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.96 MB 153.85 MB 117.02 KB -0.1%
hits_069.vortex 1.0 vortex-compact 99.76 MB 99.68 MB 78.95 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.57 MB 130.47 MB 103.80 KB -0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.67 MB 189.53 MB 152.16 KB -0.1%
hits_011.vortex 1.0 vortex-compact 153.04 MB 152.91 MB 123.80 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.92 MB 130.81 MB 106.45 KB -0.1%
hits_007.vortex 1.0 vortex-compact 153.58 MB 153.46 MB 125.66 KB -0.1%
hits_036.vortex 1.0 vortex-compact 133.37 MB 133.26 MB 109.43 KB -0.1%
hits_027.vortex 1.0 vortex-compact 138.04 MB 137.92 MB 118.51 KB -0.1%
hits_070.vortex 1.0 vortex-compact 153.86 MB 153.73 MB 133.88 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.85 MB 153.72 MB 135.92 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 169.00 MB 168.83 MB 170.07 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 201.18 MB 200.98 MB 203.85 KB -0.1%
hits_061.vortex 1.0 vortex-file-compressed 161.61 MB 161.44 MB 173.54 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.71 MB 100.60 MB 111.38 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.26 MB 153.09 MB 180.20 KB -0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.57 MB 154.39 MB 185.66 KB -0.1%
hits_073.vortex 1.0 vortex-compact 134.21 MB 134.04 MB 170.70 KB -0.1%
hits_008.vortex 1.0 vortex-compact 105.79 MB 105.65 MB 146.02 KB -0.1%
hits_099.vortex 1.0 vortex-compact 133.18 MB 132.99 MB 187.73 KB -0.1%
hits_015.vortex 1.0 vortex-compact 98.41 MB 98.26 MB 144.50 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 159.36 MB 159.13 MB 237.51 KB -0.1%
hits_018.vortex 1.0 vortex-compact 152.98 MB 152.73 MB 257.06 KB -0.2%
hits_063.vortex 1.0 vortex-file-compressed 130.97 MB 130.75 MB 227.27 KB -0.2%
hits_077.vortex 1.0 vortex-file-compressed 173.35 MB 173.05 MB 313.79 KB -0.2%
hits_059.vortex 1.0 vortex-compact 153.06 MB 152.78 MB 281.92 KB -0.2%
hits_061.vortex 1.0 vortex-compact 123.69 MB 123.47 MB 228.58 KB -0.2%
hits_065.vortex 1.0 vortex-file-compressed 162.12 MB 161.82 MB 301.59 KB -0.2%
hits_047.vortex 1.0 vortex-file-compressed 154.09 MB 153.80 MB 293.13 KB -0.2%
hits_054.vortex 1.0 vortex-compact 111.92 MB 111.70 MB 215.80 KB -0.2%
hits_016.vortex 1.0 vortex-file-compressed 180.04 MB 179.69 MB 358.56 KB -0.2%
hits_071.vortex 1.0 vortex-file-compressed 139.99 MB 139.70 MB 294.88 KB -0.2%
hits_005.vortex 1.0 vortex-compact 116.08 MB 115.81 MB 285.34 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.63 MB 167.20 MB 444.13 KB -0.3%
hits_068.vortex 1.0 vortex-compact 112.21 MB 111.90 MB 318.95 KB -0.3%
hits_089.vortex 1.0 vortex-compact 98.67 MB 98.38 MB 294.91 KB -0.3%
hits_077.vortex 1.0 vortex-compact 134.61 MB 134.18 MB 436.59 KB -0.3%
hits_063.vortex 1.0 vortex-compact 98.47 MB 98.15 MB 321.61 KB -0.3%
hits_045.vortex 1.0 vortex-file-compressed 139.99 MB 139.49 MB 512.14 KB -0.4%
hits_019.vortex 1.0 vortex-file-compressed 140.65 MB 140.08 MB 585.74 KB -0.4%
hits_021.vortex 1.0 vortex-file-compressed 154.33 MB 153.69 MB 654.80 KB -0.4%
hits_060.vortex 1.0 vortex-compact 140.84 MB 140.15 MB 711.96 KB -0.5%
hits_048.vortex 1.0 vortex-compact 153.37 MB 152.62 MB 776.77 KB -0.5%
hits_092.vortex 1.0 vortex-file-compressed 200.66 MB 199.65 MB 1.01 MB -0.5%
hits_023.vortex 1.0 vortex-compact 142.40 MB 141.68 MB 736.68 KB -0.5%
hits_041.vortex 1.0 vortex-compact 98.34 MB 97.83 MB 521.90 KB -0.5%
hits_064.vortex 1.0 vortex-compact 139.90 MB 139.14 MB 772.25 KB -0.5%
hits_028.vortex 1.0 vortex-file-compressed 153.04 MB 152.16 MB 896.09 KB -0.6%
hits_038.vortex 1.0 vortex-file-compressed 191.99 MB 190.78 MB 1.21 MB -0.6%
hits_055.vortex 1.0 vortex-file-compressed 200.63 MB 199.34 MB 1.29 MB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 200.08 MB 198.73 MB 1.36 MB -0.7%
hits_078.vortex 1.0 vortex-compact 97.95 MB 97.16 MB 800.88 KB -0.8%
hits_026.vortex 1.0 vortex-compact 99.20 MB 98.22 MB 1006.47 KB -1.0%
hits_023.vortex 1.0 vortex-file-compressed 196.92 MB 194.88 MB 2.04 MB -1.0%
hits_076.vortex 1.0 vortex-file-compressed 161.59 MB 159.89 MB 1.71 MB -1.1%
hits_087.vortex 1.0 vortex-file-compressed 161.83 MB 160.11 MB 1.72 MB -1.1%
hits_064.vortex 1.0 vortex-file-compressed 192.66 MB 190.57 MB 2.08 MB -1.1%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.0%)
  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +16.0%
Engines: DataFusion No clear signal (+10.9%, environment too noisy confidence) · DuckDB No clear signal (+21.3%, environment too noisy confidence)
Vortex (geomean): hot 0.847x ➖ · cold 0.869x ➖
Parquet (geomean): hot 0.730x ➖ · cold 0.781x ➖
Shifts: Parquet (control) -27.0% · Median polish -20.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.797x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 53282960 / 55871006 / -4.6% 136038083 / 190334754 / -28.5% 0.39 / 0.29 / +33.4%
fineweb_q01/datafusion:vortex-file-compressed 448419130 / 507839658 / -11.7% 892450496 / 921046450 / -3.1% 0.50 / 0.55 / -8.9%
fineweb_q02/datafusion:vortex-file-compressed 387951747 / 652971506 / -40.6% 🟢 609660121 / 723408321 / -15.7% 0.64 / 0.90 / -29.5%
fineweb_q03/datafusion:vortex-file-compressed 642731158 / 796206290 / -19.3% 862156528 / 1693490173 / -49.1% 🟢 0.75 / 0.47 / +58.6%
fineweb_q04/datafusion:vortex-file-compressed 438626726 / 1243085108 / -64.7% 🟢 587421139 / 1014293397 / -42.1% 🟢 0.75 / 1.23 / -39.1%
fineweb_q05/datafusion:vortex-file-compressed 493421213 / 513193388 / -3.9% 590346362 / 668821213 / -11.7% 0.84 / 0.77 / +8.9%
fineweb_q06/datafusion:vortex-file-compressed 900940926 / 841165994 / +7.1% 821897553 / 951540030 / -13.6% 1.10 / 0.88 / +24.0%
fineweb_q07/datafusion:vortex-file-compressed 623823376 / 622077738 / +0.3% 841563557 / 623957166 / +34.9% 🔴 0.74 / 1.00 / -25.6%
fineweb_q08/datafusion:vortex-file-compressed 330520022 / 373590978 / -11.5% 236562567 / 375456845 / -37.0% 🟢 1.40 / 1.00 / +40.4%
datafusion / vortex-compact / ns (0.824x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 40898434 / 53005767 / -22.8% 144974552 / 184389857 / -21.4% 0.28 / 0.29 / -1.9%
fineweb_q01/datafusion:vortex-compact 540292164 / 443906886 / +21.7% 941136130 / 897026254 / +4.9% 0.57 / 0.49 / +16.0%
fineweb_q02/datafusion:vortex-compact 418076425 / 598525230 / -30.1% 🟢 496700261 / 698450840 / -28.9% 0.84 / 0.86 / -1.8%
fineweb_q03/datafusion:vortex-compact 550365017 / 570406006 / -3.5% 865211941 / 976284442 / -11.4% 0.64 / 0.58 / +8.9%
fineweb_q04/datafusion:vortex-compact 477322472 / 621684028 / -23.2% 552474643 / 719570612 / -23.2% 0.86 / 0.86 / +0.0%
fineweb_q05/datafusion:vortex-compact 436179034 / 541437648 / -19.4% 556411689 / 504997158 / +10.2% 0.78 / 1.07 / -26.9%
fineweb_q06/datafusion:vortex-compact 733680624 / 917947189 / -20.1% 588078761 / 932554053 / -36.9% 🟢 1.25 / 0.98 / +26.7%
fineweb_q07/datafusion:vortex-compact 584234141 / 588911118 / -0.8% 760527696 / 501895581 / +51.5% 🔴 0.77 / 1.17 / -34.5%
fineweb_q08/datafusion:vortex-compact 220651815 / 392181465 / -43.7% 🟢 258932517 / 469720933 / -44.9% 🟢 0.85 / 0.83 / +2.1%
datafusion / parquet / ns (0.731x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 808467942 / 1328407074 / -39.1% 🟢 1716352516 / 1539124533 / +11.5% 0.47 / 0.86 / -45.4%
fineweb_q01/datafusion:parquet 1165072797 / 2623398592 / -55.6% 🟢 1554263589 / 3063726038 / -49.3% 🟢 0.75 / 0.86 / -12.5%
fineweb_q02/datafusion:parquet 1238241556 / 2405296232 / -48.5% 🟢 1518542099 / 2427508775 / -37.4% 🟢 0.82 / 0.99 / -17.7%
fineweb_q03/datafusion:parquet 1149577500 / 2170907264 / -47.0% 🟢 1342036674 / 3083565030 / -56.5% 🟢 0.86 / 0.70 / +21.7%
fineweb_q04/datafusion:parquet 1502463450 / 1457746482 / +3.1% 1309096005 / 2328037341 / -43.8% 🟢 1.15 / 0.63 / +83.3%
fineweb_q05/datafusion:parquet 1565355274 / 1399082232 / +11.9% 1521093308 / 1141126778 / +33.3% 🔴 1.03 / 1.23 / -16.1%
fineweb_q06/datafusion:parquet 1630506328 / 1454197488 / +12.1% 1342461459 / 971839805 / +38.1% 🔴 1.21 / 1.50 / -18.8%
fineweb_q07/datafusion:parquet 932731475 / 1438777350 / -35.2% 🟢 1650750840 / 1257592777 / +31.3% 🔴 0.57 / 1.14 / -50.6%
fineweb_q08/datafusion:parquet 1081250668 / 1124693890 / -3.9% 1071645974 / 1729336555 / -38.0% 🟢 1.01 / 0.65 / +55.1%
duckdb / vortex-file-compressed / ns (0.859x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 63812200 / 67868649 / -6.0% 73745472 / 69530800 / +6.1% 0.87 / 0.98 / -11.4%
fineweb_q01/duckdb:vortex-file-compressed 437302354 / 630799404 / -30.7% 🟢 683745939 / 577967885 / +18.3% 0.64 / 1.09 / -41.4%
fineweb_q02/duckdb:vortex-file-compressed 844405642 / 1063908956 / -20.6% 758654188 / 1127798111 / -32.7% 🟢 1.11 / 0.94 / +18.0%
fineweb_q03/duckdb:vortex-file-compressed 1056771220 / 1008143688 / +4.8% 1458232522 / 1380416154 / +5.6% 0.72 / 0.73 / -0.8%
fineweb_q04/duckdb:vortex-file-compressed 1021132300 / 972953840 / +5.0% 1002295373 / 1070150796 / -6.3% 1.02 / 0.91 / +12.1%
fineweb_q05/duckdb:vortex-file-compressed 895470200 / 1092541976 / -18.0% 973009191 / 1156464508 / -15.9% 0.92 / 0.94 / -2.6%
fineweb_q06/duckdb:vortex-file-compressed 1215339726 / 1289941818 / -5.8% 1247829117 / 1342185560 / -7.0% 0.97 / 0.96 / +1.3%
fineweb_q07/duckdb:vortex-file-compressed 1043222747 / 1158692802 / -10.0% 1100918437 / 1530841108 / -28.1% 0.95 / 0.76 / +25.2%
fineweb_q08/duckdb:vortex-file-compressed 394393720 / 613830060 / -35.7% 🟢 467954285 / 633515801 / -26.1% 0.84 / 0.97 / -13.0%
duckdb / vortex-compact / ns (0.912x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 62361300 / 72863538 / -14.4% 92050694 / 57529374 / +60.0% 🔴 0.68 / 1.27 / -46.5%
fineweb_q01/duckdb:vortex-compact 405428422 / 512840262 / -20.9% 577618776 / 900136923 / -35.8% 🟢 0.70 / 0.57 / +23.2%
fineweb_q02/duckdb:vortex-compact 584331728 / 683228132 / -14.5% 596017460 / 837302504 / -28.8% 0.98 / 0.82 / +20.1%
fineweb_q03/duckdb:vortex-compact 1209380102 / 1189000686 / +1.7% 1369908217 / 1335305751 / +2.6% 0.88 / 0.89 / -0.9%
fineweb_q04/duckdb:vortex-compact 1066060632 / 1117868158 / -4.6% 1090207676 / 1112024391 / -2.0% 0.98 / 1.01 / -2.7%
fineweb_q05/duckdb:vortex-compact 1017747152 / 1012769804 / +0.5% 1114623363 / 1087399177 / +2.5% 0.91 / 0.93 / -2.0%
fineweb_q06/duckdb:vortex-compact 1413140968 / 1230414175 / +14.9% 1410030239 / 1220136395 / +15.6% 1.00 / 1.01 / -0.6%
fineweb_q07/duckdb:vortex-compact 1019332387 / 1022450110 / -0.3% 1059240774 / 1067938893 / -0.8% 0.96 / 0.96 / +0.5%
fineweb_q08/duckdb:vortex-compact 375749318 / 553303810 / -32.1% 🟢 485965348 / 591874719 / -17.9% 0.77 / 0.93 / -17.3%
duckdb / parquet / ns (0.730x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 516900590 / 704729912 / -26.7% 641597379 / 745098036 / -13.9% 0.81 / 0.95 / -14.8%
fineweb_q01/duckdb:parquet 638646498 / 793998823 / -19.6% 593801792 / 854399788 / -30.5% 🟢 1.08 / 0.93 / +15.7%
fineweb_q02/duckdb:parquet 720655640 / 990933780 / -27.3% 640841759 / 819419079 / -21.8% 1.12 / 1.21 / -7.0%
fineweb_q03/duckdb:parquet 1807368178 / 3075846570 / -41.2% 🟢 3148173425 / 2216772417 / +42.0% 🔴 0.57 / 1.39 / -58.6%
fineweb_q04/duckdb:parquet 1051108656 / 1145937154 / -8.3% 987746698 / 1185082685 / -16.7% 1.06 / 0.97 / +10.0%
fineweb_q05/duckdb:parquet 999015159 / 1251627930 / -20.2% 979089757 / 1446438228 / -32.3% 🟢 1.02 / 0.87 / +17.9%
fineweb_q06/duckdb:parquet 2091656518 / 2873302577 / -27.2% 1924227831 / 2915595997 / -34.0% 🟢 1.09 / 0.99 / +10.3%
fineweb_q07/duckdb:parquet 1446537563 / 2398972708 / -39.7% 🟢 1223526295 / 2471353195 / -50.5% 🟢 1.18 / 0.97 / +21.8%
fineweb_q08/duckdb:parquet 629961823 / 869485442 / -27.5% 577614818 / 789944447 / -26.9% 1.09 / 1.10 / -0.9%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.8%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.013x ➖ · cold 1.000x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52577905 / 51727866 / +1.6% 72852230 / 70986485 / +2.6% 0.72 / 0.73 / -1.0%
appian_q02/datafusion:vortex-compact 233117246 / 236990716 / -1.6% 267026735 / 265991237 / +0.4% 0.87 / 0.89 / -2.0%
appian_q03/datafusion:vortex-compact 146413692 / 149204208 / -1.9% 183310106 / 188022391 / -2.5% 0.80 / 0.79 / +0.7%
appian_q04/datafusion:vortex-compact 9861545925 / 9880213610 / -0.2% 9849832265 / 9829525121 / +0.2% 1.00 / 1.01 / -0.4%
appian_q05/datafusion:vortex-compact 136192425 / 136901425 / -0.5% 161412735 / 163799100 / -1.5% 0.84 / 0.84 / +1.0%
appian_q06/datafusion:vortex-compact 142115762 / 143413462 / -0.9% 161643129 / 161089664 / +0.3% 0.88 / 0.89 / -1.2%
appian_q07/datafusion:vortex-compact 164044269 / 165464331 / -0.9% 192645301 / 194860475 / -1.1% 0.85 / 0.85 / +0.3%
appian_q08/datafusion:vortex-compact 567661705 / 543577837 / +4.4% 580342774 / 595005787 / -2.5% 0.98 / 0.91 / +7.1%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 73855854 / 73134745 / +1.0% 93248559 / 93174916 / +0.1% 0.79 / 0.78 / +0.9%
appian_q02/datafusion:parquet 304865330 / 302134702 / +0.9% 335353556 / 337644613 / -0.7% 0.91 / 0.89 / +1.6%
appian_q03/datafusion:parquet 190317808 / 188907499 / +0.7% 232526010 / 230927586 / +0.7% 0.82 / 0.82 / +0.1%
appian_q04/datafusion:parquet 9910116938 / 9907750458 / +0.0% 9885561962 / 9819126324 / +0.7% 1.00 / 1.01 / -0.6%
appian_q05/datafusion:parquet 198758447 / 197545848 / +0.6% 223505991 / 222396546 / +0.5% 0.89 / 0.89 / +0.1%
appian_q06/datafusion:parquet 170355057 / 170287476 / +0.0% 191265175 / 197519426 / -3.2% 0.89 / 0.86 / +3.3%
appian_q07/datafusion:parquet 210806099 / 209690488 / +0.5% 242273612 / 249242450 / -2.8% 0.87 / 0.84 / +3.4%
appian_q08/datafusion:parquet 658155386 / 668736073 / -1.6% 688213111 / 689642953 / -0.2% 0.96 / 0.97 / -1.4%
duckdb / vortex-compact / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91293043 / 90937239 / +0.4% 106387659 / 103398654 / +2.9% 0.86 / 0.88 / -2.4%
appian_q02/duckdb:vortex-compact 212345700 / 212361390 / -0.0% 226517762 / 228128203 / -0.7% 0.94 / 0.93 / +0.7%
appian_q03/duckdb:vortex-compact 122523707 / 121303851 / +1.0% 134551944 / 139150371 / -3.3% 0.91 / 0.87 / +4.5%
appian_q04/duckdb:vortex-compact 571486858 / 563285251 / +1.5% 617450609 / 595520235 / +3.7% 0.93 / 0.95 / -2.1%
appian_q05/duckdb:vortex-compact 132690520 / 127865073 / +3.8% 148181243 / 149484866 / -0.9% 0.90 / 0.86 / +4.7%
appian_q06/duckdb:vortex-compact 402156200 / 405864680 / -0.9% 413150063 / 395115322 / +4.6% 0.97 / 1.03 / -5.2%
appian_q07/duckdb:vortex-compact 136602455 / 135779939 / +0.6% 152970897 / 161334860 / -5.2% 0.89 / 0.84 / +6.1%
appian_q08/duckdb:vortex-compact 430414755 / 422495996 / +1.9% 473723730 / 475995563 / -0.5% 0.91 / 0.89 / +2.4%
duckdb / parquet / ns (1.023x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 98403744 / 99511483 / -1.1% 112081018 / 111854668 / +0.2% 0.88 / 0.89 / -1.3%
appian_q02/duckdb:parquet 197209474 / 198017774 / -0.4% 197268778 / 196022306 / +0.6% 1.00 / 1.01 / -1.0%
appian_q03/duckdb:parquet 124020478 / 124150550 / -0.1% 134765537 / 136493822 / -1.3% 0.92 / 0.91 / +1.2%
appian_q04/duckdb:parquet 470075557 / 434063866 / +8.3% 442673467 / 469650350 / -5.7% 1.06 / 0.92 / +14.9%
appian_q05/duckdb:parquet 143292691 / 142192091 / +0.8% 161021403 / 167412675 / -3.8% 0.89 / 0.85 / +4.8%
appian_q06/duckdb:parquet 261940341 / 236007548 / +11.0% 🔴 273905527 / 258794240 / +5.8% 0.96 / 0.91 / +4.9%
appian_q07/duckdb:parquet 152947747 / 154009908 / -0.7% 171085740 / 166463295 / +2.8% 0.89 / 0.93 / -3.4%
appian_q08/duckdb:parquet 382100596 / 376056867 / +1.6% 387219174 / 359307719 / +7.8% 0.99 / 1.05 / -5.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1240358 / 1249580 / -0.7% 20416822 / 20036317 / +1.9% 0.06 / 0.06 / -2.6%
clickbench_q01/datafusion:vortex-file-compressed 5783830 / 5889498 / -1.8% 34266386 / 33868384 / +1.2% 0.17 / 0.17 / -2.9%
clickbench_q02/datafusion:vortex-file-compressed 10182535 / 10792590 / -5.7% 40979000 / 34005596 / +20.5% 🔴 0.25 / 0.32 / -21.7%
clickbench_q03/datafusion:vortex-file-compressed 11410408 / 11899434 / -4.1% 51877919 / 51864303 / +0.0% 0.22 / 0.23 / -4.1%
clickbench_q04/datafusion:vortex-file-compressed 57177532 / 55872838 / +2.3% 89718796 / 91651986 / -2.1% 0.64 / 0.61 / +4.5%
clickbench_q05/datafusion:vortex-file-compressed 72964529 / 76330074 / -4.4% 117800578 / 118255219 / -0.4% 0.62 / 0.65 / -4.0%
clickbench_q06/datafusion:vortex-file-compressed 1264631 / 1274556 / -0.8% 19814956 / 19519982 / +1.5% 0.06 / 0.07 / -2.3%
clickbench_q07/datafusion:vortex-file-compressed 9959361 / 9685148 / +2.8% 34867645 / 32923404 / +5.9% 0.29 / 0.29 / -2.9%
clickbench_q08/datafusion:vortex-file-compressed 77464156 / 76258483 / +1.6% 113623931 / 116691785 / -2.6% 0.68 / 0.65 / +4.3%
clickbench_q09/datafusion:vortex-file-compressed 174639688 / 169945406 / +2.8% 205641705 / 209910806 / -2.0% 0.85 / 0.81 / +4.9%
clickbench_q10/datafusion:vortex-file-compressed 24208578 / 22850638 / +5.9% 66979520 / 65197246 / +2.7% 0.36 / 0.35 / +3.1%
clickbench_q11/datafusion:vortex-file-compressed 26516486 / 26139548 / +1.4% 67360624 / 67742676 / -0.6% 0.39 / 0.39 / +2.0%
clickbench_q12/datafusion:vortex-file-compressed 71766950 / 73291654 / -2.1% 111005720 / 115952583 / -4.3% 0.65 / 0.63 / +2.3%
clickbench_q13/datafusion:vortex-file-compressed 117125318 / 122170292 / -4.1% 180031696 / 177248102 / +1.6% 0.65 / 0.69 / -5.6%
clickbench_q14/datafusion:vortex-file-compressed 75900435 / 73952986 / +2.6% 116759260 / 122363714 / -4.6% 0.65 / 0.60 / +7.6%
clickbench_q15/datafusion:vortex-file-compressed 60121373 / 61775468 / -2.7% 96821944 / 97176843 / -0.4% 0.62 / 0.64 / -2.3%
clickbench_q16/datafusion:vortex-file-compressed 148238053 / 150741948 / -1.7% 206477330 / 203003680 / +1.7% 0.72 / 0.74 / -3.3%
clickbench_q17/datafusion:vortex-file-compressed 147872486 / 149997310 / -1.4% 207081153 / 217142100 / -4.6% 0.71 / 0.69 / +3.4%
clickbench_q18/datafusion:vortex-file-compressed 294758242 / 297505684 / -0.9% 367087397 / 393123729 / -6.6% 0.80 / 0.76 / +6.1%
clickbench_q19/datafusion:vortex-file-compressed 7993292 / 7630376 / +4.8% 46555774 / 46098523 / +1.0% 0.17 / 0.17 / +3.7%
clickbench_q20/datafusion:vortex-file-compressed 63396650 / 62792220 / +1.0% 232412870 / 229621871 / +1.2% 0.27 / 0.27 / -0.2%
clickbench_q21/datafusion:vortex-file-compressed 89526438 / 89281480 / +0.3% 270279046 / 266807706 / +1.3% 0.33 / 0.33 / -1.0%
clickbench_q22/datafusion:vortex-file-compressed 103710448 / 104378916 / -0.6% 348193467 / 342697313 / +1.6% 0.30 / 0.30 / -2.2%
clickbench_q23/datafusion:vortex-file-compressed 203260084 / 202535990 / +0.4% 502210999 / 521563870 / -3.7% 0.40 / 0.39 / +4.2%
clickbench_q24/datafusion:vortex-file-compressed 16186426 / 16075032 / +0.7% 62259163 / 61683665 / +0.9% 0.26 / 0.26 / -0.2%
clickbench_q25/datafusion:vortex-file-compressed 18005272 / 18410250 / -2.2% 58686161 / 55569176 / +5.6% 0.31 / 0.33 / -7.4%
clickbench_q26/datafusion:vortex-file-compressed 15526077 / 16546016 / -6.2% 63669157 / 62809405 / +1.4% 0.24 / 0.26 / -7.4%
clickbench_q27/datafusion:vortex-file-compressed 98152974 / 98459634 / -0.3% 242929172 / 243589675 / -0.3% 0.40 / 0.40 / -0.0%
clickbench_q28/datafusion:vortex-file-compressed 577425619 / 571915230 / +1.0% 613468947 / 613801553 / -0.1% 0.94 / 0.93 / +1.0%
clickbench_q29/datafusion:vortex-file-compressed 23043296 / 23156228 / -0.5% 53447407 / 49557492 / +7.8% 0.43 / 0.47 / -7.7%
clickbench_q30/datafusion:vortex-file-compressed 59319511 / 60327033 / -1.7% 104131609 / 104053729 / +0.1% 0.57 / 0.58 / -1.7%
clickbench_q31/datafusion:vortex-file-compressed 72319728 / 69965874 / +3.4% 150022594 / 150258051 / -0.2% 0.48 / 0.47 / +3.5%
clickbench_q32/datafusion:vortex-file-compressed 299613772 / 304941036 / -1.7% 380324172 / 386665929 / -1.6% 0.79 / 0.79 / -0.1%
clickbench_q33/datafusion:vortex-file-compressed 326262584 / 334969755 / -2.6% 434527490 / 429622840 / +1.1% 0.75 / 0.78 / -3.7%
clickbench_q34/datafusion:vortex-file-compressed 334789304 / 330222658 / +1.4% 442105274 / 428948607 / +3.1% 0.76 / 0.77 / -1.6%
clickbench_q35/datafusion:vortex-file-compressed 55995574 / 56008884 / -0.0% 84621703 / 89778162 / -5.7% 0.66 / 0.62 / +6.1%
clickbench_q36/datafusion:vortex-file-compressed 37219002 / 37709698 / -1.3% 65131459 / 63783498 / +2.1% 0.57 / 0.59 / -3.3%
clickbench_q37/datafusion:vortex-file-compressed 21605962 / 21974754 / -1.7% 46322259 / 46697871 / -0.8% 0.47 / 0.47 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed 11743497 / 11853115 / -0.9% 37259656 / 37441569 / -0.5% 0.32 / 0.32 / -0.4%
clickbench_q39/datafusion:vortex-file-compressed 77968762 / 77558183 / +0.5% 108135157 / 108847364 / -0.7% 0.72 / 0.71 / +1.2%
clickbench_q40/datafusion:vortex-file-compressed 11234232 / 11152808 / +0.7% 35097777 / 35492182 / -1.1% 0.32 / 0.31 / +1.9%
clickbench_q41/datafusion:vortex-file-compressed 10835074 / 10718374 / +1.1% 34608722 / 35122743 / -1.5% 0.31 / 0.31 / +2.6%
clickbench_q42/datafusion:vortex-file-compressed 10994302 / 11134559 / -1.3% 34628462 / 34638661 / -0.0% 0.32 / 0.32 / -1.2%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1220954 / 1232110 / -0.9% 19350844 / 18769268 / +3.1% 0.06 / 0.07 / -3.9%
clickbench_q01/datafusion:vortex-compact 7415636 / 7087571 / +4.6% 29802963 / 32097023 / -7.1% 0.25 / 0.22 / +12.7%
clickbench_q02/datafusion:vortex-compact 19330828 / 20126522 / -4.0% 41762161 / 42084250 / -0.8% 0.46 / 0.48 / -3.2%
clickbench_q03/datafusion:vortex-compact 14303057 / 13811178 / +3.6% 39300077 / 37628046 / +4.4% 0.36 / 0.37 / -0.8%
clickbench_q04/datafusion:vortex-compact 58444818 / 58247847 / +0.3% 88598656 / 86841052 / +2.0% 0.66 / 0.67 / -1.7%
clickbench_q05/datafusion:vortex-compact 83769445 / 83727388 / +0.1% 125282627 / 123508722 / +1.4% 0.67 / 0.68 / -1.4%
clickbench_q06/datafusion:vortex-compact 1256608 / 1244617 / +1.0% 19509546 / 19131773 / +2.0% 0.06 / 0.07 / -1.0%
clickbench_q07/datafusion:vortex-compact 12322650 / 11900135 / +3.6% 36287973 / 34047604 / +6.6% 0.34 / 0.35 / -2.8%
clickbench_q08/datafusion:vortex-compact 85067720 / 84628232 / +0.5% 117495386 / 121835744 / -3.6% 0.72 / 0.69 / +4.2%
clickbench_q09/datafusion:vortex-compact 185946208 / 190197788 / -2.2% 222614759 / 209176133 / +6.4% 0.84 / 0.91 / -8.1%
clickbench_q10/datafusion:vortex-compact 43198696 / 42915499 / +0.7% 70798743 / 70624381 / +0.2% 0.61 / 0.61 / +0.4%
clickbench_q11/datafusion:vortex-compact 55401488 / 55218550 / +0.3% 83515632 / 79325106 / +5.3% 0.66 / 0.70 / -4.7%
clickbench_q12/datafusion:vortex-compact 85417280 / 85601866 / -0.2% 128940775 / 128625931 / +0.2% 0.66 / 0.67 / -0.5%
clickbench_q13/datafusion:vortex-compact 136382802 / 133909640 / +1.8% 178721616 / 185315891 / -3.6% 0.76 / 0.72 / +5.6%
clickbench_q14/datafusion:vortex-compact 91681492 / 92338117 / -0.7% 125283147 / 126548538 / -1.0% 0.73 / 0.73 / +0.3%
clickbench_q15/datafusion:vortex-compact 64226520 / 62771078 / +2.3% 92165700 / 96450516 / -4.4% 0.70 / 0.65 / +7.1%
clickbench_q16/datafusion:vortex-compact 163193385 / 165247806 / -1.2% 212697967 / 215536087 / -1.3% 0.77 / 0.77 / +0.1%
clickbench_q17/datafusion:vortex-compact 165381960 / 169969575 / -2.7% 215303654 / 220358237 / -2.3% 0.77 / 0.77 / -0.4%
clickbench_q18/datafusion:vortex-compact 303020482 / 303626766 / -0.2% 366444551 / 388357381 / -5.6% 0.83 / 0.78 / +5.8%
clickbench_q19/datafusion:vortex-compact 10117308 / 10716654 / -5.6% 39059550 / 38051565 / +2.6% 0.26 / 0.28 / -8.0%
clickbench_q20/datafusion:vortex-compact 71289916 / 71302170 / -0.0% 188888735 / 187134027 / +0.9% 0.38 / 0.38 / -0.9%
clickbench_q21/datafusion:vortex-compact 115848866 / 117156266 / -1.1% 228952623 / 224652633 / +1.9% 0.51 / 0.52 / -3.0%
clickbench_q22/datafusion:vortex-compact 183622932 / 183852206 / -0.1% 272761556 / 268055568 / +1.8% 0.67 / 0.69 / -1.8%
clickbench_q23/datafusion:vortex-compact 520968550 / 540009438 / -3.5% 637690595 / 642607046 / -0.8% 0.82 / 0.84 / -2.8%
clickbench_q24/datafusion:vortex-compact 28338457 / 28057257 / +1.0% 59738047 / 56175289 / +6.3% 0.47 / 0.50 / -5.0%
clickbench_q25/datafusion:vortex-compact 35416590 / 36057444 / -1.8% 66682149 / 63615959 / +4.8% 0.53 / 0.57 / -6.3%
clickbench_q26/datafusion:vortex-compact 28624488 / 28365823 / +0.9% 58131347 / 61342821 / -5.2% 0.49 / 0.46 / +6.5%
clickbench_q27/datafusion:vortex-compact 102460234 / 104946672 / -2.4% 210880557 / 208976221 / +0.9% 0.49 / 0.50 / -3.3%
clickbench_q28/datafusion:vortex-compact 588117764 / 581078008 / +1.2% 613346424 / 619838114 / -1.0% 0.96 / 0.94 / +2.3%
clickbench_q29/datafusion:vortex-compact 30764388 / 31526811 / -2.4% 54438296 / 54013106 / +0.8% 0.57 / 0.58 / -3.2%
clickbench_q30/datafusion:vortex-compact 92601072 / 92057988 / +0.6% 135912702 / 123057397 / +10.4% 🔴 0.68 / 0.75 / -8.9%
clickbench_q31/datafusion:vortex-compact 101510080 / 100412848 / +1.1% 148577480 / 149732962 / -0.8% 0.68 / 0.67 / +1.9%
clickbench_q32/datafusion:vortex-compact 298180690 / 305045644 / -2.3% 378753597 / 375686315 / +0.8% 0.79 / 0.81 / -3.0%
clickbench_q33/datafusion:vortex-compact 337910558 / 344255844 / -1.8% 415777677 / 421969975 / -1.5% 0.81 / 0.82 / -0.4%
clickbench_q34/datafusion:vortex-compact 344347854 / 336681576 / +2.3% 417376693 / 414840605 / +0.6% 0.83 / 0.81 / +1.7%
clickbench_q35/datafusion:vortex-compact 63052366 / 62641234 / +0.7% 89651630 / 93119592 / -3.7% 0.70 / 0.67 / +4.5%
clickbench_q36/datafusion:vortex-compact 38221573 / 38335112 / -0.3% 65286064 / 65690832 / -0.6% 0.59 / 0.58 / +0.3%
clickbench_q37/datafusion:vortex-compact 22317760 / 22754389 / -1.9% 46406617 / 47032969 / -1.3% 0.48 / 0.48 / -0.6%
clickbench_q38/datafusion:vortex-compact 13312149 / 12365676 / +7.7% 38370145 / 38030636 / +0.9% 0.35 / 0.33 / +6.7%
clickbench_q39/datafusion:vortex-compact 78523078 / 79395584 / -1.1% 109243979 / 108937619 / +0.3% 0.72 / 0.73 / -1.4%
clickbench_q40/datafusion:vortex-compact 12907049 / 12103972 / +6.6% 34710213 / 35474889 / -2.2% 0.37 / 0.34 / +9.0%
clickbench_q41/datafusion:vortex-compact 13100345 / 12954328 / +1.1% 36824527 / 36367673 / +1.3% 0.36 / 0.36 / -0.1%
clickbench_q42/datafusion:vortex-compact 11287576 / 11406804 / -1.0% 34404361 / 33830917 / +1.7% 0.33 / 0.34 / -2.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1262818 / 1289588 / -2.1% 49699583 / 48909109 / +1.6% 0.03 / 0.03 / -3.6%
clickbench_q01/datafusion:parquet 16081844 / 16480226 / -2.4% 75431179 / 72809448 / +3.6% 0.21 / 0.23 / -5.8%
clickbench_q02/datafusion:parquet 19115450 / 18953249 / +0.9% 82416055 / 82341328 / +0.1% 0.23 / 0.23 / +0.8%
clickbench_q03/datafusion:parquet 17666656 / 17081338 / +3.4% 80975437 / 79007107 / +2.5% 0.22 / 0.22 / +0.9%
clickbench_q04/datafusion:parquet 62370507 / 63406664 / -1.6% 126155595 / 127269961 / -0.9% 0.49 / 0.50 / -0.8%
clickbench_q05/datafusion:parquet 89473128 / 89177864 / +0.3% 160411631 / 156743761 / +2.3% 0.56 / 0.57 / -2.0%
clickbench_q06/datafusion:parquet 1258448 / 1280207 / -1.7% 50037458 / 47903684 / +4.5% 0.03 / 0.03 / -5.9%
clickbench_q07/datafusion:parquet 17025870 / 16805517 / +1.3% 69291827 / 67859795 / +2.1% 0.25 / 0.25 / -0.8%
clickbench_q08/datafusion:parquet 85388976 / 84508339 / +1.0% 167868576 / 158307064 / +6.0% 0.51 / 0.53 / -4.7%
clickbench_q09/datafusion:parquet 196017124 / 192189802 / +2.0% 278737714 / 261735014 / +6.5% 0.70 / 0.73 / -4.2%
clickbench_q10/datafusion:parquet 36157888 / 36675928 / -1.4% 102841889 / 102332039 / +0.5% 0.35 / 0.36 / -1.9%
clickbench_q11/datafusion:parquet 43611576 / 42487289 / +2.6% 112089689 / 108315428 / +3.5% 0.39 / 0.39 / -0.8%
clickbench_q12/datafusion:parquet 96953356 / 95683156 / +1.3% 164869034 / 159252315 / +3.5% 0.59 / 0.60 / -2.1%
clickbench_q13/datafusion:parquet 146804632 / 148311256 / -1.0% 230703008 / 228887541 / +0.8% 0.64 / 0.65 / -1.8%
clickbench_q14/datafusion:parquet 102865286 / 102133570 / +0.7% 177522787 / 169921607 / +4.5% 0.58 / 0.60 / -3.6%
clickbench_q15/datafusion:parquet 70185516 / 72446806 / -3.1% 134533580 / 133840396 / +0.5% 0.52 / 0.54 / -3.6%
clickbench_q16/datafusion:parquet 156653758 / 156512776 / +0.1% 233125255 / 233963480 / -0.4% 0.67 / 0.67 / +0.4%
clickbench_q17/datafusion:parquet 155675149 / 156044409 / -0.2% 240143156 / 237955941 / +0.9% 0.65 / 0.66 / -1.1%
clickbench_q18/datafusion:parquet 320082664 / 313456361 / +2.1% 423554901 / 423201184 / +0.1% 0.76 / 0.74 / +2.0%
clickbench_q19/datafusion:parquet 18498757 / 18549596 / -0.3% 73287555 / 76046995 / -3.6% 0.25 / 0.24 / +3.5%
clickbench_q20/datafusion:parquet 178009818 / 178949371 / -0.5% 276926957 / 275901456 / +0.4% 0.64 / 0.65 / -0.9%
clickbench_q21/datafusion:parquet 174893410 / 173759716 / +0.7% 290913098 / 289926976 / +0.3% 0.60 / 0.60 / +0.3%
clickbench_q22/datafusion:parquet 261110200 / 264572822 / -1.3% 413929691 / 414538974 / -0.1% 0.63 / 0.64 / -1.2%
clickbench_q23/datafusion:parquet 1144405700 / 1125978872 / +1.6% 1230742164 / 1242186213 / -0.9% 0.93 / 0.91 / +2.6%
clickbench_q24/datafusion:parquet 29650625 / 29815080 / -0.6% 87474390 / 87486024 / -0.0% 0.34 / 0.34 / -0.5%
clickbench_q25/datafusion:parquet 37407612 / 37740208 / -0.9% 99978645 / 99133622 / +0.9% 0.37 / 0.38 / -1.7%
clickbench_q26/datafusion:parquet 30985430 / 30710062 / +0.9% 87627077 / 87500183 / +0.1% 0.35 / 0.35 / +0.8%
clickbench_q27/datafusion:parquet 193871732 / 195700772 / -0.9% 284455353 / 281351880 / +1.1% 0.68 / 0.70 / -2.0%
clickbench_q28/datafusion:parquet 624655658 / 625302290 / -0.1% 700749185 / 704503847 / -0.5% 0.89 / 0.89 / +0.4%
clickbench_q29/datafusion:parquet 29022786 / 29525132 / -1.7% 90684031 / 91275708 / -0.6% 0.32 / 0.32 / -1.1%
clickbench_q30/datafusion:parquet 91661094 / 91432473 / +0.3% 167204297 / 168689232 / -0.9% 0.55 / 0.54 / +1.1%
clickbench_q31/datafusion:parquet 103373554 / 103310595 / +0.1% 195420548 / 189175320 / +3.3% 0.53 / 0.55 / -3.1%
clickbench_q32/datafusion:parquet 329981251 / 323794608 / +1.9% 424198564 / 429977294 / -1.3% 0.78 / 0.75 / +3.3%
clickbench_q33/datafusion:parquet 383637914 / 386085860 / -0.6% 476414772 / 478861324 / -0.5% 0.81 / 0.81 / -0.1%
clickbench_q34/datafusion:parquet 384567133 / 383258482 / +0.3% 475107015 / 476708755 / -0.3% 0.81 / 0.80 / +0.7%
clickbench_q35/datafusion:parquet 64901756 / 63809140 / +1.7% 125067471 / 123250885 / +1.5% 0.52 / 0.52 / +0.2%
clickbench_q36/datafusion:parquet 73518942 / 73386966 / +0.2% 135060914 / 134690546 / +0.3% 0.54 / 0.54 / -0.1%
clickbench_q37/datafusion:parquet 35633926 / 35526824 / +0.3% 91847710 / 91068855 / +0.9% 0.39 / 0.39 / -0.5%
clickbench_q38/datafusion:parquet 47519013 / 47711766 / -0.4% 106503305 / 106002081 / +0.5% 0.45 / 0.45 / -0.9%
clickbench_q39/datafusion:parquet 143478670 / 143717356 / -0.2% 207321789 / 206715653 / +0.3% 0.69 / 0.70 / -0.5%
clickbench_q40/datafusion:parquet 20100786 / 20165370 / -0.3% 77911205 / 77111850 / +1.0% 0.26 / 0.26 / -1.3%
clickbench_q41/datafusion:parquet 19016762 / 18843507 / +0.9% 76738911 / 76557672 / +0.2% 0.25 / 0.25 / +0.7%
clickbench_q42/datafusion:parquet 19306990 / 19396166 / -0.5% 75266488 / 75264354 / +0.0% 0.26 / 0.26 / -0.5%
duckdb / vortex-file-compressed / ns (0.977x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1692608 / 1836864 / -7.9% 26225059 / 27061740 / -3.1% 0.06 / 0.07 / -4.9%
clickbench_q01/duckdb:vortex-file-compressed 12591209 / 12071954 / +4.3% 29534797 / 28414956 / +3.9% 0.43 / 0.42 / +0.3%
clickbench_q02/duckdb:vortex-file-compressed 12948728 / 13040298 / -0.7% 35279333 / 36446621 / -3.2% 0.37 / 0.36 / +2.6%
clickbench_q03/duckdb:vortex-file-compressed 17362109 / 17425599 / -0.4% 43942856 / 50000373 / -12.1% 🟢 0.40 / 0.35 / +13.4%
clickbench_q04/duckdb:vortex-file-compressed 71765754 / 72138494 / -0.5% 104827711 / 100460614 / +4.3% 0.68 / 0.72 / -4.7%
clickbench_q05/duckdb:vortex-file-compressed 66499518 / 68567545 / -3.0% 90587505 / 93002522 / -2.6% 0.73 / 0.74 / -0.4%
clickbench_q06/duckdb:vortex-file-compressed 2036926 / 2114441 / -3.7% 30008126 / 30382868 / -1.2% 0.07 / 0.07 / -2.5%
clickbench_q07/duckdb:vortex-file-compressed 15016934 / 17013892 / -11.7% 🟢 34369721 / 33303470 / +3.2% 0.44 / 0.51 / -14.5%
clickbench_q08/duckdb:vortex-file-compressed 84380779 / 82167791 / +2.7% 122053115 / 121392677 / +0.5% 0.69 / 0.68 / +2.1%
clickbench_q09/duckdb:vortex-file-compressed 106485234 / 106477976 / +0.0% 143454309 / 145421146 / -1.4% 0.74 / 0.73 / +1.4%
clickbench_q10/duckdb:vortex-file-compressed 33341295 / 33713214 / -1.1% 66475064 / 66352305 / +0.2% 0.50 / 0.51 / -1.3%
clickbench_q11/duckdb:vortex-file-compressed 35521965 / 35614890 / -0.3% 69645784 / 71419617 / -2.5% 0.51 / 0.50 / +2.3%
clickbench_q12/duckdb:vortex-file-compressed 73997724 / 74946157 / -1.3% 102267482 / 102766894 / -0.5% 0.72 / 0.73 / -0.8%
clickbench_q13/duckdb:vortex-file-compressed 134341688 / 146867472 / -8.5% 178380540 / 175183581 / +1.8% 0.75 / 0.84 / -10.2%
clickbench_q14/duckdb:vortex-file-compressed 77238618 / 81303078 / -5.0% 106289627 / 113025505 / -6.0% 0.73 / 0.72 / +1.0%
clickbench_q15/duckdb:vortex-file-compressed 91602512 / 93272616 / -1.8% 129236265 / 127472964 / +1.4% 0.71 / 0.73 / -3.1%
clickbench_q16/duckdb:vortex-file-compressed 160409971 / 162803808 / -1.5% 210776373 / 211855227 / -0.5% 0.76 / 0.77 / -1.0%
clickbench_q17/duckdb:vortex-file-compressed 166113577 / 162443481 / +2.3% 206886626 / 212582524 / -2.7% 0.80 / 0.76 / +5.1%
clickbench_q18/duckdb:vortex-file-compressed 318773290 / 317752902 / +0.3% 413144843 / 385964711 / +7.0% 0.77 / 0.82 / -6.3%
clickbench_q19/duckdb:vortex-file-compressed 17307562 / 18597064 / -6.9% 40937432 / 40913577 / +0.1% 0.42 / 0.45 / -7.0%
clickbench_q20/duckdb:vortex-file-compressed 108818951 / 109376061 / -0.5% 186371624 / 187233839 / -0.5% 0.58 / 0.58 / -0.0%
clickbench_q21/duckdb:vortex-file-compressed 159528131 / 154609275 / +3.2% 287186589 / 283304761 / +1.4% 0.56 / 0.55 / +1.8%
clickbench_q22/duckdb:vortex-file-compressed 237926618 / 241226646 / -1.4% 421580786 / 430742913 / -2.1% 0.56 / 0.56 / +0.8%
clickbench_q23/duckdb:vortex-file-compressed 57618471 / 65858724 / -12.5% 🟢 106038112 / 102277418 / +3.7% 0.54 / 0.64 / -15.6%
clickbench_q24/duckdb:vortex-file-compressed 25587806 / 24116778 / +6.1% 44797547 / 48881585 / -8.4% 0.57 / 0.49 / +15.8%
clickbench_q25/duckdb:vortex-file-compressed 32484120 / 31976459 / +1.6% 54421449 / 56846606 / -4.3% 0.60 / 0.56 / +6.1%
clickbench_q26/duckdb:vortex-file-compressed 20706504 / 20691604 / +0.1% 35010769 / 37080016 / -5.6% 0.59 / 0.56 / +6.0%
clickbench_q27/duckdb:vortex-file-compressed 135544462 / 135906534 / -0.3% 239919271 / 234448761 / +2.3% 0.56 / 0.58 / -2.5%
clickbench_q28/duckdb:vortex-file-compressed 597254580 / 727988280 / -18.0% 🟢 669710653 / 678852822 / -1.3% 0.89 / 1.07 / -16.8%
clickbench_q29/duckdb:vortex-file-compressed 17116770 / 18962210 / -9.7% 36209301 / 39356650 / -8.0% 0.47 / 0.48 / -1.9%
clickbench_q30/duckdb:vortex-file-compressed 65137258 / 67898211 / -4.1% 107837131 / 107404024 / +0.4% 0.60 / 0.63 / -4.5%
clickbench_q31/duckdb:vortex-file-compressed 124506758 / 126295404 / -1.4% 197350517 / 175615261 / +12.4% 🔴 0.63 / 0.72 / -12.3%
clickbench_q32/duckdb:vortex-file-compressed 449614256 / 464470786 / -3.2% 496718848 / 503705764 / -1.4% 0.91 / 0.92 / -1.8%
clickbench_q33/duckdb:vortex-file-compressed 390612552 / 404230217 / -3.4% 495088139 / 492885821 / +0.4% 0.79 / 0.82 / -3.8%
clickbench_q34/duckdb:vortex-file-compressed 415161512 / 425260408 / -2.4% 525261270 / 536514435 / -2.1% 0.79 / 0.79 / -0.3%
clickbench_q35/duckdb:vortex-file-compressed 104523307 / 103044661 / +1.4% 141074180 / 137770603 / +2.4% 0.74 / 0.75 / -0.9%
clickbench_q36/duckdb:vortex-file-compressed 15663764 / 16772802 / -6.6% 32808888 / 32910716 / -0.3% 0.48 / 0.51 / -6.3%
clickbench_q37/duckdb:vortex-file-compressed 11958158 / 11811265 / +1.2% 27749509 / 28475606 / -2.5% 0.43 / 0.41 / +3.9%
clickbench_q38/duckdb:vortex-file-compressed 13343788 / 13377614 / -0.3% 27220082 / 31096820 / -12.5% 🟢 0.49 / 0.43 / +14.0%
clickbench_q39/duckdb:vortex-file-compressed 23004176 / 23486948 / -2.1% 43042762 / 39304475 / +9.5% 0.53 / 0.60 / -10.6%
clickbench_q40/duckdb:vortex-file-compressed 12043168 / 11171942 / +7.8% 27905809 / 30994396 / -10.0% 0.43 / 0.36 / +19.7%
clickbench_q41/duckdb:vortex-file-compressed 11075244 / 11063062 / +0.1% 30114543 / 28549188 / +5.5% 0.37 / 0.39 / -5.1%
clickbench_q42/duckdb:vortex-file-compressed 11253428 / 11728062 / -4.0% 29215417 / 32448760 / -10.0% 0.39 / 0.36 / +6.6%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1786248 / 1793690 / -0.4% 24113109 / 27629201 / -12.7% 🟢 0.07 / 0.06 / +14.1%
clickbench_q01/duckdb:vortex-compact 13327628 / 13620851 / -2.2% 32995854 / 30159535 / +9.4% 0.40 / 0.45 / -10.6%
clickbench_q02/duckdb:vortex-compact 19598658 / 18190091 / +7.7% 38883088 / 39579258 / -1.8% 0.50 / 0.46 / +9.7%
clickbench_q03/duckdb:vortex-compact 20153090 / 20531846 / -1.8% 47873885 / 50642232 / -5.5% 0.42 / 0.41 / +3.8%
clickbench_q04/duckdb:vortex-compact 72822886 / 73675637 / -1.2% 96713719 / 104852323 / -7.8% 0.75 / 0.70 / +7.2%
clickbench_q05/duckdb:vortex-compact 75661716 / 78402824 / -3.5% 102309467 / 116226608 / -12.0% 🟢 0.74 / 0.67 / +9.6%
clickbench_q06/duckdb:vortex-compact 1962257 / 2067716 / -5.1% 32919916 / 30935739 / +6.4% 0.06 / 0.07 / -10.8%
clickbench_q07/duckdb:vortex-compact 16803165 / 15633952 / +7.5% 33062944 / 34782695 / -4.9% 0.51 / 0.45 / +13.1%
clickbench_q08/duckdb:vortex-compact 96953072 / 97779750 / -0.8% 132194148 / 131999486 / +0.1% 0.73 / 0.74 / -1.0%
clickbench_q09/duckdb:vortex-compact 140093444 / 142459044 / -1.7% 181419083 / 177343725 / +2.3% 0.77 / 0.80 / -3.9%
clickbench_q10/duckdb:vortex-compact 51888168 / 53052380 / -2.2% 85421637 / 87852204 / -2.8% 0.61 / 0.60 / +0.6%
clickbench_q11/duckdb:vortex-compact 64878758 / 64703626 / +0.3% 104765123 / 105629259 / -0.8% 0.62 / 0.61 / +1.1%
clickbench_q12/duckdb:vortex-compact 86921708 / 89095512 / -2.4% 120870199 / 125338547 / -3.6% 0.72 / 0.71 / +1.2%
clickbench_q13/duckdb:vortex-compact 161533912 / 162451547 / -0.6% 206564042 / 205604693 / +0.5% 0.78 / 0.79 / -1.0%
clickbench_q14/duckdb:vortex-compact 97747762 / 101503686 / -3.7% 134746406 / 131159181 / +2.7% 0.73 / 0.77 / -6.3%
clickbench_q15/duckdb:vortex-compact 95395799 / 96366458 / -1.0% 138151556 / 131497479 / +5.1% 0.69 / 0.73 / -5.8%
clickbench_q16/duckdb:vortex-compact 178473026 / 181029448 / -1.4% 231639787 / 239608333 / -3.3% 0.77 / 0.76 / +2.0%
clickbench_q17/duckdb:vortex-compact 181536614 / 181328530 / +0.1% 225330299 / 228868768 / -1.5% 0.81 / 0.79 / +1.7%
clickbench_q18/duckdb:vortex-compact 328653136 / 342322146 / -4.0% 384186881 / 379426328 / +1.3% 0.86 / 0.90 / -5.2%
clickbench_q19/duckdb:vortex-compact 17503736 / 16815600 / +4.1% 40841669 / 37653691 / +8.5% 0.43 / 0.45 / -4.0%
clickbench_q20/duckdb:vortex-compact 104521064 / 104165632 / +0.3% 173409035 / 161427362 / +7.4% 0.60 / 0.65 / -6.6%
clickbench_q21/duckdb:vortex-compact 171230958 / 169502944 / +1.0% 291052629 / 284200472 / +2.4% 0.59 / 0.60 / -1.4%
clickbench_q22/duckdb:vortex-compact 345804780 / 344983468 / +0.2% 509279973 / 495835596 / +2.7% 0.68 / 0.70 / -2.4%
clickbench_q23/duckdb:vortex-compact 94988862 / 96592811 / -1.7% 132325375 / 133332976 / -0.8% 0.72 / 0.72 / -0.9%
clickbench_q24/duckdb:vortex-compact 30713470 / 31069894 / -1.1% 43730597 / 46645093 / -6.2% 0.70 / 0.67 / +5.4%
clickbench_q25/duckdb:vortex-compact 47516568 / 46779940 / +1.6% 68856604 / 67449934 / +2.1% 0.69 / 0.69 / -0.5%
clickbench_q26/duckdb:vortex-compact 24692022 / 24384462 / +1.3% 39098442 / 41058878 / -4.8% 0.63 / 0.59 / +6.3%
clickbench_q27/duckdb:vortex-compact 191530579 / 193932872 / -1.2% 295816194 / 308736664 / -4.2% 0.65 / 0.63 / +3.1%
clickbench_q28/duckdb:vortex-compact 591089680 / 580779046 / +1.8% 703279739 / 677229814 / +3.8% 0.84 / 0.86 / -2.0%
clickbench_q29/duckdb:vortex-compact 23916996 / 23891181 / +0.1% 44329439 / 46931878 / -5.5% 0.54 / 0.51 / +6.0%
clickbench_q30/duckdb:vortex-compact 112708137 / 114824741 / -1.8% 145953716 / 150731180 / -3.2% 0.77 / 0.76 / +1.4%
clickbench_q31/duckdb:vortex-compact 172233758 / 175891491 / -2.1% 231848021 / 239962996 / -3.4% 0.74 / 0.73 / +1.3%
clickbench_q32/duckdb:vortex-compact 443728258 / 457095228 / -2.9% 532234890 / 542313235 / -1.9% 0.83 / 0.84 / -1.1%
clickbench_q33/duckdb:vortex-compact 393722626 / 393834328 / -0.0% 497827727 / 494525489 / +0.7% 0.79 / 0.80 / -0.7%
clickbench_q34/duckdb:vortex-compact 408197300 / 418012632 / -2.3% 522362753 / 529556997 / -1.4% 0.78 / 0.79 / -1.0%
clickbench_q35/duckdb:vortex-compact 110642168 / 108079404 / +2.4% 143140291 / 144877415 / -1.2% 0.77 / 0.75 / +3.6%
clickbench_q36/duckdb:vortex-compact 16054481 / 17557084 / -8.6% 34517764 / 33976686 / +1.6% 0.47 / 0.52 / -10.0%
clickbench_q37/duckdb:vortex-compact 14031816 / 13145780 / +6.7% 29581795 / 30731742 / -3.7% 0.47 / 0.43 / +10.9%
clickbench_q38/duckdb:vortex-compact 13566016 / 13604092 / -0.3% 30246509 / 29562227 / +2.3% 0.45 / 0.46 / -2.5%
clickbench_q39/duckdb:vortex-compact 25226472 / 25886020 / -2.5% 41829349 / 43348831 / -3.5% 0.60 / 0.60 / +1.0%
clickbench_q40/duckdb:vortex-compact 13984406 / 12910010 / +8.3% 29566413 / 30867191 / -4.2% 0.47 / 0.42 / +13.1%
clickbench_q41/duckdb:vortex-compact 13192132 / 12931977 / +2.0% 31773141 / 29585350 / +7.4% 0.42 / 0.44 / -5.0%
clickbench_q42/duckdb:vortex-compact 11832770 / 12798249 / -7.5% 28788014 / 27787026 / +3.6% 0.41 / 0.46 / -10.8%
duckdb / parquet / ns (0.992x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8661944 / 9326516 / -7.1% 19664303 / 22383912 / -12.1% 🟢 0.44 / 0.42 / +5.7%
clickbench_q01/duckdb:parquet 9133014 / 9099087 / +0.4% 22039913 / 19402292 / +13.6% 🔴 0.41 / 0.47 / -11.6%
clickbench_q02/duckdb:parquet 15441034 / 16431441 / -6.0% 35238090 / 31125767 / +13.2% 🔴 0.44 / 0.53 / -17.0%
clickbench_q03/duckdb:parquet 15783563 / 16830374 / -6.2% 50767524 / 52043079 / -2.5% 0.31 / 0.32 / -3.9%
clickbench_q04/duckdb:parquet 70077364 / 70874420 / -1.1% 93596924 / 89803201 / +4.2% 0.75 / 0.79 / -5.1%
clickbench_q05/duckdb:parquet 82494938 / 82383564 / +0.1% 121005055 / 128249269 / -5.6% 0.68 / 0.64 / +6.1%
clickbench_q06/duckdb:parquet 15374898 / 15550944 / -1.1% 23872475 / 25975966 / -8.1% 0.64 / 0.60 / +7.6%
clickbench_q07/duckdb:parquet 10964337 / 10970186 / -0.1% 21230824 / 20913784 / +1.5% 0.52 / 0.52 / -1.5%
clickbench_q08/duckdb:parquet 86259672 / 87199133 / -1.1% 123708281 / 131336836 / -5.8% 0.70 / 0.66 / +5.0%
clickbench_q09/duckdb:parquet 116623996 / 113785691 / +2.5% 157728885 / 154800625 / +1.9% 0.74 / 0.74 / +0.6%
clickbench_q10/duckdb:parquet 35859910 / 33989945 / +5.5% 67675301 / 69534655 / -2.7% 0.53 / 0.49 / +8.4%
clickbench_q11/duckdb:parquet 36367588 / 39996906 / -9.1% 75177656 / 74560279 / +0.8% 0.48 / 0.54 / -9.8%
clickbench_q12/duckdb:parquet 89561520 / 95980882 / -6.7% 130956043 / 129409513 / +1.2% 0.68 / 0.74 / -7.8%
clickbench_q13/duckdb:parquet 143987676 / 146728782 / -1.9% 210869029 / 208008161 / +1.4% 0.68 / 0.71 / -3.2%
clickbench_q14/duckdb:parquet 103320261 / 99556076 / +3.8% 141225298 / 138196991 / +2.2% 0.73 / 0.72 / +1.6%
clickbench_q15/duckdb:parquet 92302428 / 93544543 / -1.3% 133860869 / 124062675 / +7.9% 0.69 / 0.75 / -8.6%
clickbench_q16/duckdb:parquet 169713098 / 172855424 / -1.8% 231320700 / 227891177 / +1.5% 0.73 / 0.76 / -3.3%
clickbench_q17/duckdb:parquet 186102314 / 184041023 / +1.1% 223474494 / 233379541 / -4.2% 0.83 / 0.79 / +5.6%
clickbench_q18/duckdb:parquet 336298612 / 343294260 / -2.0% 407831618 / 407122123 / +0.2% 0.82 / 0.84 / -2.2%
clickbench_q19/duckdb:parquet 13354386 / 13735671 / -2.8% 39684386 / 40491623 / -2.0% 0.34 / 0.34 / -0.8%
clickbench_q20/duckdb:parquet 135254082 / 134691646 / +0.4% 244160114 / 244858040 / -0.3% 0.55 / 0.55 / +0.7%
clickbench_q21/duckdb:parquet 183920172 / 178369008 / +3.1% 324266992 / 318883642 / +1.7% 0.57 / 0.56 / +1.4%
clickbench_q22/duckdb:parquet 241527034 / 236995670 / +1.9% 408103970 / 410323940 / -0.5% 0.59 / 0.58 / +2.5%
clickbench_q23/duckdb:parquet 143973842 / 149559228 / -3.7% 163365791 / 166946816 / -2.1% 0.88 / 0.90 / -1.6%
clickbench_q24/duckdb:parquet 43849734 / 43473176 / +0.9% 60462441 / 63076389 / -4.1% 0.73 / 0.69 / +5.2%
clickbench_q25/duckdb:parquet 40276068 / 40222516 / +0.1% 87429780 / 88090551 / -0.8% 0.46 / 0.46 / +0.9%
clickbench_q26/duckdb:parquet 29251172 / 29720882 / -1.6% 47086981 / 48020292 / -1.9% 0.62 / 0.62 / +0.4%
clickbench_q27/duckdb:parquet 142317266 / 143660425 / -0.9% 258065313 / 251599852 / +2.6% 0.55 / 0.57 / -3.4%
clickbench_q28/duckdb:parquet 906763970 / 900066016 / +0.7% 1010945700 / 982869373 / +2.9% 0.90 / 0.92 / -2.1%
clickbench_q29/duckdb:parquet 19050499 / 16843048 / +13.1% 🔴 29934065 / 31160437 / -3.9% 0.64 / 0.54 / +17.7%
clickbench_q30/duckdb:parquet 90442136 / 97479522 / -7.2% 170031276 / 178163067 / -4.6% 0.53 / 0.55 / -2.8%
clickbench_q31/duckdb:parquet 144917618 / 145024890 / -0.1% 288848547 / 290132455 / -0.4% 0.50 / 0.50 / +0.4%
clickbench_q32/duckdb:parquet 458305914 / 453581266 / +1.0% 496566193 / 514216671 / -3.4% 0.92 / 0.88 / +4.6%
clickbench_q33/duckdb:parquet 448828128 / 457389068 / -1.9% 491586698 / 472158687 / +4.1% 0.91 / 0.97 / -5.7%
clickbench_q34/duckdb:parquet 460227352 / 452249592 / +1.8% 500266723 / 499756002 / +0.1% 0.92 / 0.90 / +1.7%
clickbench_q35/duckdb:parquet 101050230 / 99355702 / +1.7% 119086977 / 117717243 / +1.2% 0.85 / 0.84 / +0.5%
clickbench_q36/duckdb:parquet 31200801 / 31558568 / -1.1% 41579400 / 42137145 / -1.3% 0.75 / 0.75 / +0.2%
clickbench_q37/duckdb:parquet 22827856 / 23203655 / -1.6% 32789008 / 32457433 / +1.0% 0.70 / 0.71 / -2.6%
clickbench_q38/duckdb:parquet 24253746 / 24113094 / +0.6% 33138790 / 35152382 / -5.7% 0.73 / 0.69 / +6.7%
clickbench_q39/duckdb:parquet 56409942 / 57041933 / -1.1% 66488357 / 66949634 / -0.7% 0.85 / 0.85 / -0.4%
clickbench_q40/duckdb:parquet 13342110 / 13655188 / -2.3% 24617689 / 22478647 / +9.5% 0.54 / 0.61 / -10.8%
clickbench_q41/duckdb:parquet 13148256 / 13234063 / -0.6% 23339740 / 23596808 / -1.1% 0.56 / 0.56 / +0.4%
clickbench_q42/duckdb:parquet 14777308 / 14723638 / +0.4% 33575924 / 25294327 / +32.7% 🔴 0.44 / 0.58 / -24.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.1%, environment too noisy confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.974x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24091405 / 24344356 / -1.0% 44357865 / 42879444 / +3.4% 0.54 / 0.57 / -4.3%
tpcds_q02/datafusion:vortex-file-compressed 45323406 / 44993424 / +0.7% 61227484 / 62988393 / -2.8% 0.74 / 0.71 / +3.6%
tpcds_q03/datafusion:vortex-file-compressed 11954883 / 11544521 / +3.6% 28639149 / 29135950 / -1.7% 0.42 / 0.40 / +5.4%
tpcds_q04/datafusion:vortex-file-compressed 113197056 / 114826468 / -1.4% 141397081 / 145191876 / -2.6% 0.80 / 0.79 / +1.2%
tpcds_q05/datafusion:vortex-file-compressed 59640382 / 60465814 / -1.4% 82943114 / 83033472 / -0.1% 0.72 / 0.73 / -1.3%
tpcds_q06/datafusion:vortex-file-compressed 23392014 / 23709166 / -1.3% 45915604 / 47390393 / -3.1% 0.51 / 0.50 / +1.8%
tpcds_q07/datafusion:vortex-file-compressed 32608362 / 32658506 / -0.2% 55101823 / 57646180 / -4.4% 0.59 / 0.57 / +4.5%
tpcds_q08/datafusion:vortex-file-compressed 25351619 / 25218445 / +0.5% 44230353 / 43454634 / +1.8% 0.57 / 0.58 / -1.2%
tpcds_q09/datafusion:vortex-file-compressed 17243492 / 17216820 / +0.2% 36047101 / 35587493 / +1.3% 0.48 / 0.48 / -1.1%
tpcds_q10/datafusion:vortex-file-compressed 28932770 / 29044938 / -0.4% 49443467 / 50528109 / -2.1% 0.59 / 0.57 / +1.8%
tpcds_q11/datafusion:vortex-file-compressed 62712209 / 62445762 / +0.4% 90097221 / 89100784 / +1.1% 0.70 / 0.70 / -0.7%
tpcds_q12/datafusion:vortex-file-compressed 16247040 / 16547732 / -1.8% 33015274 / 32407171 / +1.9% 0.49 / 0.51 / -3.6%
tpcds_q13/datafusion:vortex-file-compressed 34075128 / 33612870 / +1.4% 51376063 / 53673737 / -4.3% 0.66 / 0.63 / +5.9%
tpcds_q14/datafusion:vortex-file-compressed 89990076 / 91114763 / -1.2% 116440092 / 123914865 / -6.0% 0.77 / 0.74 / +5.1%
tpcds_q15/datafusion:vortex-file-compressed 23755622 / 24169404 / -1.7% 41932611 / 45336787 / -7.5% 0.57 / 0.53 / +6.3%
tpcds_q16/datafusion:vortex-file-compressed 20506541 / 20411873 / +0.5% 38891733 / 41956980 / -7.3% 0.53 / 0.49 / +8.4%
tpcds_q17/datafusion:vortex-file-compressed 64261914 / 53772270 / +19.5% 🔴 76150993 / 78028690 / -2.4% 0.84 / 0.69 / +22.5%
tpcds_q18/datafusion:vortex-file-compressed 68636030 / 68756032 / -0.2% 92808726 / 93749651 / -1.0% 0.74 / 0.73 / +0.8%
tpcds_q19/datafusion:vortex-file-compressed 18439590 / 18312048 / +0.7% 39060117 / 40550091 / -3.7% 0.47 / 0.45 / +4.5%
tpcds_q20/datafusion:vortex-file-compressed 17924072 / 17471370 / +2.6% 35335211 / 35527123 / -0.5% 0.51 / 0.49 / +3.1%
tpcds_q21/datafusion:vortex-file-compressed 16568284 / 17385109 / -4.7% 41300426 / 40031658 / +3.2% 0.40 / 0.43 / -7.6%
tpcds_q22/datafusion:vortex-file-compressed 49434758 / 50523239 / -2.2% 71687103 / 71493527 / +0.3% 0.69 / 0.71 / -2.4%
tpcds_q23/datafusion:vortex-file-compressed 73006893 / 73555616 / -0.7% 96628655 / 100517102 / -3.9% 0.76 / 0.73 / +3.2%
tpcds_q24/datafusion:vortex-file-compressed 70178068 / 70541610 / -0.5% 96044222 / 94337051 / +1.8% 0.73 / 0.75 / -2.3%
tpcds_q25/datafusion:vortex-file-compressed 56161000 / 56076676 / +0.2% 73234256 / 76892728 / -4.8% 0.77 / 0.73 / +5.2%
tpcds_q26/datafusion:vortex-file-compressed 30205868 / 30213982 / -0.0% 52273187 / 52344954 / -0.1% 0.58 / 0.58 / +0.1%
tpcds_q27/datafusion:vortex-file-compressed 62311786 / 64370135 / -3.2% 88753810 / 91613165 / -3.1% 0.70 / 0.70 / -0.1%
tpcds_q28/datafusion:vortex-file-compressed 18002140 / 17854772 / +0.8% 35328419 / 36724204 / -3.8% 0.51 / 0.49 / +4.8%
tpcds_q29/datafusion:vortex-file-compressed 61413164 / 54759010 / +12.2% 🔴 86545461 / 84522697 / +2.4% 0.71 / 0.65 / +9.5%
tpcds_q30/datafusion:vortex-file-compressed 27477982 / 27346374 / +0.5% 44544077 / 48596664 / -8.3% 0.62 / 0.56 / +9.6%
tpcds_q31/datafusion:vortex-file-compressed 64061479 / 64516010 / -0.7% 89674543 / 92129214 / -2.7% 0.71 / 0.70 / +2.0%
tpcds_q32/datafusion:vortex-file-compressed 13813844 / 13526222 / +2.1% 31107148 / 31774736 / -2.1% 0.44 / 0.43 / +4.3%
tpcds_q33/datafusion:vortex-file-compressed 26938290 / 26942224 / -0.0% 47782077 / 48921405 / -2.3% 0.56 / 0.55 / +2.4%
tpcds_q34/datafusion:vortex-file-compressed 17980520 / 17952772 / +0.2% 38847889 / 40554094 / -4.2% 0.46 / 0.44 / +4.6%
tpcds_q35/datafusion:vortex-file-compressed 35386623 / 35609448 / -0.6% 56483625 / 58860319 / -4.0% 0.63 / 0.60 / +3.6%
tpcds_q36/datafusion:vortex-file-compressed 47983200 / 48127686 / -0.3% 74982908 / 70059684 / +7.0% 0.64 / 0.69 / -6.8%
tpcds_q37/datafusion:vortex-file-compressed 13738144 / 13394022 / +2.6% 33479841 / 33581158 / -0.3% 0.41 / 0.40 / +2.9%
tpcds_q38/datafusion:vortex-file-compressed 29872034 / 29997800 / -0.4% 52439821 / 52833249 / -0.7% 0.57 / 0.57 / +0.3%
tpcds_q39/datafusion:vortex-file-compressed 65216312 / 65472038 / -0.4% 89996324 / 92444995 / -2.6% 0.72 / 0.71 / +2.3%
tpcds_q40/datafusion:vortex-file-compressed 24690992 / 25068990 / -1.5% 45347539 / 47244401 / -4.0% 0.54 / 0.53 / +2.6%
tpcds_q41/datafusion:vortex-file-compressed 16536748 / 16647745 / -0.7% 31219236 / 31559274 / -1.1% 0.53 / 0.53 / +0.4%
tpcds_q42/datafusion:vortex-file-compressed 11407110 / 11374718 / +0.3% 27434920 / 28188330 / -2.7% 0.42 / 0.40 / +3.0%
tpcds_q43/datafusion:vortex-file-compressed 13308138 / 13197498 / +0.8% 31207121 / 32673176 / -4.5% 0.43 / 0.40 / +5.6%
tpcds_q44/datafusion:vortex-file-compressed 26482360 / 26231978 / +1.0% 50095411 / 52418117 / -4.4% 0.53 / 0.50 / +5.6%
tpcds_q45/datafusion:vortex-file-compressed 27727692 / 27198330 / +1.9% 47330612 / 47874309 / -1.1% 0.59 / 0.57 / +3.1%
tpcds_q46/datafusion:vortex-file-compressed 25077804 / 24517945 / +2.3% 48173390 / 48487550 / -0.6% 0.52 / 0.51 / +3.0%
tpcds_q47/datafusion:vortex-file-compressed 77325752 / 78201440 / -1.1% 104896552 / 107087306 / -2.0% 0.74 / 0.73 / +0.9%
tpcds_q48/datafusion:vortex-file-compressed 31217191 / 31667364 / -1.4% 51666335 / 52369854 / -1.3% 0.60 / 0.60 / -0.1%
tpcds_q49/datafusion:vortex-file-compressed 59395796 / 59639552 / -0.4% 88858549 / 84842029 / +4.7% 0.67 / 0.70 / -4.9%
tpcds_q50/datafusion:vortex-file-compressed 34734282 / 34316221 / +1.2% 54312013 / 55952960 / -2.9% 0.64 / 0.61 / +4.3%
tpcds_q51/datafusion:vortex-file-compressed 60256964 / 60544353 / -0.5% 81772033 / 84650902 / -3.4% 0.74 / 0.72 / +3.0%
tpcds_q52/datafusion:vortex-file-compressed 11830792 / 11697074 / +1.1% 28361942 / 28759296 / -1.4% 0.42 / 0.41 / +2.6%
tpcds_q53/datafusion:vortex-file-compressed 18430558 / 18292290 / +0.8% 37146543 / 38627270 / -3.8% 0.50 / 0.47 / +4.8%
tpcds_q54/datafusion:vortex-file-compressed 33038162 / 33799959 / -2.3% 56476985 / 62576296 / -9.7% 0.58 / 0.54 / +8.3%
tpcds_q55/datafusion:vortex-file-compressed 11252369 / 11365167 / -1.0% 26590749 / 28257374 / -5.9% 0.42 / 0.40 / +5.2%
tpcds_q56/datafusion:vortex-file-compressed 26434074 / 27278212 / -3.1% 48707941 / 50585614 / -3.7% 0.54 / 0.54 / +0.6%
tpcds_q57/datafusion:vortex-file-compressed 72967319 / 73362100 / -0.5% 96315205 / 98672333 / -2.4% 0.76 / 0.74 / +1.9%
tpcds_q58/datafusion:vortex-file-compressed 40844864 / 40391609 / +1.1% 65533834 / 68558978 / -4.4% 0.62 / 0.59 / +5.8%
tpcds_q59/datafusion:vortex-file-compressed 32266380 / 32442666 / -0.5% 52304202 / 53876762 / -2.9% 0.62 / 0.60 / +2.4%
tpcds_q60/datafusion:vortex-file-compressed 26577208 / 26668362 / -0.3% 49356666 / 49527115 / -0.3% 0.54 / 0.54 / +0.0%
tpcds_q61/datafusion:vortex-file-compressed 23290098 / 25281959 / -7.9% 47779966 / 48234495 / -0.9% 0.49 / 0.52 / -7.0%
tpcds_q62/datafusion:vortex-file-compressed 16987324 / 17114051 / -0.7% 34992520 / 36853947 / -5.1% 0.49 / 0.46 / +4.5%
tpcds_q63/datafusion:vortex-file-compressed 18513468 / 18565620 / -0.3% 37580738 / 39263874 / -4.3% 0.49 / 0.47 / +4.2%
tpcds_q64/datafusion:vortex-file-compressed 322239472 / 325038038 / -0.9% 359652213 / 362693057 / -0.8% 0.90 / 0.90 / -0.0%
tpcds_q65/datafusion:vortex-file-compressed 74567114 / 75874534 / -1.7% 94246567 / 95503911 / -1.3% 0.79 / 0.79 / -0.4%
tpcds_q66/datafusion:vortex-file-compressed 52349052 / 53393693 / -2.0% 74451751 / 77487493 / -3.9% 0.70 / 0.69 / +2.0%
tpcds_q67/datafusion:vortex-file-compressed 55034074 / 55145078 / -0.2% 84613991 / 85695839 / -1.3% 0.65 / 0.64 / +1.1%
tpcds_q68/datafusion:vortex-file-compressed 24617627 / 24591852 / +0.1% 48221082 / 48825982 / -1.2% 0.51 / 0.50 / +1.4%
tpcds_q69/datafusion:vortex-file-compressed 28123942 / 28293990 / -0.6% 47751505 / 50391413 / -5.2% 0.59 / 0.56 / +4.9%
tpcds_q70/datafusion:vortex-file-compressed 71582618 / 70704912 / +1.2% 92444637 / 94959819 / -2.6% 0.77 / 0.74 / +4.0%
tpcds_q71/datafusion:vortex-file-compressed 18638666 / 19303914 / -3.4% 36507581 / 41023821 / -11.0% 🟢 0.51 / 0.47 / +8.5%
tpcds_q72/datafusion:vortex-file-compressed 466012688 / 474533372 / -1.8% 519551073 / 544668389 / -4.6% 0.90 / 0.87 / +3.0%
tpcds_q73/datafusion:vortex-file-compressed 17590328 / 17091560 / +2.9% 37469437 / 38074906 / -1.6% 0.47 / 0.45 / +4.6%
tpcds_q74/datafusion:vortex-file-compressed 45885308 / 46712126 / -1.8% 69237158 / 70978535 / -2.5% 0.66 / 0.66 / +0.7%
tpcds_q75/datafusion:vortex-file-compressed 130151094 / 132856423 / -2.0% 156159191 / 162451544 / -3.9% 0.83 / 0.82 / +1.9%
tpcds_q76/datafusion:vortex-file-compressed 43575558 / 43904166 / -0.7% 63682937 / 62947374 / +1.2% 0.68 / 0.70 / -1.9%
tpcds_q77/datafusion:vortex-file-compressed 35168770 / 35950424 / -2.2% 60263290 / 60463837 / -0.3% 0.58 / 0.59 / -1.8%
tpcds_q78/datafusion:vortex-file-compressed 79673142 / 80278525 / -0.8% 107208814 / 111380232 / -3.7% 0.74 / 0.72 / +3.1%
tpcds_q79/datafusion:vortex-file-compressed 21419302 / 21260376 / +0.7% 43581054 / 43181431 / +0.9% 0.49 / 0.49 / -0.2%
tpcds_q80/datafusion:vortex-file-compressed 77236702 / 77855872 / -0.8% 108899769 / 112837261 / -3.5% 0.71 / 0.69 / +2.8%
tpcds_q81/datafusion:vortex-file-compressed 28200788 / 28718102 / -1.8% 44484725 / 46388046 / -4.1% 0.63 / 0.62 / +2.4%
tpcds_q82/datafusion:vortex-file-compressed 13584599 / 13716240 / -1.0% 35517846 / 34724354 / +2.3% 0.38 / 0.40 / -3.2%
tpcds_q83/datafusion:vortex-file-compressed 35944444 / 35928202 / +0.0% 57285817 / 60107826 / -4.7% 0.63 / 0.60 / +5.0%
tpcds_q84/datafusion:vortex-file-compressed 11906230 / 11973410 / -0.6% 26995016 / 29874606 / -9.6% 0.44 / 0.40 / +10.0%
tpcds_q85/datafusion:vortex-file-compressed 59226550 / 59554116 / -0.6% 83533106 / 83712906 / -0.2% 0.71 / 0.71 / -0.3%
tpcds_q86/datafusion:vortex-file-compressed 16308578 / 16551240 / -1.5% 32462154 / 33545962 / -3.2% 0.50 / 0.49 / +1.8%
tpcds_q87/datafusion:vortex-file-compressed 30067922 / 29473130 / +2.0% 52194757 / 52991778 / -1.5% 0.58 / 0.56 / +3.6%
tpcds_q88/datafusion:vortex-file-compressed 34795522 / 34559866 / +0.7% 63038379 / 61606163 / +2.3% 0.55 / 0.56 / -1.6%
tpcds_q89/datafusion:vortex-file-compressed 21391723 / 21110544 / +1.3% 41423749 / 41328056 / +0.2% 0.52 / 0.51 / +1.1%
tpcds_q90/datafusion:vortex-file-compressed 10255676 / 10370904 / -1.1% 26588974 / 27328517 / -2.7% 0.39 / 0.38 / +1.6%
tpcds_q91/datafusion:vortex-file-compressed 17205376 / 16423180 / +4.8% 32417384 / 36483702 / -11.1% 🟢 0.53 / 0.45 / +17.9%
tpcds_q92/datafusion:vortex-file-compressed 13789770 / 13814409 / -0.2% 30966768 / 31980212 / -3.2% 0.45 / 0.43 / +3.1%
tpcds_q93/datafusion:vortex-file-compressed 23856195 / 24410842 / -2.3% 45664808 / 47331606 / -3.5% 0.52 / 0.52 / +1.3%
tpcds_q94/datafusion:vortex-file-compressed 19615070 / 19929351 / -1.6% 38830639 / 40836898 / -4.9% 0.51 / 0.49 / +3.5%
tpcds_q95/datafusion:vortex-file-compressed 46339115 / 45817740 / +1.1% 65598311 / 69265284 / -5.3% 0.71 / 0.66 / +6.8%
tpcds_q96/datafusion:vortex-file-compressed 9487205 / 9648550 / -1.7% 24234733 / 26224164 / -7.6% 0.39 / 0.37 / +6.4%
tpcds_q97/datafusion:vortex-file-compressed 21048524 / 21334876 / -1.3% 42099123 / 44999634 / -6.4% 0.50 / 0.47 / +5.5%
tpcds_q98/datafusion:vortex-file-compressed 16736678 / 17129082 / -2.3% 36936419 / 38053793 / -2.9% 0.45 / 0.45 / +0.7%
tpcds_q99/datafusion:vortex-file-compressed 19519962 / 19640776 / -0.6% 37340224 / 39344738 / -5.1% 0.52 / 0.50 / +4.7%
datafusion / vortex-compact / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25574158 / 26173707 / -2.3% 44896071 / 45657477 / -1.7% 0.57 / 0.57 / -0.6%
tpcds_q02/datafusion:vortex-compact 48504912 / 48934883 / -0.9% 66943875 / 67880269 / -1.4% 0.72 / 0.72 / +0.5%
tpcds_q03/datafusion:vortex-compact 12849982 / 12960428 / -0.9% 33518852 / 33445633 / +0.2% 0.38 / 0.39 / -1.1%
tpcds_q04/datafusion:vortex-compact 122866010 / 121650488 / +1.0% 156269409 / 150377994 / +3.9% 0.79 / 0.81 / -2.8%
tpcds_q05/datafusion:vortex-compact 62057837 / 62509919 / -0.7% 85594332 / 84408515 / +1.4% 0.73 / 0.74 / -2.1%
tpcds_q06/datafusion:vortex-compact 26531690 / 26427104 / +0.4% 47703243 / 47067247 / +1.4% 0.56 / 0.56 / -0.9%
tpcds_q07/datafusion:vortex-compact 35712107 / 34696702 / +2.9% 54371430 / 56949151 / -4.5% 0.66 / 0.61 / +7.8%
tpcds_q08/datafusion:vortex-compact 30634734 / 30624438 / +0.0% 47721579 / 49435793 / -3.5% 0.64 / 0.62 / +3.6%
tpcds_q09/datafusion:vortex-compact 22307040 / 21749544 / +2.6% 41303618 / 40239968 / +2.6% 0.54 / 0.54 / -0.1%
tpcds_q10/datafusion:vortex-compact 37588358 / 37274377 / +0.8% 58596221 / 60275389 / -2.8% 0.64 / 0.62 / +3.7%
tpcds_q11/datafusion:vortex-compact 66494776 / 70819390 / -6.1% 91596537 / 95047432 / -3.6% 0.73 / 0.75 / -2.6%
tpcds_q12/datafusion:vortex-compact 20544583 / 20766926 / -1.1% 38523676 / 39636559 / -2.8% 0.53 / 0.52 / +1.8%
tpcds_q13/datafusion:vortex-compact 55334835 / 55177779 / +0.3% 74478921 / 73940523 / +0.7% 0.74 / 0.75 / -0.4%
tpcds_q14/datafusion:vortex-compact 96662988 / 98638866 / -2.0% 122430757 / 121748689 / +0.6% 0.79 / 0.81 / -2.5%
tpcds_q15/datafusion:vortex-compact 27174393 / 27426986 / -0.9% 45307689 / 47687153 / -5.0% 0.60 / 0.58 / +4.3%
tpcds_q16/datafusion:vortex-compact 23186222 / 23873722 / -2.9% 43536391 / 44270282 / -1.7% 0.53 / 0.54 / -1.2%
tpcds_q17/datafusion:vortex-compact 66581227 / 67693734 / -1.6% 93360508 / 99046790 / -5.7% 0.71 / 0.68 / +4.3%
tpcds_q18/datafusion:vortex-compact 68816458 / 68770829 / +0.1% 91352532 / 91559881 / -0.2% 0.75 / 0.75 / +0.3%
tpcds_q19/datafusion:vortex-compact 21173583 / 21667534 / -2.3% 42833447 / 43344364 / -1.2% 0.49 / 0.50 / -1.1%
tpcds_q20/datafusion:vortex-compact 22278794 / 22808194 / -2.3% 40494945 / 42684640 / -5.1% 0.55 / 0.53 / +3.0%
tpcds_q21/datafusion:vortex-compact 18018072 / 19022148 / -5.3% 39898800 / 42966753 / -7.1% 0.45 / 0.44 / +2.0%
tpcds_q22/datafusion:vortex-compact 50039607 / 50157156 / -0.2% 72712974 / 72876656 / -0.2% 0.69 / 0.69 / -0.0%
tpcds_q23/datafusion:vortex-compact 75741552 / 77862540 / -2.7% 102302759 / 104863924 / -2.4% 0.74 / 0.74 / -0.3%
tpcds_q24/datafusion:vortex-compact 77144402 / 77018493 / +0.2% 103329474 / 100832741 / +2.5% 0.75 / 0.76 / -2.3%
tpcds_q25/datafusion:vortex-compact 60046536 / 62774353 / -4.3% 85456479 / 83359600 / +2.5% 0.70 / 0.75 / -6.7%
tpcds_q26/datafusion:vortex-compact 31921298 / 33256342 / -4.0% 52847219 / 52621688 / +0.4% 0.60 / 0.63 / -4.4%
tpcds_q27/datafusion:vortex-compact 64086760 / 61398628 / +4.4% 86876117 / 85097948 / +2.1% 0.74 / 0.72 / +2.2%
tpcds_q28/datafusion:vortex-compact 27571628 / 28150418 / -2.1% 47095313 / 51650986 / -8.8% 0.59 / 0.55 / +7.4%
tpcds_q29/datafusion:vortex-compact 61405330 / 65995170 / -7.0% 81583781 / 96404490 / -15.4% 🟢 0.75 / 0.68 / +9.9%
tpcds_q30/datafusion:vortex-compact 30398920 / 30710394 / -1.0% 47115628 / 48607485 / -3.1% 0.65 / 0.63 / +2.1%
tpcds_q31/datafusion:vortex-compact 77686099 / 76150178 / +2.0% 103013339 / 106482029 / -3.3% 0.75 / 0.72 / +5.5%
tpcds_q32/datafusion:vortex-compact 16237309 / 16756886 / -3.1% 35451765 / 35271059 / +0.5% 0.46 / 0.48 / -3.6%
tpcds_q33/datafusion:vortex-compact 28571232 / 29538684 / -3.3% 50113060 / 52426456 / -4.4% 0.57 / 0.56 / +1.2%
tpcds_q34/datafusion:vortex-compact 20829524 / 21166470 / -1.6% 44166161 / 41122550 / +7.4% 0.47 / 0.51 / -8.4%
tpcds_q35/datafusion:vortex-compact 41697553 / 40590379 / +2.7% 66816091 / 64980135 / +2.8% 0.62 / 0.62 / -0.1%
tpcds_q36/datafusion:vortex-compact 52613926 / 51480242 / +2.2% 77327825 / 76981712 / +0.4% 0.68 / 0.67 / +1.7%
tpcds_q37/datafusion:vortex-compact 15678897 / 15259903 / +2.7% 38371921 / 41846088 / -8.3% 0.41 / 0.36 / +12.0%
tpcds_q38/datafusion:vortex-compact 34878330 / 34378246 / +1.5% 57842541 / 56935854 / +1.6% 0.60 / 0.60 / -0.1%
tpcds_q39/datafusion:vortex-compact 66506445 / 68518509 / -2.9% 88937633 / 92647274 / -4.0% 0.75 / 0.74 / +1.1%
tpcds_q40/datafusion:vortex-compact 27886028 / 28276860 / -1.4% 48470606 / 50795673 / -4.6% 0.58 / 0.56 / +3.3%
tpcds_q41/datafusion:vortex-compact 18567236 / 18701685 / -0.7% 31646562 / 33037690 / -4.2% 0.59 / 0.57 / +3.6%
tpcds_q42/datafusion:vortex-compact 12482914 / 12441157 / +0.3% 30972122 / 32815007 / -5.6% 0.40 / 0.38 / +6.3%
tpcds_q43/datafusion:vortex-compact 15345256 / 16234473 / -5.5% 33206518 / 34285371 / -3.1% 0.46 / 0.47 / -2.4%
tpcds_q44/datafusion:vortex-compact 30490216 / 30777993 / -0.9% 54238131 / 55176520 / -1.7% 0.56 / 0.56 / +0.8%
tpcds_q45/datafusion:vortex-compact 30532627 / 30460932 / +0.2% 48938634 / 51740420 / -5.4% 0.62 / 0.59 / +6.0%
tpcds_q46/datafusion:vortex-compact 30368395 / 28096908 / +8.1% 54936352 / 52127351 / +5.4% 0.55 / 0.54 / +2.6%
tpcds_q47/datafusion:vortex-compact 88884674 / 86862414 / +2.3% 116857749 / 116791218 / +0.1% 0.76 / 0.74 / +2.3%
tpcds_q48/datafusion:vortex-compact 50588599 / 61670102 / -18.0% 🟢 68900098 / 70426774 / -2.2% 0.73 / 0.88 / -16.2%
tpcds_q49/datafusion:vortex-compact 64056048 / 66148970 / -3.2% 88039313 / 95281281 / -7.6% 0.73 / 0.69 / +4.8%
tpcds_q50/datafusion:vortex-compact 36109694 / 36070784 / +0.1% 61410135 / 56907240 / +7.9% 0.59 / 0.63 / -7.2%
tpcds_q51/datafusion:vortex-compact 63367804 / 63610674 / -0.4% 84715729 / 86433184 / -2.0% 0.75 / 0.74 / +1.6%
tpcds_q52/datafusion:vortex-compact 13311288 / 13716992 / -3.0% 32993528 / 32802155 / +0.6% 0.40 / 0.42 / -3.5%
tpcds_q53/datafusion:vortex-compact 22139666 / 23176976 / -4.5% 40390072 / 43354426 / -6.8% 0.55 / 0.53 / +2.5%
tpcds_q54/datafusion:vortex-compact 39236902 / 40182869 / -2.4% 66042009 / 65310316 / +1.1% 0.59 / 0.62 / -3.4%
tpcds_q55/datafusion:vortex-compact 13094716 / 12394286 / +5.7% 30934008 / 32093749 / -3.6% 0.42 / 0.39 / +9.6%
tpcds_q56/datafusion:vortex-compact 29824538 / 28014362 / +6.5% 49080831 / 51653289 / -5.0% 0.61 / 0.54 / +12.0%
tpcds_q57/datafusion:vortex-compact 79860459 / 79833421 / +0.0% 108282456 / 108106166 / +0.2% 0.74 / 0.74 / -0.1%
tpcds_q58/datafusion:vortex-compact 48248896 / 48312100 / -0.1% 72058194 / 76311813 / -5.6% 0.67 / 0.63 / +5.8%
tpcds_q59/datafusion:vortex-compact 40157566 / 39837550 / +0.8% 60625138 / 61013635 / -0.6% 0.66 / 0.65 / +1.4%
tpcds_q60/datafusion:vortex-compact 28801548 / 28097520 / +2.5% 51178971 / 51892181 / -1.4% 0.56 / 0.54 / +3.9%
tpcds_q61/datafusion:vortex-compact 27687600 / 28129000 / -1.6% 49732413 / 48367822 / +2.8% 0.56 / 0.58 / -4.3%
tpcds_q62/datafusion:vortex-compact 17766567 / 17781088 / -0.1% 35693580 / 36108579 / -1.1% 0.50 / 0.49 / +1.1%
tpcds_q63/datafusion:vortex-compact 23524370 / 23493690 / +0.1% 42183597 / 43578962 / -3.2% 0.56 / 0.54 / +3.4%
tpcds_q64/datafusion:vortex-compact 448959130 / 446587424 / +0.5% 460227729 / 454249370 / +1.3% 0.98 / 0.98 / -0.8%
tpcds_q65/datafusion:vortex-compact 81631654 / 80590066 / +1.3% 99680858 / 102417873 / -2.7% 0.82 / 0.79 / +4.1%
tpcds_q66/datafusion:vortex-compact 55103559 / 55318138 / -0.4% 75187025 / 77025571 / -2.4% 0.73 / 0.72 / +2.0%
tpcds_q67/datafusion:vortex-compact 58361812 / 59319942 / -1.6% 88583501 / 90179797 / -1.8% 0.66 / 0.66 / +0.2%
tpcds_q68/datafusion:vortex-compact 27224056 / 27637102 / -1.5% 51626429 / 51691468 / -0.1% 0.53 / 0.53 / -1.4%
tpcds_q69/datafusion:vortex-compact 36461864 / 37890678 / -3.8% 58392817 / 60583722 / -3.6% 0.62 / 0.63 / -0.2%
tpcds_q70/datafusion:vortex-compact 75735586 / 76274654 / -0.7% 95973378 / 97212155 / -1.3% 0.79 / 0.78 / +0.6%
tpcds_q71/datafusion:vortex-compact 19389553 / 19319936 / +0.4% 41104997 / 41733257 / -1.5% 0.47 / 0.46 / +1.9%
tpcds_q72/datafusion:vortex-compact 468839290 / 476719140 / -1.7% 476726699 / 490022628 / -2.7% 0.98 / 0.97 / +1.1%
tpcds_q73/datafusion:vortex-compact 19632018 / 19507392 / +0.6% 39887545 / 41846093 / -4.7% 0.49 / 0.47 / +5.6%
tpcds_q74/datafusion:vortex-compact 50164099 / 51269482 / -2.2% 75909242 / 76888065 / -1.3% 0.66 / 0.67 / -0.9%
tpcds_q75/datafusion:vortex-compact 139097086 / 137048248 / +1.5% 157715642 / 168805700 / -6.6% 0.88 / 0.81 / +8.6%
tpcds_q76/datafusion:vortex-compact 41489894 / 42245534 / -1.8% 62826741 / 60153679 / +4.4% 0.66 / 0.70 / -6.0%
tpcds_q77/datafusion:vortex-compact 38349899 / 37843781 / +1.3% 63680603 / 64010116 / -0.5% 0.60 / 0.59 / +1.9%
tpcds_q78/datafusion:vortex-compact 85884758 / 86847047 / -1.1% 112096407 / 115317105 / -2.8% 0.77 / 0.75 / +1.7%
tpcds_q79/datafusion:vortex-compact 25016359 / 24483821 / +2.2% 45722961 / 51880967 / -11.9% 🟢 0.55 / 0.47 / +15.9%
tpcds_q80/datafusion:vortex-compact 79190573 / 79302510 / -0.1% 110033395 / 110537774 / -0.5% 0.72 / 0.72 / +0.3%
tpcds_q81/datafusion:vortex-compact 30499792 / 30330518 / +0.6% 47260573 / 47081993 / +0.4% 0.65 / 0.64 / +0.2%
tpcds_q82/datafusion:vortex-compact 15654162 / 15640688 / +0.1% 39444218 / 43438860 / -9.2% 0.40 / 0.36 / +10.2%
tpcds_q83/datafusion:vortex-compact 36796431 / 37202978 / -1.1% 59654438 / 59298495 / +0.6% 0.62 / 0.63 / -1.7%
tpcds_q84/datafusion:vortex-compact 12943558 / 13276838 / -2.5% 28481149 / 29453305 / -3.3% 0.45 / 0.45 / +0.8%
tpcds_q85/datafusion:vortex-compact 102782162 / 103825266 / -1.0% 126040472 / 127634739 / -1.2% 0.82 / 0.81 / +0.2%
tpcds_q86/datafusion:vortex-compact 16429450 / 16631698 / -1.2% 35469600 / 36609294 / -3.1% 0.46 / 0.45 / +2.0%
tpcds_q87/datafusion:vortex-compact 33579202 / 33361089 / +0.7% 54814130 / 56381300 / -2.8% 0.61 / 0.59 / +3.5%
tpcds_q88/datafusion:vortex-compact 41147011 / 41313464 / -0.4% 68275541 / 69330629 / -1.5% 0.60 / 0.60 / +1.1%
tpcds_q89/datafusion:vortex-compact 25902442 / 25883650 / +0.1% 45033442 / 46951097 / -4.1% 0.58 / 0.55 / +4.3%
tpcds_q90/datafusion:vortex-compact 11196474 / 11332713 / -1.2% 28089040 / 28674375 / -2.0% 0.40 / 0.40 / +0.9%
tpcds_q91/datafusion:vortex-compact 26523739 / 27325378 / -2.9% 45281169 / 48020696 / -5.7% 0.59 / 0.57 / +2.9%
tpcds_q92/datafusion:vortex-compact 15317812 / 15752174 / -2.8% 33317611 / 35090246 / -5.1% 0.46 / 0.45 / +2.4%
tpcds_q93/datafusion:vortex-compact 25049989 / 25406306 / -1.4% 46978660 / 45039086 / +4.3% 0.53 / 0.56 / -5.5%
tpcds_q94/datafusion:vortex-compact 21846588 / 22051122 / -0.9% 41469982 / 42143826 / -1.6% 0.53 / 0.52 / +0.7%
tpcds_q95/datafusion:vortex-compact 50138628 / 49620810 / +1.0% 69851770 / 71759661 / -2.7% 0.72 / 0.69 / +3.8%
tpcds_q96/datafusion:vortex-compact 10681193 / 10807670 / -1.2% 26267166 / 26446181 / -0.7% 0.41 / 0.41 / -0.5%
tpcds_q97/datafusion:vortex-compact 25348776 / 24654181 / +2.8% 45310429 / 46773362 / -3.1% 0.56 / 0.53 / +6.1%
tpcds_q98/datafusion:vortex-compact 21541710 / 21833484 / -1.3% 42032683 / 44121145 / -4.7% 0.51 / 0.49 / +3.6%
tpcds_q99/datafusion:vortex-compact 20834995 / 21230934 / -1.9% 39235822 / 40642714 / -3.5% 0.53 / 0.52 / +1.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31642828 / 32193134 / -1.7% 47012685 / 51593813 / -8.9% 0.67 / 0.62 / +7.9%
tpcds_q02/datafusion:parquet 39563161 / 40106574 / -1.4% 57609235 / 57357946 / +0.4% 0.69 / 0.70 / -1.8%
tpcds_q03/datafusion:parquet 16424247 / 16540580 / -0.7% 30930531 / 31141307 / -0.7% 0.53 / 0.53 / -0.0%
tpcds_q04/datafusion:parquet 200780681 / 200766016 / +0.0% 228673410 / 231962930 / -1.4% 0.88 / 0.87 / +1.4%
tpcds_q05/datafusion:parquet 72390021 / 72434648 / -0.1% 98762380 / 95497380 / +3.4% 0.73 / 0.76 / -3.4%
tpcds_q06/datafusion:parquet 28407938 / 28191417 / +0.8% 48148479 / 50616678 / -4.9% 0.59 / 0.56 / +5.9%
tpcds_q07/datafusion:parquet 47460585 / 46458502 / +2.2% 67809339 / 70461885 / -3.8% 0.70 / 0.66 / +6.2%
tpcds_q08/datafusion:parquet 31653896 / 31837240 / -0.6% 48345719 / 49133359 / -1.6% 0.65 / 0.65 / +1.0%
tpcds_q09/datafusion:parquet 28527654 / 30145840 / -5.4% 38515726 / 37543423 / +2.6% 0.74 / 0.80 / -7.8%
tpcds_q10/datafusion:parquet 41904340 / 41572853 / +0.8% 63272458 / 61462265 / +2.9% 0.66 / 0.68 / -2.1%
tpcds_q11/datafusion:parquet 95710360 / 96019852 / -0.3% 119400595 / 121911947 / -2.1% 0.80 / 0.79 / +1.8%
tpcds_q12/datafusion:parquet 21577202 / 22087666 / -2.3% 34678499 / 35729841 / -2.9% 0.62 / 0.62 / +0.7%
tpcds_q13/datafusion:parquet 43123679 / 41917650 / +2.9% 67101714 / 66279406 / +1.2% 0.64 / 0.63 / +1.6%
tpcds_q14/datafusion:parquet 127825136 / 127300681 / +0.4% 150341217 / 154297468 / -2.6% 0.85 / 0.83 / +3.1%
tpcds_q15/datafusion:parquet 33162966 / 33409010 / -0.7% 49563398 / 48675494 / +1.8% 0.67 / 0.69 / -2.5%
tpcds_q16/datafusion:parquet 37354705 / 37531299 / -0.5% 53076786 / 53794860 / -1.3% 0.70 / 0.70 / +0.9%
tpcds_q17/datafusion:parquet 78522318 / 76628335 / +2.5% 102840353 / 103880584 / -1.0% 0.76 / 0.74 / +3.5%
tpcds_q18/datafusion:parquet 58709308 / 61717988 / -4.9% 78040235 / 80912083 / -3.5% 0.75 / 0.76 / -1.4%
tpcds_q19/datafusion:parquet 26571242 / 26521066 / +0.2% 44388591 / 46404836 / -4.3% 0.60 / 0.57 / +4.7%
tpcds_q20/datafusion:parquet 22813108 / 22659596 / +0.7% 37517555 / 36679286 / +2.3% 0.61 / 0.62 / -1.6%
tpcds_q21/datafusion:parquet 18447873 / 18100330 / +1.9% 32254317 / 33198320 / -2.8% 0.57 / 0.55 / +4.9%
tpcds_q22/datafusion:parquet 74772044 / 75468630 / -0.9% 90752566 / 89897762 / +1.0% 0.82 / 0.84 / -1.9%
tpcds_q23/datafusion:parquet 109088470 / 107171152 / +1.8% 136593497 / 138677254 / -1.5% 0.80 / 0.77 / +3.3%
tpcds_q24/datafusion:parquet 95790142 / 96526930 / -0.8% 124303887 / 123398751 / +0.7% 0.77 / 0.78 / -1.5%
tpcds_q25/datafusion:parquet 79745857 / 77804962 / +2.5% 104399650 / 105713964 / -1.2% 0.76 / 0.74 / +3.8%
tpcds_q26/datafusion:parquet 44895118 / 44618133 / +0.6% 62181636 / 62666563 / -0.8% 0.72 / 0.71 / +1.4%
tpcds_q27/datafusion:parquet 74846660 / 75564924 / -1.0% 95401990 / 100794690 / -5.4% 0.78 / 0.75 / +4.6%
tpcds_q28/datafusion:parquet 28008400 / 27639130 / +1.3% 43836393 / 45768610 / -4.2% 0.64 / 0.60 / +5.8%
tpcds_q29/datafusion:parquet 79408937 / 78670019 / +0.9% 105852125 / 106074733 / -0.2% 0.75 / 0.74 / +1.2%
tpcds_q30/datafusion:parquet 44087118 / 43606824 / +1.1% 62686212 / 67228665 / -6.8% 0.70 / 0.65 / +8.4%
tpcds_q31/datafusion:parquet 80597329 / 80350442 / +0.3% 102464857 / 105509294 / -2.9% 0.79 / 0.76 / +3.3%
tpcds_q32/datafusion:parquet 23668524 / 23473266 / +0.8% 40861075 / 40558871 / +0.7% 0.58 / 0.58 / +0.1%
tpcds_q33/datafusion:parquet 33280820 / 33548364 / -0.8% 51450210 / 51657424 / -0.4% 0.65 / 0.65 / -0.4%
tpcds_q34/datafusion:parquet 23208692 / 22745654 / +2.0% 38635585 / 38462792 / +0.4% 0.60 / 0.59 / +1.6%
tpcds_q35/datafusion:parquet 51853326 / 49609160 / +4.5% 70031768 / 72334149 / -3.2% 0.74 / 0.69 / +8.0%
tpcds_q36/datafusion:parquet 53896692 / 52881124 / +1.9% 72897399 / 76422148 / -4.6% 0.74 / 0.69 / +6.8%
tpcds_q37/datafusion:parquet 22471994 / 22807922 / -1.5% 37808271 / 38522342 / -1.9% 0.59 / 0.59 / +0.4%
tpcds_q38/datafusion:parquet 43528944 / 43881712 / -0.8% 64270033 / 64677121 / -0.6% 0.68 / 0.68 / -0.2%
tpcds_q39/datafusion:parquet 71721703 / 71887034 / -0.2% 89483608 / 86917245 / +3.0% 0.80 / 0.83 / -3.1%
tpcds_q40/datafusion:parquet 29497722 / 30968234 / -4.7% 50807106 / 49620286 / +2.4% 0.58 / 0.62 / -7.0%
tpcds_q41/datafusion:parquet 17425024 / 17218924 / +1.2% 28771551 / 28451826 / +1.1% 0.61 / 0.61 / +0.1%
tpcds_q42/datafusion:parquet 15381931 / 15234257 / +1.0% 28718240 / 29115124 / -1.4% 0.54 / 0.52 / +2.4%
tpcds_q43/datafusion:parquet 17775952 / 17510014 / +1.5% 31962806 / 32521362 / -1.7% 0.56 / 0.54 / +3.3%
tpcds_q44/datafusion:parquet 33228098 / 33665100 / -1.3% 51396980 / 53571172 / -4.1% 0.65 / 0.63 / +2.9%
tpcds_q45/datafusion:parquet 37353506 / 37217536 / +0.4% 53763218 / 53600611 / +0.3% 0.69 / 0.69 / +0.1%
tpcds_q46/datafusion:parquet 28453546 / 28438854 / +0.1% 49442893 / 50330379 / -1.8% 0.58 / 0.57 / +1.8%
tpcds_q47/datafusion:parquet 95748916 / 95987674 / -0.2% 122488654 / 125113615 / -2.1% 0.78 / 0.77 / +1.9%
tpcds_q48/datafusion:parquet 39374898 / 39185256 / +0.5% 59447084 / 57740887 / +3.0% 0.66 / 0.68 / -2.4%
tpcds_q49/datafusion:parquet 73688642 / 75652764 / -2.6% 103907712 / 96779951 / +7.4% 0.71 / 0.78 / -9.3%
tpcds_q50/datafusion:parquet 50632704 / 51150980 / -1.0% 71652170 / 71362391 / +0.4% 0.71 / 0.72 / -1.4%
tpcds_q51/datafusion:parquet 66992905 / 67001768 / -0.0% 88857090 / 91454908 / -2.8% 0.75 / 0.73 / +2.9%
tpcds_q52/datafusion:parquet 15780903 / 15840271 / -0.4% 30467699 / 30794836 / -1.1% 0.52 / 0.51 / +0.7%
tpcds_q53/datafusion:parquet 21860944 / 21697714 / +0.8% 38554517 / 38778952 / -0.6% 0.57 / 0.56 / +1.3%
tpcds_q54/datafusion:parquet 46062676 / 45423444 / +1.4% 69249835 / 66321987 / +4.4% 0.67 / 0.68 / -2.9%
tpcds_q55/datafusion:parquet 15757704 / 15524225 / +1.5% 28717965 / 29603190 / -3.0% 0.55 / 0.52 / +4.6%
tpcds_q56/datafusion:parquet 30947264 / 31329062 / -1.2% 53975551 / 51721617 / +4.4% 0.57 / 0.61 / -5.3%
tpcds_q57/datafusion:parquet 99046018 / 98804223 / +0.2% 121716350 / 123026216 / -1.1% 0.81 / 0.80 / +1.3%
tpcds_q58/datafusion:parquet 64779146 / 65097936 / -0.5% 85616713 / 87208951 / -1.8% 0.76 / 0.75 / +1.4%
tpcds_q59/datafusion:parquet 42858284 / 42777760 / +0.2% 63894075 / 64354884 / -0.7% 0.67 / 0.66 / +0.9%
tpcds_q60/datafusion:parquet 32372832 / 30943329 / +4.6% 52059699 / 53523773 / -2.7% 0.62 / 0.58 / +7.6%
tpcds_q61/datafusion:parquet 34091011 / 33415304 / +2.0% 55602275 / 55201021 / +0.7% 0.61 / 0.61 / +1.3%
tpcds_q62/datafusion:parquet 24128862 / 24088340 / +0.2% 38763479 / 39349050 / -1.5% 0.62 / 0.61 / +1.7%
tpcds_q63/datafusion:parquet 22019756 / 21500376 / +2.4% 38338038 / 39141226 / -2.1% 0.57 / 0.55 / +4.6%
tpcds_q64/datafusion:parquet 205333428 / 201258087 / +2.0% 243276288 / 239196878 / +1.7% 0.84 / 0.84 / +0.3%
tpcds_q65/datafusion:parquet 39041766 / 38660654 / +1.0% 60871529 / 60629815 / +0.4% 0.64 / 0.64 / +0.6%
tpcds_q66/datafusion:parquet 61743520 / 62271947 / -0.8% 78245456 / 79549731 / -1.6% 0.79 / 0.78 / +0.8%
tpcds_q67/datafusion:parquet 69619128 / 69684785 / -0.1% 95981686 / 97094986 / -1.1% 0.73 / 0.72 / +1.1%
tpcds_q68/datafusion:parquet 29330382 / 28945978 / +1.3% 50294473 / 52500902 / -4.2% 0.58 / 0.55 / +5.8%
tpcds_q69/datafusion:parquet 40545923 / 42896362 / -5.5% 59770185 / 59477417 / +0.5% 0.68 / 0.72 / -5.9%
tpcds_q70/datafusion:parquet 32626921 / 32317643 / +1.0% 55345867 / 56311933 / -1.7% 0.59 / 0.57 / +2.7%
tpcds_q71/datafusion:parquet 22931458 / 23500122 / -2.4% 39177100 / 38725887 / +1.2% 0.59 / 0.61 / -3.5%
tpcds_q72/datafusion:parquet 551675382 / 549276922 / +0.4% 569001313 / 574801498 / -1.0% 0.97 / 0.96 / +1.5%
tpcds_q73/datafusion:parquet 22449344 / 21942422 / +2.3% 38254015 / 38403214 / -0.4% 0.59 / 0.57 / +2.7%
tpcds_q74/datafusion:parquet 66377785 / 66709030 / -0.5% 84283896 / 88564633 / -4.8% 0.79 / 0.75 / +4.6%
tpcds_q75/datafusion:parquet 147481276 / 149676739 / -1.5% 173241820 / 174177362 / -0.5% 0.85 / 0.86 / -0.9%
tpcds_q76/datafusion:parquet 47662206 / 48613137 / -2.0% 66599528 / 67804157 / -1.8% 0.72 / 0.72 / -0.2%
tpcds_q77/datafusion:parquet 53636796 / 52317268 / +2.5% 74212234 / 74249062 / -0.0% 0.72 / 0.70 / +2.6%
tpcds_q78/datafusion:parquet 92275257 / 91622188 / +0.7% 124248537 / 125114114 / -0.7% 0.74 / 0.73 / +1.4%
tpcds_q79/datafusion:parquet 25648838 / 25503970 / +0.6% 45057155 / 46378293 / -2.8% 0.57 / 0.55 / +3.5%
tpcds_q80/datafusion:parquet 81848882 / 83885424 / -2.4% 113512983 / 113600947 / -0.1% 0.72 / 0.74 / -2.4%
tpcds_q81/datafusion:parquet 38871396 / 39047937 / -0.5% 59089399 / 61311211 / -3.6% 0.66 / 0.64 / +3.3%
tpcds_q82/datafusion:parquet 25712677 / 25268415 / +1.8% 39694127 / 40153038 / -1.1% 0.65 / 0.63 / +2.9%
tpcds_q83/datafusion:parquet 47449761 / 47741840 / -0.6% 68065708 / 68015797 / +0.1% 0.70 / 0.70 / -0.7%
tpcds_q84/datafusion:parquet 28786050 / 29876194 / -3.6% 45982572 / 44132896 / +4.2% 0.63 / 0.68 / -7.5%
tpcds_q85/datafusion:parquet 87677258 / 87304253 / +0.4% 110070606 / 108766625 / +1.2% 0.80 / 0.80 / -0.8%
tpcds_q86/datafusion:parquet 20763342 / 21190204 / -2.0% 33911996 / 33686295 / +0.7% 0.61 / 0.63 / -2.7%
tpcds_q87/datafusion:parquet 42958548 / 43942481 / -2.2% 62610657 / 60058042 / +4.3% 0.69 / 0.73 / -6.2%
tpcds_q88/datafusion:parquet 38392822 / 38647036 / -0.7% 63085387 / 57821083 / +9.1% 0.61 / 0.67 / -8.9%
tpcds_q89/datafusion:parquet 25419887 / 25562753 / -0.6% 42827990 / 43132662 / -0.7% 0.59 / 0.59 / +0.1%
tpcds_q90/datafusion:parquet 15796901 / 15689754 / +0.7% 29327881 / 30134285 / -2.7% 0.54 / 0.52 / +3.5%
tpcds_q91/datafusion:parquet 31388307 / 32275253 / -2.7% 50233068 / 48438645 / +3.7% 0.62 / 0.67 / -6.2%
tpcds_q92/datafusion:parquet 23704304 / 23579980 / +0.5% 40436478 / 40712281 / -0.7% 0.59 / 0.58 / +1.2%
tpcds_q93/datafusion:parquet 27974566 / 27855154 / +0.4% 49271535 / 49177777 / +0.2% 0.57 / 0.57 / +0.2%
tpcds_q94/datafusion:parquet 31643321 / 31781467 / -0.4% 48234400 / 49716059 / -3.0% 0.66 / 0.64 / +2.6%
tpcds_q95/datafusion:parquet 65214917 / 65101614 / +0.2% 81265512 / 84187548 / -3.5% 0.80 / 0.77 / +3.8%
tpcds_q96/datafusion:parquet 12877933 / 12680849 / +1.6% 27649677 / 28407169 / -2.7% 0.47 / 0.45 / +4.3%
tpcds_q97/datafusion:parquet 31822118 / 32283688 / -1.4% 51648706 / 52624699 / -1.9% 0.62 / 0.61 / +0.4%
tpcds_q98/datafusion:parquet 22510683 / 22707494 / -0.9% 37683950 / 39146881 / -3.7% 0.60 / 0.58 / +3.0%
tpcds_q99/datafusion:parquet 28632677 / 28290862 / +1.2% 43610810 / 42257588 / +3.2% 0.66 / 0.67 / -1.9%
duckdb / vortex-file-compressed / ns (1.000x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15074509 / 15028140 / +0.3% 24207984 / 22641719 / +6.9% 0.62 / 0.66 / -6.2%
tpcds_q02/duckdb:vortex-file-compressed 14897858 / 15002612 / -0.7% 19900239 / 20679468 / -3.8% 0.75 / 0.73 / +3.2%
tpcds_q03/duckdb:vortex-file-compressed 10779768 / 10806488 / -0.2% 22191619 / 20075461 / +10.5% 🔴 0.49 / 0.54 / -9.8%
tpcds_q04/duckdb:vortex-file-compressed 50634940 / 50451815 / +0.4% 59204378 / 60966437 / -2.9% 0.86 / 0.83 / +3.4%
tpcds_q05/duckdb:vortex-file-compressed 18464966 / 18821514 / -1.9% 25189650 / 25659140 / -1.8% 0.73 / 0.73 / -0.1%
tpcds_q06/duckdb:vortex-file-compressed 28058616 / 26858796 / +4.5% 39272655 / 40718353 / -3.6% 0.71 / 0.66 / +8.3%
tpcds_q07/duckdb:vortex-file-compressed 17437992 / 15440860 / +12.9% 🔴 29233650 / 29726715 / -1.7% 0.60 / 0.52 / +14.8%
tpcds_q08/duckdb:vortex-file-compressed 19059634 / 19039492 / +0.1% 26547989 / 28146145 / -5.7% 0.72 / 0.68 / +6.1%
tpcds_q09/duckdb:vortex-file-compressed 13674472 / 13401422 / +2.0% 21507510 / 22668446 / -5.1% 0.64 / 0.59 / +7.5%
tpcds_q10/duckdb:vortex-file-compressed 27417998 / 27281964 / +0.5% 42400914 / 41417778 / +2.4% 0.65 / 0.66 / -1.8%
tpcds_q11/duckdb:vortex-file-compressed 40175268 / 39957194 / +0.5% 49438121 / 54310548 / -9.0% 0.81 / 0.74 / +10.5%
tpcds_q12/duckdb:vortex-file-compressed 10151506 / 11656934 / -12.9% 🟢 15559264 / 18517877 / -16.0% 🟢 0.65 / 0.63 / +3.6%
tpcds_q13/duckdb:vortex-file-compressed 21846979 / 21014958 / +4.0% 34979346 / 35470883 / -1.4% 0.62 / 0.59 / +5.4%
tpcds_q14/duckdb:vortex-file-compressed 58963722 / 59028498 / -0.1% 71896671 / 72505242 / -0.8% 0.82 / 0.81 / +0.7%
tpcds_q15/duckdb:vortex-file-compressed 20614840 / 20596530 / +0.1% 27314118 / 27522140 / -0.8% 0.75 / 0.75 / +0.9%
tpcds_q16/duckdb:vortex-file-compressed 17135429 / 17374886 / -1.4% 25238038 / 27729864 / -9.0% 0.68 / 0.63 / +8.4%
tpcds_q17/duckdb:vortex-file-compressed 29499663 / 29747970 / -0.8% 43562180 / 44175084 / -1.4% 0.68 / 0.67 / +0.6%
tpcds_q18/duckdb:vortex-file-compressed 28330438 / 28377612 / -0.2% 37148911 / 38473160 / -3.4% 0.76 / 0.74 / +3.4%
tpcds_q19/duckdb:vortex-file-compressed 23549701 / 24026610 / -2.0% 38184657 / 34247219 / +11.5% 🔴 0.62 / 0.70 / -12.1%
tpcds_q20/duckdb:vortex-file-compressed 10791353 / 10527186 / +2.5% 15142271 / 18556364 / -18.4% 🟢 0.71 / 0.57 / +25.6%
tpcds_q21/duckdb:vortex-file-compressed 9572742 / 9644187 / -0.7% 20278426 / 21274338 / -4.7% 0.47 / 0.45 / +4.1%
tpcds_q22/duckdb:vortex-file-compressed 29810105 / 29659088 / +0.5% 44783710 / 39714170 / +12.8% 🔴 0.67 / 0.75 / -10.9%
tpcds_q23/duckdb:vortex-file-compressed 37104991 / 38009054 / -2.4% 45861941 / 49539317 / -7.4% 0.81 / 0.77 / +5.4%
tpcds_q24/duckdb:vortex-file-compressed 28272957 / 27755722 / +1.9% 37462644 / 43149335 / -13.2% 🟢 0.75 / 0.64 / +17.3%
tpcds_q25/duckdb:vortex-file-compressed 25368870 / 25088730 / +1.1% 40422107 / 43169548 / -6.4% 0.63 / 0.58 / +8.0%
tpcds_q26/duckdb:vortex-file-compressed 13194501 / 13180300 / +0.1% 19770112 / 20828203 / -5.1% 0.67 / 0.63 / +5.5%
tpcds_q27/duckdb:vortex-file-compressed 18583854 / 17531542 / +6.0% 29935843 / 30732755 / -2.6% 0.62 / 0.57 / +8.8%
tpcds_q28/duckdb:vortex-file-compressed 12654409 / 12351023 / +2.5% 24497245 / 18896077 / +29.6% 🔴 0.52 / 0.65 / -21.0%
tpcds_q29/duckdb:vortex-file-compressed 28372308 / 28181886 / +0.7% 41275295 / 46858447 / -11.9% 🟢 0.69 / 0.60 / +14.3%
tpcds_q30/duckdb:vortex-file-compressed 18956624 / 19241618 / -1.5% 26884905 / 28523118 / -5.7% 0.71 / 0.67 / +4.5%
tpcds_q31/duckdb:vortex-file-compressed 18855056 / 19056245 / -1.1% 26053169 / 28617848 / -9.0% 0.72 / 0.67 / +8.7%
tpcds_q32/duckdb:vortex-file-compressed 9632388 / 9750236 / -1.2% 16072126 / 15956933 / +0.7% 0.60 / 0.61 / -1.9%
tpcds_q33/duckdb:vortex-file-compressed 16533037 / 16563572 / -0.2% 26077177 / 28268703 / -7.8% 0.63 / 0.59 / +8.2%
tpcds_q34/duckdb:vortex-file-compressed 15417420 / 15508022 / -0.6% 19679601 / 21953340 / -10.4% 🟢 0.78 / 0.71 / +10.9%
tpcds_q35/duckdb:vortex-file-compressed 46395685 / 45753544 / +1.4% 63667203 / 59657612 / +6.7% 0.73 / 0.77 / -5.0%
tpcds_q36/duckdb:vortex-file-compressed 15978064 / 15023648 / +6.4% 28595553 / 30983771 / -7.7% 0.56 / 0.48 / +15.2%
tpcds_q37/duckdb:vortex-file-compressed 13720983 / 13887742 / -1.2% 24502969 / 26256457 / -6.7% 0.56 / 0.53 / +5.9%
tpcds_q38/duckdb:vortex-file-compressed 22137665 / 22572280 / -1.9% 29272086 / 28768592 / +1.8% 0.76 / 0.78 / -3.6%
tpcds_q39/duckdb:vortex-file-compressed 18148004 / 18161864 / -0.1% 26070565 / 31005840 / -15.9% 🟢 0.70 / 0.59 / +18.8%
tpcds_q40/duckdb:vortex-file-compressed 13262100 / 12984422 / +2.1% 18418730 / 19963876 / -7.7% 0.72 / 0.65 / +10.7%
tpcds_q41/duckdb:vortex-file-compressed 6409373 / 6420614 / -0.2% 9554931 / 9327083 / +2.4% 0.67 / 0.69 / -2.6%
tpcds_q42/duckdb:vortex-file-compressed 7824372 / 8353295 / -6.3% 18496358 / 17677511 / +4.6% 0.42 / 0.47 / -10.5%
tpcds_q43/duckdb:vortex-file-compressed 10167201 / 10081731 / +0.8% 17560187 / 18389739 / -4.5% 0.58 / 0.55 / +5.6%
tpcds_q44/duckdb:vortex-file-compressed 15892332 / 15021975 / +5.8% 23753111 / 29506471 / -19.5% 🟢 0.67 / 0.51 / +31.4%
tpcds_q45/duckdb:vortex-file-compressed 22044558 / 22048853 / -0.0% 29383482 / 29865760 / -1.6% 0.75 / 0.74 / +1.6%
tpcds_q46/duckdb:vortex-file-compressed 18444536 / 18747524 / -1.6% 28676848 / 30045228 / -4.6% 0.64 / 0.62 / +3.1%
tpcds_q47/duckdb:vortex-file-compressed 30717294 / 31074586 / -1.1% 42984891 / 42117555 / +2.1% 0.71 / 0.74 / -3.1%
tpcds_q48/duckdb:vortex-file-compressed 18825807 / 19029018 / -1.1% 28343234 / 30842583 / -8.1% 0.66 / 0.62 / +7.7%
tpcds_q49/duckdb:vortex-file-compressed 16540313 / 16853259 / -1.9% 27480280 / 31114280 / -11.7% 🟢 0.60 / 0.54 / +11.1%
tpcds_q50/duckdb:vortex-file-compressed 16633533 / 16586608 / +0.3% 26048563 / 28452513 / -8.4% 0.64 / 0.58 / +9.5%
tpcds_q51/duckdb:vortex-file-compressed 76354736 / 75822298 / +0.7% 61813767 / 87821918 / -29.6% 🟢 1.24 / 0.86 / +43.1%
tpcds_q52/duckdb:vortex-file-compressed 9812732 / 9311128 / +5.4% 17567359 / 21673351 / -18.9% 🟢 0.56 / 0.43 / +30.0%
tpcds_q53/duckdb:vortex-file-compressed 14083777 / 14158006 / -0.5% 23041919 / 24785266 / -7.0% 0.61 / 0.57 / +7.0%
tpcds_q54/duckdb:vortex-file-compressed 19909131 / 20034388 / -0.6% 30548656 / 31497364 / -3.0% 0.65 / 0.64 / +2.5%
tpcds_q55/duckdb:vortex-file-compressed 8542916 / 8366954 / +2.1% 19698322 / 20814479 / -5.4% 0.43 / 0.40 / +7.9%
tpcds_q56/duckdb:vortex-file-compressed 17106058 / 16850216 / +1.5% 28128549 / 30375117 / -7.4% 0.61 / 0.55 / +9.6%
tpcds_q57/duckdb:vortex-file-compressed 24057788 / 26326620 / -8.6% 34083038 / 33919611 / +0.5% 0.71 / 0.78 / -9.1%
tpcds_q58/duckdb:vortex-file-compressed 17714074 / 17359000 / +2.0% 26520684 / 28079592 / -5.6% 0.67 / 0.62 / +8.0%
tpcds_q59/duckdb:vortex-file-compressed 18550013 / 18303160 / +1.3% 27892059 / 28077733 / -0.7% 0.67 / 0.65 / +2.0%
tpcds_q60/duckdb:vortex-file-compressed 18089192 / 18034662 / +0.3% 27494901 / 30217600 / -9.0% 0.66 / 0.60 / +10.2%
tpcds_q61/duckdb:vortex-file-compressed 19097854 / 19482374 / -2.0% 29613050 / 32535964 / -9.0% 0.64 / 0.60 / +7.7%
tpcds_q62/duckdb:vortex-file-compressed 10218268 / 10268040 / -0.5% 17569188 / 15927685 / +10.3% 🔴 0.58 / 0.64 / -9.8%
tpcds_q63/duckdb:vortex-file-compressed 13294360 / 13624705 / -2.4% 23541184 / 23570729 / -0.1% 0.56 / 0.58 / -2.3%
tpcds_q64/duckdb:vortex-file-compressed 61818920 / 61753098 / +0.1% 76623131 / 78911023 / -2.9% 0.81 / 0.78 / +3.1%
tpcds_q65/duckdb:vortex-file-compressed 16071002 / 15480352 / +3.8% 24715486 / 27377719 / -9.7% 0.65 / 0.57 / +15.0%
tpcds_q66/duckdb:vortex-file-compressed 20884004 / 20910322 / -0.1% 32558081 / 29436065 / +10.6% 🔴 0.64 / 0.71 / -9.7%
tpcds_q67/duckdb:vortex-file-compressed 66134476 / 65205254 / +1.4% 82437333 / 81475265 / +1.2% 0.80 / 0.80 / +0.2%
tpcds_q68/duckdb:vortex-file-compressed 17994411 / 18139630 / -0.8% 27945079 / 31012984 / -9.9% 0.64 / 0.58 / +10.1%
tpcds_q69/duckdb:vortex-file-compressed 28479939 / 28644785 / -0.6% 41144887 / 42804962 / -3.9% 0.69 / 0.67 / +3.4%
tpcds_q70/duckdb:vortex-file-compressed 18640200 / 18568400 / +0.4% 33062291 / 29187503 / +13.3% 🔴 0.56 / 0.64 / -11.4%
tpcds_q71/duckdb:vortex-file-compressed 12554730 / 12385923 / +1.4% 24575273 / 24596899 / -0.1% 0.51 / 0.50 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed 62087840 / 61703726 / +0.6% 76893831 / 77436233 / -0.7% 0.81 / 0.80 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed 14740968 / 14660914 / +0.5% 19370940 / 20829802 / -7.0% 0.76 / 0.70 / +8.1%
tpcds_q74/duckdb:vortex-file-compressed 27179545 / 27392072 / -0.8% 35666124 / 38183594 / -6.6% 0.76 / 0.72 / +6.2%
tpcds_q75/duckdb:vortex-file-compressed 29024506 / 27888947 / +4.1% 41342012 / 39515421 / +4.6% 0.70 / 0.71 / -0.5%
tpcds_q76/duckdb:vortex-file-compressed 12336252 / 12047214 / +2.4% 22273203 / 26276573 / -15.2% 🟢 0.55 / 0.46 / +20.8%
tpcds_q77/duckdb:vortex-file-compressed 15940506 / 15897432 / +0.3% 22908106 / 24555184 / -6.7% 0.70 / 0.65 / +7.5%
tpcds_q78/duckdb:vortex-file-compressed 36751632 / 37448453 / -1.9% 45921337 / 48380874 / -5.1% 0.80 / 0.77 / +3.4%
tpcds_q79/duckdb:vortex-file-compressed 14216353 / 17176802 / -17.2% 🟢 22647251 / 26216231 / -13.6% 🟢 0.63 / 0.66 / -4.2%
tpcds_q80/duckdb:vortex-file-compressed 27139724 / 27691296 / -2.0% 40035136 / 46292762 / -13.5% 🟢 0.68 / 0.60 / +13.3%
tpcds_q81/duckdb:vortex-file-compressed 22216588 / 22271072 / -0.2% 30231958 / 32289923 / -6.4% 0.73 / 0.69 / +6.5%
tpcds_q82/duckdb:vortex-file-compressed 31987156 / 32001928 / -0.0% 39130678 / 39684580 / -1.4% 0.82 / 0.81 / +1.4%
tpcds_q83/duckdb:vortex-file-compressed 19550728 / 19697421 / -0.7% 24984721 / 25551810 / -2.2% 0.78 / 0.77 / +1.5%
tpcds_q84/duckdb:vortex-file-compressed 12602726 / 12694464 / -0.7% 21959754 / 21835235 / +0.6% 0.57 / 0.58 / -1.3%
tpcds_q85/duckdb:vortex-file-compressed 30745602 / 30770178 / -0.1% 38485985 / 39918952 / -3.6% 0.80 / 0.77 / +3.6%
tpcds_q86/duckdb:vortex-file-compressed 10606876 / 10559662 / +0.4% 17715770 / 19629786 / -9.8% 0.60 / 0.54 / +11.3%
tpcds_q87/duckdb:vortex-file-compressed 24188143 / 24437154 / -1.0% 30145980 / 35797484 / -15.8% 🟢 0.80 / 0.68 / +17.5%
tpcds_q88/duckdb:vortex-file-compressed 31959110 / 33891269 / -5.7% 42862149 / 47658761 / -10.1% 🟢 0.75 / 0.71 / +4.9%
tpcds_q89/duckdb:vortex-file-compressed 13930525 / 15251348 / -8.7% 25854781 / 23597257 / +9.6% 0.54 / 0.65 / -16.6%
tpcds_q90/duckdb:vortex-file-compressed 8064072 / 8083491 / -0.2% 14449242 / 14889054 / -3.0% 0.56 / 0.54 / +2.8%
tpcds_q91/duckdb:vortex-file-compressed 15086230 / 15063928 / +0.1% 20991554 / 22473537 / -6.6% 0.72 / 0.67 / +7.2%
tpcds_q92/duckdb:vortex-file-compressed 12598099 / 12724530 / -1.0% 20266629 / 21302334 / -4.9% 0.62 / 0.60 / +4.1%
tpcds_q93/duckdb:vortex-file-compressed 16703366 / 17517696 / -4.6% 26305232 / 23595211 / +11.5% 🔴 0.63 / 0.74 / -14.5%
tpcds_q94/duckdb:vortex-file-compressed 15945480 / 16115204 / -1.1% 24979448 / 26610971 / -6.1% 0.64 / 0.61 / +5.4%
tpcds_q95/duckdb:vortex-file-compressed 45340841 / 43772506 / +3.6% 53258433 / 51382986 / +3.6% 0.85 / 0.85 / -0.1%
tpcds_q96/duckdb:vortex-file-compressed 9046177 / 7117592 / +27.1% 🔴 16140989 / 15422856 / +4.7% 0.56 / 0.46 / +21.4%
tpcds_q97/duckdb:vortex-file-compressed 22095796 / 22160806 / -0.3% 28906164 / 29958681 / -3.5% 0.76 / 0.74 / +3.3%
tpcds_q98/duckdb:vortex-file-compressed 13270918 / 13368110 / -0.7% 20732597 / 22268092 / -6.9% 0.64 / 0.60 / +6.6%
tpcds_q99/duckdb:vortex-file-compressed 13339126 / 13365266 / -0.2% 19131121 / 21641836 / -11.6% 🟢 0.70 / 0.62 / +12.9%
duckdb / vortex-compact / ns (1.000x ➖, 4↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16468488 / 16581244 / -0.7% 22567719 / 24064630 / -6.2% 0.73 / 0.69 / +5.9%
tpcds_q02/duckdb:vortex-compact 16474358 / 16245346 / +1.4% 21371761 / 21828182 / -2.1% 0.77 / 0.74 / +3.6%
tpcds_q03/duckdb:vortex-compact 21665004 / 21512062 / +0.7% 34001815 / 36682083 / -7.3% 0.64 / 0.59 / +8.6%
tpcds_q04/duckdb:vortex-compact 53797834 / 53269976 / +1.0% 72277891 / 64389809 / +12.3% 🔴 0.74 / 0.83 / -10.0%
tpcds_q05/duckdb:vortex-compact 24087096 / 23703534 / +1.6% 29773041 / 32057568 / -7.1% 0.81 / 0.74 / +9.4%
tpcds_q06/duckdb:vortex-compact 34141971 / 33341482 / +2.4% 45820378 / 46356538 / -1.2% 0.75 / 0.72 / +3.6%
tpcds_q07/duckdb:vortex-compact 25285148 / 25729087 / -1.7% 34695647 / 34355796 / +1.0% 0.73 / 0.75 / -2.7%
tpcds_q08/duckdb:vortex-compact 48595730 / 49492784 / -1.8% 55442038 / 57080166 / -2.9% 0.88 / 0.87 / +1.1%
tpcds_q09/duckdb:vortex-compact 18876107 / 19382008 / -2.6% 26464678 / 28354949 / -6.7% 0.71 / 0.68 / +4.3%
tpcds_q10/duckdb:vortex-compact 45025708 / 45395650 / -0.8% 56934415 / 57070678 / -0.2% 0.79 / 0.80 / -0.6%
tpcds_q11/duckdb:vortex-compact 45429412 / 45666854 / -0.5% 55695855 / 58439911 / -4.7% 0.82 / 0.78 / +4.4%
tpcds_q12/duckdb:vortex-compact 13568342 / 13384122 / +1.4% 19585530 / 19539899 / +0.2% 0.69 / 0.68 / +1.1%
tpcds_q13/duckdb:vortex-compact 35618384 / 35928688 / -0.9% 48210414 / 47390072 / +1.7% 0.74 / 0.76 / -2.6%
tpcds_q14/duckdb:vortex-compact 65527782 / 67603035 / -3.1% 81616440 / 78321198 / +4.2% 0.80 / 0.86 / -7.0%
tpcds_q15/duckdb:vortex-compact 25943526 / 26106490 / -0.6% 31846102 / 31932043 / -0.3% 0.81 / 0.82 / -0.4%
tpcds_q16/duckdb:vortex-compact 28398071 / 24384883 / +16.5% 🔴 44352608 / 35470422 / +25.0% 🔴 0.64 / 0.69 / -6.9%
tpcds_q17/duckdb:vortex-compact 44794382 / 45064081 / -0.6% 56892666 / 57631077 / -1.3% 0.79 / 0.78 / +0.7%
tpcds_q18/duckdb:vortex-compact 35793842 / 35561983 / +0.7% 44456739 / 45588346 / -2.5% 0.81 / 0.78 / +3.2%
tpcds_q19/duckdb:vortex-compact 35589513 / 36315351 / -2.0% 43619674 / 43752012 / -0.3% 0.82 / 0.83 / -1.7%
tpcds_q20/duckdb:vortex-compact 14249846 / 13812651 / +3.2% 19226524 / 18957539 / +1.4% 0.74 / 0.73 / +1.7%
tpcds_q21/duckdb:vortex-compact 13718090 / 10357162 / +32.5% 🔴 18180320 / 21555193 / -15.7% 🟢 0.75 / 0.48 / +57.0%
tpcds_q22/duckdb:vortex-compact 30616973 / 35803342 / -14.5% 🟢 39286909 / 40750033 / -3.6% 0.78 / 0.88 / -11.3%
tpcds_q23/duckdb:vortex-compact 43475530 / 43335170 / +0.3% 54143915 / 52908169 / +2.3% 0.80 / 0.82 / -2.0%
tpcds_q24/duckdb:vortex-compact 39627020 / 39626235 / +0.0% 47762633 / 52695767 / -9.4% 0.83 / 0.75 / +10.3%
tpcds_q25/duckdb:vortex-compact 43386264 / 42673014 / +1.7% 60944826 / 55200904 / +10.4% 🔴 0.71 / 0.77 / -7.9%
tpcds_q26/duckdb:vortex-compact 22291188 / 22224346 / +0.3% 27227354 / 27074531 / +0.6% 0.82 / 0.82 / -0.3%
tpcds_q27/duckdb:vortex-compact 29941284 / 28433770 / +5.3% 36910266 / 43760037 / -15.7% 🟢 0.81 / 0.65 / +24.8%
tpcds_q28/duckdb:vortex-compact 22323364 / 22283394 / +0.2% 31723352 / 34526274 / -8.1% 0.70 / 0.65 / +9.0%
tpcds_q29/duckdb:vortex-compact 43973014 / 44350607 / -0.9% 62468972 / 56294268 / +11.0% 🔴 0.70 / 0.79 / -10.7%
tpcds_q30/duckdb:vortex-compact 22520642 / 22410322 / +0.5% 29556848 / 30469930 / -3.0% 0.76 / 0.74 / +3.6%
tpcds_q31/duckdb:vortex-compact 23556896 / 23493624 / +0.3% 32359336 / 30518241 / +6.0% 0.73 / 0.77 / -5.4%
tpcds_q32/duckdb:vortex-compact 13957647 / 14168964 / -1.5% 19773203 / 21730241 / -9.0% 0.71 / 0.65 / +8.3%
tpcds_q33/duckdb:vortex-compact 22882114 / 23161904 / -1.2% 31771286 / 34949553 / -9.1% 0.72 / 0.66 / +8.7%
tpcds_q34/duckdb:vortex-compact 23134120 / 21972506 / +5.3% 28457391 / 29347850 / -3.0% 0.81 / 0.75 / +8.6%
tpcds_q35/duckdb:vortex-compact 61310735 / 61267740 / +0.1% 73492003 / 77596996 / -5.3% 0.83 / 0.79 / +5.7%
tpcds_q36/duckdb:vortex-compact 22213260 / 21992498 / +1.0% 32513721 / 31303369 / +3.9% 0.68 / 0.70 / -2.8%
tpcds_q37/duckdb:vortex-compact 14880092 / 15469520 / -3.8% 27318964 / 25107712 / +8.8% 0.54 / 0.62 / -11.6%
tpcds_q38/duckdb:vortex-compact 26243690 / 26595508 / -1.3% 32734385 / 32315603 / +1.3% 0.80 / 0.82 / -2.6%
tpcds_q39/duckdb:vortex-compact 19885066 / 19514934 / +1.9% 28329203 / 27626922 / +2.5% 0.70 / 0.71 / -0.6%
tpcds_q40/duckdb:vortex-compact 16070874 / 15944485 / +0.8% 20941795 / 21352533 / -1.9% 0.77 / 0.75 / +2.8%
tpcds_q41/duckdb:vortex-compact 7779488 / 7459492 / +4.3% 10895146 / 10366269 / +5.1% 0.71 / 0.72 / -0.8%
tpcds_q42/duckdb:vortex-compact 11892248 / 11787250 / +0.9% 19344449 / 20361820 / -5.0% 0.61 / 0.58 / +6.2%
tpcds_q43/duckdb:vortex-compact 16087400 / 16171238 / -0.5% 22842083 / 25149217 / -9.2% 0.70 / 0.64 / +9.5%
tpcds_q44/duckdb:vortex-compact 22782812 / 22539606 / +1.1% 33367329 / 34212952 / -2.5% 0.68 / 0.66 / +3.6%
tpcds_q45/duckdb:vortex-compact 27216758 / 27181128 / +0.1% 33173985 / 32419242 / +2.3% 0.82 / 0.84 / -2.1%
tpcds_q46/duckdb:vortex-compact 28746522 / 33060026 / -13.0% 🟢 51443012 / 38585922 / +33.3% 🔴 0.56 / 0.86 / -34.8%
tpcds_q47/duckdb:vortex-compact 37028244 / 36283784 / +2.1% 52298051 / 46434322 / +12.6% 🔴 0.71 / 0.78 / -9.4%
tpcds_q48/duckdb:vortex-compact 32785106 / 32954236 / -0.5% 47466860 / 46249528 / +2.6% 0.69 / 0.71 / -3.1%
tpcds_q49/duckdb:vortex-compact 23276522 / 24267008 / -4.1% 34906696 / 36314050 / -3.9% 0.67 / 0.67 / -0.2%
tpcds_q50/duckdb:vortex-compact 26839654 / 27510532 / -2.4% 34308742 / 35332825 / -2.9% 0.78 / 0.78 / +0.5%
tpcds_q51/duckdb:vortex-compact 53308593 / 54052336 / -1.4% 62416541 / 65913274 / -5.3% 0.85 / 0.82 / +4.1%
tpcds_q52/duckdb:vortex-compact 13295486 / 11786770 / +12.8% 🔴 19264835 / 20981309 / -8.2% 0.69 / 0.56 / +22.9%
tpcds_q53/duckdb:vortex-compact 21010878 / 21067218 / -0.3% 28602247 / 28994496 / -1.4% 0.73 / 0.73 / +1.1%
tpcds_q54/duckdb:vortex-compact 27367680 / 27179272 / +0.7% 34839815 / 34868786 / -0.1% 0.79 / 0.78 / +0.8%
tpcds_q55/duckdb:vortex-compact 11992536 / 14189044 / -15.5% 🟢 20365428 / 21659760 / -6.0% 0.59 / 0.66 / -10.1%
tpcds_q56/duckdb:vortex-compact 23508794 / 24166286 / -2.7% 31801734 / 35515838 / -10.5% 🟢 0.74 / 0.68 / +8.6%
tpcds_q57/duckdb:vortex-compact 28623380 / 27943973 / +2.4% 35953081 / 36089785 / -0.4% 0.80 / 0.77 / +2.8%
tpcds_q58/duckdb:vortex-compact 24037094 / 24169703 / -0.5% 35378515 / 33207306 / +6.5% 0.68 / 0.73 / -6.7%
tpcds_q59/duckdb:vortex-compact 23236228 / 23094405 / +0.6% 28658135 / 29396248 / -2.5% 0.81 / 0.79 / +3.2%
tpcds_q60/duckdb:vortex-compact 24180830 / 24534628 / -1.4% 33560225 / 38559468 / -13.0% 🟢 0.72 / 0.64 / +13.2%
tpcds_q61/duckdb:vortex-compact 33422306 / 31776826 / +5.2% 43104303 / 44094210 / -2.2% 0.78 / 0.72 / +7.6%
tpcds_q62/duckdb:vortex-compact 11533340 / 11766502 / -2.0% 18669987 / 22312165 / -16.3% 🟢 0.62 / 0.53 / +17.1%
tpcds_q63/duckdb:vortex-compact 20086822 / 20325150 / -1.2% 32447284 / 30613587 / +6.0% 0.62 / 0.66 / -6.8%
tpcds_q64/duckdb:vortex-compact 84754260 / 84326551 / +0.5% 95556379 / 97797542 / -2.3% 0.89 / 0.86 / +2.9%
tpcds_q65/duckdb:vortex-compact 20477851 / 19257690 / +6.3% 30568736 / 28913186 / +5.7% 0.67 / 0.67 / +0.6%
tpcds_q66/duckdb:vortex-compact 25130054 / 25856089 / -2.8% 36167177 / 34311322 / +5.4% 0.69 / 0.75 / -7.8%
tpcds_q67/duckdb:vortex-compact 71763054 / 71621513 / +0.2% 85885794 / 92886660 / -7.5% 0.84 / 0.77 / +8.4%
tpcds_q68/duckdb:vortex-compact 30262289 / 28731184 / +5.3% 39469875 / 41818998 / -5.6% 0.77 / 0.69 / +11.6%
tpcds_q69/duckdb:vortex-compact 46334908 / 46757061 / -0.9% 59682246 / 60619767 / -1.5% 0.78 / 0.77 / +0.7%
tpcds_q70/duckdb:vortex-compact 30902692 / 31157466 / -0.8% 38776432 / 39796889 / -2.6% 0.80 / 0.78 / +1.8%
tpcds_q71/duckdb:vortex-compact 19689246 / 22219510 / -11.4% 🟢 29479726 / 29586144 / -0.4% 0.67 / 0.75 / -11.1%
tpcds_q72/duckdb:vortex-compact 70202730 / 68550550 / +2.4% 83689898 / 81692322 / +2.4% 0.84 / 0.84 / -0.0%
tpcds_q73/duckdb:vortex-compact 21486178 / 21327240 / +0.7% 29312025 / 31609398 / -7.3% 0.73 / 0.67 / +8.6%
tpcds_q74/duckdb:vortex-compact 31836652 / 31826664 / +0.0% 43762356 / 41612298 / +5.2% 0.73 / 0.76 / -4.9%
tpcds_q75/duckdb:vortex-compact 33383970 / 32937250 / +1.4% 43473210 / 46721068 / -7.0% 0.77 / 0.70 / +8.9%
tpcds_q76/duckdb:vortex-compact 16439334 / 16638721 / -1.2% 25933159 / 27259749 / -4.9% 0.63 / 0.61 / +3.9%
tpcds_q77/duckdb:vortex-compact 22317134 / 22716558 / -1.8% 29901021 / 31714907 / -5.7% 0.75 / 0.72 / +4.2%
tpcds_q78/duckdb:vortex-compact 41774846 / 41652114 / +0.3% 53657475 / 51955106 / +3.3% 0.78 / 0.80 / -2.9%
tpcds_q79/duckdb:vortex-compact 37456446 / 37415058 / +0.1% 47000391 / 49660221 / -5.4% 0.80 / 0.75 / +5.8%
tpcds_q80/duckdb:vortex-compact 36102922 / 36932048 / -2.2% 48710512 / 56354344 / -13.6% 🟢 0.74 / 0.66 / +13.1%
tpcds_q81/duckdb:vortex-compact 24470696 / 24264452 / +0.8% 31415816 / 32038329 / -1.9% 0.78 / 0.76 / +2.8%
tpcds_q82/duckdb:vortex-compact 35843272 / 35979625 / -0.4% 42566361 / 43056898 / -1.1% 0.84 / 0.84 / +0.8%
tpcds_q83/duckdb:vortex-compact 28468392 / 29356466 / -3.0% 32181029 / 33593788 / -4.2% 0.88 / 0.87 / +1.2%
tpcds_q84/duckdb:vortex-compact 15073359 / 16468202 / -8.5% 24111827 / 22141931 / +8.9% 0.63 / 0.74 / -15.9%
tpcds_q85/duckdb:vortex-compact 41297425 / 41271176 / +0.1% 49339428 / 50072850 / -1.5% 0.84 / 0.82 / +1.6%
tpcds_q86/duckdb:vortex-compact 13105677 / 11984870 / +9.4% 19082764 / 18329482 / +4.1% 0.69 / 0.65 / +5.0%
tpcds_q87/duckdb:vortex-compact 28159026 / 28011252 / +0.5% 34481013 / 34737313 / -0.7% 0.82 / 0.81 / +1.3%
tpcds_q88/duckdb:vortex-compact 66900464 / 68327674 / -2.1% 79733420 / 83782338 / -4.8% 0.84 / 0.82 / +2.9%
tpcds_q89/duckdb:vortex-compact 20471643 / 21045858 / -2.7% 27911018 / 29162815 / -4.3% 0.73 / 0.72 / +1.6%
tpcds_q90/duckdb:vortex-compact 12598417 / 13527467 / -6.9% 18299692 / 20253491 / -9.6% 0.69 / 0.67 / +3.1%
tpcds_q91/duckdb:vortex-compact 30087944 / 30262048 / -0.6% 38445345 / 37675571 / +2.0% 0.78 / 0.80 / -2.6%
tpcds_q92/duckdb:vortex-compact 20205864 / 20176920 / +0.1% 26210818 / 28225549 / -7.1% 0.77 / 0.71 / +7.8%
tpcds_q93/duckdb:vortex-compact 19703630 / 18795296 / +4.8% 25646030 / 29880221 / -14.2% 🟢 0.77 / 0.63 / +22.1%
tpcds_q94/duckdb:vortex-compact 21873552 / 22107170 / -1.1% 35590651 / 30875124 / +15.3% 🔴 0.61 / 0.72 / -14.2%
tpcds_q95/duckdb:vortex-compact 46858677 / 46608886 / +0.5% 57426135 / 55722195 / +3.1% 0.82 / 0.84 / -2.4%
tpcds_q96/duckdb:vortex-compact 16837968 / 17070303 / -1.4% 25199339 / 23821804 / +5.8% 0.67 / 0.72 / -6.8%
tpcds_q97/duckdb:vortex-compact 25517410 / 25023855 / +2.0% 30945194 / 33280889 / -7.0% 0.82 / 0.75 / +9.7%
tpcds_q98/duckdb:vortex-compact 18256940 / 18093285 / +0.9% 26845004 / 27908546 / -3.8% 0.68 / 0.65 / +4.9%
tpcds_q99/duckdb:vortex-compact 16875823 / 16770814 / +0.6% 23220479 / 25799815 / -10.0% 0.73 / 0.65 / +11.8%
duckdb / parquet / ns (1.001x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 25615496 / 24799706 / +3.3% 34252928 / 33973745 / +0.8% 0.75 / 0.73 / +2.4%
tpcds_q02/duckdb:parquet 15828953 / 15595350 / +1.5% 20608357 / 21421456 / -3.8% 0.77 / 0.73 / +5.5%
tpcds_q03/duckdb:parquet 9240298 / 9203844 / +0.4% 16665908 / 18993709 / -12.3% 🟢 0.55 / 0.48 / +14.4%
tpcds_q04/duckdb:parquet 129684427 / 130334692 / -0.5% 134587551 / 135666042 / -0.8% 0.96 / 0.96 / +0.3%
tpcds_q05/duckdb:parquet 22521614 / 22295806 / +1.0% 25680386 / 25751991 / -0.3% 0.88 / 0.87 / +1.3%
tpcds_q06/duckdb:parquet 27587226 / 26990814 / +2.2% 39083274 / 36719081 / +6.4% 0.71 / 0.74 / -4.0%
tpcds_q07/duckdb:parquet 15476352 / 15426707 / +0.3% 26822833 / 22549616 / +19.0% 🔴 0.58 / 0.68 / -15.7%
tpcds_q08/duckdb:parquet 25959386 / 25793890 / +0.6% 32972404 / 33190348 / -0.7% 0.79 / 0.78 / +1.3%
tpcds_q09/duckdb:parquet 19267307 / 20233794 / -4.8% 23178097 / 23470567 / -1.2% 0.83 / 0.86 / -3.6%
tpcds_q10/duckdb:parquet 28097738 / 27845434 / +0.9% 39162460 / 39465143 / -0.8% 0.72 / 0.71 / +1.7%
tpcds_q11/duckdb:parquet 73487764 / 73297578 / +0.3% 79939076 / 77877334 / +2.6% 0.92 / 0.94 / -2.3%
tpcds_q12/duckdb:parquet 12759844 / 12728890 / +0.2% 17809611 / 18326345 / -2.8% 0.72 / 0.69 / +3.2%
tpcds_q13/duckdb:parquet 24384714 / 24166047 / +0.9% 30683179 / 31221856 / -1.7% 0.79 / 0.77 / +2.7%
tpcds_q14/duckdb:parquet 61958501 / 61496660 / +0.8% 74076804 / 68384298 / +8.3% 0.84 / 0.90 / -7.0%
tpcds_q15/duckdb:parquet 25289580 / 25449328 / -0.6% 31062721 / 29937281 / +3.8% 0.81 / 0.85 / -4.2%
tpcds_q16/duckdb:parquet 20962731 / 20947666 / +0.1% 29816062 / 28860696 / +3.3% 0.70 / 0.73 / -3.1%
tpcds_q17/duckdb:parquet 32712297 / 32626910 / +0.3% 41195521 / 40301401 / +2.2% 0.79 / 0.81 / -1.9%
tpcds_q18/duckdb:parquet 40106549 / 39842378 / +0.7% 51920977 / 52278085 / -0.7% 0.77 / 0.76 / +1.4%
tpcds_q19/duckdb:parquet 25213717 / 25249459 / -0.1% 32432283 / 32150363 / +0.9% 0.78 / 0.79 / -1.0%
tpcds_q20/duckdb:parquet 13998260 / 14074144 / -0.5% 19189903 / 20349838 / -5.7% 0.73 / 0.69 / +5.5%
tpcds_q21/duckdb:parquet 9421938 / 9446975 / -0.3% 13255794 / 12271953 / +8.0% 0.71 / 0.77 / -7.7%
tpcds_q22/duckdb:parquet 35268740 / 35901548 / -1.8% 39429319 / 38866514 / +1.4% 0.89 / 0.92 / -3.2%
tpcds_q23/duckdb:parquet 41468490 / 41074246 / +1.0% 48064655 / 47767347 / +0.6% 0.86 / 0.86 / +0.3%
tpcds_q24/duckdb:parquet 33756314 / 33754053 / +0.0% 42177373 / 41597072 / +1.4% 0.80 / 0.81 / -1.4%
tpcds_q25/duckdb:parquet 31668606 / 31248726 / +1.3% 40624079 / 39531531 / +2.8% 0.78 / 0.79 / -1.4%
tpcds_q26/duckdb:parquet 31725532 / 33342213 / -4.8% 39052602 / 41510183 / -5.9% 0.81 / 0.80 / +1.1%
tpcds_q27/duckdb:parquet 32909566 / 31669525 / +3.9% 41314677 / 43320391 / -4.6% 0.80 / 0.73 / +9.0%
tpcds_q28/duckdb:parquet 17719202 / 17440830 / +1.6% 22439405 / 21873998 / +2.6% 0.79 / 0.80 / -1.0%
tpcds_q29/duckdb:parquet 31276865 / 31104839 / +0.6% 38763405 / 39158562 / -1.0% 0.81 / 0.79 / +1.6%
tpcds_q30/duckdb:parquet 34677648 / 35145693 / -1.3% 44104535 / 42287984 / +4.3% 0.79 / 0.83 / -5.4%
tpcds_q31/duckdb:parquet 20620956 / 20823129 / -1.0% 25728501 / 25833304 / -0.4% 0.80 / 0.81 / -0.6%
tpcds_q32/duckdb:parquet 12322894 / 12097980 / +1.9% 21893114 / 18807459 / +16.4% 🔴 0.56 / 0.64 / -12.5%
tpcds_q33/duckdb:parquet 16407532 / 17085736 / -4.0% 23363923 / 23415365 / -0.2% 0.70 / 0.73 / -3.8%
tpcds_q34/duckdb:parquet 16458078 / 16501632 / -0.3% 22741191 / 28770759 / -21.0% 🟢 0.72 / 0.57 / +26.2%
tpcds_q35/duckdb:parquet 48731666 / 46707000 / +4.3% 58707389 / 57458475 / +2.2% 0.83 / 0.81 / +2.1%
tpcds_q36/duckdb:parquet 15994591 / 17474426 / -8.5% 26590046 / 23464228 / +13.3% 🔴 0.60 / 0.74 / -19.2%
tpcds_q37/duckdb:parquet 12366522 / 12315961 / +0.4% 19748413 / 18772882 / +5.2% 0.63 / 0.66 / -4.5%
tpcds_q38/duckdb:parquet 26977206 / 27074973 / -0.4% 31367556 / 30336090 / +3.4% 0.86 / 0.89 / -3.6%
tpcds_q39/duckdb:parquet 24485290 / 25257954 / -3.1% 32205808 / 30666490 / +5.0% 0.76 / 0.82 / -7.7%
tpcds_q40/duckdb:parquet 16512386 / 16186580 / +2.0% 22225730 / 20723947 / +7.2% 0.74 / 0.78 / -4.9%
tpcds_q41/duckdb:parquet 7937770 / 11125332 / -28.7% 🟢 13598345 / 15393160 / -11.7% 🟢 0.58 / 0.72 / -19.2%
tpcds_q42/duckdb:parquet 8767334 / 8647851 / +1.4% 15814163 / 15160638 / +4.3% 0.55 / 0.57 / -2.8%
tpcds_q43/duckdb:parquet 11159532 / 10658221 / +4.7% 15089403 / 14743622 / +2.3% 0.74 / 0.72 / +2.3%
tpcds_q44/duckdb:parquet 15905592 / 15986550 / -0.5% 22086192 / 21453803 / +2.9% 0.72 / 0.75 / -3.4%
tpcds_q45/duckdb:parquet 23851318 / 23413451 / +1.9% 29261455 / 29678502 / -1.4% 0.82 / 0.79 / +3.3%
tpcds_q46/duckdb:parquet 36923098 / 36866265 / +0.2% 45441978 / 45044513 / +0.9% 0.81 / 0.82 / -0.7%
tpcds_q47/duckdb:parquet 31439873 / 32918090 / -4.5% 36819704 / 36642537 / +0.5% 0.85 / 0.90 / -5.0%
tpcds_q48/duckdb:parquet 22540998 / 21069292 / +7.0% 28766387 / 27368047 / +5.1% 0.78 / 0.77 / +1.8%
tpcds_q49/duckdb:parquet 20300514 / 20273190 / +0.1% 30789746 / 28242749 / +9.0% 0.66 / 0.72 / -8.1%
tpcds_q50/duckdb:parquet 17890426 / 18006310 / -0.6% 24066614 / 27878532 / -13.7% 🟢 0.74 / 0.65 / +15.1%
tpcds_q51/duckdb:parquet 53534650 / 53441748 / +0.2% 60330155 / 60401283 / -0.1% 0.89 / 0.88 / +0.3%
tpcds_q52/duckdb:parquet 8950996 / 8996118 / -0.5% 15821639 / 15843617 / -0.1% 0.57 / 0.57 / -0.4%
tpcds_q53/duckdb:parquet 11883608 / 11834697 / +0.4% 16304445 / 16765598 / -2.8% 0.73 / 0.71 / +3.3%
tpcds_q54/duckdb:parquet 20701797 / 20765080 / -0.3% 30710534 / 29122585 / +5.5% 0.67 / 0.71 / -5.5%
tpcds_q55/duckdb:parquet 8842098 / 9412998 / -6.1% 16330654 / 15659297 / +4.3% 0.54 / 0.60 / -9.9%
tpcds_q56/duckdb:parquet 16959332 / 17289522 / -1.9% 24440867 / 24287983 / +0.6% 0.69 / 0.71 / -2.5%
tpcds_q57/duckdb:parquet 28884141 / 28986668 / -0.4% 36708521 / 34574520 / +6.2% 0.79 / 0.84 / -6.1%
tpcds_q58/duckdb:parquet 19258642 / 19066670 / +1.0% 26965143 / 26551339 / +1.6% 0.71 / 0.72 / -0.5%
tpcds_q59/duckdb:parquet 20057730 / 21531438 / -6.8% 24691716 / 28323049 / -12.8% 🟢 0.81 / 0.76 / +6.9%
tpcds_q60/duckdb:parquet 17791988 / 17754246 / +0.2% 24542548 / 24506289 / +0.1% 0.72 / 0.72 / +0.1%
tpcds_q61/duckdb:parquet 22048850 / 22138218 / -0.4% 29493859 / 28946614 / +1.9% 0.75 / 0.76 / -2.3%
tpcds_q62/duckdb:parquet 10810482 / 10971472 / -1.5% 14943469 / 15069390 / -0.8% 0.72 / 0.73 / -0.6%
tpcds_q63/duckdb:parquet 11243916 / 11298816 / -0.5% 16047668 / 16587926 / -3.3% 0.70 / 0.68 / +2.9%
tpcds_q64/duckdb:parquet 55115772 / 53497124 / +3.0% 67676626 / 67228978 / +0.7% 0.81 / 0.80 / +2.3%
tpcds_q65/duckdb:parquet 14692012 / 16760106 / -12.3% 🟢 23625927 / 23473281 / +0.7% 0.62 / 0.71 / -12.9%
tpcds_q66/duckdb:parquet 24986200 / 24845591 / +0.6% 33754090 / 32132872 / +5.0% 0.74 / 0.77 / -4.3%
tpcds_q67/duckdb:parquet 79556938 / 76404608 / +4.1% 99969514 / 83043886 / +20.4% 🔴 0.80 / 0.92 / -13.5%
tpcds_q68/duckdb:parquet 30254507 / 30186614 / +0.2% 43484401 / 39695430 / +9.5% 0.70 / 0.76 / -8.5%
tpcds_q69/duckdb:parquet 29725255 / 28997830 / +2.5% 42050533 / 38957784 / +7.9% 0.71 / 0.74 / -5.0%
tpcds_q70/duckdb:parquet 17203572 / 18739124 / -8.2% 27353576 / 22176480 / +23.3% 🔴 0.63 / 0.84 / -25.6%
tpcds_q71/duckdb:parquet 15076094 / 15134582 / -0.4% 21172443 / 21513821 / -1.6% 0.71 / 0.70 / +1.2%
tpcds_q72/duckdb:parquet 81472795 / 81863636 / -0.5% 85923901 / 93246028 / -7.9% 0.95 / 0.88 / +8.0%
tpcds_q73/duckdb:parquet 14391396 / 13742968 / +4.7% 22575834 / 19333610 / +16.8% 🔴 0.64 / 0.71 / -10.3%
tpcds_q74/duckdb:parquet 99575110 / 100275076 / -0.7% 107525386 / 109440411 / -1.7% 0.93 / 0.92 / +1.1%
tpcds_q75/duckdb:parquet 40845587 / 40707938 / +0.3% 51196552 / 50883273 / +0.6% 0.80 / 0.80 / -0.3%
tpcds_q76/duckdb:parquet 15007364 / 14226689 / +5.5% 21457825 / 21539709 / -0.4% 0.70 / 0.66 / +5.9%
tpcds_q77/duckdb:parquet 17858298 / 17783934 / +0.4% 25413321 / 25344941 / +0.3% 0.70 / 0.70 / +0.1%
tpcds_q78/duckdb:parquet 48758128 / 48387212 / +0.8% 55865784 / 53552256 / +4.3% 0.87 / 0.90 / -3.4%
tpcds_q79/duckdb:parquet 21478178 / 21131570 / +1.6% 29112392 / 28948652 / +0.6% 0.74 / 0.73 / +1.1%
tpcds_q80/duckdb:parquet 33205478 / 32780630 / +1.3% 39488428 / 39985729 / -1.2% 0.84 / 0.82 / +2.6%
tpcds_q81/duckdb:parquet 31349337 / 31333040 / +0.1% 39900496 / 40153412 / -0.6% 0.79 / 0.78 / +0.7%
tpcds_q82/duckdb:parquet 13808598 / 12491846 / +10.5% 🔴 20497124 / 17519203 / +17.0% 🔴 0.67 / 0.71 / -5.5%
tpcds_q83/duckdb:parquet 16680460 / 16536560 / +0.9% 21882771 / 23390245 / -6.4% 0.76 / 0.71 / +7.8%
tpcds_q84/duckdb:parquet 18697686 / 18670196 / +0.1% 24709320 / 24224540 / +2.0% 0.76 / 0.77 / -1.8%
tpcds_q85/duckdb:parquet 35909071 / 35263324 / +1.8% 45287575 / 45401585 / -0.3% 0.79 / 0.78 / +2.1%
tpcds_q86/duckdb:parquet 14359929 / 11369504 / +26.3% 🔴 18840506 / 16179461 / +16.4% 🔴 0.76 / 0.70 / +8.5%
tpcds_q87/duckdb:parquet 28488694 / 28620512 / -0.5% 36596768 / 32386554 / +13.0% 🔴 0.78 / 0.88 / -11.9%
tpcds_q88/duckdb:parquet 27096292 / 26974264 / +0.5% 34092044 / 31342222 / +8.8% 0.79 / 0.86 / -7.6%
tpcds_q89/duckdb:parquet 12930794 / 12856356 / +0.6% 18291082 / 19015913 / -3.8% 0.71 / 0.68 / +4.6%
tpcds_q90/duckdb:parquet 6934815 / 7017885 / -1.2% 11266819 / 12159718 / -7.3% 0.62 / 0.58 / +6.6%
tpcds_q91/duckdb:parquet 21709325 / 24169744 / -10.2% 🟢 29684120 / 28842113 / +2.9% 0.73 / 0.84 / -12.7%
tpcds_q92/duckdb:parquet 12598422 / 12693616 / -0.7% 19512090 / 19249637 / +1.4% 0.65 / 0.66 / -2.1%
tpcds_q93/duckdb:parquet 21843562 / 21293196 / +2.6% 26848309 / 26820049 / +0.1% 0.81 / 0.79 / +2.5%
tpcds_q94/duckdb:parquet 16946028 / 17041956 / -0.6% 25705410 / 29038419 / -11.5% 🟢 0.66 / 0.59 / +12.3%
tpcds_q95/duckdb:parquet 93783788 / 90874498 / +3.2% 98060337 / 97958202 / +0.1% 0.96 / 0.93 / +3.1%
tpcds_q96/duckdb:parquet 7853055 / 7010989 / +12.0% 🔴 11317746 / 10386486 / +9.0% 0.69 / 0.68 / +2.8%
tpcds_q97/duckdb:parquet 25963510 / 25783124 / +0.7% 35626527 / 32280172 / +10.4% 🔴 0.73 / 0.80 / -8.8%
tpcds_q98/duckdb:parquet 17838302 / 15364954 / +16.1% 🔴 22263998 / 22682260 / -1.8% 0.80 / 0.68 / +18.3%
tpcds_q99/duckdb:parquet 17355813 / 17301222 / +0.3% 21518695 / 21296544 / +1.0% 0.81 / 0.81 / -0.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.942x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.977x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 97833882 / 98832712 / -1.0% 169707460 / 172765445 / -1.8% 0.58 / 0.57 / +0.8%
tpch_q02/datafusion:vortex-file-compressed 64445081 / 65045046 / -0.9% 93381848 / 98755290 / -5.4% 0.69 / 0.66 / +4.8%
tpch_q03/datafusion:vortex-file-compressed 65092855 / 64792659 / +0.5% 114576084 / 120836496 / -5.2% 0.57 / 0.54 / +6.0%
tpch_q04/datafusion:vortex-file-compressed 34916807 / 35761806 / -2.4% 81916004 / 80236133 / +2.1% 0.43 / 0.45 / -4.4%
tpch_q05/datafusion:vortex-file-compressed 117950038 / 120839361 / -2.4% 185975135 / 184479455 / +0.8% 0.63 / 0.66 / -3.2%
tpch_q06/datafusion:vortex-file-compressed 14828650 / 14542748 / +2.0% 70047557 / 72808513 / -3.8% 0.21 / 0.20 / +6.0%
tpch_q07/datafusion:vortex-file-compressed 138972295 / 137353086 / +1.2% 182022814 / 206378015 / -11.8% 🟢 0.76 / 0.67 / +14.7%
tpch_q08/datafusion:vortex-file-compressed 140765872 / 146048250 / -3.6% 199989474 / 217256241 / -7.9% 0.70 / 0.67 / +4.7%
tpch_q09/datafusion:vortex-file-compressed 185108277 / 185179538 / -0.0% 257790449 / 271464841 / -5.0% 0.72 / 0.68 / +5.3%
tpch_q10/datafusion:vortex-file-compressed 73416143 / 74753594 / -1.8% 137354720 / 143992344 / -4.6% 0.53 / 0.52 / +3.0%
tpch_q11/datafusion:vortex-file-compressed 43718434 / 43141635 / +1.3% 70417333 / 72178656 / -2.4% 0.62 / 0.60 / +3.9%
tpch_q12/datafusion:vortex-file-compressed 43621787 / 45038011 / -3.1% 92639819 / 95455432 / -2.9% 0.47 / 0.47 / -0.2%
tpch_q13/datafusion:vortex-file-compressed 46988076 / 47029458 / -0.1% 83004733 / 78731860 / +5.4% 0.57 / 0.60 / -5.2%
tpch_q14/datafusion:vortex-file-compressed 24728277 / 25212031 / -1.9% 92417326 / 103220833 / -10.5% 🟢 0.27 / 0.24 / +9.5%
tpch_q15/datafusion:vortex-file-compressed 36498246 / 36589229 / -0.2% 97624318 / 103274015 / -5.5% 0.37 / 0.35 / +5.5%
tpch_q16/datafusion:vortex-file-compressed 37118794 / 37188919 / -0.2% 65022729 / 70627139 / -7.9% 0.57 / 0.53 / +8.4%
tpch_q17/datafusion:vortex-file-compressed 177005039 / 178259274 / -0.7% 224890988 / 231362284 / -2.8% 0.79 / 0.77 / +2.2%
tpch_q18/datafusion:vortex-file-compressed 200088251 / 201362440 / -0.6% 258255083 / 265318382 / -2.7% 0.77 / 0.76 / +2.1%
tpch_q19/datafusion:vortex-file-compressed 34047418 / 34113429 / -0.2% 95636977 / 93601979 / +2.2% 0.36 / 0.36 / -2.3%
tpch_q20/datafusion:vortex-file-compressed 62936609 / 63192994 / -0.4% 120057387 / 122265749 / -1.8% 0.52 / 0.52 / +1.4%
tpch_q21/datafusion:vortex-file-compressed 184168923 / 186184946 / -1.1% 239888999 / 246008657 / -2.5% 0.77 / 0.76 / +1.4%
tpch_q22/datafusion:vortex-file-compressed 25646666 / 25645735 / +0.0% 55374888 / 58634516 / -5.6% 0.46 / 0.44 / +5.9%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 98838442 / 100274632 / -1.4% 149838932 / 163845103 / -8.5% 0.66 / 0.61 / +7.8%
tpch_q02/datafusion:vortex-compact 65855172 / 64731955 / +1.7% 92423605 / 96000432 / -3.7% 0.71 / 0.67 / +5.7%
tpch_q03/datafusion:vortex-compact 65486441 / 66016144 / -0.8% 107998302 / 103609829 / +4.2% 0.61 / 0.64 / -4.8%
tpch_q04/datafusion:vortex-compact 41420959 / 41525546 / -0.3% 80413335 / 80811367 / -0.5% 0.52 / 0.51 / +0.2%
tpch_q05/datafusion:vortex-compact 117296926 / 117744948 / -0.4% 164322353 / 183082702 / -10.2% 🟢 0.71 / 0.64 / +11.0%
tpch_q06/datafusion:vortex-compact 17880135 / 18015515 / -0.8% 64893568 / 66519092 / -2.4% 0.28 / 0.27 / +1.7%
tpch_q07/datafusion:vortex-compact 144135678 / 141888270 / +1.6% 179038433 / 187689015 / -4.6% 0.81 / 0.76 / +6.5%
tpch_q08/datafusion:vortex-compact 144588004 / 142793887 / +1.3% 195459197 / 199088491 / -1.8% 0.74 / 0.72 / +3.1%
tpch_q09/datafusion:vortex-compact 183273079 / 184148043 / -0.5% 242102435 / 248964821 / -2.8% 0.76 / 0.74 / +2.3%
tpch_q10/datafusion:vortex-compact 77994003 / 80101847 / -2.6% 124638093 / 128240201 / -2.8% 0.63 / 0.62 / +0.2%
tpch_q11/datafusion:vortex-compact 43598001 / 43701427 / -0.2% 67417588 / 66929962 / +0.7% 0.65 / 0.65 / -1.0%
tpch_q12/datafusion:vortex-compact 56963177 / 57008306 / -0.1% 94329746 / 95068166 / -0.8% 0.60 / 0.60 / +0.7%
tpch_q13/datafusion:vortex-compact 52964533 / 54124936 / -2.1% 77848609 / 79774414 / -2.4% 0.68 / 0.68 / +0.3%
tpch_q14/datafusion:vortex-compact 27219290 / 26812408 / +1.5% 93074170 / 99111086 / -6.1% 0.29 / 0.27 / +8.1%
tpch_q15/datafusion:vortex-compact 44533421 / 44748067 / -0.5% 101496570 / 103089345 / -1.5% 0.44 / 0.43 / +1.1%
tpch_q16/datafusion:vortex-compact 40044199 / 40377968 / -0.8% 70546405 / 68944834 / +2.3% 0.57 / 0.59 / -3.1%
tpch_q17/datafusion:vortex-compact 171389018 / 169860277 / +0.9% 217176461 / 217873291 / -0.3% 0.79 / 0.78 / +1.2%
tpch_q18/datafusion:vortex-compact 200398561 / 204276933 / -1.9% 263994939 / 266333831 / -0.9% 0.76 / 0.77 / -1.0%
tpch_q19/datafusion:vortex-compact 41074387 / 40197173 / +2.2% 90219402 / 100178892 / -9.9% 0.46 / 0.40 / +13.5%
tpch_q20/datafusion:vortex-compact 66174909 / 65941655 / +0.4% 120106901 / 117153842 / +2.5% 0.55 / 0.56 / -2.1%
tpch_q21/datafusion:vortex-compact 192453500 / 194550918 / -1.1% 241449929 / 245676818 / -1.7% 0.80 / 0.79 / +0.7%
tpch_q22/datafusion:vortex-compact 26132351 / 26759771 / -2.3% 54091011 / 59631437 / -9.3% 0.48 / 0.45 / +7.7%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 86748317 / 87061677 / -0.4% 134582406 / 132951604 / +1.2% 0.64 / 0.65 / -1.6%
tpch_q02/datafusion:parquet 157931200 / 158040553 / -0.1% 185257728 / 191055311 / -3.0% 0.85 / 0.83 / +3.1%
tpch_q03/datafusion:parquet 142474777 / 143424191 / -0.7% 191306397 / 200040283 / -4.4% 0.74 / 0.72 / +3.9%
tpch_q04/datafusion:parquet 59648084 / 59796447 / -0.2% 97719906 / 100898860 / -3.2% 0.61 / 0.59 / +3.0%
tpch_q05/datafusion:parquet 181724575 / 181267533 / +0.3% 235855837 / 245538733 / -3.9% 0.77 / 0.74 / +4.4%
tpch_q06/datafusion:parquet 35365836 / 35115476 / +0.7% 81348237 / 82921429 / -1.9% 0.43 / 0.42 / +2.7%
tpch_q07/datafusion:parquet 234833216 / 233402564 / +0.6% 285010917 / 307815360 / -7.4% 0.82 / 0.76 / +8.7%
tpch_q08/datafusion:parquet 233419338 / 234321016 / -0.4% 309187231 / 310889004 / -0.5% 0.75 / 0.75 / +0.2%
tpch_q09/datafusion:parquet 316257770 / 317531087 / -0.4% 381021448 / 385877074 / -1.3% 0.83 / 0.82 / +0.9%
tpch_q10/datafusion:parquet 408431834 / 406029629 / +0.6% 454018048 / 469636829 / -3.3% 0.90 / 0.86 / +4.1%
tpch_q11/datafusion:parquet 104487260 / 105418814 / -0.9% 126122757 / 133283360 / -5.4% 0.83 / 0.79 / +4.7%
tpch_q12/datafusion:parquet 84881873 / 85203990 / -0.4% 123721252 / 134182112 / -7.8% 0.69 / 0.63 / +8.0%
tpch_q13/datafusion:parquet 227901995 / 229843629 / -0.8% 253622104 / 259914575 / -2.4% 0.90 / 0.88 / +1.6%
tpch_q14/datafusion:parquet 88038068 / 89686936 / -1.8% 198744045 / 205664487 / -3.4% 0.44 / 0.44 / +1.6%
tpch_q15/datafusion:parquet 91229912 / 90343517 / +1.0% 137914911 / 146467666 / -5.8% 0.66 / 0.62 / +7.2%
tpch_q16/datafusion:parquet 95336844 / 94968156 / +0.4% 121358237 / 126413825 / -4.0% 0.79 / 0.75 / +4.6%
tpch_q17/datafusion:parquet 218763010 / 217996563 / +0.4% 267288874 / 279121978 / -4.2% 0.82 / 0.78 / +4.8%
tpch_q18/datafusion:parquet 291713581 / 290658710 / +0.4% 332269758 / 332226102 / +0.0% 0.88 / 0.87 / +0.3%
tpch_q19/datafusion:parquet 109393063 / 108883253 / +0.5% 172950376 / 178641733 / -3.2% 0.63 / 0.61 / +3.8%
tpch_q20/datafusion:parquet 182863160 / 183688967 / -0.4% 246070685 / 249034356 / -1.2% 0.74 / 0.74 / +0.7%
tpch_q21/datafusion:parquet 243418627 / 245361599 / -0.8% 324313480 / 317022639 / +2.3% 0.75 / 0.77 / -3.0%
tpch_q22/datafusion:parquet 199412884 / 199872645 / -0.2% 219751810 / 223403314 / -1.6% 0.91 / 0.89 / +1.4%
duckdb / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 53880070 / 54194502 / -0.6% 95881510 / 104563790 / -8.3% 0.56 / 0.52 / +8.4%
tpch_q02/duckdb:vortex-file-compressed 31998578 / 32523438 / -1.6% 44952371 / 52903392 / -15.0% 🟢 0.71 / 0.61 / +15.8%
tpch_q03/duckdb:vortex-file-compressed 56535123 / 58449776 / -3.3% 103962241 / 112069728 / -7.2% 0.54 / 0.52 / +4.3%
tpch_q04/duckdb:vortex-file-compressed 79865929 / 80177567 / -0.4% 115256830 / 124599654 / -7.5% 0.69 / 0.64 / +7.7%
tpch_q05/duckdb:vortex-file-compressed 65406043 / 65898202 / -0.7% 123909185 / 133010717 / -6.8% 0.53 / 0.50 / +6.5%
tpch_q06/duckdb:vortex-file-compressed 21449091 / 19758442 / +8.6% 56375308 / 64228225 / -12.2% 🟢 0.38 / 0.31 / +23.7%
tpch_q07/duckdb:vortex-file-compressed 59343415 / 60803106 / -2.4% 127476974 / 134940936 / -5.5% 0.47 / 0.45 / +3.3%
tpch_q08/duckdb:vortex-file-compressed 84703056 / 86393269 / -2.0% 151876321 / 165908271 / -8.5% 0.56 / 0.52 / +7.1%
tpch_q09/duckdb:vortex-file-compressed 164412279 / 167019036 / -1.6% 227097834 / 249217144 / -8.9% 0.72 / 0.67 / +8.0%
tpch_q10/duckdb:vortex-file-compressed 107229411 / 113144704 / -5.2% 160540526 / 174342249 / -7.9% 0.67 / 0.65 / +2.9%
tpch_q11/duckdb:vortex-file-compressed 17847435 / 17071734 / +4.5% 30068126 / 31561628 / -4.7% 0.59 / 0.54 / +9.7%
tpch_q12/duckdb:vortex-file-compressed 57266806 / 56884674 / +0.7% 103851961 / 107942520 / -3.8% 0.55 / 0.53 / +4.6%
tpch_q13/duckdb:vortex-file-compressed 92277985 / 90957478 / +1.5% 132094738 / 150089335 / -12.0% 🟢 0.70 / 0.61 / +15.3%
tpch_q14/duckdb:vortex-file-compressed 30384372 / 30552306 / -0.5% 74573588 / 77051142 / -3.2% 0.41 / 0.40 / +2.8%
tpch_q15/duckdb:vortex-file-compressed 38338883 / 40302829 / -4.9% 88236862 / 111339154 / -20.7% 🟢 0.43 / 0.36 / +20.0%
tpch_q16/duckdb:vortex-file-compressed 41619121 / 43169277 / -3.6% 53983491 / 54953708 / -1.8% 0.77 / 0.79 / -1.9%
tpch_q17/duckdb:vortex-file-compressed 56115885 / 60091976 / -6.6% 112270448 / 137209721 / -18.2% 🟢 0.50 / 0.44 / +14.1%
tpch_q18/duckdb:vortex-file-compressed 128512607 / 133725311 / -3.9% 153770195 / 166560338 / -7.7% 0.84 / 0.80 / +4.1%
tpch_q19/duckdb:vortex-file-compressed 38290700 / 43592005 / -12.2% 🟢 80329778 / 107599858 / -25.3% 🟢 0.48 / 0.41 / +17.7%
tpch_q20/duckdb:vortex-file-compressed 60775688 / 59207815 / +2.6% 119671518 / 126533300 / -5.4% 0.51 / 0.47 / +8.5%
tpch_q21/duckdb:vortex-file-compressed 241544939 / 238871655 / +1.1% 276976974 / 292828928 / -5.4% 0.87 / 0.82 / +6.9%
tpch_q22/duckdb:vortex-file-compressed 41572744 / 42381410 / -1.9% 63246385 / 60188312 / +5.1% 0.66 / 0.70 / -6.7%
duckdb / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 68830193 / 67970559 / +1.3% 103299507 / 111492046 / -7.3% 0.67 / 0.61 / +9.3%
tpch_q02/duckdb:vortex-compact 35349776 / 35425846 / -0.2% 48209890 / 53159727 / -9.3% 0.73 / 0.67 / +10.0%
tpch_q03/duckdb:vortex-compact 61072049 / 64268230 / -5.0% 99215171 / 111653754 / -11.1% 🟢 0.62 / 0.58 / +6.9%
tpch_q04/duckdb:vortex-compact 86859692 / 88176102 / -1.5% 117197815 / 124690403 / -6.0% 0.74 / 0.71 / +4.8%
tpch_q05/duckdb:vortex-compact 68226056 / 72166279 / -5.5% 109966735 / 126041296 / -12.8% 🟢 0.62 / 0.57 / +8.4%
tpch_q06/duckdb:vortex-compact 25893408 / 24807386 / +4.4% 64698217 / 65801407 / -1.7% 0.40 / 0.38 / +6.2%
tpch_q07/duckdb:vortex-compact 71191373 / 71383115 / -0.3% 131860685 / 138277572 / -4.6% 0.54 / 0.52 / +4.6%
tpch_q08/duckdb:vortex-compact 90189077 / 90612109 / -0.5% 141394112 / 153662262 / -8.0% 0.64 / 0.59 / +8.2%
tpch_q09/duckdb:vortex-compact 174834393 / 175055116 / -0.1% 232188788 / 245949252 / -5.6% 0.75 / 0.71 / +5.8%
tpch_q10/duckdb:vortex-compact 115949579 / 115436547 / +0.4% 154753422 / 164781172 / -6.1% 0.75 / 0.70 / +7.0%
tpch_q11/duckdb:vortex-compact 19784469 / 19060580 / +3.8% 33541768 / 36773958 / -8.8% 0.59 / 0.52 / +13.8%
tpch_q12/duckdb:vortex-compact 68501218 / 70793587 / -3.2% 108034804 / 117695088 / -8.2% 0.63 / 0.60 / +5.4%
tpch_q13/duckdb:vortex-compact 95794203 / 94894033 / +0.9% 137787678 / 144465751 / -4.6% 0.70 / 0.66 / +5.8%
tpch_q14/duckdb:vortex-compact 34924614 / 32913323 / +6.1% 73397214 / 76699738 / -4.3% 0.48 / 0.43 / +10.9%
tpch_q15/duckdb:vortex-compact 45246099 / 44590813 / +1.5% 98472183 / 105569652 / -6.7% 0.46 / 0.42 / +8.8%
tpch_q16/duckdb:vortex-compact 44013645 / 44536959 / -1.2% 56938125 / 57263488 / -0.6% 0.77 / 0.78 / -0.6%
tpch_q17/duckdb:vortex-compact 55691543 / 57868258 / -3.8% 89544161 / 113696765 / -21.2% 🟢 0.62 / 0.51 / +22.2%
tpch_q18/duckdb:vortex-compact 144854229 / 141801552 / +2.2% 147911757 / 165001239 / -10.4% 🟢 0.98 / 0.86 / +14.0%
tpch_q19/duckdb:vortex-compact 42789302 / 44681853 / -4.2% 85581114 / 87704994 / -2.4% 0.50 / 0.51 / -1.9%
tpch_q20/duckdb:vortex-compact 66998341 / 67057423 / -0.1% 118251253 / 140012925 / -15.5% 🟢 0.57 / 0.48 / +18.3%
tpch_q21/duckdb:vortex-compact 259598475 / 259848949 / -0.1% 282176413 / 296639719 / -4.9% 0.92 / 0.88 / +5.0%
tpch_q22/duckdb:vortex-compact 43700441 / 44118771 / -0.9% 65023338 / 68106374 / -4.5% 0.67 / 0.65 / +3.7%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72494789 / 72617967 / -0.2% 86615505 / 89632429 / -3.4% 0.84 / 0.81 / +3.3%
tpch_q02/duckdb:parquet 80639647 / 83843676 / -3.8% 91948698 / 91416760 / +0.6% 0.88 / 0.92 / -4.4%
tpch_q03/duckdb:parquet 122081231 / 122436235 / -0.3% 144505002 / 146541584 / -1.4% 0.84 / 0.84 / +1.1%
tpch_q04/duckdb:parquet 76088318 / 76493607 / -0.5% 92562166 / 92865413 / -0.3% 0.82 / 0.82 / -0.2%
tpch_q05/duckdb:parquet 129863795 / 130941845 / -0.8% 160000919 / 162848759 / -1.7% 0.81 / 0.80 / +0.9%
tpch_q06/duckdb:parquet 34791995 / 34787374 / +0.0% 47132512 / 48276454 / -2.4% 0.74 / 0.72 / +2.4%
tpch_q07/duckdb:parquet 93324654 / 93072648 / +0.3% 127136660 / 132711666 / -4.2% 0.73 / 0.70 / +4.7%
tpch_q08/duckdb:parquet 149453504 / 151548540 / -1.4% 201733768 / 193346231 / +4.3% 0.74 / 0.78 / -5.5%
tpch_q09/duckdb:parquet 228021491 / 228152547 / -0.1% 292342649 / 272536267 / +7.3% 0.78 / 0.84 / -6.8%
tpch_q10/duckdb:parquet 513054709 / 515297299 / -0.4% 541243007 / 547388162 / -1.1% 0.95 / 0.94 / +0.7%
tpch_q11/duckdb:parquet 33642046 / 33913449 / -0.8% 38974222 / 39321912 / -0.9% 0.86 / 0.86 / +0.1%
tpch_q12/duckdb:parquet 76443853 / 77174587 / -0.9% 88009133 / 89536331 / -1.7% 0.87 / 0.86 / +0.8%
tpch_q13/duckdb:parquet 322997303 / 327078937 / -1.2% 334154220 / 346684599 / -3.6% 0.97 / 0.94 / +2.5%
tpch_q14/duckdb:parquet 112548585 / 108853205 / +3.4% 151736967 / 135180114 / +12.2% 🔴 0.74 / 0.81 / -7.9%
tpch_q15/duckdb:parquet 43266813 / 43977530 / -1.6% 66297915 / 78013990 / -15.0% 🟢 0.65 / 0.56 / +15.8%
tpch_q16/duckdb:parquet 118195133 / 119778678 / -1.3% 128845853 / 130025895 / -0.9% 0.92 / 0.92 / -0.4%
tpch_q17/duckdb:parquet 80899691 / 80403888 / +0.6% 107163005 / 110951518 / -3.4% 0.75 / 0.72 / +4.2%
tpch_q18/duckdb:parquet 215386743 / 214640999 / +0.3% 181137881 / 181018955 / +0.1% 1.19 / 1.19 / +0.3%
tpch_q19/duckdb:parquet 166139722 / 167162042 / -0.6% 192838061 / 194883654 / -1.0% 0.86 / 0.86 / +0.4%
tpch_q20/duckdb:parquet 135771838 / 136408817 / -0.5% 166200727 / 179566088 / -7.4% 0.82 / 0.76 / +7.5%
tpch_q21/duckdb:parquet 283235341 / 277663261 / +2.0% 289293409 / 306635873 / -5.7% 0.98 / 0.91 / +8.1%
tpch_q22/duckdb:parquet 268103662 / 268942426 / -0.3% 277605935 / 282586854 / -1.8% 0.97 / 0.95 / +1.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 803a0e97 vs base dd1ce26a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1801902 / 1805788 / -0.2% 5086473 / 5859538 / -13.2% 🟢 0.35 / 0.31 / +15.0%
statpopgen_q01/datafusion:vortex-file-compressed 26180576 / 25187302 / +3.9% 34049237 / 33365687 / +2.0% 0.77 / 0.75 / +1.9%
statpopgen_q02/datafusion:vortex-file-compressed 111655439 / 111601055 / +0.0% 138967677 / 142187438 / -2.3% 0.80 / 0.78 / +2.4%
statpopgen_q03/datafusion:vortex-file-compressed 351834582 / 347683701 / +1.2% 381978372 / 389028926 / -1.8% 0.92 / 0.89 / +3.1%
statpopgen_q04/datafusion:vortex-file-compressed 342083792 / 370795206 / -7.7% 383646976 / 384535995 / -0.2% 0.89 / 0.96 / -7.5%
statpopgen_q05/datafusion:vortex-file-compressed 251024592 / 213826020 / +17.4% 🔴 314393210 / 309812935 / +1.5% 0.80 / 0.69 / +15.7%
statpopgen_q06/datafusion:vortex-file-compressed 761961830 / 755918722 / +0.8% 782425398 / 791605624 / -1.2% 0.97 / 0.95 / +2.0%
statpopgen_q07/datafusion:vortex-file-compressed 414228541 / 411311701 / +0.7% 420969512 / 426025438 / -1.2% 0.98 / 0.97 / +1.9%
statpopgen_q08/datafusion:vortex-file-compressed 408015073 / 420310717 / -2.9% 419431474 / 438378199 / -4.3% 0.97 / 0.96 / +1.5%
statpopgen_q09/datafusion:vortex-file-compressed 249816316 / 249682438 / +0.1% 286010468 / 290720876 / -1.6% 0.87 / 0.86 / +1.7%
statpopgen_q10/datafusion:vortex-file-compressed 747224497 / 761725489 / -1.9% 780573121 / 776145939 / +0.6% 0.96 / 0.98 / -2.5%
datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1786744 / 1799949 / -0.7% 5212880 / 5883974 / -11.4% 🟢 0.34 / 0.31 / +12.0%
statpopgen_q01/datafusion:vortex-compact 27341132 / 27572480 / -0.8% 27176329 / 25325458 / +7.3% 1.01 / 1.09 / -7.6%
statpopgen_q02/datafusion:vortex-compact 211398664 / 211516338 / -0.1% 233603370 / 230891543 / +1.2% 0.90 / 0.92 / -1.2%
statpopgen_q03/datafusion:vortex-compact 466147672 / 465754316 / +0.1% 487980421 / 475148632 / +2.7% 0.96 / 0.98 / -2.5%
statpopgen_q04/datafusion:vortex-compact 463675805 / 463483832 / +0.0% 483555406 / 479625215 / +0.8% 0.96 / 0.97 / -0.8%
statpopgen_q05/datafusion:vortex-compact 314503530 / 313847547 / +0.2% 334000719 / 334521542 / -0.2% 0.94 / 0.94 / +0.4%
statpopgen_q06/datafusion:vortex-compact 878618678 / 874242094 / +0.5% 894832732 / 897189416 / -0.3% 0.98 / 0.97 / +0.8%
statpopgen_q07/datafusion:vortex-compact 972768191 / 974715598 / -0.2% 979108984 / 997005299 / -1.8% 0.99 / 0.98 / +1.6%
statpopgen_q08/datafusion:vortex-compact 969515652 / 969733320 / -0.0% 965168867 / 980560036 / -1.6% 1.00 / 0.99 / +1.6%
statpopgen_q09/datafusion:vortex-compact 362895357 / 364390804 / -0.4% 388118463 / 386640813 / +0.4% 0.94 / 0.94 / -0.8%
statpopgen_q10/datafusion:vortex-compact 964485557 / 970699898 / -0.6% 992592128 / 984757985 / +0.8% 0.97 / 0.99 / -1.4%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1983404 / 1989884 / -0.3% 89548277 / 89964056 / -0.5% 0.02 / 0.02 / +0.1%
statpopgen_q01/datafusion:parquet 160454470 / 160147765 / +0.2% 172547217 / 173668195 / -0.6% 0.93 / 0.92 / +0.8%
statpopgen_q02/datafusion:parquet 278489592 / 283084182 / -1.6% 419488356 / 421328449 / -0.4% 0.66 / 0.67 / -1.2%
statpopgen_q03/datafusion:parquet 396089929 / 400035664 / -1.0% 536181942 / 529470534 / +1.3% 0.74 / 0.76 / -2.2%
statpopgen_q04/datafusion:parquet 402246984 / 402624280 / -0.1% 536310671 / 508456106 / +5.5% 0.75 / 0.79 / -5.3%
statpopgen_q05/datafusion:parquet 325243246 / 320131891 / +1.6% 443944199 / 440922956 / +0.7% 0.73 / 0.73 / +0.9%
statpopgen_q06/datafusion:parquet 503884410 / 527412446 / -4.5% 637320295 / 621682205 / +2.5% 0.79 / 0.85 / -6.8%
statpopgen_q07/datafusion:parquet 435612076 / 432332308 / +0.8% 550510205 / 553575702 / -0.6% 0.79 / 0.78 / +1.3%
statpopgen_q08/datafusion:parquet 444355786 / 442811823 / +0.3% 551030676 / 545603817 / +1.0% 0.81 / 0.81 / -0.6%
statpopgen_q09/datafusion:parquet 365137894 / 368214164 / -0.8% 493189894 / 505246060 / -2.4% 0.74 / 0.73 / +1.6%
statpopgen_q10/datafusion:parquet 561061883 / 566142414 / -0.9% 670270564 / 678888069 / -1.3% 0.84 / 0.83 / +0.4%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9019436 / 9042234 / -0.3% 9468606 / 9488601 / -0.2% 0.95 / 0.95 / -0.0%
statpopgen_q01/duckdb:vortex-file-compressed 10319128 / 10316586 / +0.0% 13297580 / 15790153 / -15.8% 🟢 0.78 / 0.65 / +18.8%
statpopgen_q02/duckdb:vortex-file-compressed 303745334 / 303373816 / +0.1% 346859505 / 348172996 / -0.4% 0.88 / 0.87 / +0.5%
statpopgen_q03/duckdb:vortex-file-compressed 816691172 / 817657452 / -0.1% 823843688 / 818656135 / +0.6% 0.99 / 1.00 / -0.7%
statpopgen_q04/duckdb:vortex-file-compressed 812582906 / 817843510 / -0.6% 830042214 / 820580650 / +1.2% 0.98 / 1.00 / -1.8%
statpopgen_q05/duckdb:vortex-file-compressed 321536751 / 322083510 / -0.2% 357888593 / 345261131 / +3.7% 0.90 / 0.93 / -3.7%
statpopgen_q06/duckdb:vortex-file-compressed 1137934905 / 1150012006 / -1.1% 1159853107 / 1151226296 / +0.7% 0.98 / 1.00 / -1.8%
statpopgen_q07/duckdb:vortex-file-compressed 370723953 / 385957886 / -3.9% 377109072 / 425023482 / -11.3% 🟢 0.98 / 0.91 / +8.3%
statpopgen_q08/duckdb:vortex-file-compressed 384424308 / 390652081 / -1.6% 430187754 / 433275546 / -0.7% 0.89 / 0.90 / -0.9%
statpopgen_q09/duckdb:vortex-file-compressed 596367540 / 610528738 / -2.3% 622322837 / 619931428 / +0.4% 0.96 / 0.98 / -2.7%
statpopgen_q10/duckdb:vortex-file-compressed 1919313468 / 1919346084 / -0.0% 1887139895 / 1880909968 / +0.3% 1.02 / 1.02 / -0.3%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9065190 / 9065002 / +0.0% 9422350 / 9537133 / -1.2% 0.96 / 0.95 / +1.2%
statpopgen_q01/duckdb:vortex-compact 10230612 / 10297344 / -0.6% 12834613 / 13634443 / -5.9% 0.80 / 0.76 / +5.5%
statpopgen_q02/duckdb:vortex-compact 384021020 / 380715327 / +0.9% 404128680 / 396791665 / +1.8% 0.95 / 0.96 / -1.0%
statpopgen_q03/duckdb:vortex-compact 894801829 / 896749350 / -0.2% 903946892 / 911221160 / -0.8% 0.99 / 0.98 / +0.6%
statpopgen_q04/duckdb:vortex-compact 904450384 / 900916988 / +0.4% 902139824 / 897572022 / +0.5% 1.00 / 1.00 / -0.1%
statpopgen_q05/duckdb:vortex-compact 427302378 / 427294791 / +0.0% 440925266 / 438053515 / +0.7% 0.97 / 0.98 / -0.6%
statpopgen_q06/duckdb:vortex-compact 1169975451 / 1167459797 / +0.2% 1174160828 / 1168601028 / +0.5% 1.00 / 1.00 / -0.3%
statpopgen_q07/duckdb:vortex-compact 933914245 / 933480918 / +0.0% 928414188 / 931426329 / -0.3% 1.01 / 1.00 / +0.4%
statpopgen_q08/duckdb:vortex-compact 936503370 / 950557000 / -1.5% 933208558 / 948239053 / -1.6% 1.00 / 1.00 / +0.1%
statpopgen_q09/duckdb:vortex-compact 712597064 / 708103050 / +0.6% 727221838 / 734511373 / -1.0% 0.98 / 0.96 / +1.6%
statpopgen_q10/duckdb:vortex-compact 2012999453 / 2033886217 / -1.0% 1986165820 / 1981838776 / +0.2% 1.01 / 1.03 / -1.2%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245310624 / 245270660 / +0.0% 246089271 / 245966058 / +0.1% 1.00 / 1.00 / -0.0%
statpopgen_q01/duckdb:parquet 301347217 / 302396880 / -0.3% 302754505 / 304567497 / -0.6% 1.00 / 0.99 / +0.2%
statpopgen_q02/duckdb:parquet 560057047 / 544210467 / +2.9% 573558931 / 548732801 / +4.5% 0.98 / 0.99 / -1.5%
statpopgen_q03/duckdb:parquet 860148852 / 864712260 / -0.5% 881239413 / 875740240 / +0.6% 0.98 / 0.99 / -1.1%
statpopgen_q04/duckdb:parquet 843144274 / 864026620 / -2.4% 806050603 / 870814612 / -7.4% 1.05 / 0.99 / +5.4%
statpopgen_q05/duckdb:parquet 604072852 / 607182858 / -0.5% 630033955 / 593060016 / +6.2% 0.96 / 1.02 / -6.4%
statpopgen_q06/duckdb:parquet 733240014 / 726024970 / +1.0% 702090836 / 735017261 / -4.5% 1.04 / 0.99 / +5.7%
statpopgen_q07/duckdb:parquet 605232211 / 604099654 / +0.2% 673698553 / 687628157 / -2.0% 0.90 / 0.88 / +2.3%
statpopgen_q08/duckdb:parquet 615751900 / 619653840 / -0.6% 678584241 / 702146302 / -3.4% 0.91 / 0.88 / +2.8%
statpopgen_q09/duckdb:parquet 776402012 / 787846008 / -1.5% 822447089 / 797564620 / +3.1% 0.94 / 0.99 / -4.4%
statpopgen_q10/duckdb:parquet 1418461312 / 1383545726 / +2.5% 1341552563 / 1268009058 / +5.8% 1.06 / 1.09 / -3.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 803a0e97 vs base dc0e885d

vortex / vortex-file-compressed / ns (0.981x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
compress time/Arade 762121592 / 770565969 / -1.1%
compress time/Bimbo 3669183144 / 3747843353 / -2.1%
compress time/CMSprovider 2622780421 / 2653673956 / -1.2%
compress time/Euro2016 270482885 / 275007243 / -1.6%
compress time/Food 280719085 / 285233170 / -1.6%
compress time/HashTags 480479663 / 489479497 / -1.8%
compress time/TPC-H l_comment canonical 626015230 / 640764171 / -2.3%
compress time/TPC-H l_comment chunked 627233675 / 638122188 / -1.7%
compress time/taxi 403850724 / 406402632 / -0.6%
compress time/wide table cols=100 chunks=1 rows=1000 7112513 / 7143592 / -0.4%
compress time/wide table cols=100 chunks=50 rows=1000 7082242 / 7131595 / -0.7%
compress time/wide table cols=1000 chunks=1 rows=1000 69598826 / 69268034 / +0.5%
compress time/wide table cols=1000 chunks=50 rows=1000 69890514 / 70367622 / -0.7%
compress time/wide table cols=10000 chunks=1 rows=1000 746587616 / 777579243 / -4.0%
compress time/wide table cols=10000 chunks=50 rows=1000 768127074 / 771920368 / -0.5%
decompress time/Arade 8952450 / 9207803 / -2.8%
decompress time/Bimbo 36358766 / 38475593 / -5.5%
decompress time/CMSprovider 27401552 / 28601717 / -4.2%
decompress time/Euro2016 6696402 / 7082635 / -5.5%
decompress time/Food 2948319 / 2334361 / +26.3% 🔴
decompress time/HashTags 48261712 / 51039770 / -5.4%
decompress time/TPC-H l_comment canonical 19892503 / 21873235 / -9.1%
decompress time/TPC-H l_comment chunked 20828841 / 21899798 / -4.9%
decompress time/taxi 5796182 / 5520974 / +5.0%
decompress time/wide table cols=100 chunks=1 rows=1000 1912642 / 2009930 / -4.8%
decompress time/wide table cols=100 chunks=50 rows=1000 1935735 / 2035953 / -4.9%
decompress time/wide table cols=1000 chunks=1 rows=1000 18475722 / 19336945 / -4.5%
decompress time/wide table cols=1000 chunks=50 rows=1000 18507407 / 19501754 / -5.1%
decompress time/wide table cols=10000 chunks=1 rows=1000 213552247 / 225053990 / -5.1%
decompress time/wide table cols=10000 chunks=50 rows=1000 218399676 / 226006358 / -3.4%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420778812 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016 164046188 / 164045668 / +0.0%
vortex-file-compressed size/Food 38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags 190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.991x ➖, 0↑ 1↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.339070711 / 0.342118217 / -0.9%
vortex:parquet-zstd ratio compress time/Bimbo 0.311308941 / 0.316838312 / -1.7%
vortex:parquet-zstd ratio compress time/CMSprovider 0.41006935 / 0.416128274 / -1.5%
vortex:parquet-zstd ratio compress time/Euro2016 0.251047673 / 0.254053329 / -1.2%
vortex:parquet-zstd ratio compress time/Food 0.379189227 / 0.38529618 / -1.6%
vortex:parquet-zstd ratio compress time/HashTags 0.262177565 / 0.266968485 / -1.8%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.238088868 / 0.24345239 / -2.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.238904628 / 0.242075198 / -1.3%
vortex:parquet-zstd ratio compress time/taxi 0.371807328 / 0.372469552 / -0.2%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.80121305 / 1.81680318 / -0.9%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.80017701 / 1.79079481 / +0.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.56024267 / 1.54754559 / +0.8%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.57087594 / 1.54807299 / +1.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.63621414 / 1.70264145 / -3.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.67587815 / 1.67518207 / +0.0%
vortex:parquet-zstd ratio decompress time/Arade 0.0160904586 / 0.0164974613 / -2.5%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0226474473 / 0.0238513356 / -5.0%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0201421731 / 0.0209189403 / -3.7%
vortex:parquet-zstd ratio decompress time/Euro2016 0.020089975 / 0.0213427376 / -5.9%
vortex:parquet-zstd ratio decompress time/Food 0.0172948341 / 0.0137044139 / +26.2% 🔴
vortex:parquet-zstd ratio decompress time/HashTags 0.0936295934 / 0.0987720246 / -5.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0401043808 / 0.0436572246 / -8.1%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0419806487 / 0.043740536 / -4.0%
vortex:parquet-zstd ratio decompress time/taxi 0.026577762 / 0.0252671549 / +5.2%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.931579188 / 0.976040053 / -4.6%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.946696063 / 0.994190492 / -4.8%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.782422369 / 0.816859889 / -4.2%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.784357533 / 0.802632976 / -2.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.873017661 / 0.906795483 / -3.7%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.901193107 / 0.911097116 / -1.1%
vortex:parquet-zstd size/Arade 0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11645611 / 1.11645609 / +0.0%
vortex:parquet-zstd size/Euro2016 1.33393606 / 1.33393183 / +0.0%
vortex:parquet-zstd size/Food 1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags 1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (0.995x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2247677456 / 2252338314 / -0.2%
parquet_rs-zstd compress time/Bimbo 11786308259 / 11828883096 / -0.4%
parquet_rs-zstd compress time/CMSprovider 6395943568 / 6377057555 / +0.3%
parquet_rs-zstd compress time/Euro2016 1077416420 / 1082478406 / -0.5%
parquet_rs-zstd compress time/Food 740313978 / 740295868 / +0.0%
parquet_rs-zstd compress time/HashTags 1832649802 / 1833472958 / -0.0%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2629334307 / 2631989650 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2625456364 / 2636049426 / -0.4%
parquet_rs-zstd compress time/taxi 1086182797 / 1091102963 / -0.5%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3948735 / 3931957 / +0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3934192 / 3982363 / -1.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44607693 / 44759931 / -0.3%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44491428 / 45454977 / -2.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 456289673 / 456689953 / -0.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 458343032 / 460797894 / -0.5%
parquet_rs-zstd decompress time/Arade 556382525 / 558134541 / -0.3%
parquet_rs-zstd decompress time/Bimbo 1605424466 / 1613142073 / -0.5%
parquet_rs-zstd decompress time/CMSprovider 1360406939 / 1367264144 / -0.5%
parquet_rs-zstd decompress time/Euro2016 333320574 / 331852227 / +0.4%
parquet_rs-zstd decompress time/Food 170473968 / 170336435 / +0.1%
parquet_rs-zstd decompress time/HashTags 515453611 / 516743179 / -0.2%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 496018205 / 501022115 / -1.0%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 496153386 / 500675118 / -0.9%
parquet_rs-zstd decompress time/taxi 218083900 / 218503984 / -0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2053118 / 2059270 / -0.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2044727 / 2047850 / -0.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23613489 / 23672291 / -0.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23595626 / 24297225 / -2.9%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 244613891 / 248186051 / -1.4%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 242345036 / 248059569 / -2.3%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.951x ➖, 5↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98704265 / 99264102 / -0.6%
arrow-ipc compress time/Bimbo 620168448 / 626173094 / -1.0%
arrow-ipc compress time/CMSprovider 382190632 / 386929520 / -1.2%
arrow-ipc compress time/Euro2016 38458608 / 38612259 / -0.4%
arrow-ipc compress time/Food 33750681 / 34119441 / -1.1%
arrow-ipc compress time/HashTags 78943296 / 79147264 / -0.3%
arrow-ipc compress time/TPC-H l_comment canonical 496570700 / 523991824 / -5.2%
arrow-ipc compress time/TPC-H l_comment chunked 500846666 / 505576838 / -0.9%
arrow-ipc compress time/taxi 74819038 / 75493600 / -0.9%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 203427 / 210060 / -3.2%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 202537 / 206712 / -2.0%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2260220 / 2288052 / -1.2%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2221426 / 2274240 / -2.3%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25375170 / 25762033 / -1.5%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25749628 / 26120382 / -1.4%
arrow-ipc decompress time/Arade 139847669 / 181887297 / -23.1% 🟢
arrow-ipc decompress time/Bimbo 405748194 / 421150420 / -3.7%
arrow-ipc decompress time/CMSprovider 472086814 / 583450934 / -19.1% 🟢
arrow-ipc decompress time/Euro2016 63799423 / 75044672 / -15.0% 🟢
arrow-ipc decompress time/Food 48852184 / 58470503 / -16.4% 🟢
arrow-ipc decompress time/HashTags 120407058 / 143509482 / -16.1% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical 540777156 / 534247504 / +1.2%
arrow-ipc decompress time/TPC-H l_comment chunked 539719890 / 531237569 / +1.6%
arrow-ipc decompress time/taxi 45027939 / 48820799 / -7.8%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 318319 / 320879 / -0.8%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 317540 / 320156 / -0.8%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3491151 / 3648262 / -4.3%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3455640 / 3645659 / -5.2%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35660298 / 36907317 / -3.4%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35673987 / 36909838 / -3.3%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.5%
Engines: DataFusion No clear signal (-7.1%, environment too noisy confidence) · DuckDB No clear signal (-17.7%, environment too noisy confidence)
Vortex (geomean): hot 0.904x ➖ · cold 0.927x ➖
Parquet (geomean): hot 1.034x ➖ · cold 1.042x ➖
Shifts: Parquet (control) +3.4% · Median polish -11.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.964x ➖, 5↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 246579616 / 227406706 / +8.4% 807749607 / 1044861900 / -22.7% 0.31 / 0.22 / +40.3%
tpch_q02/datafusion:vortex-file-compressed 732619528 / 362893520 / +101.9% 🔴 882718606 / 735506017 / +20.0% 0.83 / 0.49 / +68.2%
tpch_q03/datafusion:vortex-file-compressed 434458987 / 557784763 / -22.1% 1016890883 / 1353767100 / -24.9% 0.43 / 0.41 / +3.7%
tpch_q04/datafusion:vortex-file-compressed 203805452 / 259214662 / -21.4% 400660865 / 463388520 / -13.5% 0.51 / 0.56 / -9.1%
tpch_q05/datafusion:vortex-file-compressed 439549496 / 732518388 / -40.0% 🟢 1286070562 / 697793592 / +84.3% 🔴 0.34 / 1.05 / -67.4%
tpch_q06/datafusion:vortex-file-compressed 253437823 / 352026262 / -28.0% 445102933 / 529147386 / -15.9% 0.57 / 0.67 / -14.4%
tpch_q07/datafusion:vortex-file-compressed 957778416 / 494033216 / +93.9% 🔴 779070661 / 679737153 / +14.6% 1.23 / 0.73 / +69.2%
tpch_q08/datafusion:vortex-file-compressed 633439783 / 684130878 / -7.4% 1545456619 / 820834148 / +88.3% 🔴 0.41 / 0.83 / -50.8%
tpch_q09/datafusion:vortex-file-compressed 822546080 / 455396504 / +80.6% 🔴 1014153163 / 618575619 / +63.9% 🔴 0.81 / 0.74 / +10.2%
tpch_q10/datafusion:vortex-file-compressed 757120217 / 434485416 / +74.3% 🔴 1155135572 / 565607276 / +104.2% 🔴 0.66 / 0.77 / -14.7%
tpch_q11/datafusion:vortex-file-compressed 1035963844 / 356914809 / +190.3% 🔴 1516566648 / 543757031 / +178.9% 🔴 0.68 / 0.66 / +4.1%
tpch_q12/datafusion:vortex-file-compressed 473604739 / 883339642 / -46.4% 🟢 682415109 / 839764493 / -18.7% 0.69 / 1.05 / -34.0%
tpch_q13/datafusion:vortex-file-compressed 145710386 / 160433055 / -9.2% 360528792 / 321926343 / +12.0% 0.40 / 0.50 / -18.9%
tpch_q14/datafusion:vortex-file-compressed 193616430 / 344884573 / -43.9% 🟢 381906254 / 372150112 / +2.6% 0.51 / 0.93 / -45.3%
tpch_q15/datafusion:vortex-file-compressed 316037714 / 552997595 / -42.9% 🟢 1201659500 / 1163079564 / +3.3% 0.26 / 0.48 / -44.7%
tpch_q16/datafusion:vortex-file-compressed 189093984 / 247326997 / -23.5% 305810360 / 410612531 / -25.5% 0.62 / 0.60 / +2.7%
tpch_q17/datafusion:vortex-file-compressed 598071937 / 843196959 / -29.1% 751767287 / 872514096 / -13.8% 0.80 / 0.97 / -17.7%
tpch_q18/datafusion:vortex-file-compressed 293808807 / 358754811 / -18.1% 594770928 / 548805038 / +8.4% 0.49 / 0.65 / -24.4%
tpch_q19/datafusion:vortex-file-compressed 361977088 / 419652552 / -13.7% 459332517 / 704095339 / -34.8% 🟢 0.79 / 0.60 / +32.2%
tpch_q20/datafusion:vortex-file-compressed 407682571 / 309729894 / +31.6% 🔴 1630449622 / 485712096 / +235.7% 🔴 0.25 / 0.64 / -60.8%
tpch_q21/datafusion:vortex-file-compressed 527786718 / 837638286 / -37.0% 🟢 1294042844 / 1175911852 / +10.0% 0.41 / 0.71 / -42.7%
tpch_q22/datafusion:vortex-file-compressed 196627134 / 206308490 / -4.7% 459685457 / 373039775 / +23.2% 0.43 / 0.55 / -22.7%
datafusion / vortex-compact / ns (0.896x ➖, 5↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 248744338 / 234456956 / +6.1% 755003299 / 823067566 / -8.3% 0.33 / 0.28 / +15.7%
tpch_q02/datafusion:vortex-compact 759308676 / 331418231 / +129.1% 🔴 645339690 / 781186557 / -17.4% 1.18 / 0.42 / +177.3%
tpch_q03/datafusion:vortex-compact 310613441 / 446824217 / -30.5% 🟢 709138553 / 1044279508 / -32.1% 🟢 0.44 / 0.43 / +2.4%
tpch_q04/datafusion:vortex-compact 183005745 / 176824367 / +3.5% 397195241 / 500774590 / -20.7% 0.46 / 0.35 / +30.5%
tpch_q05/datafusion:vortex-compact 352641511 / 485397921 / -27.4% 537725209 / 613339319 / -12.3% 0.66 / 0.79 / -17.1%
tpch_q06/datafusion:vortex-compact 296697768 / 339425006 / -12.6% 487301158 / 511060445 / -4.6% 0.61 / 0.66 / -8.3%
tpch_q07/datafusion:vortex-compact 474172592 / 514963966 / -7.9% 564480421 / 690954509 / -18.3% 0.84 / 0.75 / +12.7%
tpch_q08/datafusion:vortex-compact 499757566 / 552141941 / -9.5% 696674394 / 745746074 / -6.6% 0.72 / 0.74 / -3.1%
tpch_q09/datafusion:vortex-compact 463437550 / 309472447 / +49.8% 🔴 938054633 / 569244534 / +64.8% 🔴 0.49 / 0.54 / -9.1%
tpch_q10/datafusion:vortex-compact 316341694 / 451535808 / -29.9% 523316617 / 646958174 / -19.1% 0.60 / 0.70 / -13.4%
tpch_q11/datafusion:vortex-compact 296741078 / 298125936 / -0.5% 540063226 / 516093337 / +4.6% 0.55 / 0.58 / -4.9%
tpch_q12/datafusion:vortex-compact 383600613 / 407836329 / -5.9% 753457983 / 589482405 / +27.8% 0.51 / 0.69 / -26.4%
tpch_q13/datafusion:vortex-compact 135265764 / 305477662 / -55.7% 🟢 357130748 / 787646663 / -54.7% 🟢 0.38 / 0.39 / -2.3%
tpch_q14/datafusion:vortex-compact 189182003 / 378819370 / -50.1% 🟢 337518650 / 658521469 / -48.7% 🟢 0.56 / 0.58 / -2.6%
tpch_q15/datafusion:vortex-compact 297465553 / 419866741 / -29.2% 568400666 / 610128266 / -6.8% 0.52 / 0.69 / -24.0%
tpch_q16/datafusion:vortex-compact 144286601 / 214928740 / -32.9% 🟢 268801270 / 584554078 / -54.0% 🟢 0.54 / 0.37 / +46.0%
tpch_q17/datafusion:vortex-compact 290996609 / 502430527 / -42.1% 🟢 458473824 / 698161580 / -34.3% 🟢 0.63 / 0.72 / -11.8%
tpch_q18/datafusion:vortex-compact 926890529 / 471641015 / +96.5% 🔴 1278250140 / 846432311 / +51.0% 🔴 0.73 / 0.56 / +30.1%
tpch_q19/datafusion:vortex-compact 428538055 / 546928451 / -21.6% 508388670 / 994142878 / -48.9% 🟢 0.84 / 0.55 / +53.2%
tpch_q20/datafusion:vortex-compact 293024499 / 297487018 / -1.5% 565113862 / 535621045 / +5.5% 0.52 / 0.56 / -6.6%
tpch_q21/datafusion:vortex-compact 473154610 / 503255207 / -6.0% 847351298 / 740976738 / +14.4% 0.56 / 0.68 / -17.8%
tpch_q22/datafusion:vortex-compact 210947843 / 186828488 / +12.9% 351652311 / 435606382 / -19.3% 0.60 / 0.43 / +39.9%
datafusion / parquet / ns (1.000x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 165542264 / 208041042 / -20.4% 463400089 / 518170364 / -10.6% 0.36 / 0.40 / -11.0%
tpch_q02/datafusion:parquet 260178070 / 315544283 / -17.5% 586652611 / 527940280 / +11.1% 0.44 / 0.60 / -25.8%
tpch_q03/datafusion:parquet 437495750 / 270064650 / +62.0% 🔴 989900356 / 796739185 / +24.2% 0.44 / 0.34 / +30.4%
tpch_q04/datafusion:parquet 191408772 / 165099780 / +15.9% 390617518 / 425023019 / -8.1% 0.49 / 0.39 / +26.1%
tpch_q05/datafusion:parquet 462666246 / 342563706 / +35.1% 🔴 1363490446 / 544837604 / +150.3% 🔴 0.34 / 0.63 / -46.0%
tpch_q06/datafusion:parquet 160487303 / 155950380 / +2.9% 283458696 / 349194218 / -18.8% 0.57 / 0.45 / +26.8%
tpch_q07/datafusion:parquet 418711541 / 397244435 / +5.4% 522438309 / 576575751 / -9.4% 0.80 / 0.69 / +16.3%
tpch_q08/datafusion:parquet 487067032 / 428883226 / +13.6% 638073805 / 566595681 / +12.6% 0.76 / 0.76 / +0.8%
tpch_q09/datafusion:parquet 386855474 / 477507606 / -19.0% 660692666 / 898713372 / -26.5% 0.59 / 0.53 / +10.2%
tpch_q10/datafusion:parquet 432446210 / 535476448 / -19.2% 561674017 / 522284252 / +7.5% 0.77 / 1.03 / -24.9%
tpch_q11/datafusion:parquet 249673165 / 270974747 / -7.9% 465915195 / 456526254 / +2.1% 0.54 / 0.59 / -9.7%
tpch_q12/datafusion:parquet 170472895 / 198376694 / -14.1% 358722732 / 400487564 / -10.4% 0.48 / 0.50 / -4.1%
tpch_q13/datafusion:parquet 384193722 / 367751260 / +4.5% 578635309 / 450416641 / +28.5% 0.66 / 0.82 / -18.7%
tpch_q14/datafusion:parquet 173655690 / 246602865 / -29.6% 382655290 / 520725884 / -26.5% 0.45 / 0.47 / -4.2%
tpch_q15/datafusion:parquet 312215855 / 363367045 / -14.1% 465646876 / 539413324 / -13.7% 0.67 / 0.67 / -0.5%
tpch_q16/datafusion:parquet 114331074 / 118565587 / -3.6% 457850717 / 290568151 / +57.6% 🔴 0.25 / 0.41 / -38.8%
tpch_q17/datafusion:parquet 290495713 / 319310170 / -9.0% 402394696 / 463049271 / -13.1% 0.72 / 0.69 / +4.7%
tpch_q18/datafusion:parquet 411779241 / 383100099 / +7.5% 605317832 / 487961646 / +24.1% 0.68 / 0.79 / -13.4%
tpch_q19/datafusion:parquet 248863776 / 229854678 / +8.3% 370105490 / 404130476 / -8.4% 0.67 / 0.57 / +18.2%
tpch_q20/datafusion:parquet 245919084 / 237436714 / +3.6% 576946981 / 431043892 / +33.8% 🔴 0.43 / 0.55 / -22.6%
tpch_q21/datafusion:parquet 369536609 / 342732983 / +7.8% 490195911 / 522796197 / -6.2% 0.75 / 0.66 / +15.0%
tpch_q22/datafusion:parquet 207803513 / 157967299 / +31.5% 🔴 410154348 / 356415877 / +15.1% 0.51 / 0.44 / +14.3%
duckdb / vortex-file-compressed / ns (0.879x ➖, 6↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 203609722 / 324195648 / -37.2% 🟢 346949943 / 764125867 / -54.6% 🟢 0.59 / 0.42 / +38.3%
tpch_q02/duckdb:vortex-file-compressed 777866360 / 402215958 / +93.4% 🔴 1041586039 / 569101240 / +83.0% 🔴 0.75 / 0.71 / +5.7%
tpch_q03/duckdb:vortex-file-compressed 499712903 / 580597511 / -13.9% 626640715 / 902577471 / -30.6% 🟢 0.80 / 0.64 / +24.0%
tpch_q04/duckdb:vortex-file-compressed 309294878 / 486531512 / -36.4% 🟢 409697913 / 458299892 / -10.6% 0.75 / 1.06 / -28.9%
tpch_q05/duckdb:vortex-file-compressed 541582235 / 594214978 / -8.9% 543162396 / 838618871 / -35.2% 🟢 1.00 / 0.71 / +40.7%
tpch_q06/duckdb:vortex-file-compressed 328685095 / 457970938 / -28.2% 282544042 / 488417200 / -42.2% 🟢 1.16 / 0.94 / +24.1%
tpch_q07/duckdb:vortex-file-compressed 714064157 / 611169938 / +16.8% 848006939 / 742001862 / +14.3% 0.84 / 0.82 / +2.2%
tpch_q08/duckdb:vortex-file-compressed 761955699 / 772265039 / -1.3% 716651695 / 873209983 / -17.9% 1.06 / 0.88 / +20.2%
tpch_q09/duckdb:vortex-file-compressed 526336043 / 631345817 / -16.6% 611372765 / 557726731 / +9.6% 0.86 / 1.13 / -23.9%
tpch_q10/duckdb:vortex-file-compressed 599214755 / 614779877 / -2.5% 763953081 / 837792429 / -8.8% 0.78 / 0.73 / +6.9%
tpch_q11/duckdb:vortex-file-compressed 784481233 / 213953786 / +266.7% 🔴 808605162 / 227194532 / +255.9% 🔴 0.97 / 0.94 / +3.0%
tpch_q12/duckdb:vortex-file-compressed 478219667 / 1223905210 / -60.9% 🟢 604733003 / 1278306757 / -52.7% 🟢 0.79 / 0.96 / -17.4%
tpch_q13/duckdb:vortex-file-compressed 340562955 / 346541279 / -1.7% 341125278 / 393764465 / -13.4% 1.00 / 0.88 / +13.4%
tpch_q14/duckdb:vortex-file-compressed 260444753 / 490038390 / -46.9% 🟢 354848127 / 666644496 / -46.8% 🟢 0.73 / 0.74 / -0.2%
tpch_q15/duckdb:vortex-file-compressed 156579782 / 389382453 / -59.8% 🟢 222848894 / 467071910 / -52.3% 🟢 0.70 / 0.83 / -15.7%
tpch_q16/duckdb:vortex-file-compressed 185861114 / 197817918 / -6.0% 253326403 / 200078399 / +26.6% 0.73 / 0.99 / -25.8%
tpch_q17/duckdb:vortex-file-compressed 535469806 / 764726607 / -30.0% 527549192 / 646721157 / -18.4% 1.02 / 1.18 / -14.2%
tpch_q18/duckdb:vortex-file-compressed 380095862 / 570304025 / -33.4% 🟢 515045240 / 573439503 / -10.2% 0.74 / 0.99 / -25.8%
tpch_q19/duckdb:vortex-file-compressed 368029672 / 406979721 / -9.6% 397691749 / 470882484 / -15.5% 0.93 / 0.86 / +7.1%
tpch_q20/duckdb:vortex-file-compressed 525306688 / 423732056 / +24.0% 535014480 / 632224067 / -15.4% 0.98 / 0.67 / +46.5%
tpch_q21/duckdb:vortex-file-compressed 908648448 / 1053860681 / -13.8% 920529907 / 1034897888 / -11.1% 0.99 / 1.02 / -3.1%
tpch_q22/duckdb:vortex-file-compressed 372273418 / 333859874 / +11.5% 356195974 / 355149622 / +0.3% 1.05 / 0.94 / +11.2%
duckdb / vortex-compact / ns (0.880x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 227660204 / 224653138 / +1.3% 381172645 / 391145405 / -2.5% 0.60 / 0.57 / +4.0%
tpch_q02/duckdb:vortex-compact 392761516 / 434297443 / -9.6% 469418190 / 631642139 / -25.7% 0.84 / 0.69 / +21.7%
tpch_q03/duckdb:vortex-compact 490005404 / 541041979 / -9.4% 540565048 / 925742075 / -41.6% 🟢 0.91 / 0.58 / +55.1%
tpch_q04/duckdb:vortex-compact 289559717 / 406362538 / -28.7% 260637710 / 426075498 / -38.8% 🟢 1.11 / 0.95 / +16.5%
tpch_q05/duckdb:vortex-compact 396482816 / 459700210 / -13.8% 506154708 / 604841607 / -16.3% 0.78 / 0.76 / +3.1%
tpch_q06/duckdb:vortex-compact 304393606 / 423148872 / -28.1% 342178008 / 346644379 / -1.3% 0.89 / 1.22 / -27.1%
tpch_q07/duckdb:vortex-compact 526547468 / 513581045 / +2.5% 538993799 / 504526683 / +6.8% 0.98 / 1.02 / -4.0%
tpch_q08/duckdb:vortex-compact 607573689 / 652202864 / -6.8% 721299861 / 684225671 / +5.4% 0.84 / 0.95 / -11.6%
tpch_q09/duckdb:vortex-compact 482556784 / 554883574 / -13.0% 480280070 / 765479651 / -37.3% 🟢 1.00 / 0.72 / +38.6%
tpch_q10/duckdb:vortex-compact 398159043 / 506578525 / -21.4% 408708838 / 515721774 / -20.8% 0.97 / 0.98 / -0.8%
tpch_q11/duckdb:vortex-compact 213604398 / 220370621 / -3.1% 214427302 / 225956213 / -5.1% 1.00 / 0.98 / +2.1%
tpch_q12/duckdb:vortex-compact 491455055 / 550548921 / -10.7% 517874469 / 647793827 / -20.1% 0.95 / 0.85 / +11.7%
tpch_q13/duckdb:vortex-compact 249967803 / 268092222 / -6.8% 231617817 / 413482258 / -44.0% 🟢 1.08 / 0.65 / +66.5%
tpch_q14/duckdb:vortex-compact 275823435 / 265370848 / +3.9% 344958539 / 331728981 / +4.0% 0.80 / 0.80 / -0.0%
tpch_q15/duckdb:vortex-compact 161404869 / 262876563 / -38.6% 🟢 204565944 / 297448643 / -31.2% 🟢 0.79 / 0.88 / -10.7%
tpch_q16/duckdb:vortex-compact 180501741 / 194951143 / -7.4% 192957823 / 209204428 / -7.8% 0.94 / 0.93 / +0.4%
tpch_q17/duckdb:vortex-compact 421517037 / 485432230 / -13.2% 501588075 / 556299057 / -9.8% 0.84 / 0.87 / -3.7%
tpch_q18/duckdb:vortex-compact 285459785 / 498802448 / -42.8% 🟢 333539960 / 610749344 / -45.4% 🟢 0.86 / 0.82 / +4.8%
tpch_q19/duckdb:vortex-compact 416434224 / 499635184 / -16.7% 576270620 / 589555294 / -2.3% 0.72 / 0.85 / -14.7%
tpch_q20/duckdb:vortex-compact 396882393 / 423139023 / -6.2% 526907091 / 518943292 / +1.5% 0.75 / 0.82 / -7.6%
tpch_q21/duckdb:vortex-compact 632353305 / 833592924 / -24.1% 719746746 / 788282889 / -8.7% 0.88 / 1.06 / -16.9%
tpch_q22/duckdb:vortex-compact 278275432 / 156579516 / +77.7% 🔴 443114751 / 170816308 / +159.4% 🔴 0.63 / 0.92 / -31.5%
duckdb / parquet / ns (1.068x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 304613651 / 347901676 / -12.4% 611361683 / 364012436 / +68.0% 🔴 0.50 / 0.96 / -47.9%
tpch_q02/duckdb:parquet 645067268 / 653595818 / -1.3% 722696003 / 711762974 / +1.5% 0.89 / 0.92 / -2.8%
tpch_q03/duckdb:parquet 905262252 / 807232290 / +12.1% 1044866070 / 1003487066 / +4.1% 0.87 / 0.80 / +7.7%
tpch_q04/duckdb:parquet 514842119 / 483632920 / +6.5% 518287803 / 573763508 / -9.7% 0.99 / 0.84 / +17.8%
tpch_q05/duckdb:parquet 1109500927 / 956870051 / +16.0% 1210313167 / 845480330 / +43.2% 🔴 0.92 / 1.13 / -19.0%
tpch_q06/duckdb:parquet 325010530 / 346922396 / -6.3% 309404573 / 416719435 / -25.8% 1.05 / 0.83 / +26.2%
tpch_q07/duckdb:parquet 872130698 / 1021547803 / -14.6% 875293363 / 982915113 / -10.9% 1.00 / 1.04 / -4.1%
tpch_q08/duckdb:parquet 1173874561 / 1137450769 / +3.2% 1206874655 / 1202150500 / +0.4% 0.97 / 0.95 / +2.8%
tpch_q09/duckdb:parquet 974517915 / 1058342887 / -7.9% 1006870064 / 1020662735 / -1.4% 0.97 / 1.04 / -6.7%
tpch_q10/duckdb:parquet 1386953844 / 914312790 / +51.7% 🔴 1327204511 / 981436164 / +35.2% 🔴 1.05 / 0.93 / +12.2%
tpch_q11/duckdb:parquet 410575170 / 420812594 / -2.4% 451327691 / 398739344 / +13.2% 0.91 / 1.06 / -13.8%
tpch_q12/duckdb:parquet 619283138 / 669890425 / -7.6% 644365061 / 693652978 / -7.1% 0.96 / 0.97 / -0.5%
tpch_q13/duckdb:parquet 745937170 / 698948919 / +6.7% 1006994676 / 962226929 / +4.7% 0.74 / 0.73 / +2.0%
tpch_q14/duckdb:parquet 608348650 / 522496287 / +16.4% 517332835 / 719415302 / -28.1% 1.18 / 0.73 / +61.9%
tpch_q15/duckdb:parquet 581557141 / 430828811 / +35.0% 🔴 543688465 / 923702345 / -41.1% 🟢 1.07 / 0.47 / +129.3%
tpch_q16/duckdb:parquet 559780109 / 497241027 / +12.6% 519413820 / 452951120 / +14.7% 1.08 / 1.10 / -1.8%
tpch_q17/duckdb:parquet 466578195 / 498212343 / -6.3% 550522453 / 451070129 / +22.0% 0.85 / 1.10 / -23.3%
tpch_q18/duckdb:parquet 737885152 / 610581741 / +20.8% 808560610 / 655002079 / +23.4% 0.91 / 0.93 / -2.1%
tpch_q19/duckdb:parquet 621446922 / 661068094 / -6.0% 503238987 / 669151886 / -24.8% 1.23 / 0.99 / +25.0%
tpch_q20/duckdb:parquet 842231579 / 852408121 / -1.2% 803415613 / 839793480 / -4.3% 1.05 / 1.02 / +3.3%
tpch_q21/duckdb:parquet 704831782 / 769484076 / -8.4% 730772297 / 712869787 / +2.5% 0.96 / 1.08 / -10.6%
tpch_q22/duckdb:parquet 835539184 / 443832814 / +88.3% 🔴 691119249 / 419718305 / +64.7% 🔴 1.21 / 1.06 / +14.3%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 803a0e97 vs base d14fa267
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +14.8%
Engines: DataFusion No clear signal (+11.9%, environment too noisy confidence) · DuckDB No clear signal (+17.9%, environment too noisy confidence)
Vortex (geomean): hot 0.820x ➖ · cold 0.776x ➖
Parquet (geomean): hot 0.714x ➖ · cold 0.760x ➖
Shifts: Parquet (control) -28.6% · Median polish -25.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (0.742x ➖, 8↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 356537053 / 878207514 / -59.4% 🟢 1078070376 / 1598473029 / -32.6% 🟢 0.33 / 0.55 / -39.8%
tpch_q02/datafusion:vortex-compact 660938961 / 593781579 / +11.3% 1195092228 / 1228919718 / -2.8% 0.55 / 0.48 / +14.5%
tpch_q03/datafusion:vortex-compact 754782623 / 1425992975 / -47.1% 🟢 1758222257 / 2684198458 / -34.5% 🟢 0.43 / 0.53 / -19.2%
tpch_q04/datafusion:vortex-compact 457049204 / 554783185 / -17.6% 823497341 / 984086456 / -16.3% 0.56 / 0.56 / -1.6%
tpch_q05/datafusion:vortex-compact 821293175 / 1221744002 / -32.8% 🟢 996819067 / 1350544969 / -26.2% 0.82 / 0.90 / -8.9%
tpch_q06/datafusion:vortex-compact 494822713 / 1476309073 / -66.5% 🟢 652103563 / 1197620207 / -45.6% 🟢 0.76 / 1.23 / -38.4%
tpch_q07/datafusion:vortex-compact 949502807 / 1184360572 / -19.8% 1103167538 / 1307396067 / -15.6% 0.86 / 0.91 / -5.0%
tpch_q08/datafusion:vortex-compact 1129528189 / 1450612988 / -22.1% 1282205586 / 1857864048 / -31.0% 🟢 0.88 / 0.78 / +12.8%
tpch_q09/datafusion:vortex-compact 951363898 / 1147059900 / -17.1% 1225839765 / 1273737845 / -3.8% 0.78 / 0.90 / -13.8%
tpch_q10/datafusion:vortex-compact 837305767 / 1407480457 / -40.5% 🟢 1367127190 / 1595487492 / -14.3% 0.61 / 0.88 / -30.6%
tpch_q11/datafusion:vortex-compact 411352983 / 357422220 / +15.1% 800142415 / 735673477 / +8.8% 0.51 / 0.49 / +5.8%
tpch_q12/datafusion:vortex-compact 868258549 / 1060058374 / -18.1% 1045735923 / 1678864108 / -37.7% 🟢 0.83 / 0.63 / +31.5%
tpch_q13/datafusion:vortex-compact 269030049 / 238345834 / +12.9% 616498876 / 809804932 / -23.9% 0.44 / 0.29 / +48.3%
tpch_q14/datafusion:vortex-compact 472111444 / 807989270 / -41.6% 🟢 800469035 / 1483586180 / -46.0% 🟢 0.59 / 0.54 / +8.3%
tpch_q15/datafusion:vortex-compact 1003570404 / 1686589695 / -40.5% 🟢 1569665097 / 2239796855 / -29.9% 0.64 / 0.75 / -15.1%
tpch_q16/datafusion:vortex-compact 377160399 / 270627000 / +39.4% 🔴 512459340 / 482621507 / +6.2% 0.74 / 0.56 / +31.3%
tpch_q17/datafusion:vortex-compact 970139886 / 1328558379 / -27.0% 987812904 / 1588947648 / -37.8% 🟢 0.98 / 0.84 / +17.5%
tpch_q18/datafusion:vortex-compact 735222637 / 1024600183 / -28.2% 770506672 / 1604613294 / -52.0% 🟢 0.95 / 0.64 / +49.4%
tpch_q19/datafusion:vortex-compact 647359642 / 1106151772 / -41.5% 🟢 1060502830 / 1469961718 / -27.9% 0.61 / 0.75 / -18.9%
tpch_q20/datafusion:vortex-compact 906617055 / 1206901388 / -24.9% 1086135128 / 2260080017 / -51.9% 🟢 0.83 / 0.53 / +56.3%
tpch_q21/datafusion:vortex-compact 1761658252 / 2417986031 / -27.1% 1641415727 / 3070183993 / -46.5% 🟢 1.07 / 0.79 / +36.3%
tpch_q22/datafusion:vortex-compact 498450527 / 423488572 / +17.7% 877973885 / 788551353 / +11.3% 0.57 / 0.54 / +5.7%
datafusion / parquet / ns (0.663x ✅, 15↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 445646033 / 666283420 / -33.1% 🟢 1249088248 / 1477719191 / -15.5% 0.36 / 0.45 / -20.9%
tpch_q02/datafusion:parquet 494429313 / 1119083832 / -55.8% 🟢 1085820710 / 1874012853 / -42.1% 🟢 0.46 / 0.60 / -23.7%
tpch_q03/datafusion:parquet 802682812 / 956996464 / -16.1% 1291267935 / 1606599189 / -19.6% 0.62 / 0.60 / +4.4%
tpch_q04/datafusion:parquet 374572604 / 547671590 / -31.6% 🟢 592439204 / 752667038 / -21.3% 0.63 / 0.73 / -13.1%
tpch_q05/datafusion:parquet 699406918 / 1100374912 / -36.4% 🟢 1959429584 / 1432939491 / +36.7% 🔴 0.36 / 0.77 / -53.5%
tpch_q06/datafusion:parquet 437014551 / 667814273 / -34.6% 🟢 838955003 / 764104672 / +9.8% 0.52 / 0.87 / -40.4%
tpch_q07/datafusion:parquet 885935412 / 926693679 / -4.4% 1011793781 / 1358864656 / -25.5% 0.88 / 0.68 / +28.4%
tpch_q08/datafusion:parquet 1015557915 / 1113598974 / -8.8% 1572645993 / 1600516153 / -1.7% 0.65 / 0.70 / -7.2%
tpch_q09/datafusion:parquet 1012480113 / 1861609733 / -45.6% 🟢 1779434806 / 2035707093 / -12.6% 0.57 / 0.91 / -37.8%
tpch_q10/datafusion:parquet 1811372245 / 1586977460 / +14.1% 2359078368 / 2313862393 / +2.0% 0.77 / 0.69 / +12.0%
tpch_q11/datafusion:parquet 455982041 / 975088742 / -53.2% 🟢 753094511 / 1747782355 / -56.9% 🟢 0.61 / 0.56 / +8.5%
tpch_q12/datafusion:parquet 402177677 / 751983235 / -46.5% 🟢 688531147 / 1005900792 / -31.6% 🟢 0.58 / 0.75 / -21.9%
tpch_q13/datafusion:parquet 573107715 / 584831193 / -2.0% 1485973037 / 1000457050 / +48.5% 🔴 0.39 / 0.58 / -34.0%
tpch_q14/datafusion:parquet 495564827 / 935748172 / -47.0% 🟢 728841184 / 1207131915 / -39.6% 🟢 0.68 / 0.78 / -12.3%
tpch_q15/datafusion:parquet 720420068 / 1433617418 / -49.7% 🟢 1033047341 / 1663146316 / -37.9% 🟢 0.70 / 0.86 / -19.1%
tpch_q16/datafusion:parquet 251076662 / 827256151 / -69.6% 🟢 489828983 / 1174478269 / -58.3% 🟢 0.51 / 0.70 / -27.2%
tpch_q17/datafusion:parquet 860868948 / 1345555783 / -36.0% 🟢 919776862 / 1560693895 / -41.1% 🟢 0.94 / 0.86 / +8.6%
tpch_q18/datafusion:parquet 1141367734 / 889386672 / +28.3% 2081532640 / 1205504836 / +72.7% 🔴 0.55 / 0.74 / -25.7%
tpch_q19/datafusion:parquet 486105460 / 1009200188 / -51.8% 🟢 805067056 / 1054630892 / -23.7% 0.60 / 0.96 / -36.9%
tpch_q20/datafusion:parquet 799134531 / 1318821420 / -39.4% 🟢 1161453921 / 1559886299 / -25.5% 0.69 / 0.85 / -18.6%
tpch_q21/datafusion:parquet 1005895179 / 1641110139 / -38.7% 🟢 1152836066 / 1678902319 / -31.3% 🟢 0.87 / 0.98 / -10.7%
tpch_q22/datafusion:parquet 541124901 / 507997049 / +6.5% 796465734 / 926743299 / -14.1% 0.68 / 0.55 / +23.9%
duckdb / vortex-compact / ns (0.907x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1271817238 / 1287859713 / -1.2% 1953718137 / 2605269572 / -25.0% 0.65 / 0.49 / +31.7%
tpch_q02/duckdb:vortex-compact 634578944 / 480771432 / +32.0% 🔴 727474770 / 803595978 / -9.5% 0.87 / 0.60 / +45.8%
tpch_q03/duckdb:vortex-compact 1462682050 / 1507285463 / -3.0% 1649722985 / 2364123561 / -30.2% 🟢 0.89 / 0.64 / +39.1%
tpch_q04/duckdb:vortex-compact 918037701 / 1069954551 / -14.2% 922421104 / 1477978542 / -37.6% 🟢 1.00 / 0.72 / +37.5%
tpch_q05/duckdb:vortex-compact 1605814098 / 1967206295 / -18.4% 1920826832 / 2638078113 / -27.2% 0.84 / 0.75 / +12.1%
tpch_q06/duckdb:vortex-compact 1401769165 / 1778555657 / -21.2% 1411178529 / 1676154354 / -15.8% 0.99 / 1.06 / -6.4%
tpch_q07/duckdb:vortex-compact 1858181050 / 2267577058 / -18.1% 1855011245 / 1906258918 / -2.7% 1.00 / 1.19 / -15.8%
tpch_q08/duckdb:vortex-compact 1792291768 / 2380755381 / -24.7% 2045962736 / 2802879396 / -27.0% 0.88 / 0.85 / +3.1%
tpch_q09/duckdb:vortex-compact 2309294932 / 2344661061 / -1.5% 2225425395 / 2902019847 / -23.3% 1.04 / 0.81 / +28.4%
tpch_q10/duckdb:vortex-compact 1776349458 / 2118678855 / -16.2% 2633594677 / 2448653150 / +7.6% 0.67 / 0.87 / -22.0%
tpch_q11/duckdb:vortex-compact 683670016 / 535622923 / +27.6% 804632251 / 731970685 / +9.9% 0.85 / 0.73 / +16.1%
tpch_q12/duckdb:vortex-compact 2189985319 / 2606283390 / -16.0% 2351772776 / 3496759304 / -32.7% 🟢 0.93 / 0.75 / +24.9%
tpch_q13/duckdb:vortex-compact 1142113171 / 1188484542 / -3.9% 1656263289 / 2110836624 / -21.5% 0.69 / 0.56 / +22.5%
tpch_q14/duckdb:vortex-compact 1115762802 / 1171415922 / -4.8% 1077230755 / 1551290611 / -30.6% 🟢 1.04 / 0.76 / +37.2%
tpch_q15/duckdb:vortex-compact 1142363873 / 1330593559 / -14.1% 1269284606 / 1647786288 / -23.0% 0.90 / 0.81 / +11.5%
tpch_q16/duckdb:vortex-compact 249836143 / 263670509 / -5.2% 328113769 / 301639953 / +8.8% 0.76 / 0.87 / -12.9%
tpch_q17/duckdb:vortex-compact 1453615654 / 1838011028 / -20.9% 1593078770 / 2097697361 / -24.1% 0.91 / 0.88 / +4.1%
tpch_q18/duckdb:vortex-compact 1057665888 / 1544645518 / -31.5% 🟢 1247229933 / 1709983441 / -27.1% 0.85 / 0.90 / -6.1%
tpch_q19/duckdb:vortex-compact 1550785400 / 1701935165 / -8.9% 1372589772 / 1709828704 / -19.7% 1.13 / 1.00 / +13.5%
tpch_q20/duckdb:vortex-compact 1928480960 / 2009078453 / -4.0% 2940127771 / 2013714024 / +46.0% 🔴 0.66 / 1.00 / -34.3%
tpch_q21/duckdb:vortex-compact 2702571529 / 3150043882 / -14.2% 2659587998 / 3576110445 / -25.6% 1.02 / 0.88 / +15.4%
tpch_q22/duckdb:vortex-compact 479880218 / 470142909 / +2.1% 690809266 / 756521407 / -8.7% 0.69 / 0.62 / +11.8%
duckdb / parquet / ns (0.770x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 519477092 / 1141248000 / -54.5% 🟢 484880522 / 1658089686 / -70.8% 🟢 1.07 / 0.69 / +55.7%
tpch_q02/duckdb:parquet 927769992 / 1936964133 / -52.1% 🟢 1181307534 / 3004739038 / -60.7% 🟢 0.79 / 0.64 / +21.8%
tpch_q03/duckdb:parquet 1155534818 / 1515732625 / -23.8% 1298769125 / 2923651367 / -55.6% 🟢 0.89 / 0.52 / +71.6%
tpch_q04/duckdb:parquet 638081572 / 896535941 / -28.8% 861517848 / 1113310002 / -22.6% 0.74 / 0.81 / -8.0%
tpch_q05/duckdb:parquet 1510761749 / 1353990040 / +11.6% 1472544008 / 1693111991 / -13.0% 1.03 / 0.80 / +28.3%
tpch_q06/duckdb:parquet 763010085 / 930970769 / -18.0% 789800687 / 1082400590 / -27.0% 0.97 / 0.86 / +12.3%
tpch_q07/duckdb:parquet 1251582816 / 1455898785 / -14.0% 1169207044 / 1747685777 / -33.1% 🟢 1.07 / 0.83 / +28.5%
tpch_q08/duckdb:parquet 2058081933 / 1519950950 / +35.4% 🔴 2014998613 / 1478932924 / +36.2% 🔴 1.02 / 1.03 / -0.6%
tpch_q09/duckdb:parquet 1855374450 / 2639152974 / -29.7% 2636786610 / 3381417985 / -22.0% 0.70 / 0.78 / -9.8%
tpch_q10/duckdb:parquet 2198297790 / 2799263307 / -21.5% 2790395517 / 2933535992 / -4.9% 0.79 / 0.95 / -17.4%
tpch_q11/duckdb:parquet 495441658 / 1344849379 / -63.2% 🟢 514842344 / 1673484655 / -69.2% 🟢 0.96 / 0.80 / +19.7%
tpch_q12/duckdb:parquet 872962258 / 1079116105 / -19.1% 1016012735 / 1141971236 / -11.0% 0.86 / 0.94 / -9.1%
tpch_q13/duckdb:parquet 1031931823 / 943275321 / +9.4% 1554904602 / 1301063641 / +19.5% 0.66 / 0.73 / -8.5%
tpch_q14/duckdb:parquet 1162184443 / 1619276171 / -28.2% 1435155885 / 1541303384 / -6.9% 0.81 / 1.05 / -22.9%
tpch_q15/duckdb:parquet 749370815 / 1016613357 / -26.3% 902036017 / 951100317 / -5.2% 0.83 / 1.07 / -22.3%
tpch_q16/duckdb:parquet 626440004 / 1225827046 / -48.9% 🟢 700542911 / 1826871014 / -61.7% 🟢 0.89 / 0.67 / +33.3%
tpch_q17/duckdb:parquet 1266726801 / 1108460212 / +14.3% 1198734501 / 957610861 / +25.2% 1.06 / 1.16 / -8.7%
tpch_q18/duckdb:parquet 1024538437 / 956437899 / +7.1% 1106975434 / 1104321014 / +0.2% 0.93 / 0.87 / +6.9%
tpch_q19/duckdb:parquet 1046771185 / 1302592764 / -19.6% 1156635797 / 1312840532 / -11.9% 0.91 / 0.99 / -8.8%
tpch_q20/duckdb:parquet 1617169013 / 2127454483 / -24.0% 1532502496 / 2346224180 / -34.7% 🟢 1.06 / 0.91 / +16.4%
tpch_q21/duckdb:parquet 1005450162 / 1410711051 / -28.7% 974818030 / 1776849486 / -45.1% 🟢 1.03 / 0.79 / +29.9%
tpch_q22/duckdb:parquet 788876073 / 812821436 / -2.9% 929353006 / 870868507 / +6.7% 0.85 / 0.93 / -9.1%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 803a0e97 vs base dc0e885d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: random-access No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.982x ➖
Parquet (geomean): hot 0.993x ➖
Shifts: Parquet (control) -0.7% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
vortex / arrow-ipc / ns (0.940x ➖, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 70171 / 73637 / -4.7%
random-access/arrow-tokio-local-disk-footer 162993 / 164098 / -0.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1328649 / 2539469 / -47.7% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 1968341 / 2087152 / -5.7%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 56047704 / 55304737 / +1.3%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 32796163 / 32881849 / -0.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk 59037 / 60840 / -3.0%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 102380 / 105039 / -2.5%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1110193 / 1123100 / -1.1%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1177991 / 1187796 / -0.8%
random-access/nested-structs/correlated/arrow-tokio-local-disk 52890 / 56525 / -6.4%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 95675 / 94447 / +1.3%
random-access/nested-structs/uniform/arrow-tokio-local-disk 874082 / 925714 / -5.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 929191 / 948783 / -2.1%
random-access/taxi/correlated/arrow-tokio-local-disk 119368 / 123721 / -3.5%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 212373 / 219094 / -3.1%
random-access/taxi/uniform/arrow-tokio-local-disk 2849834 / 2971649 / -4.1%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2971802 / 3100120 / -4.1%
random-access / vortex-file-compressed / ns (0.982x ➖, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 243500 / 244531 / -0.4%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1195732 / 1239609 / -3.5%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1407076 / 1436776 / -2.1%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2661054 / 2676387 / -0.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk 204590 / 234367 / -12.7% 🟢
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 363032 / 393516 / -7.7%
random-access/nested-lists/uniform/vortex-tokio-local-disk 712596 / 746651 / -4.6%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 929233 / 938389 / -1.0%
random-access/nested-structs/correlated/vortex-tokio-local-disk 287196 / 272164 / +5.5%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 512222 / 520344 / -1.6%
random-access/nested-structs/uniform/vortex-tokio-local-disk 616880 / 592153 / +4.2%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 955282 / 967652 / -1.3%
random-access/taxi/correlated/vortex-tokio-local-disk 652644 / 670029 / -2.6%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1465376 / 1443807 / +1.5%
random-access/taxi/uniform/vortex-tokio-local-disk 2678113 / 2601313 / +3.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3779704 / 3805649 / -0.7%
random-access/vortex-tokio-local-disk 431911 / 447229 / -3.4%
random-access/vortex-tokio-local-disk-footer 1055743 / 1082462 / -2.5%
random-access / parquet / ns (0.993x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107313884010 / 107456737883 / -0.1%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 108263928845 / 108047914281 / +0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 107941911222 / 113640909249 / -5.0%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 108422643654 / 114000552433 / -4.9%
random-access/nested-lists/correlated/parquet-tokio-local-disk 144412368 / 144439331 / -0.0%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 147945027 / 148188217 / -0.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk 144201347 / 148027428 / -2.6%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 148054983 / 148984132 / -0.6%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44155617 / 44261005 / -0.2%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 44140939 / 44228726 / -0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44075334 / 44155940 / -0.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 44147243 / 44191264 / -0.1%
random-access/parquet-tokio-local-disk 118700487 / 120220527 / -1.3%
random-access/parquet-tokio-local-disk-footer 120501052 / 120527456 / -0.0%
random-access/taxi/correlated/parquet-tokio-local-disk 178135182 / 180481695 / -1.3%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 180728081 / 179875289 / +0.5%
random-access/taxi/uniform/parquet-tokio-local-disk 192883339 / 187831646 / +2.7%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 193156471 / 192565774 / +0.3%
random-access / lance / ns (0.988x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 292550 / 302977 / -3.4%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1228408 / 1254075 / -2.0%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1026889 / 1061124 / -3.2%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1966736 / 2016999 / -2.5%
random-access/lance-tokio-local-disk 525762 / 527337 / -0.3%
random-access/lance-tokio-local-disk-footer 1477255 / 1492897 / -1.0%
random-access/nested-lists/correlated/lance-tokio-local-disk 159199 / 157726 / +0.9%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 726160 / 731264 / -0.7%
random-access/nested-lists/uniform/lance-tokio-local-disk 835870 / 855746 / -2.3%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1450928 / 1445035 / +0.4%
random-access/nested-structs/correlated/lance-tokio-local-disk 267513 / 276222 / -3.2%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 639792 / 646702 / -1.1%
random-access/nested-structs/uniform/lance-tokio-local-disk 2279131 / 2278620 / +0.0%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2676877 / 2689430 / -0.5%
random-access/taxi/correlated/lance-tokio-local-disk 758494 / 762070 / -0.5%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2048456 / 2047818 / +0.0%
random-access/taxi/uniform/lance-tokio-local-disk 8046826 / 8089020 / -0.5%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8962544 / 9086096 / -1.4%

@github-actions

github-actions Bot commented Oct 6, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 803a0e97 vs base d8fa2b66
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.0%
Engines: random-access No clear signal (-11.0%, environment too noisy confidence)
Vortex (geomean): hot 0.934x ➖
Parquet (geomean): hot 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish +3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
random-access / vortex-file-compressed / ns (0.934x ➖, 4↑ 4↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 49953879 / 650447126 / -92.3% 🟢
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 124603763 / 115132908 / +8.2%
random-access/feature-vectors/uniform/vortex-tokio-s3 273433960 / 705724537 / -61.3% 🟢
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 231403433 / 749463203 / -69.1% 🟢
random-access/nested-lists/correlated/vortex-tokio-s3 51334818 / 74843052 / -31.4% 🟢
random-access/nested-lists/correlated/vortex-tokio-s3-footer 92777135 / 115902578 / -20.0%
random-access/nested-lists/uniform/vortex-tokio-s3 160199119 / 164773478 / -2.8%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 201895925 / 199992260 / +1.0%
random-access/nested-structs/correlated/vortex-tokio-s3 299523561 / 142905150 / +109.6% 🔴
random-access/nested-structs/correlated/vortex-tokio-s3-footer 338686256 / 112327737 / +201.5% 🔴
random-access/nested-structs/uniform/vortex-tokio-s3 387894064 / 169650480 / +128.6% 🔴
random-access/nested-structs/uniform/vortex-tokio-s3-footer 505290533 / 213836908 / +136.3% 🔴
random-access/taxi/correlated/vortex-tokio-s3 98201390 / 97255005 / +1.0%
random-access/taxi/correlated/vortex-tokio-s3-footer 151227699 / 132999978 / +13.7%
random-access/taxi/uniform/vortex-tokio-s3 174690239 / 174046970 / +0.4%
random-access/taxi/uniform/vortex-tokio-s3-footer 221937404 / 216418564 / +2.6%
random-access/vortex-tokio-s3 56377296 / 45687179 / +23.4%
random-access/vortex-tokio-s3-footer 94659522 / 86669221 / +9.2%
random-access / parquet / ns (1.049x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 177924170146 / 169526633030 / +5.0%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 182815598635 / 166385085082 / +9.9%
random-access/feature-vectors/uniform/parquet-tokio-s3 179438236258 / 179674981371 / -0.1%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 180302433590 / 193914818564 / -7.0%
random-access/nested-lists/correlated/parquet-tokio-s3 1130229090 / 1029776281 / +9.8%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1127885625 / 1105056331 / +2.1%
random-access/nested-lists/uniform/parquet-tokio-s3 1139042496 / 1031603874 / +10.4%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1196685843 / 1130565121 / +5.8%
random-access/nested-structs/correlated/parquet-tokio-s3 452905448 / 457398217 / -1.0%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 532927558 / 530433013 / +0.5%
random-access/nested-structs/uniform/parquet-tokio-s3 702272144 / 452114049 / +55.3% 🔴
random-access/nested-structs/uniform/parquet-tokio-s3-footer 532246656 / 541040371 / -1.6%
random-access/parquet-tokio-s3 486047893 / 475918048 / +2.1%
random-access/parquet-tokio-s3-footer 526865217 / 541761194 / -2.7%
random-access/taxi/correlated/parquet-tokio-s3 736623708 / 714938466 / +3.0%
random-access/taxi/correlated/parquet-tokio-s3-footer 849990441 / 783825771 / +8.4%
random-access/taxi/uniform/parquet-tokio-s3 802696343 / 776569559 / +3.4%
random-access/taxi/uniform/parquet-tokio-s3-footer 831509139 / 854798938 / -2.7%
random-access / lance / ns (0.855x ➖, 3↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 42560037 / 159502545 / -73.3% 🟢
random-access/feature-vectors/correlated/lance-tokio-s3-footer 208269412 / 260131327 / -19.9%
random-access/feature-vectors/uniform/lance-tokio-s3 225113768 / 241620304 / -6.8%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 361473785 / 419158811 / -13.8%
random-access/lance-tokio-s3 58660828 / 100452149 / -41.6% 🟢
random-access/lance-tokio-s3-footer 245000421 / 272358642 / -10.0%
random-access/nested-lists/correlated/lance-tokio-s3 55110333 / 32799994 / +68.0% 🔴
random-access/nested-lists/correlated/lance-tokio-s3-footer 291601830 / 223738508 / +30.3% 🔴
random-access/nested-lists/uniform/lance-tokio-s3 180768758 / 185357201 / -2.5%
random-access/nested-lists/uniform/lance-tokio-s3-footer 323205254 / 275751460 / +17.2%
random-access/nested-structs/correlated/lance-tokio-s3 47338649 / 54678585 / -13.4%
random-access/nested-structs/correlated/lance-tokio-s3-footer 244982954 / 251710465 / -2.7%
random-access/nested-structs/uniform/lance-tokio-s3 121493441 / 151007257 / -19.5%
random-access/nested-structs/uniform/lance-tokio-s3-footer 306130784 / 321565595 / -4.8%
random-access/taxi/correlated/lance-tokio-s3 59211147 / 80034544 / -26.0%
random-access/taxi/correlated/lance-tokio-s3-footer 259222787 / 290402522 / -10.7%
random-access/taxi/uniform/lance-tokio-s3 226975956 / 327793523 / -30.8% 🟢
random-access/taxi/uniform/lance-tokio-s3-footer 498247426 / 562317285 / -11.4%

@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 4 times, most recently from 243389b to 957acbb Compare October 12, 2026 12:56
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 5 times, most recently from 6478d51 to 59e77bd Compare October 16, 2026 00:06
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 7 times, most recently from 0312f9f to 8c8b6c8 Compare October 23, 2026 14:58
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch 2 times, most recently from f89c6b5 to 3115e2c Compare October 23, 2026 18:46
@robert3005 robert3005 changed the title Reclassify and simplify error types Simplify error types, remove kind from struct Oct 26, 2026
@robert3005 @claude
Collapse VortexError into a single message-carrying error
be70183 
VortexError had an enum variant per failure mode and per foreign error
type (Arrow, flatbuffers, prost, io, object_store, jiff, ...). Callers
rarely branched on the variant, and keeping one per dependency made the
type large and the set of variants grow with every new dependency.

A VortexError is now a message, an optional source and a backtrace. A
foreign error is kept as the source and recovered by downcasting, and
context is added in place with with_context. The payload sits behind a
single Arc, so VortexError and VortexResult<()> are one pointer wide,
which keeps most results in registers on the success path.

The error macros take a plain format string, plus the Context: and
External: forms. Call sites that used the variant-specific forms now pass
a message, and errors that were formatted into new errors now add
context instead, so their source and backtrace survive. Tests that
matched on a variant now assert on the guard's message.

Python raises RuntimeError for every Vortex error, as before. The C API
reports VX_ERROR_CODE_OTHER for Vortex errors and VX_ERROR_CODE_PANIC for
panics, at their existing values; the other codes are retired, and the
C++ ErrorCode mirrors the C enum.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01S7EtMqoZ91rrCCh9vS2yTm
@robert3005
robert3005 force-pushed the claude/affectionate-keller-4j7w5g branch from 3115e2c to be70183 Compare October 26, 2026 13:27
@robert3005
robert3005 merged commit f3cbb32 into develop Oct 26, 2026
87 of 88 checks passed
@robert3005
robert3005 deleted the claude/affectionate-keller-4j7w5g branch October 26, 2026 14:00
@connortsui20 connortsui20 mentioned this pull request Oct 26, 2026
Open
20 of 34 tasks
connortsui20 added a commit that referenced this pull request Oct 26, 2026
@connortsui20
Update the Narrow and decimal research for the first PRs
0c062ea 
Records why FX2 was dropped (#10798 documents the cast-rule contract), the merged CD2 fixtures, the error types without categories (#10080), and the FoR scheme change (#10757). The tracking issues #10701 and #10733 now hold the state of each PR, so part 4 points to them instead of a status table.

Signed-off-by: Connor Tsui <[email protected]>
connortsui20 added a commit that referenced this pull request Oct 26, 2026
@connortsui20
Update the Narrow and decimal research for the first PRs
f3f42a2 
Records why FX2 was dropped (#10798 documents the cast-rule contract), the merged CD2 fixtures, the error types without categories (#10080), and the FoR scheme change (#10757). The tracking issues #10701 and #10733 now hold the state of each PR, so part 4 points to them instead of a status table.

Signed-off-by: Connor Tsui <[email protected]>
@connortsui20 connortsui20 mentioned this pull request Nov 4, 2026
Merged
connortsui20 added a commit that referenced this pull request Nov 4, 2026
@connortsui20
Fix the mixed-dimension chunk test in vortex-bench (#11236)
9d2da79 
## Summary

`chunked_input_with_mixed_dimensions_returns_error` has failed on
`develop` since #10080 removed the "Mismatched types" text that it looks
for. CI excludes `vortex-bench` from nextest, so CI never ran it. The
conversion still rejects chunks with different vector dimensions at the
`vortex_ensure_eq!` in `list_to_vector_ext`, so only the assertion was
stale.

## Changes

The test now checks that the error names both vector dtypes: dimension 2
from the second chunk against dimension 3 from the first.

Signed-off-by: Connor Tsui <[email protected]>
@robert3005 robert3005 mentioned this pull request Nov 6, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joseph-isaacs joseph-isaacs joseph-isaacs approved these changes

Assignees

No one assigned

Labels

changelog/break A breaking API change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@robert3005 @joseph-isaacs