Skip to content

fix(layout): preserve shared segment wakeups during prefetch races - #11334

Draft
joseph-isaacs wants to merge 1 commit into
developfrom
ji/clickbench-v2-20261109-01-io-wakeups
Draft

fix(layout): preserve shared segment wakeups during prefetch races#11334
joseph-isaacs wants to merge 1 commit into
developfrom
ji/clickbench-v2-20261109-01-io-wakeups

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Nov 9, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Draft correctness fix. The deterministic regression is fixed; measured performance costs and uncertainty are disclosed below.

Summary

A temporary V2 prefetch poll can consume a shared segment notification while concurrent readers return pending, leaving those readers without another wakeup. Preserve the handoff so readers can resume after the active poll finishes.

Based on develop at b2f8d0f946e0 (s00).

Changes

  • Coordinate polls of each shared segment and wake competing readers after the active poll returns. Release the gate during unwinding and invoke wake callbacks outside its mutex.
  • Add a deterministic test that forces the prefetch/read race. The identical test fails on b2f8d0f946e0 and passes on a2765d424380, using the same regression-test source in both runs.
  • Validation: all six targeted V2 IO and shared-segment tests passed. This demonstrates the tested interleaving; it does not attribute every previously observed benchmark stall to this race.

Benchmark evidence

This is a correctness/liveness repair. Its evidence is the deterministic before/after regression test; no latency win is claimed. The full-suite screen separately measures its cost.

32-core aarch64 host, full 100-file partitioned ClickBench fixture, Vortex V2, ordinary local reads with no mmap, 32 workers/partitions/threads, DuckDB --reuse. DataFusion 55.2 retains enable_topk_aggregation=true. Compiler, Cargo feature union, profile and runtime environment are fixed across parent/candidate. Executable and library hashes, canonical SQL and fixture identities are recorded.

Full43 screening

The complete series screen finished 168/168 processes, with no failures or overlaps and successful source/SQL/binary/fixture checks. Each source/engine comparison used four balanced exact-parent process pairs and two matching identical-binary A/A pairs, with 10 executions/query and the first 3 discarded. This screen is descriptive: no new gain, equivalence, or regression-free claim is inferred, and no observations or controls were subtracted.

The deterministic regression test supports this wakeup correctness fix independently of performance. The all43 screen nevertheless shows DuckDB Q2 medians 2.73% slower in all four pairs and Q42 means 10.21% slower with variable tails; the latter's medians are mixed. Broad CPU and total latency changes are small and control-sized. Treat this as a correctness-value change with disclosed measured costs, not a performance win or neutrality proof; optional follow-up can resolve the cost decision.

Validation

  • 6 targeted test executions passed on this exact source tree: scan::v2::io::tests, segments::shared::tests.
  • All 43 ClickBench query results match fresh-develop Parquet results in each engine (86 comparisons for this candidate); strict types, floating tolerance, tied-row membership and independent oracles included.
  • Both benchmark packages built together with --locked, the release_debug profile, profile.release_debug.debug=1, and RUSTFLAGS="-C target-cpu=native -C force-frame-pointers=yes". Rust changes were formatted with pinned nightly; patch whitespace checks passed. Workspace-wide clippy was not run; CI status is separate.

Measured local source commit: a2765d42438062db73d431ef6d296930e69f5b28; full source tree: 7b8fcf0df070cccdf14e57cad26a467edf0faa10. Measured parent: b2f8d0f946e003d3e463d1447ed357ed88990686.

PR source commit: da10665e5b0fad748a1e0e6550cc19880edd0317; mapped parent: b2f8d0f946e003d3e463d1447ed357ed88990686. The complete source tree and mapped parent graph match the measured source. GitHub regenerated commit metadata/timestamps, so the measured local commit and executable hashes remain the benchmark identities. The complete remote Git object, original message and author/committer signoffs were verified.

Measurements use the develop snapshot b2f8d0f946e003d3e463d1447ed357ed88990686. Develop advanced during the campaign; these results retain the recorded source and binary identities.

Repository SQL benchmark

The SQL workflow completed 8/8 suites on this exact PR head. The ClickBench bot verdict is No clear signal (low confidence).

The preset covers V2 ClickBench, TPC-H, TPC-DS and FineWeb, plus a legacy PolarSignals control. These cloud runs use suite-specific historical develop baselines and FLAT_LAYOUT_INLINE_ARRAY_NODE=1; they are separate from the local exact-parent comparisons and cannot isolate this stack's incremental effect. Ordinary draft CI was skipped; SQL benchmark success is not an overall CI pass.

@joseph-isaacs
fix(layout): preserve shared segment wakeups during prefetch races
da10665 
Wake fetchers that race with a temporary prefetch poll after the shared future releases its polling state. Keep the handoff outside the mutex and release the gate on unwind. Add a deterministic regression test that forces the lost-wakeup interleaving.

Signed-off-by: Joe Isaacs <[email protected]>
This was referenced Nov 9, 2026
Draft
Draft
Draft
Draft
Draft
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Nov 9, 2026
@github-actions

github-actions Bot commented Nov 9, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done da10665 fineweb 1 Explore Profiling Data
🟢 Done da10665 clickbench-nvme 1 Explore Profiling Data
🟢 Done da10665 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done da10665 polarsignals 1 Explore Profiling Data
🟢 Done da10665 tpch-nvme-10 1 Explore Profiling Data
🟢 Done da10665 tpch-s3 1 Explore Profiling Data
🟢 Done da10665 tpcds-nvme 1 Explore Profiling Data
🟢 Done da10665 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR da10665e vs base b2f8d0f9
Vortex (geomean): hot 1.019x ➖ · cold 0.880x ✅

datafusion / vortex-file-compressed / ns (1.019x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44202448 / 44247398 / -0.1% 82607569 / 86756764 / -4.8% 0.54 / 0.51 / +4.9%
polarsignals_q01/datafusion:vortex-file-compressed 52990284 / 53190033 / -0.4% 108227459 / 111620562 / -3.0% 0.49 / 0.48 / +2.7%
polarsignals_q02/datafusion:vortex-file-compressed 12364821 / 14308001 / -13.6% 🟢 41453957 / 50938846 / -18.6% 🟢 0.30 / 0.28 / +6.2%
polarsignals_q03/datafusion:vortex-file-compressed 84855729 / 69231543 / +22.6% 🔴 107082541 / 116022576 / -7.7% 0.79 / 0.60 / +32.8%
polarsignals_q04/datafusion:vortex-file-compressed 9377014 / 9324230 / +0.6% 36642255 / 43390473 / -15.6% 🟢 0.26 / 0.21 / +19.1%
polarsignals_q05/datafusion:vortex-file-compressed 11549860 / 11645938 / -0.8% 37896134 / 46740242 / -18.9% 🟢 0.30 / 0.25 / +22.3%
polarsignals_q06/datafusion:vortex-file-compressed 23295768 / 22759316 / +2.4% 50314117 / 56616878 / -11.1% 🟢 0.46 / 0.40 / +15.2%
polarsignals_q07/datafusion:vortex-file-compressed 10568965 / 10826504 / -2.4% 38396991 / 45422058 / -15.5% 🟢 0.28 / 0.24 / +15.5%
polarsignals_q08/datafusion:vortex-file-compressed 112443046 / 96763190 / +16.2% 🔴 149593233 / 161828007 / -7.6% 0.75 / 0.60 / +25.7%
polarsignals_q09/datafusion:vortex-file-compressed 10078514 / 9924556 / +1.6% 34457050 / 41195204 / -16.4% 🟢 0.29 / 0.24 / +21.4%
polarsignals_q10/datafusion:vortex-file-compressed 54991782 / 55401320 / -0.7% 103579305 / 116674031 / -11.2% 🟢 0.53 / 0.47 / +11.8%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR da10665e vs base b8f511d0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (+0.8%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.967x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15561447 / 15688950 / -0.8% 41012492 / 42044683 / -2.5% 0.38 / 0.37 / +1.7%
tpch_q02/datafusion:vortex-file-compressed 17476763 / 17642963 / -0.9% 36871030 / 38300817 / -3.7% 0.47 / 0.46 / +2.9%
tpch_q03/datafusion:vortex-file-compressed 19217966 / 19065844 / +0.8% 42557917 / 48397388 / -12.1% 🟢 0.45 / 0.39 / +14.6%
tpch_q04/datafusion:vortex-file-compressed 10506284 / 11164861 / -5.9% 34797967 / 35072742 / -0.8% 0.30 / 0.32 / -5.2%
tpch_q05/datafusion:vortex-file-compressed 37738722 / 37464731 / +0.7% 68102055 / 67783021 / +0.5% 0.55 / 0.55 / +0.3%
tpch_q06/datafusion:vortex-file-compressed 4386724 / 4339682 / +1.1% 24545847 / 24863986 / -1.3% 0.18 / 0.17 / +2.4%
tpch_q07/datafusion:vortex-file-compressed 52331265 / 52692511 / -0.7% 79053182 / 85054942 / -7.1% 0.66 / 0.62 / +6.9%
tpch_q08/datafusion:vortex-file-compressed 51995344 / 52605829 / -1.2% 84416996 / 84709539 / -0.3% 0.62 / 0.62 / -0.8%
tpch_q09/datafusion:vortex-file-compressed 47542167 / 48498381 / -2.0% 78733609 / 84507228 / -6.8% 0.60 / 0.57 / +5.2%
tpch_q10/datafusion:vortex-file-compressed 17721224 / 17830636 / -0.6% 46844900 / 50418361 / -7.1% 0.38 / 0.35 / +7.0%
tpch_q11/datafusion:vortex-file-compressed 14631179 / 14797088 / -1.1% 34415004 / 34636066 / -0.6% 0.43 / 0.43 / -0.5%
tpch_q12/datafusion:vortex-file-compressed 18510157 / 18367682 / +0.8% 42056216 / 44324157 / -5.1% 0.44 / 0.41 / +6.2%
tpch_q13/datafusion:vortex-file-compressed 19187972 / 19445378 / -1.3% 39618311 / 43547559 / -9.0% 0.48 / 0.45 / +8.5%
tpch_q14/datafusion:vortex-file-compressed 14537222 / 14501344 / +0.2% 38597705 / 38502171 / +0.2% 0.38 / 0.38 / -0.0%
tpch_q15/datafusion:vortex-file-compressed 18808824 / 18611040 / +1.1% 45473072 / 47147954 / -3.6% 0.41 / 0.39 / +4.8%
tpch_q16/datafusion:vortex-file-compressed 18622330 / 18720655 / -0.5% 37793432 / 39847079 / -5.2% 0.49 / 0.47 / +4.9%
tpch_q17/datafusion:vortex-file-compressed 29109282 / 28917794 / +0.7% 57712784 / 58954760 / -2.1% 0.50 / 0.49 / +2.8%
tpch_q18/datafusion:vortex-file-compressed 36375158 / 36473671 / -0.3% 59461619 / 59803246 / -0.6% 0.61 / 0.61 / +0.3%
tpch_q19/datafusion:vortex-file-compressed 9983843 / 9988295 / -0.0% 35419314 / 36396214 / -2.7% 0.28 / 0.27 / +2.7%
tpch_q20/datafusion:vortex-file-compressed 21136525 / 21253874 / -0.6% 47647173 / 52124094 / -8.6% 0.44 / 0.41 / +8.8%
tpch_q21/datafusion:vortex-file-compressed 34797459 / 35502918 / -2.0% 64236381 / 66036777 / -2.7% 0.54 / 0.54 / +0.8%
tpch_q22/datafusion:vortex-file-compressed 10755450 / 10854425 / -0.9% 30484265 / 31535557 / -3.3% 0.35 / 0.34 / +2.5%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71152012 / 71385078 / -0.3% 86839285 / 87261585 / -0.5% 0.82 / 0.82 / +0.2%
tpch_q02/datafusion:parquet 75897664 / 76624116 / -0.9% 93383751 / 91913452 / +1.6% 0.81 / 0.83 / -2.5%
tpch_q03/datafusion:parquet 81754404 / 82108255 / -0.4% 101909787 / 104243587 / -2.2% 0.80 / 0.79 / +1.8%
tpch_q04/datafusion:parquet 39618763 / 39117802 / +1.3% 55727525 / 58381793 / -4.5% 0.71 / 0.67 / +6.1%
tpch_q05/datafusion:parquet 110562930 / 110097915 / +0.4% 135525278 / 137152327 / -1.2% 0.82 / 0.80 / +1.6%
tpch_q06/datafusion:parquet 31496980 / 31364851 / +0.4% 46492524 / 46559945 / -0.1% 0.68 / 0.67 / +0.6%
tpch_q07/datafusion:parquet 113020937 / 113603354 / -0.5% 136765327 / 139063930 / -1.7% 0.83 / 0.82 / +1.2%
tpch_q08/datafusion:parquet 117282780 / 118351864 / -0.9% 141514781 / 143663582 / -1.5% 0.83 / 0.82 / +0.6%
tpch_q09/datafusion:parquet 138284664 / 137262432 / +0.7% 165512003 / 166772416 / -0.8% 0.84 / 0.82 / +1.5%
tpch_q10/datafusion:parquet 102998617 / 103456749 / -0.4% 124725037 / 126729504 / -1.6% 0.83 / 0.82 / +1.2%
tpch_q11/datafusion:parquet 61998078 / 62363006 / -0.6% 80658215 / 82069278 / -1.7% 0.77 / 0.76 / +1.2%
tpch_q12/datafusion:parquet 63135769 / 63533745 / -0.6% 81811805 / 85351184 / -4.1% 0.77 / 0.74 / +3.7%
tpch_q13/datafusion:parquet 143869926 / 142477870 / +1.0% 161985909 / 161849930 / +0.1% 0.89 / 0.88 / +0.9%
tpch_q14/datafusion:parquet 47261535 / 47624060 / -0.8% 67107895 / 68804881 / -2.5% 0.70 / 0.69 / +1.7%
tpch_q15/datafusion:parquet 73239359 / 74880432 / -2.2% 91110523 / 92266259 / -1.3% 0.80 / 0.81 / -1.0%
tpch_q16/datafusion:parquet 43622829 / 43181694 / +1.0% 60212310 / 59549382 / +1.1% 0.72 / 0.73 / -0.1%
tpch_q17/datafusion:parquet 122717978 / 123682757 / -0.8% 142812426 / 147020505 / -2.9% 0.86 / 0.84 / +2.1%
tpch_q18/datafusion:parquet 120650683 / 121104227 / -0.4% 140014353 / 142447395 / -1.7% 0.86 / 0.85 / +1.4%
tpch_q19/datafusion:parquet 57255206 / 57774413 / -0.9% 78850046 / 82236501 / -4.1% 0.73 / 0.70 / +3.4%
tpch_q20/datafusion:parquet 78229647 / 78510463 / -0.4% 101163692 / 101516128 / -0.3% 0.77 / 0.77 / -0.0%
tpch_q21/datafusion:parquet 113408204 / 113088915 / +0.3% 138209570 / 139363438 / -0.8% 0.82 / 0.81 / +1.1%
tpch_q22/datafusion:parquet 51442019 / 51831048 / -0.8% 65882171 / 67131696 / -1.9% 0.78 / 0.77 / +1.1%
duckdb / vortex-file-compressed / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9386144 / 9046497 / +3.8% 18294818 / 20027987 / -8.7% 0.51 / 0.45 / +13.6%
tpch_q02/duckdb:vortex-file-compressed 15366259 / 15124900 / +1.6% 25016122 / 25341316 / -1.3% 0.61 / 0.60 / +2.9%
tpch_q03/duckdb:vortex-file-compressed 18399620 / 18447734 / -0.3% 34748868 / 34750008 / -0.0% 0.53 / 0.53 / -0.3%
tpch_q04/duckdb:vortex-file-compressed 12291831 / 12448707 / -1.3% 26330107 / 26846587 / -1.9% 0.47 / 0.46 / +0.7%
tpch_q05/duckdb:vortex-file-compressed 20599477 / 20254666 / +1.7% 36530748 / 35776065 / +2.1% 0.56 / 0.57 / -0.4%
tpch_q06/duckdb:vortex-file-compressed 4806897 / 4488820 / +7.1% 14717997 / 15022696 / -2.0% 0.33 / 0.30 / +9.3%
tpch_q07/duckdb:vortex-file-compressed 24223024 / 23909987 / +1.3% 38586805 / 41780280 / -7.6% 0.63 / 0.57 / +9.7%
tpch_q08/duckdb:vortex-file-compressed 21243406 / 20744171 / +2.4% 36766409 / 37318055 / -1.5% 0.58 / 0.56 / +3.9%
tpch_q09/duckdb:vortex-file-compressed 22731790 / 23055861 / -1.4% 39512170 / 38487753 / +2.7% 0.58 / 0.60 / -4.0%
tpch_q10/duckdb:vortex-file-compressed 27133982 / 26815462 / +1.2% 41310117 / 45530635 / -9.3% 0.66 / 0.59 / +11.5%
tpch_q11/duckdb:vortex-file-compressed 8071380 / 7968318 / +1.3% 17191920 / 18104165 / -5.0% 0.47 / 0.44 / +6.7%
tpch_q12/duckdb:vortex-file-compressed 14488173 / 14764927 / -1.9% 25645432 / 27095283 / -5.4% 0.56 / 0.54 / +3.7%
tpch_q13/duckdb:vortex-file-compressed 19623489 / 19378947 / +1.3% 32788371 / 31743144 / +3.3% 0.60 / 0.61 / -2.0%
tpch_q14/duckdb:vortex-file-compressed 11434741 / 11181264 / +2.3% 23236855 / 25354587 / -8.4% 0.49 / 0.44 / +11.6%
tpch_q15/duckdb:vortex-file-compressed 8498939 / 8381204 / +1.4% 19937608 / 20995174 / -5.0% 0.43 / 0.40 / +6.8%
tpch_q16/duckdb:vortex-file-compressed 16676447 / 16413233 / +1.6% 22664940 / 23979720 / -5.5% 0.74 / 0.68 / +7.5%
tpch_q17/duckdb:vortex-file-compressed 12371315 / 12592677 / -1.8% 28100530 / 28445363 / -1.2% 0.44 / 0.44 / -0.6%
tpch_q18/duckdb:vortex-file-compressed 24088343 / 24316808 / -0.9% 33549804 / 34951044 / -4.0% 0.72 / 0.70 / +3.2%
tpch_q19/duckdb:vortex-file-compressed 11578760 / 11426195 / +1.3% 26530731 / 25766839 / +3.0% 0.44 / 0.44 / -1.6%
tpch_q20/duckdb:vortex-file-compressed 14372898 / 14325643 / +0.3% 30758916 / 30552986 / +0.7% 0.47 / 0.47 / -0.3%
tpch_q21/duckdb:vortex-file-compressed 48464654 / 48281048 / +0.4% 64547391 / 66017908 / -2.2% 0.75 / 0.73 / +2.7%
tpch_q22/duckdb:vortex-file-compressed 16746967 / 16702790 / +0.3% 26556610 / 26800262 / -0.9% 0.63 / 0.62 / +1.2%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47557773 / 47547581 / +0.0% 53506547 / 54112740 / -1.1% 0.89 / 0.88 / +1.2%
tpch_q02/duckdb:parquet 48432548 / 48312217 / +0.2% 54847517 / 55151190 / -0.6% 0.88 / 0.88 / +0.8%
tpch_q03/duckdb:parquet 60257205 / 60217500 / +0.1% 67959574 / 69288935 / -1.9% 0.89 / 0.87 / +2.0%
tpch_q04/duckdb:parquet 34887452 / 34656547 / +0.7% 42575963 / 43053263 / -1.1% 0.82 / 0.80 / +1.8%
tpch_q05/duckdb:parquet 67026392 / 67091722 / -0.1% 76396321 / 77316587 / -1.2% 0.88 / 0.87 / +1.1%
tpch_q06/duckdb:parquet 21421472 / 21601570 / -0.8% 27102449 / 27249425 / -0.5% 0.79 / 0.79 / -0.3%
tpch_q07/duckdb:parquet 63782078 / 63799205 / -0.0% 72690348 / 72405251 / +0.4% 0.88 / 0.88 / -0.4%
tpch_q08/duckdb:parquet 75789605 / 75667269 / +0.2% 86448383 / 86769393 / -0.4% 0.88 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 107572589 / 107847179 / -0.3% 118729332 / 118570948 / +0.1% 0.91 / 0.91 / -0.4%
tpch_q10/duckdb:parquet 106001525 / 105720936 / +0.3% 116690643 / 117200993 / -0.4% 0.91 / 0.90 / +0.7%
tpch_q11/duckdb:parquet 29631582 / 29439572 / +0.7% 34728136 / 34922812 / -0.6% 0.85 / 0.84 / +1.2%
tpch_q12/duckdb:parquet 37237401 / 37121505 / +0.3% 43550321 / 43764563 / -0.5% 0.86 / 0.85 / +0.8%
tpch_q13/duckdb:parquet 174889970 / 174812670 / +0.0% 181836053 / 184970583 / -1.7% 0.96 / 0.95 / +1.8%
tpch_q14/duckdb:parquet 42510445 / 42356235 / +0.4% 51176854 / 51063051 / +0.2% 0.83 / 0.83 / +0.1%
tpch_q15/duckdb:parquet 32697460 / 32503990 / +0.6% 41111439 / 41334737 / -0.5% 0.80 / 0.79 / +1.1%
tpch_q16/duckdb:parquet 47591405 / 47147798 / +0.9% 52522970 / 52668299 / -0.3% 0.91 / 0.90 / +1.2%
tpch_q17/duckdb:parquet 48046984 / 47964459 / +0.2% 57290292 / 56795941 / +0.9% 0.84 / 0.84 / -0.7%
tpch_q18/duckdb:parquet 74565279 / 73982405 / +0.8% 81774934 / 80482798 / +1.6% 0.91 / 0.92 / -0.8%
tpch_q19/duckdb:parquet 49096512 / 49071842 / +0.1% 60084019 / 55601512 / +8.1% 0.82 / 0.88 / -7.4%
tpch_q20/duckdb:parquet 63536926 / 63412118 / +0.2% 73104676 / 73364368 / -0.4% 0.87 / 0.86 / +0.6%
tpch_q21/duckdb:parquet 106841285 / 106560704 / +0.3% 116774705 / 116038695 / +0.6% 0.91 / 0.92 / -0.4%
tpch_q22/duckdb:parquet 50487062 / 50470913 / +0.0% 58040804 / 59155611 / -1.9% 0.87 / 0.85 / +2.0%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR da10665e vs base 74c8f9d2
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.993x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.012x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 91264840 / 92177346 / -1.0% 163249152 / 156197099 / +4.5% 0.56 / 0.59 / -5.3%
tpch_q02/datafusion:vortex-file-compressed 65368442 / 64428754 / +1.5% 96224100 / 94872596 / +1.4% 0.68 / 0.68 / +0.0%
tpch_q03/datafusion:vortex-file-compressed 62328966 / 64151894 / -2.8% 124812837 / 126780702 / -1.6% 0.50 / 0.51 / -1.3%
tpch_q04/datafusion:vortex-file-compressed 33911885 / 35028676 / -3.2% 71247998 / 68466710 / +4.1% 0.48 / 0.51 / -7.0%
tpch_q05/datafusion:vortex-file-compressed 120310897 / 118900162 / +1.2% 182975506 / 185439522 / -1.3% 0.66 / 0.64 / +2.5%
tpch_q06/datafusion:vortex-file-compressed 9975458 / 9649196 / +3.4% 57249894 / 57652551 / -0.7% 0.17 / 0.17 / +4.1%
tpch_q07/datafusion:vortex-file-compressed 96504553 / 97449767 / -1.0% 158695134 / 161011516 / -1.4% 0.61 / 0.61 / +0.5%
tpch_q08/datafusion:vortex-file-compressed 140683413 / 142206475 / -1.1% 216580372 / 226695985 / -4.5% 0.65 / 0.63 / +3.5%
tpch_q09/datafusion:vortex-file-compressed 184556165 / 182840408 / +0.9% 274403184 / 275147335 / -0.3% 0.67 / 0.66 / +1.2%
tpch_q10/datafusion:vortex-file-compressed 69925201 / 70621645 / -1.0% 134430339 / 136262721 / -1.3% 0.52 / 0.52 / +0.4%
tpch_q11/datafusion:vortex-file-compressed 45841974 / 45658051 / +0.4% 73267443 / 72364105 / +1.2% 0.63 / 0.63 / -0.8%
tpch_q12/datafusion:vortex-file-compressed 35617165 / 35235879 / +1.1% 79551054 / 79705799 / -0.2% 0.45 / 0.44 / +1.3%
tpch_q13/datafusion:vortex-file-compressed 48164883 / 48598467 / -0.9% 79400597 / 87210304 / -9.0% 0.61 / 0.56 / +8.9%
tpch_q14/datafusion:vortex-file-compressed 20480311 / 20650370 / -0.8% 89318711 / 88048054 / +1.4% 0.23 / 0.23 / -2.2%
tpch_q15/datafusion:vortex-file-compressed 32407920 / 33753614 / -4.0% 95504259 / 90785220 / +5.2% 0.34 / 0.37 / -8.7%
tpch_q16/datafusion:vortex-file-compressed 37141970 / 36919743 / +0.6% 64531309 / 65843812 / -2.0% 0.58 / 0.56 / +2.6%
tpch_q17/datafusion:vortex-file-compressed 180356159 / 176998771 / +1.9% 225187758 / 239755261 / -6.1% 0.80 / 0.74 / +8.5%
tpch_q18/datafusion:vortex-file-compressed 203425863 / 207996354 / -2.2% 273619916 / 275106107 / -0.5% 0.74 / 0.76 / -1.7%
tpch_q19/datafusion:vortex-file-compressed 28841621 / 28526869 / +1.1% 86493155 / 87666580 / -1.3% 0.33 / 0.33 / +2.5%
tpch_q20/datafusion:vortex-file-compressed 59817961 / 61936223 / -3.4% 116686141 / 118852369 / -1.8% 0.51 / 0.52 / -1.6%
tpch_q21/datafusion:vortex-file-compressed 181352297 / 182704046 / -0.7% 226046614 / 234984863 / -3.8% 0.80 / 0.78 / +3.2%
tpch_q22/datafusion:vortex-file-compressed 24983232 / 25513774 / -2.1% 52151300 / 55406439 / -5.9% 0.48 / 0.46 / +4.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87188874 / 87311538 / -0.1% 127923266 / 122516163 / +4.4% 0.68 / 0.71 / -4.4%
tpch_q02/datafusion:parquet 174508972 / 174735537 / -0.1% 199919828 / 198265824 / +0.8% 0.87 / 0.88 / -1.0%
tpch_q03/datafusion:parquet 135119309 / 135233090 / -0.1% 180919811 / 179364012 / +0.9% 0.75 / 0.75 / -0.9%
tpch_q04/datafusion:parquet 56616891 / 56985913 / -0.6% 87967169 / 85885070 / +2.4% 0.64 / 0.66 / -3.0%
tpch_q05/datafusion:parquet 166595322 / 166291221 / +0.2% 226168500 / 214896169 / +5.2% 0.74 / 0.77 / -4.8%
tpch_q06/datafusion:parquet 36377956 / 36510562 / -0.4% 80154397 / 72908306 / +9.9% 0.45 / 0.50 / -9.4%
tpch_q07/datafusion:parquet 215042210 / 215778947 / -0.3% 275206537 / 260314182 / +5.7% 0.78 / 0.83 / -5.7%
tpch_q08/datafusion:parquet 217615175 / 216791369 / +0.4% 283237555 / 278971702 / +1.5% 0.77 / 0.78 / -1.1%
tpch_q09/datafusion:parquet 310865785 / 307685989 / +1.0% 370793851 / 369588127 / +0.3% 0.84 / 0.83 / +0.7%
tpch_q10/datafusion:parquet 311409351 / 311954014 / -0.2% 366335845 / 359417304 / +1.9% 0.85 / 0.87 / -2.1%
tpch_q11/datafusion:parquet 127534610 / 127035714 / +0.4% 149455062 / 149936598 / -0.3% 0.85 / 0.85 / +0.7%
tpch_q12/datafusion:parquet 82003645 / 82433202 / -0.5% 116883857 / 116835758 / +0.0% 0.70 / 0.71 / -0.6%
tpch_q13/datafusion:parquet 210316857 / 210618688 / -0.1% 239757716 / 238788117 / +0.4% 0.88 / 0.88 / -0.5%
tpch_q14/datafusion:parquet 86326227 / 85602024 / +0.8% 191648377 / 186569859 / +2.7% 0.45 / 0.46 / -1.8%
tpch_q15/datafusion:parquet 105394674 / 106606603 / -1.1% 155399397 / 154598932 / +0.5% 0.68 / 0.69 / -1.6%
tpch_q16/datafusion:parquet 96661080 / 94683007 / +2.1% 122913131 / 123221265 / -0.3% 0.79 / 0.77 / +2.3%
tpch_q17/datafusion:parquet 213774007 / 215630850 / -0.9% 264732154 / 257798988 / +2.7% 0.81 / 0.84 / -3.5%
tpch_q18/datafusion:parquet 267612015 / 267541314 / +0.0% 312082113 / 318452912 / -2.0% 0.86 / 0.84 / +2.1%
tpch_q19/datafusion:parquet 107552792 / 108282497 / -0.7% 166784383 / 164045798 / +1.7% 0.64 / 0.66 / -2.3%
tpch_q20/datafusion:parquet 186228017 / 185298197 / +0.5% 248103896 / 237189433 / +4.6% 0.75 / 0.78 / -3.9%
tpch_q21/datafusion:parquet 242410584 / 244268713 / -0.8% 308679215 / 306493573 / +0.7% 0.79 / 0.80 / -1.5%
tpch_q22/datafusion:parquet 149411613 / 149723897 / -0.2% 172711030 / 171986203 / +0.4% 0.87 / 0.87 / -0.6%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33220205 / 33162813 / +0.2% 61724257 / 60965941 / +1.2% 0.54 / 0.54 / -1.1%
tpch_q02/duckdb:vortex-file-compressed 28241827 / 28441284 / -0.7% 42271584 / 42490796 / -0.5% 0.67 / 0.67 / -0.2%
tpch_q03/duckdb:vortex-file-compressed 51863450 / 51806352 / +0.1% 97732584 / 96181102 / +1.6% 0.53 / 0.54 / -1.5%
tpch_q04/duckdb:vortex-file-compressed 51141908 / 51520893 / -0.7% 85834031 / 83080389 / +3.3% 0.60 / 0.62 / -3.9%
tpch_q05/duckdb:vortex-file-compressed 68172125 / 68278233 / -0.2% 105425583 / 110549285 / -4.6% 0.65 / 0.62 / +4.7%
tpch_q06/duckdb:vortex-file-compressed 14890878 / 14995905 / -0.7% 49699596 / 49678736 / +0.0% 0.30 / 0.30 / -0.7%
tpch_q07/duckdb:vortex-file-compressed 54100108 / 55095502 / -1.8% 105243384 / 99927713 / +5.3% 0.51 / 0.55 / -6.8%
tpch_q08/duckdb:vortex-file-compressed 85036900 / 84730600 / +0.4% 125819780 / 128300677 / -1.9% 0.68 / 0.66 / +2.3%
tpch_q09/duckdb:vortex-file-compressed 102523005 / 102680463 / -0.2% 150592193 / 149752209 / +0.6% 0.68 / 0.69 / -0.7%
tpch_q10/duckdb:vortex-file-compressed 94813562 / 95736829 / -1.0% 144034305 / 145772381 / -1.2% 0.66 / 0.66 / +0.2%
tpch_q11/duckdb:vortex-file-compressed 12763089 / 13161487 / -3.0% 29177314 / 28614710 / +2.0% 0.44 / 0.46 / -4.9%
tpch_q12/duckdb:vortex-file-compressed 45542429 / 45171630 / +0.8% 77768379 / 74559415 / +4.3% 0.59 / 0.61 / -3.3%
tpch_q13/duckdb:vortex-file-compressed 70781946 / 71277113 / -0.7% 94600207 / 98751212 / -4.2% 0.75 / 0.72 / +3.7%
tpch_q14/duckdb:vortex-file-compressed 27880486 / 27742167 / +0.5% 68284698 / 68588058 / -0.4% 0.41 / 0.40 / +0.9%
tpch_q15/duckdb:vortex-file-compressed 23568363 / 24169914 / -2.5% 61173685 / 62760479 / -2.5% 0.39 / 0.39 / +0.0%
tpch_q16/duckdb:vortex-file-compressed 49431563 / 49823920 / -0.8% 57722744 / 58191998 / -0.8% 0.86 / 0.86 / +0.0%
tpch_q17/duckdb:vortex-file-compressed 35037546 / 34928738 / +0.3% 66004551 / 64550565 / +2.3% 0.53 / 0.54 / -1.9%
tpch_q18/duckdb:vortex-file-compressed 108017216 / 102866087 / +5.0% 119164028 / 121696816 / -2.1% 0.91 / 0.85 / +7.2%
tpch_q19/duckdb:vortex-file-compressed 27281970 / 27489534 / -0.8% 70080833 / 76106199 / -7.9% 0.39 / 0.36 / +7.8%
tpch_q20/duckdb:vortex-file-compressed 41158175 / 41385355 / -0.5% 84463638 / 88937430 / -5.0% 0.49 / 0.47 / +4.7%
tpch_q21/duckdb:vortex-file-compressed 93603598 / 92643489 / +1.0% 142550289 / 140692444 / +1.3% 0.66 / 0.66 / -0.3%
tpch_q22/duckdb:vortex-file-compressed 33013007 / 33019958 / -0.0% 48724723 / 47168881 / +3.3% 0.68 / 0.70 / -3.2%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67108992 / 68061708 / -1.4% 88719495 / 88188170 / +0.6% 0.76 / 0.77 / -2.0%
tpch_q02/duckdb:parquet 86496757 / 87254980 / -0.9% 96348984 / 98880371 / -2.6% 0.90 / 0.88 / +1.7%
tpch_q03/duckdb:parquet 109165588 / 110221645 / -1.0% 141926692 / 141238280 / +0.5% 0.77 / 0.78 / -1.4%
tpch_q04/duckdb:parquet 76070358 / 76532636 / -0.6% 98194381 / 97762896 / +0.4% 0.77 / 0.78 / -1.0%
tpch_q05/duckdb:parquet 121724938 / 123479542 / -1.4% 157838042 / 155668079 / +1.4% 0.77 / 0.79 / -2.8%
tpch_q06/duckdb:parquet 35646710 / 35931981 / -0.8% 58194295 / 56977323 / +2.1% 0.61 / 0.63 / -2.9%
tpch_q07/duckdb:parquet 117102990 / 119339250 / -1.9% 155825535 / 153627189 / +1.4% 0.75 / 0.78 / -3.3%
tpch_q08/duckdb:parquet 146871102 / 147255450 / -0.3% 191023601 / 190628929 / +0.2% 0.77 / 0.77 / -0.5%
tpch_q09/duckdb:parquet 237916612 / 235578554 / +1.0% 277202462 / 276803702 / +0.1% 0.86 / 0.85 / +0.8%
tpch_q10/duckdb:parquet 313180356 / 313587478 / -0.1% 338986801 / 337403692 / +0.5% 0.92 / 0.93 / -0.6%
tpch_q11/duckdb:parquet 43611866 / 43490479 / +0.3% 50351433 / 50005616 / +0.7% 0.87 / 0.87 / -0.4%
tpch_q12/duckdb:parquet 70748811 / 70505417 / +0.3% 88889683 / 90007679 / -1.2% 0.80 / 0.78 / +1.6%
tpch_q13/duckdb:parquet 291774241 / 293441858 / -0.6% 304303922 / 310736944 / -2.1% 0.96 / 0.94 / +1.5%
tpch_q14/duckdb:parquet 100550375 / 101133653 / -0.6% 137922058 / 136327535 / +1.2% 0.73 / 0.74 / -1.7%
tpch_q15/duckdb:parquet 57009421 / 57306184 / -0.5% 87139570 / 84972419 / +2.6% 0.65 / 0.67 / -3.0%
tpch_q16/duckdb:parquet 99957506 / 100633707 / -0.7% 106639321 / 107203047 / -0.5% 0.94 / 0.94 / -0.1%
tpch_q17/duckdb:parquet 81483402 / 83962666 / -3.0% 114406544 / 110031995 / +4.0% 0.71 / 0.76 / -6.7%
tpch_q18/duckdb:parquet 157182567 / 157083225 / +0.1% 168263662 / 172862922 / -2.7% 0.93 / 0.91 / +2.8%
tpch_q19/duckdb:parquet 96889783 / 98792583 / -1.9% 131295562 / 130377546 / +0.7% 0.74 / 0.76 / -2.6%
tpch_q20/duckdb:parquet 146182846 / 146971997 / -0.5% 182098902 / 181619680 / +0.3% 0.80 / 0.81 / -0.8%
tpch_q21/duckdb:parquet 253072388 / 254756250 / -0.7% 272406485 / 271034790 / +0.5% 0.93 / 0.94 / -1.2%
tpch_q22/duckdb:parquet 168245966 / 168406469 / -0.1% 179639786 / 179252698 / +0.2% 0.94 / 0.94 / -0.3%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR da10665e vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Engines: DataFusion No clear signal (+1.6%, low confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.014x ➖ · cold 1.039x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5969548 / 6250168 / -4.5% 20462185 / 19751173 / +3.6% 0.29 / 0.32 / -7.8%
fineweb_q01/datafusion:vortex-file-compressed 8656736 / 9285400 / -6.8% 47187944 / 35575139 / +32.6% 🔴 0.18 / 0.26 / -29.7%
fineweb_q02/datafusion:vortex-file-compressed 11385200 / 10567512 / +7.7% 45176443 / 40643432 / +11.2% 🔴 0.25 / 0.26 / -3.1%
fineweb_q03/datafusion:vortex-file-compressed 17919478 / 17539240 / +2.2% 108839507 / 102692107 / +6.0% 0.16 / 0.17 / -3.6%
fineweb_q04/datafusion:vortex-file-compressed 65854530 / 64090120 / +2.8% 152008010 / 144508483 / +5.2% 0.43 / 0.44 / -2.3%
fineweb_q05/datafusion:vortex-file-compressed 62304796 / 63203121 / -1.4% 142589248 / 139485427 / +2.2% 0.44 / 0.45 / -3.6%
fineweb_q06/datafusion:vortex-file-compressed 16479821 / 17269226 / -4.6% 116385183 / 106346388 / +9.4% 0.14 / 0.16 / -12.8%
fineweb_q07/datafusion:vortex-file-compressed 16427754 / 16748794 / -1.9% 112105587 / 103498538 / +8.3% 0.15 / 0.16 / -9.4%
fineweb_q08/datafusion:vortex-file-compressed 10302260 / 8455804 / +21.8% 🔴 31083026 / 26524896 / +17.2% 🔴 0.33 / 0.32 / +4.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9393492 / 9321344 / +0.8% 33695171 / 32543553 / +3.5% 0.28 / 0.29 / -2.7%
fineweb_q01/datafusion:parquet 75993206 / 75943192 / +0.1% 162689562 / 168115168 / -3.2% 0.47 / 0.45 / +3.4%
fineweb_q02/datafusion:parquet 74977972 / 75797688 / -1.1% 152454751 / 156430678 / -2.5% 0.49 / 0.48 / +1.5%
fineweb_q03/datafusion:parquet 74903646 / 73828035 / +1.5% 160282061 / 151042261 / +6.1% 0.47 / 0.49 / -4.4%
fineweb_q04/datafusion:parquet 83277074 / 82454360 / +1.0% 158461487 / 161665686 / -2.0% 0.53 / 0.51 / +3.0%
fineweb_q05/datafusion:parquet 81190496 / 81339953 / -0.2% 155886452 / 155427779 / +0.3% 0.52 / 0.52 / -0.5%
fineweb_q06/datafusion:parquet 74220846 / 76823475 / -3.4% 158702728 / 164720545 / -3.7% 0.47 / 0.47 / +0.3%
fineweb_q07/datafusion:parquet 74418012 / 73784924 / +0.9% 155461258 / 154776922 / +0.4% 0.48 / 0.48 / +0.4%
fineweb_q08/datafusion:parquet 72520036 / 73667172 / -1.6% 150767492 / 153339658 / -1.7% 0.48 / 0.48 / +0.1%
duckdb / vortex-file-compressed / ns (1.013x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2130794 / 2129396 / +0.1% 7148304 / 8430467 / -15.2% 🟢 0.30 / 0.25 / +18.0%
fineweb_q01/duckdb:vortex-file-compressed 7275858 / 7609840 / -4.4% 26812741 / 27699884 / -3.2% 0.27 / 0.27 / -1.2%
fineweb_q02/duckdb:vortex-file-compressed 9082087 / 8999654 / +0.9% 30860192 / 32238453 / -4.3% 0.29 / 0.28 / +5.4%
fineweb_q03/duckdb:vortex-file-compressed 18569692 / 17999961 / +3.2% 91967072 / 89729159 / +2.5% 0.20 / 0.20 / +0.7%
fineweb_q04/duckdb:vortex-file-compressed 65311382 / 64895256 / +0.6% 105646611 / 105319449 / +0.3% 0.62 / 0.62 / +0.3%
fineweb_q05/duckdb:vortex-file-compressed 65178096 / 64576607 / +0.9% 102138950 / 100642505 / +1.5% 0.64 / 0.64 / -0.5%
fineweb_q06/duckdb:vortex-file-compressed 17877479 / 17451004 / +2.4% 91781687 / 90997772 / +0.9% 0.19 / 0.19 / +1.6%
fineweb_q07/duckdb:vortex-file-compressed 17189132 / 17567882 / -2.2% 92233363 / 90262327 / +2.2% 0.19 / 0.19 / -4.2%
fineweb_q08/duckdb:vortex-file-compressed 4975858 / 4479276 / +11.1% 🔴 12347058 / 12680631 / -2.6% 0.40 / 0.35 / +14.1%
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23597040 / 23575786 / +0.1% 27741199 / 27901054 / -0.6% 0.85 / 0.84 / +0.7%
fineweb_q01/duckdb:parquet 53782886 / 53435612 / +0.6% 75298318 / 71035947 / +6.0% 0.71 / 0.75 / -5.0%
fineweb_q02/duckdb:parquet 57948750 / 58133262 / -0.3% 77714147 / 71614459 / +8.5% 0.75 / 0.81 / -8.1%
fineweb_q03/duckdb:parquet 120083549 / 119431288 / +0.5% 176034651 / 174813976 / +0.7% 0.68 / 0.68 / -0.2%
fineweb_q04/duckdb:parquet 166640762 / 160054805 / +4.1% 205034056 / 201506963 / +1.8% 0.81 / 0.79 / +2.3%
fineweb_q05/duckdb:parquet 159764500 / 159362006 / +0.3% 202014168 / 199292933 / +1.4% 0.79 / 0.80 / -1.1%
fineweb_q06/duckdb:parquet 88334250 / 88786282 / -0.5% 146172946 / 152544283 / -4.2% 0.60 / 0.58 / +3.8%
fineweb_q07/duckdb:parquet 90992704 / 90890989 / +0.1% 142921955 / 143350764 / -0.3% 0.64 / 0.63 / +0.4%
fineweb_q08/duckdb:parquet 29130406 / 28981936 / +0.5% 30906360 / 30002232 / +3.0% 0.94 / 0.97 / -2.4%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR da10665e vs base ab5a0046
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.025x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.014x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21536795 / 21999911 / -2.1% 42334714 / 39946370 / +6.0% 0.51 / 0.55 / -7.6%
tpcds_q02/datafusion:vortex-file-compressed 43198740 / 42893253 / +0.7% 64481679 / 62914880 / +2.5% 0.67 / 0.68 / -1.7%
tpcds_q03/datafusion:vortex-file-compressed 11745490 / 11605178 / +1.2% 27960528 / 26609156 / +5.1% 0.42 / 0.44 / -3.7%
tpcds_q04/datafusion:vortex-file-compressed 81948933 / 78951654 / +3.8% 111547882 / 104564818 / +6.7% 0.73 / 0.76 / -2.7%
tpcds_q05/datafusion:vortex-file-compressed 56379984 / 55941465 / +0.8% 78149579 / 74124262 / +5.4% 0.72 / 0.75 / -4.4%
tpcds_q06/datafusion:vortex-file-compressed 22456394 / 21333720 / +5.3% 42258342 / 41069841 / +2.9% 0.53 / 0.52 / +2.3%
tpcds_q07/datafusion:vortex-file-compressed 26474097 / 26386390 / +0.3% 50693212 / 48176326 / +5.2% 0.52 / 0.55 / -4.6%
tpcds_q08/datafusion:vortex-file-compressed 25817066 / 25587712 / +0.9% 46420084 / 43682364 / +6.3% 0.56 / 0.59 / -5.1%
tpcds_q09/datafusion:vortex-file-compressed 19785418 / 19896226 / -0.6% 38792289 / 37474977 / +3.5% 0.51 / 0.53 / -3.9%
tpcds_q10/datafusion:vortex-file-compressed 29201503 / 29546889 / -1.2% 52404768 / 51180613 / +2.4% 0.56 / 0.58 / -3.5%
tpcds_q11/datafusion:vortex-file-compressed 49190722 / 49121194 / +0.1% 78042519 / 75394766 / +3.5% 0.63 / 0.65 / -3.3%
tpcds_q12/datafusion:vortex-file-compressed 15184354 / 14946749 / +1.6% 33494005 / 31749886 / +5.5% 0.45 / 0.47 / -3.7%
tpcds_q13/datafusion:vortex-file-compressed 31711611 / 31860550 / -0.5% 56234021 / 53865238 / +4.4% 0.56 / 0.59 / -4.7%
tpcds_q14/datafusion:vortex-file-compressed 490152121 / 487421370 / +0.6% 546465957 / 542474028 / +0.7% 0.90 / 0.90 / -0.2%
tpcds_q15/datafusion:vortex-file-compressed 12958240 / 12586756 / +3.0% 30696914 / 29869991 / +2.8% 0.42 / 0.42 / +0.2%
tpcds_q16/datafusion:vortex-file-compressed 18742812 / 18761618 / -0.1% 39438997 / 37089591 / +6.3% 0.48 / 0.51 / -6.1%
tpcds_q17/datafusion:vortex-file-compressed 53643268 / 53607682 / +0.1% 74366653 / 70072689 / +6.1% 0.72 / 0.77 / -5.7%
tpcds_q18/datafusion:vortex-file-compressed 63980916 / 62349632 / +2.6% 74986698 / 88633124 / -15.4% 🟢 0.85 / 0.70 / +21.3%
tpcds_q19/datafusion:vortex-file-compressed 17077232 / 17064877 / +0.1% 39944015 / 38137570 / +4.7% 0.43 / 0.45 / -4.5%
tpcds_q20/datafusion:vortex-file-compressed 16639393 / 16875604 / -1.4% 35265460 / 33398462 / +5.6% 0.47 / 0.51 / -6.6%
tpcds_q21/datafusion:vortex-file-compressed 15562240 / 14801170 / +5.1% 35413471 / 32973615 / +7.4% 0.44 / 0.45 / -2.1%
tpcds_q22/datafusion:vortex-file-compressed 49636018 / 49325762 / +0.6% 71978878 / 67699156 / +6.3% 0.69 / 0.73 / -5.4%
tpcds_q23/datafusion:vortex-file-compressed 71009324 / 72276124 / -1.8% 99896150 / 97272882 / +2.7% 0.71 / 0.74 / -4.3%
tpcds_q24/datafusion:vortex-file-compressed 63704830 / 63926868 / -0.3% 87233458 / 83129432 / +4.9% 0.73 / 0.77 / -5.0%
tpcds_q25/datafusion:vortex-file-compressed 45769390 / 44475855 / +2.9% 76015688 / 66779639 / +13.8% 🔴 0.60 / 0.67 / -9.6%
tpcds_q26/datafusion:vortex-file-compressed 26195190 / 26101808 / +0.4% 47083904 / 45977400 / +2.4% 0.56 / 0.57 / -2.0%
tpcds_q27/datafusion:vortex-file-compressed 51357128 / 53289153 / -3.6% 73527443 / 76338183 / -3.7% 0.70 / 0.70 / +0.1%
tpcds_q28/datafusion:vortex-file-compressed 20439406 / 19381416 / +5.5% 36538938 / 39922526 / -8.5% 0.56 / 0.49 / +15.2%
tpcds_q29/datafusion:vortex-file-compressed 51290466 / 52347589 / -2.0% 69304993 / 73566264 / -5.8% 0.74 / 0.71 / +4.0%
tpcds_q30/datafusion:vortex-file-compressed 27204400 / 27661427 / -1.7% 48245119 / 45075272 / +7.0% 0.56 / 0.61 / -8.1%
tpcds_q31/datafusion:vortex-file-compressed 62211417 / 62516696 / -0.5% 90475808 / 87634339 / +3.2% 0.69 / 0.71 / -3.6%
tpcds_q32/datafusion:vortex-file-compressed 12595009 / 13025350 / -3.3% 29503381 / 30062663 / -1.9% 0.43 / 0.43 / -1.5%
tpcds_q33/datafusion:vortex-file-compressed 28299961 / 27991706 / +1.1% 50052711 / 50078992 / -0.1% 0.57 / 0.56 / +1.2%
tpcds_q34/datafusion:vortex-file-compressed 17673472 / 17855906 / -1.0% 38545830 / 36650085 / +5.2% 0.46 / 0.49 / -5.9%
tpcds_q35/datafusion:vortex-file-compressed 30357348 / 31075584 / -2.3% 54299023 / 54010849 / +0.5% 0.56 / 0.58 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 48264823 / 46691248 / +3.4% 69430057 / 69134076 / +0.4% 0.70 / 0.68 / +2.9%
tpcds_q37/datafusion:vortex-file-compressed 12811901 / 12935278 / -1.0% 35035674 / 33965509 / +3.2% 0.37 / 0.38 / -4.0%
tpcds_q38/datafusion:vortex-file-compressed 26474828 / 26436550 / +0.1% 50476588 / 46500479 / +8.6% 0.52 / 0.57 / -7.7%
tpcds_q39/datafusion:vortex-file-compressed 64675458 / 64408856 / +0.4% 88995771 / 87056639 / +2.2% 0.73 / 0.74 / -1.8%
tpcds_q40/datafusion:vortex-file-compressed 22859015 / 22195258 / +3.0% 41617037 / 39059042 / +6.5% 0.55 / 0.57 / -3.3%
tpcds_q41/datafusion:vortex-file-compressed 20235016 / 20181415 / +0.3% 32319647 / 32305841 / +0.0% 0.63 / 0.62 / +0.2%
tpcds_q42/datafusion:vortex-file-compressed 11522200 / 11610268 / -0.8% 29222876 / 27549864 / +6.1% 0.39 / 0.42 / -6.4%
tpcds_q43/datafusion:vortex-file-compressed 13359356 / 13251107 / +0.8% 35717208 / 31511768 / +13.3% 🔴 0.37 / 0.42 / -11.1%
tpcds_q44/datafusion:vortex-file-compressed 27546654 / 27407222 / +0.5% 52189839 / 49901538 / +4.6% 0.53 / 0.55 / -3.9%
tpcds_q45/datafusion:vortex-file-compressed 16705910 / 17168016 / -2.7% 35265156 / 34200247 / +3.1% 0.47 / 0.50 / -5.6%
tpcds_q46/datafusion:vortex-file-compressed 23940526 / 23558210 / +1.6% 46435913 / 45525195 / +2.0% 0.52 / 0.52 / -0.4%
tpcds_q47/datafusion:vortex-file-compressed 74686364 / 75593490 / -1.2% 106321860 / 103395942 / +2.8% 0.70 / 0.73 / -3.9%
tpcds_q48/datafusion:vortex-file-compressed 28474085 / 28579330 / -0.4% 54389148 / 51250463 / +6.1% 0.52 / 0.56 / -6.1%
tpcds_q49/datafusion:vortex-file-compressed 58009690 / 57212074 / +1.4% 83375611 / 74563681 / +11.8% 🔴 0.70 / 0.77 / -9.3%
tpcds_q50/datafusion:vortex-file-compressed 31061158 / 31077502 / -0.1% 53540580 / 51768133 / +3.4% 0.58 / 0.60 / -3.4%
tpcds_q51/datafusion:vortex-file-compressed 67756621 / 67219460 / +0.8% 90489704 / 89984116 / +0.6% 0.75 / 0.75 / +0.2%
tpcds_q52/datafusion:vortex-file-compressed 12099456 / 11829058 / +2.3% 28838469 / 28624926 / +0.7% 0.42 / 0.41 / +1.5%
tpcds_q53/datafusion:vortex-file-compressed 18503194 / 18240894 / +1.4% 41703921 / 37934996 / +9.9% 0.44 / 0.48 / -7.7%
tpcds_q54/datafusion:vortex-file-compressed 31649554 / 32073801 / -1.3% 56509903 / 53625583 / +5.4% 0.56 / 0.60 / -6.4%
tpcds_q55/datafusion:vortex-file-compressed 11608492 / 11528832 / +0.7% 27695859 / 27437884 / +0.9% 0.42 / 0.42 / -0.2%
tpcds_q56/datafusion:vortex-file-compressed 26819686 / 26666916 / +0.6% 48011998 / 47448670 / +1.2% 0.56 / 0.56 / -0.6%
tpcds_q57/datafusion:vortex-file-compressed 61903769 / 62012122 / -0.2% 90103085 / 87267119 / +3.2% 0.69 / 0.71 / -3.3%
tpcds_q58/datafusion:vortex-file-compressed 40273940 / 40818922 / -1.3% 68374237 / 64518211 / +6.0% 0.59 / 0.63 / -6.9%
tpcds_q59/datafusion:vortex-file-compressed 28065734 / 27906409 / +0.6% 56308411 / 53781464 / +4.7% 0.50 / 0.52 / -3.9%
tpcds_q60/datafusion:vortex-file-compressed 27134626 / 27726237 / -2.1% 48535611 / 47532249 / +2.1% 0.56 / 0.58 / -4.2%
tpcds_q61/datafusion:vortex-file-compressed 20422079 / 20214066 / +1.0% 42221710 / 39682747 / +6.4% 0.48 / 0.51 / -5.0%
tpcds_q62/datafusion:vortex-file-compressed 16447987 / 16850174 / -2.4% 35832131 / 34396629 / +4.2% 0.46 / 0.49 / -6.3%
tpcds_q63/datafusion:vortex-file-compressed 18490012 / 18192128 / +1.6% 39979239 / 37641254 / +6.2% 0.46 / 0.48 / -4.3%
tpcds_q64/datafusion:vortex-file-compressed 189483650 / 188561892 / +0.5% 221016298 / 229680212 / -3.8% 0.86 / 0.82 / +4.4%
tpcds_q65/datafusion:vortex-file-compressed 74229298 / 73066724 / +1.6% 96674558 / 96562612 / +0.1% 0.77 / 0.76 / +1.5%
tpcds_q66/datafusion:vortex-file-compressed 50161708 / 50096568 / +0.1% 71272024 / 69306342 / +2.8% 0.70 / 0.72 / -2.6%
tpcds_q67/datafusion:vortex-file-compressed 51073402 / 51663640 / -1.1% 84250886 / 83492505 / +0.9% 0.61 / 0.62 / -2.0%
tpcds_q68/datafusion:vortex-file-compressed 23137860 / 22888054 / +1.1% 46030445 / 44101071 / +4.4% 0.50 / 0.52 / -3.1%
tpcds_q69/datafusion:vortex-file-compressed 27583267 / 27546142 / +0.1% 52100448 / 47372016 / +10.0% 0.53 / 0.58 / -9.0%
tpcds_q70/datafusion:vortex-file-compressed 73673500 / 73486667 / +0.3% 98137600 / 97916702 / +0.2% 0.75 / 0.75 / +0.0%
tpcds_q71/datafusion:vortex-file-compressed 19598775 / 19173117 / +2.2% 40171389 / 37641700 / +6.7% 0.49 / 0.51 / -4.2%
tpcds_q72/datafusion:vortex-file-compressed 265105489 / 247376824 / +7.2% 285445332 / 279389691 / +2.2% 0.93 / 0.89 / +4.9%
tpcds_q73/datafusion:vortex-file-compressed 16775933 / 16283788 / +3.0% 37036052 / 37287301 / -0.7% 0.45 / 0.44 / +3.7%
tpcds_q74/datafusion:vortex-file-compressed 40981374 / 40826743 / +0.4% 67369476 / 66742487 / +0.9% 0.61 / 0.61 / -0.6%
tpcds_q75/datafusion:vortex-file-compressed 134425996 / 133968630 / +0.3% 165314021 / 162666038 / +1.6% 0.81 / 0.82 / -1.3%
tpcds_q76/datafusion:vortex-file-compressed 28819884 / 28638050 / +0.6% 50399640 / 48545831 / +3.8% 0.57 / 0.59 / -3.1%
tpcds_q77/datafusion:vortex-file-compressed 44617153 / 44422120 / +0.4% 69780586 / 65708594 / +6.2% 0.64 / 0.68 / -5.4%
tpcds_q78/datafusion:vortex-file-compressed 60788470 / 60965657 / -0.3% 90789240 / 86015972 / +5.5% 0.67 / 0.71 / -5.5%
tpcds_q79/datafusion:vortex-file-compressed 20420622 / 20279438 / +0.7% 42170865 / 42110377 / +0.1% 0.48 / 0.48 / +0.6%
tpcds_q80/datafusion:vortex-file-compressed 68205980 / 68766030 / -0.8% 92863387 / 93570722 / -0.8% 0.73 / 0.73 / -0.1%
tpcds_q81/datafusion:vortex-file-compressed 27617692 / 28260648 / -2.3% 47683464 / 45300560 / +5.3% 0.58 / 0.62 / -7.2%
tpcds_q82/datafusion:vortex-file-compressed 12767813 / 12807434 / -0.3% 38212273 / 35626130 / +7.3% 0.33 / 0.36 / -7.1%
tpcds_q83/datafusion:vortex-file-compressed 35040696 / 35376074 / -0.9% 55782998 / 52093141 / +7.1% 0.63 / 0.68 / -7.5%
tpcds_q84/datafusion:vortex-file-compressed 10508876 / 10461540 / +0.5% 27150111 / 25885722 / +4.9% 0.39 / 0.40 / -4.2%
tpcds_q85/datafusion:vortex-file-compressed 52030674 / 51809666 / +0.4% 78346239 / 75574697 / +3.7% 0.66 / 0.69 / -3.1%
tpcds_q86/datafusion:vortex-file-compressed 16370676 / 16113415 / +1.6% 34856983 / 34409002 / +1.3% 0.47 / 0.47 / +0.3%
tpcds_q87/datafusion:vortex-file-compressed 26445390 / 26499568 / -0.2% 50736570 / 48598250 / +4.4% 0.52 / 0.55 / -4.4%
tpcds_q88/datafusion:vortex-file-compressed 32315228 / 32357568 / -0.1% 53678153 / 50858837 / +5.5% 0.60 / 0.64 / -5.4%
tpcds_q89/datafusion:vortex-file-compressed 22015031 / 21807304 / +1.0% 44074591 / 42407282 / +3.9% 0.50 / 0.51 / -2.9%
tpcds_q90/datafusion:vortex-file-compressed 10380071 / 10365216 / +0.1% 25886306 / 24066050 / +7.6% 0.40 / 0.43 / -6.9%
tpcds_q91/datafusion:vortex-file-compressed 15588022 / 16048840 / -2.9% 37523176 / 36604324 / +2.5% 0.42 / 0.44 / -5.2%
tpcds_q92/datafusion:vortex-file-compressed 12899089 / 13198902 / -2.3% 31974373 / 29685220 / +7.7% 0.40 / 0.44 / -9.3%
tpcds_q93/datafusion:vortex-file-compressed 19654454 / 20150414 / -2.5% 43224946 / 40148939 / +7.7% 0.45 / 0.50 / -9.4%
tpcds_q94/datafusion:vortex-file-compressed 18714265 / 18552985 / +0.9% 38664169 / 37927246 / +1.9% 0.48 / 0.49 / -1.1%
tpcds_q95/datafusion:vortex-file-compressed 41819528 / 41763500 / +0.1% 63044298 / 60866535 / +3.6% 0.66 / 0.69 / -3.3%
tpcds_q96/datafusion:vortex-file-compressed 7731256 / 7859994 / -1.6% 27290126 / 23576532 / +15.8% 🔴 0.28 / 0.33 / -15.0%
tpcds_q97/datafusion:vortex-file-compressed 17257176 / 17259486 / -0.0% 40629380 / 37350276 / +8.8% 0.42 / 0.46 / -8.1%
tpcds_q98/datafusion:vortex-file-compressed 15994314 / 16185816 / -1.2% 33876476 / 32671739 / +3.7% 0.47 / 0.50 / -4.7%
tpcds_q99/datafusion:vortex-file-compressed 16247032 / 16384194 / -0.8% 34862896 / 33993322 / +2.6% 0.47 / 0.48 / -3.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43509639 / 43046149 / +1.1% 61829253 / 59333915 / +4.2% 0.70 / 0.73 / -3.0%
tpcds_q02/datafusion:parquet 54975594 / 55017496 / -0.1% 70589502 / 69006470 / +2.3% 0.78 / 0.80 / -2.3%
tpcds_q03/datafusion:parquet 18932898 / 19078092 / -0.8% 31599805 / 32968281 / -4.2% 0.60 / 0.58 / +3.5%
tpcds_q04/datafusion:parquet 180253466 / 179731768 / +0.3% 203956319 / 199226926 / +2.4% 0.88 / 0.90 / -2.0%
tpcds_q05/datafusion:parquet 68586137 / 68363662 / +0.3% 89662174 / 88310082 / +1.5% 0.76 / 0.77 / -1.2%
tpcds_q06/datafusion:parquet 33783988 / 35133400 / -3.8% 45391804 / 44032369 / +3.1% 0.74 / 0.80 / -6.7%
tpcds_q07/datafusion:parquet 46535136 / 47015244 / -1.0% 67022701 / 63060866 / +6.3% 0.69 / 0.75 / -6.9%
tpcds_q08/datafusion:parquet 30845318 / 31108916 / -0.8% 44632400 / 46407336 / -3.8% 0.69 / 0.67 / +3.1%
tpcds_q09/datafusion:parquet 31412524 / 32235404 / -2.6% 37610378 / 38162448 / -1.4% 0.84 / 0.84 / -1.1%
tpcds_q10/datafusion:parquet 44837118 / 45810956 / -2.1% 59017581 / 55821116 / +5.7% 0.76 / 0.82 / -7.4%
tpcds_q11/datafusion:parquet 97509870 / 97324552 / +0.2% 120842415 / 116986930 / +3.3% 0.81 / 0.83 / -3.0%
tpcds_q12/datafusion:parquet 23530958 / 23829389 / -1.3% 35878552 / 34561700 / +3.8% 0.66 / 0.69 / -4.9%
tpcds_q13/datafusion:parquet 46339620 / 47205746 / -1.8% 69891896 / 66519722 / +5.1% 0.66 / 0.71 / -6.6%
tpcds_q14/datafusion:parquet 537041632 / 536062596 / +0.2% 580824140 / 573875357 / +1.2% 0.92 / 0.93 / -1.0%
tpcds_q15/datafusion:parquet 23691189 / 23467316 / +1.0% 38108937 / 36912696 / +3.2% 0.62 / 0.64 / -2.2%
tpcds_q16/datafusion:parquet 37112186 / 36797934 / +0.9% 49764104 / 49093338 / +1.4% 0.75 / 0.75 / -0.5%
tpcds_q17/datafusion:parquet 74228454 / 77417738 / -4.1% 96523827 / 94152957 / +2.5% 0.77 / 0.82 / -6.5%
tpcds_q18/datafusion:parquet 67545773 / 67730459 / -0.3% 87898085 / 89015478 / -1.3% 0.77 / 0.76 / +1.0%
tpcds_q19/datafusion:parquet 29490710 / 29767255 / -0.9% 43425276 / 40859608 / +6.3% 0.68 / 0.73 / -6.8%
tpcds_q20/datafusion:parquet 25151574 / 24985466 / +0.7% 38498379 / 37149008 / +3.6% 0.65 / 0.67 / -2.9%
tpcds_q21/datafusion:parquet 20285108 / 20098942 / +0.9% 31594684 / 31199048 / +1.3% 0.64 / 0.64 / -0.3%
tpcds_q22/datafusion:parquet 76834309 / 78225004 / -1.8% 88979882 / 88011450 / +1.1% 0.86 / 0.89 / -2.8%
tpcds_q23/datafusion:parquet 92343318 / 93465786 / -1.2% 113895522 / 115763272 / -1.6% 0.81 / 0.81 / +0.4%
tpcds_q24/datafusion:parquet 91073088 / 90530880 / +0.6% 115416836 / 112774834 / +2.3% 0.79 / 0.80 / -1.7%
tpcds_q25/datafusion:parquet 81853856 / 78942378 / +3.7% 106956236 / 100286343 / +6.7% 0.77 / 0.79 / -2.8%
tpcds_q26/datafusion:parquet 43437220 / 42985690 / +1.1% 60131900 / 59286646 / +1.4% 0.72 / 0.73 / -0.4%
tpcds_q27/datafusion:parquet 74523677 / 78387144 / -4.9% 95320941 / 99975873 / -4.7% 0.78 / 0.78 / -0.3%
tpcds_q28/datafusion:parquet 28560940 / 28355490 / +0.7% 43027474 / 41055918 / +4.8% 0.66 / 0.69 / -3.9%
tpcds_q29/datafusion:parquet 74827671 / 74275574 / +0.7% 95752096 / 99075419 / -3.4% 0.78 / 0.75 / +4.2%
tpcds_q30/datafusion:parquet 45931350 / 44266542 / +3.8% 58609606 / 55134805 / +6.3% 0.78 / 0.80 / -2.4%
tpcds_q31/datafusion:parquet 76662458 / 80991932 / -5.3% 102231835 / 100088488 / +2.1% 0.75 / 0.81 / -7.3%
tpcds_q32/datafusion:parquet 25196914 / 27160338 / -7.2% 39336807 / 37888363 / +3.8% 0.64 / 0.72 / -10.6%
tpcds_q33/datafusion:parquet 38461774 / 37472210 / +2.6% 53581839 / 52784833 / +1.5% 0.72 / 0.71 / +1.1%
tpcds_q34/datafusion:parquet 24667058 / 24223199 / +1.8% 35965843 / 34925847 / +3.0% 0.69 / 0.69 / -1.1%
tpcds_q35/datafusion:parquet 51794643 / 50061658 / +3.5% 62921556 / 66186392 / -4.9% 0.82 / 0.76 / +8.8%
tpcds_q36/datafusion:parquet 52185538 / 53863620 / -3.1% 72832188 / 72008538 / +1.1% 0.72 / 0.75 / -4.2%
tpcds_q37/datafusion:parquet 21388749 / 21492292 / -0.5% 35168153 / 33965178 / +3.5% 0.61 / 0.63 / -3.9%
tpcds_q38/datafusion:parquet 45314944 / 43738358 / +3.6% 60134347 / 58984516 / +1.9% 0.75 / 0.74 / +1.6%
tpcds_q39/datafusion:parquet 69128160 / 68451454 / +1.0% 85484753 / 84694449 / +0.9% 0.81 / 0.81 / +0.1%
tpcds_q40/datafusion:parquet 29977622 / 29898065 / +0.3% 48750810 / 49416081 / -1.3% 0.61 / 0.61 / +1.6%
tpcds_q41/datafusion:parquet 20081611 / 19725044 / +1.8% 31459200 / 31567276 / -0.3% 0.64 / 0.62 / +2.2%
tpcds_q42/datafusion:parquet 18310350 / 18410036 / -0.5% 29020090 / 29096386 / -0.3% 0.63 / 0.63 / -0.3%
tpcds_q43/datafusion:parquet 19284630 / 19482850 / -1.0% 32568088 / 30496940 / +6.8% 0.59 / 0.64 / -7.3%
tpcds_q44/datafusion:parquet 34364176 / 35289568 / -2.6% 50540991 / 48402674 / +4.4% 0.68 / 0.73 / -6.7%
tpcds_q45/datafusion:parquet 28008213 / 28034722 / -0.1% 41419972 / 38421721 / +7.8% 0.68 / 0.73 / -7.3%
tpcds_q46/datafusion:parquet 28676904 / 29018574 / -1.2% 45717090 / 44678861 / +2.3% 0.63 / 0.65 / -3.4%
tpcds_q47/datafusion:parquet 98137739 / 96614053 / +1.6% 120191679 / 119575121 / +0.5% 0.82 / 0.81 / +1.1%
tpcds_q48/datafusion:parquet 41931253 / 42307228 / -0.9% 60979849 / 57749935 / +5.6% 0.69 / 0.73 / -6.1%
tpcds_q49/datafusion:parquet 72434950 / 72427164 / +0.0% 99906221 / 91585118 / +9.1% 0.73 / 0.79 / -8.3%
tpcds_q50/datafusion:parquet 48873246 / 47500422 / +2.9% 65998776 / 68227695 / -3.3% 0.74 / 0.70 / +6.4%
tpcds_q51/datafusion:parquet 75428115 / 74856850 / +0.8% 94702277 / 94480088 / +0.2% 0.80 / 0.79 / +0.5%
tpcds_q52/datafusion:parquet 18813875 / 18570137 / +1.3% 31277270 / 28281276 / +10.6% 🔴 0.60 / 0.66 / -8.4%
tpcds_q53/datafusion:parquet 22060260 / 21996628 / +0.3% 38126556 / 37632392 / +1.3% 0.58 / 0.58 / -1.0%
tpcds_q54/datafusion:parquet 53054688 / 53403201 / -0.7% 68365485 / 65412957 / +4.5% 0.78 / 0.82 / -4.9%
tpcds_q55/datafusion:parquet 18213486 / 18094322 / +0.7% 31553030 / 28452535 / +10.9% 🔴 0.58 / 0.64 / -9.2%
tpcds_q56/datafusion:parquet 41431225 / 42064521 / -1.5% 58146192 / 52494093 / +10.8% 🔴 0.71 / 0.80 / -11.1%
tpcds_q57/datafusion:parquet 101288200 / 98531152 / +2.8% 119464459 / 115051750 / +3.8% 0.85 / 0.86 / -1.0%
tpcds_q58/datafusion:parquet 66163710 / 66028114 / +0.2% 85708391 / 80484923 / +6.5% 0.77 / 0.82 / -5.9%
tpcds_q59/datafusion:parquet 48096018 / 48124550 / -0.1% 65522562 / 63375622 / +3.4% 0.73 / 0.76 / -3.3%
tpcds_q60/datafusion:parquet 42852361 / 41774428 / +2.6% 56304818 / 52913053 / +6.4% 0.76 / 0.79 / -3.6%
tpcds_q61/datafusion:parquet 35768602 / 36568854 / -2.2% 51069118 / 53842276 / -5.2% 0.70 / 0.68 / +3.1%
tpcds_q62/datafusion:parquet 25232914 / 25168784 / +0.3% 37897062 / 38657488 / -2.0% 0.67 / 0.65 / +2.3%
tpcds_q63/datafusion:parquet 22182094 / 22467320 / -1.3% 37829745 / 36224907 / +4.4% 0.59 / 0.62 / -5.5%
tpcds_q64/datafusion:parquet 287180838 / 285654170 / +0.5% 322832840 / 321241476 / +0.5% 0.89 / 0.89 / +0.0%
tpcds_q65/datafusion:parquet 122568233 / 119227688 / +2.8% 138086469 / 139579808 / -1.1% 0.89 / 0.85 / +3.9%
tpcds_q66/datafusion:parquet 60918680 / 61287888 / -0.6% 78639068 / 75163315 / +4.6% 0.77 / 0.82 / -5.0%
tpcds_q67/datafusion:parquet 68560379 / 69044428 / -0.7% 92199266 / 91696967 / +0.5% 0.74 / 0.75 / -1.2%
tpcds_q68/datafusion:parquet 28907860 / 29075160 / -0.6% 48685701 / 47405672 / +2.7% 0.59 / 0.61 / -3.2%
tpcds_q69/datafusion:parquet 43328740 / 43304174 / +0.1% 57220842 / 58652073 / -2.4% 0.76 / 0.74 / +2.6%
tpcds_q70/datafusion:parquet 80436310 / 80027439 / +0.5% 98633413 / 97604918 / +1.1% 0.82 / 0.82 / -0.5%
tpcds_q71/datafusion:parquet 26650918 / 25732466 / +3.6% 40200804 / 40528677 / -0.8% 0.66 / 0.63 / +4.4%
tpcds_q72/datafusion:parquet 522781152 / 527634840 / -0.9% 551195344 / 554349016 / -0.6% 0.95 / 0.95 / -0.4%
tpcds_q73/datafusion:parquet 23770152 / 23762050 / +0.0% 36156178 / 35077300 / +3.1% 0.66 / 0.68 / -3.0%
tpcds_q74/datafusion:parquet 69557857 / 69999536 / -0.6% 90616824 / 88289509 / +2.6% 0.77 / 0.79 / -3.2%
tpcds_q75/datafusion:parquet 153727000 / 152662930 / +0.7% 174808482 / 180450074 / -3.1% 0.88 / 0.85 / +3.9%
tpcds_q76/datafusion:parquet 33899044 / 33132911 / +2.3% 48411379 / 44935481 / +7.7% 0.70 / 0.74 / -5.0%
tpcds_q77/datafusion:parquet 56912512 / 56979256 / -0.1% 75696007 / 72969812 / +3.7% 0.75 / 0.78 / -3.7%
tpcds_q78/datafusion:parquet 86599211 / 85272162 / +1.6% 117298240 / 115614404 / +1.5% 0.74 / 0.74 / +0.1%
tpcds_q79/datafusion:parquet 27100208 / 26735792 / +1.4% 42493878 / 39769716 / +6.8% 0.64 / 0.67 / -5.1%
tpcds_q80/datafusion:parquet 81621936 / 78680880 / +3.7% 110305905 / 107863155 / +2.3% 0.74 / 0.73 / +1.4%
tpcds_q81/datafusion:parquet 38766153 / 39558134 / -2.0% 53801525 / 51081109 / +5.3% 0.72 / 0.77 / -7.0%
tpcds_q82/datafusion:parquet 22362554 / 22190428 / +0.8% 36023349 / 34291795 / +5.0% 0.62 / 0.65 / -4.1%
tpcds_q83/datafusion:parquet 58235817 / 58307740 / -0.1% 75289485 / 73002134 / +3.1% 0.77 / 0.80 / -3.2%
tpcds_q84/datafusion:parquet 27193857 / 27313596 / -0.4% 39510354 / 40041516 / -1.3% 0.69 / 0.68 / +0.9%
tpcds_q85/datafusion:parquet 80780448 / 79983598 / +1.0% 103849759 / 102306985 / +1.5% 0.78 / 0.78 / -0.5%
tpcds_q86/datafusion:parquet 20722198 / 21058438 / -1.6% 33553862 / 32574181 / +3.0% 0.62 / 0.65 / -4.5%
tpcds_q87/datafusion:parquet 45823650 / 45280914 / +1.2% 60675465 / 62384128 / -2.7% 0.76 / 0.73 / +4.0%
tpcds_q88/datafusion:parquet 37127370 / 37757294 / -1.7% 52609176 / 51820809 / +1.5% 0.71 / 0.73 / -3.1%
tpcds_q89/datafusion:parquet 25895870 / 26318301 / -1.6% 42130283 / 39991728 / +5.3% 0.61 / 0.66 / -6.6%
tpcds_q90/datafusion:parquet 15260178 / 15087966 / +1.1% 26947075 / 26597960 / +1.3% 0.57 / 0.57 / -0.2%
tpcds_q91/datafusion:parquet 32494736 / 32625398 / -0.4% 47165660 / 45196471 / +4.4% 0.69 / 0.72 / -4.6%
tpcds_q92/datafusion:parquet 26989787 / 26834922 / +0.6% 40277619 / 38063167 / +5.8% 0.67 / 0.71 / -5.0%
tpcds_q93/datafusion:parquet 27178921 / 26735974 / +1.7% 46392623 / 42486273 / +9.2% 0.59 / 0.63 / -6.9%
tpcds_q94/datafusion:parquet 35076457 / 35393988 / -0.9% 48445781 / 47118664 / +2.8% 0.72 / 0.75 / -3.6%
tpcds_q95/datafusion:parquet 66086011 / 64212454 / +2.9% 77709220 / 79492966 / -2.2% 0.85 / 0.81 / +5.3%
tpcds_q96/datafusion:parquet 12904366 / 12723054 / +1.4% 24204111 / 23429883 / +3.3% 0.53 / 0.54 / -1.8%
tpcds_q97/datafusion:parquet 35518948 / 35098156 / +1.2% 51556670 / 49335860 / +4.5% 0.69 / 0.71 / -3.2%
tpcds_q98/datafusion:parquet 24676666 / 25139323 / -1.8% 38193313 / 36349537 / +5.1% 0.65 / 0.69 / -6.6%
tpcds_q99/datafusion:parquet 29378036 / 29673968 / -1.0% 42704566 / 41366470 / +3.2% 0.69 / 0.72 / -4.1%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15818049 / 15890239 / -0.5% 24320423 / 24196641 / +0.5% 0.65 / 0.66 / -1.0%
tpcds_q02/duckdb:vortex-file-compressed 17844174 / 18657920 / -4.4% 23029009 / 22422968 / +2.7% 0.77 / 0.83 / -6.9%
tpcds_q03/duckdb:vortex-file-compressed 7047470 / 7149274 / -1.4% 17122686 / 16220757 / +5.6% 0.41 / 0.44 / -6.6%
tpcds_q04/duckdb:vortex-file-compressed 59016349 / 58862208 / +0.3% 70602573 / 71856038 / -1.7% 0.84 / 0.82 / +2.0%
tpcds_q05/duckdb:vortex-file-compressed 22940936 / 23117854 / -0.8% 31730140 / 32942130 / -3.7% 0.72 / 0.70 / +3.0%
tpcds_q06/duckdb:vortex-file-compressed 23793130 / 24164680 / -1.5% 38925957 / 37874428 / +2.8% 0.61 / 0.64 / -4.2%
tpcds_q07/duckdb:vortex-file-compressed 22069862 / 22109802 / -0.2% 34492139 / 32504438 / +6.1% 0.64 / 0.68 / -5.9%
tpcds_q08/duckdb:vortex-file-compressed 17362544 / 17492722 / -0.7% 25794808 / 25089879 / +2.8% 0.67 / 0.70 / -3.5%
tpcds_q09/duckdb:vortex-file-compressed 19182842 / 19005454 / +0.9% 29294092 / 29541405 / -0.8% 0.65 / 0.64 / +1.8%
tpcds_q10/duckdb:vortex-file-compressed 27663960 / 27533383 / +0.5% 42002154 / 41135181 / +2.1% 0.66 / 0.67 / -1.6%
tpcds_q11/duckdb:vortex-file-compressed 36359466 / 36618646 / -0.7% 46051917 / 44343100 / +3.9% 0.79 / 0.83 / -4.4%
tpcds_q12/duckdb:vortex-file-compressed 9526766 / 9679752 / -1.6% 16944551 / 17229625 / -1.7% 0.56 / 0.56 / +0.1%
tpcds_q13/duckdb:vortex-file-compressed 19763831 / 19843352 / -0.4% 32968481 / 31995768 / +3.0% 0.60 / 0.62 / -3.3%
tpcds_q14/duckdb:vortex-file-compressed 54652033 / 55297112 / -1.2% 63630746 / 64955646 / -2.0% 0.86 / 0.85 / +0.9%
tpcds_q15/duckdb:vortex-file-compressed 11253918 / 11325009 / -0.6% 17624924 / 18325444 / -3.8% 0.64 / 0.62 / +3.3%
tpcds_q16/duckdb:vortex-file-compressed 24049431 / 24731064 / -2.8% 36153352 / 34853379 / +3.7% 0.67 / 0.71 / -6.3%
tpcds_q17/duckdb:vortex-file-compressed 20128790 / 20396798 / -1.3% 31760969 / 32338231 / -1.8% 0.63 / 0.63 / +0.5%
tpcds_q18/duckdb:vortex-file-compressed 32337992 / 32346349 / -0.0% 44926200 / 43278488 / +3.8% 0.72 / 0.75 / -3.7%
tpcds_q19/duckdb:vortex-file-compressed 20502770 / 20786617 / -1.4% 29383328 / 29101806 / +1.0% 0.70 / 0.71 / -2.3%
tpcds_q20/duckdb:vortex-file-compressed 10625140 / 10704608 / -0.7% 17339422 / 17476285 / -0.8% 0.61 / 0.61 / +0.0%
tpcds_q21/duckdb:vortex-file-compressed 9037150 / 9371898 / -3.6% 22877572 / 21703364 / +5.4% 0.40 / 0.43 / -8.5%
tpcds_q22/duckdb:vortex-file-compressed 17373755 / 17643249 / -1.5% 30326273 / 29161310 / +4.0% 0.57 / 0.61 / -5.3%
tpcds_q23/duckdb:vortex-file-compressed 36803722 / 37431455 / -1.7% 49512928 / 48459168 / +2.2% 0.74 / 0.77 / -3.8%
tpcds_q24/duckdb:vortex-file-compressed 26701903 / 26441519 / +1.0% 38814643 / 36595428 / +6.1% 0.69 / 0.72 / -4.8%
tpcds_q25/duckdb:vortex-file-compressed 19266682 / 19221668 / +0.2% 31267798 / 30221864 / +3.5% 0.62 / 0.64 / -3.1%
tpcds_q26/duckdb:vortex-file-compressed 21421840 / 21300105 / +0.6% 32065530 / 31212707 / +2.7% 0.67 / 0.68 / -2.1%
tpcds_q27/duckdb:vortex-file-compressed 24835802 / 24807916 / +0.1% 37716047 / 35637087 / +5.8% 0.66 / 0.70 / -5.4%
tpcds_q28/duckdb:vortex-file-compressed 15022776 / 15090790 / -0.5% 25725400 / 25912108 / -0.7% 0.58 / 0.58 / +0.3%
tpcds_q29/duckdb:vortex-file-compressed 18677701 / 18678136 / -0.0% 31105883 / 29174081 / +6.6% 0.60 / 0.64 / -6.2%
tpcds_q30/duckdb:vortex-file-compressed 18382754 / 18682425 / -1.6% 27261734 / 27172488 / +0.3% 0.67 / 0.69 / -1.9%
tpcds_q31/duckdb:vortex-file-compressed 17686370 / 17961668 / -1.5% 26210799 / 26844104 / -2.4% 0.67 / 0.67 / +0.8%
tpcds_q32/duckdb:vortex-file-compressed 10205496 / 10237077 / -0.3% 19054304 / 18081369 / +5.4% 0.54 / 0.57 / -5.4%
tpcds_q33/duckdb:vortex-file-compressed 17654964 / 17651904 / +0.0% 27583964 / 27599437 / -0.1% 0.64 / 0.64 / +0.1%
tpcds_q34/duckdb:vortex-file-compressed 13036030 / 12881700 / +1.2% 22593967 / 21645185 / +4.4% 0.58 / 0.60 / -3.1%
tpcds_q35/duckdb:vortex-file-compressed 31008992 / 31119364 / -0.4% 43788891 / 42566508 / +2.9% 0.71 / 0.73 / -3.1%
tpcds_q36/duckdb:vortex-file-compressed 13957017 / 14037150 / -0.6% 24715145 / 23560362 / +4.9% 0.56 / 0.60 / -5.2%
tpcds_q37/duckdb:vortex-file-compressed 9425386 / 9278629 / +1.6% 24190321 / 24238961 / -0.2% 0.39 / 0.38 / +1.8%
tpcds_q38/duckdb:vortex-file-compressed 24298373 / 24606434 / -1.3% 32010827 / 31179343 / +2.7% 0.76 / 0.79 / -3.8%
tpcds_q39/duckdb:vortex-file-compressed 18653187 / 18495272 / +0.9% 32044205 / 30737214 / +4.3% 0.58 / 0.60 / -3.3%
tpcds_q40/duckdb:vortex-file-compressed 11166620 / 11167876 / -0.0% 20091298 / 19316090 / +4.0% 0.56 / 0.58 / -3.9%
tpcds_q41/duckdb:vortex-file-compressed 17304178 / 17305600 / -0.0% 23835412 / 24395246 / -2.3% 0.73 / 0.71 / +2.3%
tpcds_q42/duckdb:vortex-file-compressed 6911578 / 6914912 / -0.0% 16979750 / 15064464 / +12.7% 🔴 0.41 / 0.46 / -11.3%
tpcds_q43/duckdb:vortex-file-compressed 9544864 / 9643249 / -1.0% 19069648 / 18160250 / +5.0% 0.50 / 0.53 / -5.7%
tpcds_q44/duckdb:vortex-file-compressed 12501787 / 12476409 / +0.2% 24089536 / 23821756 / +1.1% 0.52 / 0.52 / -0.9%
tpcds_q45/duckdb:vortex-file-compressed 23537963 / 23587638 / -0.2% 30628162 / 30430270 / +0.7% 0.77 / 0.78 / -0.9%
tpcds_q46/duckdb:vortex-file-compressed 31620100 / 31418024 / +0.6% 44468170 / 43171545 / +3.0% 0.71 / 0.73 / -2.3%
tpcds_q47/duckdb:vortex-file-compressed 30828278 / 31264494 / -1.4% 40429076 / 41141020 / -1.7% 0.76 / 0.76 / +0.3%
tpcds_q48/duckdb:vortex-file-compressed 22792180 / 22472531 / +1.4% 35815922 / 35469142 / +1.0% 0.64 / 0.63 / +0.4%
tpcds_q49/duckdb:vortex-file-compressed 18334410 / 18985566 / -3.4% 29845506 / 29722088 / +0.4% 0.61 / 0.64 / -3.8%
tpcds_q50/duckdb:vortex-file-compressed 14753135 / 14896845 / -1.0% 25002716 / 25687406 / -2.7% 0.59 / 0.58 / +1.7%
tpcds_q51/duckdb:vortex-file-compressed 49024323 / 48063878 / +2.0% 57344820 / 76334322 / -24.9% 🟢 0.85 / 0.63 / +35.8%
tpcds_q52/duckdb:vortex-file-compressed 6932553 / 7171716 / -3.3% 16105184 / 15978547 / +0.8% 0.43 / 0.45 / -4.1%
tpcds_q53/duckdb:vortex-file-compressed 11378346 / 11319189 / +0.5% 21006713 / 21681207 / -3.1% 0.54 / 0.52 / +3.8%
tpcds_q54/duckdb:vortex-file-compressed 19632221 / 19748759 / -0.6% 30948928 / 29438540 / +5.1% 0.63 / 0.67 / -5.4%
tpcds_q55/duckdb:vortex-file-compressed 6941775 / 6847788 / +1.4% 16064309 / 15285422 / +5.1% 0.43 / 0.45 / -3.5%
tpcds_q56/duckdb:vortex-file-compressed 18131111 / 17817582 / +1.8% 28992138 / 28613711 / +1.3% 0.63 / 0.62 / +0.4%
tpcds_q57/duckdb:vortex-file-compressed 25532297 / 25308086 / +0.9% 33988795 / 33487780 / +1.5% 0.75 / 0.76 / -0.6%
tpcds_q58/duckdb:vortex-file-compressed 20540938 / 20359384 / +0.9% 30205433 / 29241349 / +3.3% 0.68 / 0.70 / -2.3%
tpcds_q59/duckdb:vortex-file-compressed 19483242 / 19485481 / -0.0% 27692399 / 26442217 / +4.7% 0.70 / 0.74 / -4.5%
tpcds_q60/duckdb:vortex-file-compressed 18349278 / 18504610 / -0.8% 28673551 / 28842068 / -0.6% 0.64 / 0.64 / -0.3%
tpcds_q61/duckdb:vortex-file-compressed 19840730 / 19922872 / -0.4% 31234258 / 30039600 / +4.0% 0.64 / 0.66 / -4.2%
tpcds_q62/duckdb:vortex-file-compressed 11076664 / 10937722 / +1.3% 17764565 / 17144486 / +3.6% 0.62 / 0.64 / -2.3%
tpcds_q63/duckdb:vortex-file-compressed 10911294 / 10809960 / +0.9% 19233670 / 20560158 / -6.5% 0.57 / 0.53 / +7.9%
tpcds_q64/duckdb:vortex-file-compressed 52537689 / 52513062 / +0.0% 68743819 / 68406502 / +0.5% 0.76 / 0.77 / -0.4%
tpcds_q65/duckdb:vortex-file-compressed 12958691 / 13060742 / -0.8% 23355841 / 23236608 / +0.5% 0.55 / 0.56 / -1.3%
tpcds_q66/duckdb:vortex-file-compressed 31324050 / 31272590 / +0.2% 39343762 / 39351988 / -0.0% 0.80 / 0.79 / +0.2%
tpcds_q67/duckdb:vortex-file-compressed 55012042 / 55266268 / -0.5% 65728129 / 64683896 / +1.6% 0.84 / 0.85 / -2.0%
tpcds_q68/duckdb:vortex-file-compressed 22723472 / 23009998 / -1.2% 36483276 / 35296552 / +3.4% 0.62 / 0.65 / -4.5%
tpcds_q69/duckdb:vortex-file-compressed 21951012 / 22017648 / -0.3% 37626256 / 36691775 / +2.5% 0.58 / 0.60 / -2.8%
tpcds_q70/duckdb:vortex-file-compressed 14477656 / 14724129 / -1.7% 26044262 / 25052861 / +4.0% 0.56 / 0.59 / -5.4%
tpcds_q71/duckdb:vortex-file-compressed 13313339 / 13347567 / -0.3% 23678898 / 23409485 / +1.2% 0.56 / 0.57 / -1.4%
tpcds_q72/duckdb:vortex-file-compressed 42968952 / 43060600 / -0.2% 56885236 / 56269909 / +1.1% 0.76 / 0.77 / -1.3%
tpcds_q73/duckdb:vortex-file-compressed 11921762 / 11829364 / +0.8% 21199191 / 21106781 / +0.4% 0.56 / 0.56 / +0.3%
tpcds_q74/duckdb:vortex-file-compressed 30691932 / 30874616 / -0.6% 39442429 / 39304395 / +0.4% 0.78 / 0.79 / -0.9%
tpcds_q75/duckdb:vortex-file-compressed 37212948 / 37067086 / +0.4% 50775988 / 48402666 / +4.9% 0.73 / 0.77 / -4.3%
tpcds_q76/duckdb:vortex-file-compressed 12638398 / 12879005 / -1.9% 22846171 / 22058251 / +3.6% 0.55 / 0.58 / -5.3%
tpcds_q77/duckdb:vortex-file-compressed 20551186 / 20386666 / +0.8% 31912982 / 31298903 / +2.0% 0.64 / 0.65 / -1.1%
tpcds_q78/duckdb:vortex-file-compressed 43000648 / 42921238 / +0.2% 55620401 / 52920959 / +5.1% 0.77 / 0.81 / -4.7%
tpcds_q79/duckdb:vortex-file-compressed 17038238 / 17204298 / -1.0% 27800836 / 26915068 / +3.3% 0.61 / 0.64 / -4.1%
tpcds_q80/duckdb:vortex-file-compressed 29581270 / 29835128 / -0.9% 45348549 / 43751968 / +3.6% 0.65 / 0.68 / -4.3%
tpcds_q81/duckdb:vortex-file-compressed 21068260 / 21403570 / -1.6% 30383780 / 30302750 / +0.3% 0.69 / 0.71 / -1.8%
tpcds_q82/duckdb:vortex-file-compressed 9217216 / 9601288 / -4.0% 24900296 / 23700733 / +5.1% 0.37 / 0.41 / -8.6%
tpcds_q83/duckdb:vortex-file-compressed 17520532 / 17487681 / +0.2% 24699503 / 24391032 / +1.3% 0.71 / 0.72 / -1.1%
tpcds_q84/duckdb:vortex-file-compressed 15301710 / 15474432 / -1.1% 22779124 / 23926919 / -4.8% 0.67 / 0.65 / +3.9%
tpcds_q85/duckdb:vortex-file-compressed 24804440 / 25015558 / -0.8% 36898933 / 36358715 / +1.5% 0.67 / 0.69 / -2.3%
tpcds_q86/duckdb:vortex-file-compressed 9665368 / 9625184 / +0.4% 16534763 / 16115124 / +2.6% 0.58 / 0.60 / -2.1%
tpcds_q87/duckdb:vortex-file-compressed 25631952 / 26050646 / -1.6% 32543145 / 33749194 / -3.6% 0.79 / 0.77 / +2.0%
tpcds_q88/duckdb:vortex-file-compressed 29917486 / 30341066 / -1.4% 39364885 / 40666123 / -3.2% 0.76 / 0.75 / +1.9%
tpcds_q89/duckdb:vortex-file-compressed 12134442 / 11880278 / +2.1% 20874740 / 21020275 / -0.7% 0.58 / 0.57 / +2.9%
tpcds_q90/duckdb:vortex-file-compressed 7715624 / 7873380 / -2.0% 14553975 / 15793821 / -7.9% 0.53 / 0.50 / +6.3%
tpcds_q91/duckdb:vortex-file-compressed 14488728 / 14680431 / -1.3% 23293235 / 23432754 / -0.6% 0.62 / 0.63 / -0.7%
tpcds_q92/duckdb:vortex-file-compressed 10303752 / 10362186 / -0.6% 17814922 / 17798675 / +0.1% 0.58 / 0.58 / -0.7%
tpcds_q93/duckdb:vortex-file-compressed 10085364 / 10321070 / -2.3% 23580288 / 22416155 / +5.2% 0.43 / 0.46 / -7.1%
tpcds_q94/duckdb:vortex-file-compressed 21998084 / 22085020 / -0.4% 32295128 / 31715817 / +1.8% 0.68 / 0.70 / -2.2%
tpcds_q95/duckdb:vortex-file-compressed 61036526 / 60520896 / +0.9% 68874270 / 67458992 / +2.1% 0.89 / 0.90 / -1.2%
tpcds_q96/duckdb:vortex-file-compressed 6339036 / 6497133 / -2.4% 16464972 / 15310655 / +7.5% 0.39 / 0.42 / -9.3%
tpcds_q97/duckdb:vortex-file-compressed 23195440 / 22917520 / +1.2% 31950244 / 31822045 / +0.4% 0.73 / 0.72 / +0.8%
tpcds_q98/duckdb:vortex-file-compressed 10804056 / 10919490 / -1.1% 20392605 / 19425955 / +5.0% 0.53 / 0.56 / -5.7%
tpcds_q99/duckdb:vortex-file-compressed 14487335 / 14421880 / +0.5% 21691223 / 22012689 / -1.5% 0.67 / 0.66 / +1.9%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23877126 / 24093628 / -0.9% 30665595 / 30609636 / +0.2% 0.78 / 0.79 / -1.1%
tpcds_q02/duckdb:parquet 17831122 / 17984803 / -0.9% 23855859 / 24025915 / -0.7% 0.75 / 0.75 / -0.1%
tpcds_q03/duckdb:parquet 9654958 / 9812261 / -1.6% 15630348 / 15610845 / +0.1% 0.62 / 0.63 / -1.7%
tpcds_q04/duckdb:parquet 118835296 / 118053322 / +0.7% 123597468 / 125451786 / -1.5% 0.96 / 0.94 / +2.2%
tpcds_q05/duckdb:parquet 28179192 / 28431532 / -0.9% 32739328 / 33184023 / -1.3% 0.86 / 0.86 / +0.5%
tpcds_q06/duckdb:parquet 26182364 / 26561266 / -1.4% 35552152 / 34919227 / +1.8% 0.74 / 0.76 / -3.2%
tpcds_q07/duckdb:parquet 33346422 / 31458600 / +6.0% 38967076 / 38910397 / +0.1% 0.86 / 0.81 / +5.8%
tpcds_q08/duckdb:parquet 19830344 / 19835614 / -0.0% 24852901 / 26315778 / -5.6% 0.80 / 0.75 / +5.9%
tpcds_q09/duckdb:parquet 26635504 / 27590826 / -3.5% 29994053 / 29561025 / +1.5% 0.89 / 0.93 / -4.9%
tpcds_q10/duckdb:parquet 32455027 / 32550451 / -0.3% 40187884 / 40051128 / +0.3% 0.81 / 0.81 / -0.6%
tpcds_q11/duckdb:parquet 69105418 / 68928280 / +0.3% 76345062 / 76188001 / +0.2% 0.91 / 0.90 / +0.1%
tpcds_q12/duckdb:parquet 14079582 / 13995176 / +0.6% 19099369 / 19053083 / +0.2% 0.74 / 0.73 / +0.4%
tpcds_q13/duckdb:parquet 31161428 / 33308439 / -6.4% 39261995 / 39541391 / -0.7% 0.79 / 0.84 / -5.8%
tpcds_q14/duckdb:parquet 63667724 / 64769091 / -1.7% 68386533 / 68114003 / +0.4% 0.93 / 0.95 / -2.1%
tpcds_q15/duckdb:parquet 16478386 / 16637540 / -1.0% 22338327 / 22243900 / +0.4% 0.74 / 0.75 / -1.4%
tpcds_q16/duckdb:parquet 30083887 / 30104670 / -0.1% 37344047 / 37135181 / +0.6% 0.81 / 0.81 / -0.6%
tpcds_q17/duckdb:parquet 34509030 / 34477460 / +0.1% 39957940 / 40356696 / -1.0% 0.86 / 0.85 / +1.1%
tpcds_q18/duckdb:parquet 46871589 / 47148372 / -0.6% 54709987 / 54249081 / +0.8% 0.86 / 0.87 / -1.4%
tpcds_q19/duckdb:parquet 18597998 / 19018304 / -2.2% 25723805 / 25382414 / +1.3% 0.72 / 0.75 / -3.5%
tpcds_q20/duckdb:parquet 14867962 / 14902117 / -0.2% 19674827 / 19412123 / +1.4% 0.76 / 0.77 / -1.6%
tpcds_q21/duckdb:parquet 10391904 / 10731116 / -3.2% 16983519 / 17030686 / -0.3% 0.61 / 0.63 / -2.9%
tpcds_q22/duckdb:parquet 20594430 / 20507718 / +0.4% 26499187 / 26762155 / -1.0% 0.78 / 0.77 / +1.4%
tpcds_q23/duckdb:parquet 43890747 / 42833082 / +2.5% 46277070 / 49424056 / -6.4% 0.95 / 0.87 / +9.4%
tpcds_q24/duckdb:parquet 30310716 / 29943294 / +1.2% 36246333 / 36464447 / -0.6% 0.84 / 0.82 / +1.8%
tpcds_q25/duckdb:parquet 30198666 / 30514354 / -1.0% 36588233 / 37025273 / -1.2% 0.83 / 0.82 / +0.1%
tpcds_q26/duckdb:parquet 28556822 / 29252328 / -2.4% 35438021 / 35038512 / +1.1% 0.81 / 0.83 / -3.5%
tpcds_q27/duckdb:parquet 34445148 / 34872377 / -1.2% 41824898 / 41229992 / +1.4% 0.82 / 0.85 / -2.6%
tpcds_q28/duckdb:parquet 25970172 / 25185258 / +3.1% 35514280 / 31104212 / +14.2% 🔴 0.73 / 0.81 / -9.7%
tpcds_q29/duckdb:parquet 32334661 / 32150195 / +0.6% 39640865 / 38969206 / +1.7% 0.82 / 0.83 / -1.1%
tpcds_q30/duckdb:parquet 35260544 / 35528874 / -0.8% 44518141 / 44172843 / +0.8% 0.79 / 0.80 / -1.5%
tpcds_q31/duckdb:parquet 35534534 / 35529000 / +0.0% 43429343 / 42639874 / +1.9% 0.82 / 0.83 / -1.8%
tpcds_q32/duckdb:parquet 14011801 / 14179243 / -1.2% 20569143 / 21025962 / -2.2% 0.68 / 0.67 / +1.0%
tpcds_q33/duckdb:parquet 23247170 / 23095442 / +0.7% 28737813 / 28549004 / +0.7% 0.81 / 0.81 / -0.0%
tpcds_q34/duckdb:parquet 16924882 / 16952271 / -0.2% 23936198 / 24176719 / -1.0% 0.71 / 0.70 / +0.8%
tpcds_q35/duckdb:parquet 35063792 / 34975734 / +0.3% 43791420 / 43207543 / +1.4% 0.80 / 0.81 / -1.1%
tpcds_q36/duckdb:parquet 40292190 / 39485050 / +2.0% 47248480 / 47479406 / -0.5% 0.85 / 0.83 / +2.5%
tpcds_q37/duckdb:parquet 12575081 / 12797622 / -1.7% 19009671 / 19277008 / -1.4% 0.66 / 0.66 / -0.4%
tpcds_q38/duckdb:parquet 29609653 / 29621006 / -0.0% 33785297 / 33433489 / +1.1% 0.88 / 0.89 / -1.1%
tpcds_q39/duckdb:parquet 23129798 / 23128167 / +0.0% 29509280 / 29595365 / -0.3% 0.78 / 0.78 / +0.3%
tpcds_q40/duckdb:parquet 15817352 / 16054940 / -1.5% 21282527 / 21235777 / +0.2% 0.74 / 0.76 / -1.7%
tpcds_q41/duckdb:parquet 11991106 / 11966633 / +0.2% 18198717 / 18065700 / +0.7% 0.66 / 0.66 / -0.5%
tpcds_q42/duckdb:parquet 9466580 / 9626178 / -1.7% 15532494 / 15525610 / +0.0% 0.61 / 0.62 / -1.7%
tpcds_q43/duckdb:parquet 12020215 / 12048868 / -0.2% 17718975 / 18128038 / -2.3% 0.68 / 0.66 / +2.1%
tpcds_q44/duckdb:parquet 20334521 / 21607511 / -5.9% 26989945 / 26196804 / +3.0% 0.75 / 0.82 / -8.7%
tpcds_q45/duckdb:parquet 20704044 / 20908743 / -1.0% 27932441 / 27486675 / +1.6% 0.74 / 0.76 / -2.6%
tpcds_q46/duckdb:parquet 37168988 / 35288508 / +5.3% 43989845 / 43320711 / +1.5% 0.84 / 0.81 / +3.7%
tpcds_q47/duckdb:parquet 35429058 / 34531498 / +2.6% 41534688 / 41336316 / +0.5% 0.85 / 0.84 / +2.1%
tpcds_q48/duckdb:parquet 31185624 / 29103170 / +7.2% 37182950 / 36426435 / +2.1% 0.84 / 0.80 / +5.0%
tpcds_q49/duckdb:parquet 28788787 / 30233053 / -4.8% 36345375 / 36303817 / +0.1% 0.79 / 0.83 / -4.9%
tpcds_q50/duckdb:parquet 19460800 / 20388898 / -4.6% 25323429 / 25331399 / -0.0% 0.77 / 0.80 / -4.5%
tpcds_q51/duckdb:parquet 51520606 / 52104356 / -1.1% 59536694 / 61245199 / -2.8% 0.87 / 0.85 / +1.7%
tpcds_q52/duckdb:parquet 9573409 / 9659180 / -0.9% 15258217 / 15499988 / -1.6% 0.63 / 0.62 / +0.7%
tpcds_q53/duckdb:parquet 13908517 / 14537118 / -4.3% 20836211 / 20752143 / +0.4% 0.67 / 0.70 / -4.7%
tpcds_q54/duckdb:parquet 25165514 / 24733616 / +1.7% 32080299 / 31908376 / +0.5% 0.78 / 0.78 / +1.2%
tpcds_q55/duckdb:parquet 9355279 / 9489484 / -1.4% 15290798 / 15341981 / -0.3% 0.61 / 0.62 / -1.1%
tpcds_q56/duckdb:parquet 26560598 / 27141406 / -2.1% 31047238 / 30419221 / +2.1% 0.86 / 0.89 / -4.1%
tpcds_q57/duckdb:parquet 30346566 / 30693180 / -1.1% 35921830 / 36167354 / -0.7% 0.84 / 0.85 / -0.5%
tpcds_q58/duckdb:parquet 23543974 / 23919381 / -1.6% 29023283 / 29814453 / -2.7% 0.81 / 0.80 / +1.1%
tpcds_q59/duckdb:parquet 22562267 / 22867650 / -1.3% 28607791 / 28707391 / -0.3% 0.79 / 0.80 / -1.0%
tpcds_q60/duckdb:parquet 28736918 / 26316208 / +9.2% 32045872 / 31957179 / +0.3% 0.90 / 0.82 / +8.9%
tpcds_q61/duckdb:parquet 25086626 / 24749493 / +1.4% 29079659 / 29026258 / +0.2% 0.86 / 0.85 / +1.2%
tpcds_q62/duckdb:parquet 12709721 / 12721642 / -0.1% 17944627 / 17771445 / +1.0% 0.71 / 0.72 / -1.1%
tpcds_q63/duckdb:parquet 13162584 / 14341675 / -8.2% 20057170 / 20011856 / +0.2% 0.66 / 0.72 / -8.4%
tpcds_q64/duckdb:parquet 69721003 / 70307914 / -0.8% 79909999 / 79575965 / +0.4% 0.87 / 0.88 / -1.2%
tpcds_q65/duckdb:parquet 21036438 / 20569484 / +2.3% 25545488 / 25477560 / +0.3% 0.82 / 0.81 / +2.0%
tpcds_q66/duckdb:parquet 33232188 / 33045765 / +0.6% 38012045 / 38019443 / -0.0% 0.87 / 0.87 / +0.6%
tpcds_q67/duckdb:parquet 60344902 / 61027914 / -1.1% 67779404 / 66818321 / +1.4% 0.89 / 0.91 / -2.5%
tpcds_q68/duckdb:parquet 30491310 / 30834914 / -1.1% 36668941 / 35993030 / +1.9% 0.83 / 0.86 / -2.9%
tpcds_q69/duckdb:parquet 25699754 / 25794512 / -0.4% 34316109 / 33964184 / +1.0% 0.75 / 0.76 / -1.4%
tpcds_q70/duckdb:parquet 19014156 / 19255869 / -1.3% 26806314 / 26582665 / +0.8% 0.71 / 0.72 / -2.1%
tpcds_q71/duckdb:parquet 16778971 / 16803522 / -0.1% 24067673 / 23382022 / +2.9% 0.70 / 0.72 / -3.0%
tpcds_q72/duckdb:parquet 52933741 / 53014220 / -0.2% 59691512 / 59449489 / +0.4% 0.89 / 0.89 / -0.6%
tpcds_q73/duckdb:parquet 14732714 / 15895421 / -7.3% 21465594 / 21585777 / -0.6% 0.69 / 0.74 / -6.8%
tpcds_q74/duckdb:parquet 84106850 / 85004257 / -1.1% 90230672 / 89575448 / +0.7% 0.93 / 0.95 / -1.8%
tpcds_q75/duckdb:parquet 45443070 / 44183878 / +2.8% 49940845 / 49282250 / +1.3% 0.91 / 0.90 / +1.5%
tpcds_q76/duckdb:parquet 18085489 / 18510097 / -2.3% 22946223 / 22802776 / +0.6% 0.79 / 0.81 / -2.9%
tpcds_q77/duckdb:parquet 25597752 / 25530442 / +0.3% 31411113 / 31441226 / -0.1% 0.81 / 0.81 / +0.4%
tpcds_q78/duckdb:parquet 77967249 / 78229121 / -0.3% 84206802 / 85641462 / -1.7% 0.93 / 0.91 / +1.4%
tpcds_q79/duckdb:parquet 22750056 / 24067906 / -5.5% 28501723 / 28358044 / +0.5% 0.80 / 0.85 / -6.0%
tpcds_q80/duckdb:parquet 37680708 / 38479893 / -2.1% 43938845 / 43843592 / +0.2% 0.86 / 0.88 / -2.3%
tpcds_q81/duckdb:parquet 36053067 / 36125748 / -0.2% 45061967 / 44907713 / +0.3% 0.80 / 0.80 / -0.5%
tpcds_q82/duckdb:parquet 13305680 / 13496682 / -1.4% 20510401 / 20103202 / +2.0% 0.65 / 0.67 / -3.4%
tpcds_q83/duckdb:parquet 20049410 / 19941274 / +0.5% 24961410 / 24813592 / +0.6% 0.80 / 0.80 / -0.1%
tpcds_q84/duckdb:parquet 22637480 / 23090262 / -2.0% 28736045 / 28462809 / +1.0% 0.79 / 0.81 / -2.9%
tpcds_q85/duckdb:parquet 32393255 / 32217004 / +0.5% 40105520 / 38985194 / +2.9% 0.81 / 0.83 / -2.3%
tpcds_q86/duckdb:parquet 11709726 / 11811458 / -0.9% 17033813 / 16496302 / +3.3% 0.69 / 0.72 / -4.0%
tpcds_q87/duckdb:parquet 31261548 / 31436775 / -0.6% 35187915 / 35185024 / +0.0% 0.89 / 0.89 / -0.6%
tpcds_q88/duckdb:parquet 38224182 / 38059442 / +0.4% 42840813 / 41928306 / +2.2% 0.89 / 0.91 / -1.7%
tpcds_q89/duckdb:parquet 13959912 / 14206404 / -1.7% 21261169 / 21172421 / +0.4% 0.66 / 0.67 / -2.1%
tpcds_q90/duckdb:parquet 10046791 / 10080660 / -0.3% 15148195 / 15448563 / -1.9% 0.66 / 0.65 / +1.6%
tpcds_q91/duckdb:parquet 20778402 / 21048574 / -1.3% 28326001 / 28220317 / +0.4% 0.73 / 0.75 / -1.7%
tpcds_q92/duckdb:parquet 15475376 / 15572126 / -0.6% 22037393 / 22096515 / -0.3% 0.70 / 0.70 / -0.4%
tpcds_q93/duckdb:parquet 14103538 / 14091483 / +0.1% 20584600 / 20175447 / +2.0% 0.69 / 0.70 / -1.9%
tpcds_q94/duckdb:parquet 25400568 / 25392360 / +0.0% 32443401 / 32388339 / +0.2% 0.78 / 0.78 / -0.1%
tpcds_q95/duckdb:parquet 43629440 / 43748374 / -0.3% 49780500 / 49895274 / -0.2% 0.88 / 0.88 / -0.0%
tpcds_q96/duckdb:parquet 8143582 / 8272491 / -1.6% 14202111 / 13988491 / +1.5% 0.57 / 0.59 / -3.0%
tpcds_q97/duckdb:parquet 27405440 / 27667050 / -0.9% 34086154 / 32852985 / +3.8% 0.80 / 0.84 / -4.5%
tpcds_q98/duckdb:parquet 16415402 / 16378365 / +0.2% 23133012 / 22777602 / +1.6% 0.71 / 0.72 / -1.3%
tpcds_q99/duckdb:parquet 18634403 / 18807829 / -0.9% 24568077 / 24915617 / -1.4% 0.76 / 0.75 / +0.5%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR da10665e vs base 1cdc8cf9
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.3%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.992x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1218173 / 1277762 / -4.7% 23669913 / 22701905 / +4.3% 0.05 / 0.06 / -8.6%
clickbench_q01/datafusion:vortex-file-compressed 5739732 / 5701054 / +0.7% 31682603 / 34133473 / -7.2% 0.18 / 0.17 / +8.5%
clickbench_q02/datafusion:vortex-file-compressed 10312290 / 11059978 / -6.8% 39829471 / 45727346 / -12.9% 🟢 0.26 / 0.24 / +7.0%
clickbench_q03/datafusion:vortex-file-compressed 13192034 / 12962152 / +1.8% 54895769 / 59966511 / -8.5% 0.24 / 0.22 / +11.2%
clickbench_q04/datafusion:vortex-file-compressed 58437683 / 58491492 / -0.1% 103673599 / 107265399 / -3.3% 0.56 / 0.55 / +3.4%
clickbench_q05/datafusion:vortex-file-compressed 74633222 / 75324188 / -0.9% 128288754 / 127176489 / +0.9% 0.58 / 0.59 / -1.8%
clickbench_q06/datafusion:vortex-file-compressed 1265360 / 1281209 / -1.2% 22444225 / 22762946 / -1.4% 0.06 / 0.06 / +0.2%
clickbench_q07/datafusion:vortex-file-compressed 8919588 / 9121962 / -2.2% 37772126 / 36679638 / +3.0% 0.24 / 0.25 / -5.0%
clickbench_q08/datafusion:vortex-file-compressed 79291577 / 79202689 / +0.1% 126299038 / 130034036 / -2.9% 0.63 / 0.61 / +3.1%
clickbench_q09/datafusion:vortex-file-compressed 167761311 / 169891930 / -1.3% 214462899 / 215849640 / -0.6% 0.78 / 0.79 / -0.6%
clickbench_q10/datafusion:vortex-file-compressed 22309272 / 23576041 / -5.4% 70315791 / 71620517 / -1.8% 0.32 / 0.33 / -3.6%
clickbench_q11/datafusion:vortex-file-compressed 24858376 / 25595211 / -2.9% 74174285 / 73456297 / +1.0% 0.34 / 0.35 / -3.8%
clickbench_q12/datafusion:vortex-file-compressed 71226860 / 72340317 / -1.5% 130278622 / 126525748 / +3.0% 0.55 / 0.57 / -4.4%
clickbench_q13/datafusion:vortex-file-compressed 115018214 / 114454353 / +0.5% 183367706 / 187159194 / -2.0% 0.63 / 0.61 / +2.6%
clickbench_q14/datafusion:vortex-file-compressed 75431158 / 75015054 / +0.6% 127507462 / 128127094 / -0.5% 0.59 / 0.59 / +1.0%
clickbench_q15/datafusion:vortex-file-compressed 62778608 / 63035252 / -0.4% 99320338 / 102527113 / -3.1% 0.63 / 0.61 / +2.8%
clickbench_q16/datafusion:vortex-file-compressed 152230655 / 154339830 / -1.4% 207536557 / 220216995 / -5.8% 0.73 / 0.70 / +4.7%
clickbench_q17/datafusion:vortex-file-compressed 154867267 / 153975190 / +0.6% 219819752 / 221571282 / -0.8% 0.70 / 0.69 / +1.4%
clickbench_q18/datafusion:vortex-file-compressed 292744608 / 297646745 / -1.6% 388296701 / 388335753 / -0.0% 0.75 / 0.77 / -1.6%
clickbench_q19/datafusion:vortex-file-compressed 7239468 / 7750414 / -6.6% 51369968 / 48721099 / +5.4% 0.14 / 0.16 / -11.4%
clickbench_q20/datafusion:vortex-file-compressed 66187609 / 68136855 / -2.9% 253347355 / 256425057 / -1.2% 0.26 / 0.27 / -1.7%
clickbench_q21/datafusion:vortex-file-compressed 78171514 / 80037805 / -2.3% 287935643 / 300737630 / -4.3% 0.27 / 0.27 / +2.0%
clickbench_q22/datafusion:vortex-file-compressed 95286047 / 95054287 / +0.2% 389469456 / 395336147 / -1.5% 0.24 / 0.24 / +1.8%
clickbench_q23/datafusion:vortex-file-compressed 84436932 / 80171206 / +5.3% 413655837 / 416246090 / -0.6% 0.20 / 0.19 / +6.0%
clickbench_q24/datafusion:vortex-file-compressed 8861014 / 8409700 / +5.4% 64620510 / 57093319 / +13.2% 🔴 0.14 / 0.15 / -6.9%
clickbench_q25/datafusion:vortex-file-compressed 18893792 / 18152158 / +4.1% 67265271 / 63410099 / +6.1% 0.28 / 0.29 / -1.9%
clickbench_q26/datafusion:vortex-file-compressed 14731456 / 15624998 / -5.7% 69370749 / 69615012 / -0.4% 0.21 / 0.22 / -5.4%
clickbench_q27/datafusion:vortex-file-compressed 97886354 / 100553100 / -2.7% 254213548 / 266070098 / -4.5% 0.39 / 0.38 / +1.9%
clickbench_q28/datafusion:vortex-file-compressed 551216758 / 561882003 / -1.9% 641784640 / 634483917 / +1.2% 0.86 / 0.89 / -3.0%
clickbench_q29/datafusion:vortex-file-compressed 24229852 / 24813306 / -2.4% 56922375 / 53938850 / +5.5% 0.43 / 0.46 / -7.5%
clickbench_q30/datafusion:vortex-file-compressed 54470848 / 54469824 / +0.0% 109590523 / 110322321 / -0.7% 0.50 / 0.49 / +0.7%
clickbench_q31/datafusion:vortex-file-compressed 64270184 / 63713036 / +0.9% 157442236 / 165094546 / -4.6% 0.41 / 0.39 / +5.8%
clickbench_q32/datafusion:vortex-file-compressed 287017023 / 287471359 / -0.2% 396738189 / 395194655 / +0.4% 0.72 / 0.73 / -0.5%
clickbench_q33/datafusion:vortex-file-compressed 319034078 / 318812426 / +0.1% 433203706 / 434359824 / -0.3% 0.74 / 0.73 / +0.3%
clickbench_q34/datafusion:vortex-file-compressed 317116376 / 319825400 / -0.8% 429819258 / 438643717 / -2.0% 0.74 / 0.73 / +1.2%
clickbench_q35/datafusion:vortex-file-compressed 56714542 / 56594294 / +0.2% 89068124 / 89838837 / -0.9% 0.64 / 0.63 / +1.1%
clickbench_q36/datafusion:vortex-file-compressed 37373258 / 37371240 / +0.0% 69744170 / 69504069 / +0.3% 0.54 / 0.54 / -0.3%
clickbench_q37/datafusion:vortex-file-compressed 20965411 / 20731798 / +1.1% 48474194 / 48713358 / -0.5% 0.43 / 0.43 / +1.6%
clickbench_q38/datafusion:vortex-file-compressed 12749432 / 12866674 / -0.9% 43844846 / 41261053 / +6.3% 0.29 / 0.31 / -6.8%
clickbench_q39/datafusion:vortex-file-compressed 77718312 / 78717482 / -1.3% 114216385 / 110822448 / +3.1% 0.68 / 0.71 / -4.2%
clickbench_q40/datafusion:vortex-file-compressed 10211030 / 10368860 / -1.5% 37811214 / 36576948 / +3.4% 0.27 / 0.28 / -4.7%
clickbench_q41/datafusion:vortex-file-compressed 9512578 / 9655634 / -1.5% 36857939 / 35212183 / +4.7% 0.26 / 0.27 / -5.9%
clickbench_q42/datafusion:vortex-file-compressed 9872685 / 9562990 / +3.2% 38118939 / 37134881 / +2.6% 0.26 / 0.26 / +0.6%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1254910 / 1245508 / +0.8% 49708363 / 49111389 / +1.2% 0.03 / 0.03 / -0.5%
clickbench_q01/datafusion:parquet 16286720 / 16128558 / +1.0% 67808495 / 65974016 / +2.8% 0.24 / 0.24 / -1.8%
clickbench_q02/datafusion:parquet 18503574 / 18679866 / -0.9% 81242645 / 81045048 / +0.2% 0.23 / 0.23 / -1.2%
clickbench_q03/datafusion:parquet 17050452 / 17636144 / -3.3% 80542525 / 78906984 / +2.1% 0.21 / 0.22 / -5.3%
clickbench_q04/datafusion:parquet 63552960 / 63147200 / +0.6% 125134511 / 123651426 / +1.2% 0.51 / 0.51 / -0.6%
clickbench_q05/datafusion:parquet 89694432 / 89173734 / +0.6% 157746392 / 155684349 / +1.3% 0.57 / 0.57 / -0.7%
clickbench_q06/datafusion:parquet 1252858 / 1267736 / -1.2% 50497661 / 49808656 / +1.4% 0.02 / 0.03 / -2.5%
clickbench_q07/datafusion:parquet 16701890 / 16815682 / -0.7% 68120344 / 68530680 / -0.6% 0.25 / 0.25 / -0.1%
clickbench_q08/datafusion:parquet 86481370 / 84420552 / +2.4% 161784669 / 159615748 / +1.4% 0.53 / 0.53 / +1.1%
clickbench_q09/datafusion:parquet 188574268 / 189340200 / -0.4% 268869936 / 270568486 / -0.6% 0.70 / 0.70 / +0.2%
clickbench_q10/datafusion:parquet 35587042 / 35838825 / -0.7% 101129702 / 101351871 / -0.2% 0.35 / 0.35 / -0.5%
clickbench_q11/datafusion:parquet 42629741 / 43388606 / -1.7% 112181455 / 110234963 / +1.8% 0.38 / 0.39 / -3.5%
clickbench_q12/datafusion:parquet 95364626 / 96400254 / -1.1% 161618265 / 164380304 / -1.7% 0.59 / 0.59 / +0.6%
clickbench_q13/datafusion:parquet 145842997 / 149050407 / -2.2% 225926546 / 229020286 / -1.4% 0.65 / 0.65 / -0.8%
clickbench_q14/datafusion:parquet 101440180 / 101751008 / -0.3% 174340667 / 173752765 / +0.3% 0.58 / 0.59 / -0.6%
clickbench_q15/datafusion:parquet 71828518 / 74751018 / -3.9% 131155475 / 132562825 / -1.1% 0.55 / 0.56 / -2.9%
clickbench_q16/datafusion:parquet 155050499 / 157130106 / -1.3% 233908724 / 235404102 / -0.6% 0.66 / 0.67 / -0.7%
clickbench_q17/datafusion:parquet 155653275 / 158408130 / -1.7% 234669885 / 232535206 / +0.9% 0.66 / 0.68 / -2.6%
clickbench_q18/datafusion:parquet 306981026 / 311659828 / -1.5% 419259165 / 428769037 / -2.2% 0.73 / 0.73 / +0.7%
clickbench_q19/datafusion:parquet 18850630 / 18808941 / +0.2% 78940976 / 76943382 / +2.6% 0.24 / 0.24 / -2.3%
clickbench_q20/datafusion:parquet 177450292 / 178190524 / -0.4% 281132273 / 283067790 / -0.7% 0.63 / 0.63 / +0.3%
clickbench_q21/datafusion:parquet 173320082 / 174542982 / -0.7% 300746234 / 303338278 / -0.9% 0.58 / 0.58 / +0.2%
clickbench_q22/datafusion:parquet 260327528 / 260781561 / -0.2% 429085068 / 433914101 / -1.1% 0.61 / 0.60 / +0.9%
clickbench_q23/datafusion:parquet 1004464268 / 1007396844 / -0.3% 1188902185 / 1196675958 / -0.6% 0.84 / 0.84 / +0.4%
clickbench_q24/datafusion:parquet 29898818 / 30726530 / -2.7% 90296045 / 88445505 / +2.1% 0.33 / 0.35 / -4.7%
clickbench_q25/datafusion:parquet 36223102 / 37097776 / -2.4% 101441801 / 103458997 / -1.9% 0.36 / 0.36 / -0.4%
clickbench_q26/datafusion:parquet 30524020 / 30667637 / -0.5% 88651623 / 89958756 / -1.5% 0.34 / 0.34 / +1.0%
clickbench_q27/datafusion:parquet 192365670 / 193541858 / -0.6% 286982288 / 294014301 / -2.4% 0.67 / 0.66 / +1.8%
clickbench_q28/datafusion:parquet 621073550 / 622381386 / -0.2% 706975722 / 709605194 / -0.4% 0.88 / 0.88 / +0.2%
clickbench_q29/datafusion:parquet 28959335 / 28382270 / +2.0% 90532395 / 89726118 / +0.9% 0.32 / 0.32 / +1.1%
clickbench_q30/datafusion:parquet 91577004 / 90292652 / +1.4% 173354630 / 173921114 / -0.3% 0.53 / 0.52 / +1.8%
clickbench_q31/datafusion:parquet 102830684 / 103509501 / -0.7% 199346582 / 200971596 / -0.8% 0.52 / 0.52 / +0.2%
clickbench_q32/datafusion:parquet 305577690 / 311115870 / -1.8% 425868910 / 428727602 / -0.7% 0.72 / 0.73 / -1.1%
clickbench_q33/datafusion:parquet 377846283 / 380048496 / -0.6% 479002767 / 479600127 / -0.1% 0.79 / 0.79 / -0.5%
clickbench_q34/datafusion:parquet 377410946 / 378557524 / -0.3% 475117497 / 477936899 / -0.6% 0.79 / 0.79 / +0.3%
clickbench_q35/datafusion:parquet 65552314 / 64249088 / +2.0% 124427748 / 123443405 / +0.8% 0.53 / 0.52 / +1.2%
clickbench_q36/datafusion:parquet 73389257 / 73977852 / -0.8% 139300872 / 136178878 / +2.3% 0.53 / 0.54 / -3.0%
clickbench_q37/datafusion:parquet 35603216 / 35633496 / -0.1% 91889549 / 91419997 / +0.5% 0.39 / 0.39 / -0.6%
clickbench_q38/datafusion:parquet 47705801 / 47903072 / -0.4% 108704881 / 108411604 / +0.3% 0.44 / 0.44 / -0.7%
clickbench_q39/datafusion:parquet 143297682 / 144526362 / -0.9% 215032946 / 212015185 / +1.4% 0.67 / 0.68 / -2.2%
clickbench_q40/datafusion:parquet 19878856 / 20349552 / -2.3% 77345542 / 77770096 / -0.5% 0.26 / 0.26 / -1.8%
clickbench_q41/datafusion:parquet 18716170 / 18824178 / -0.6% 76746392 / 74972994 / +2.4% 0.24 / 0.25 / -2.9%
clickbench_q42/datafusion:parquet 19041864 / 19068224 / -0.1% 75912687 / 75207188 / +0.9% 0.25 / 0.25 / -1.1%
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2292242 / 2239520 / +2.4% 24510507 / 25410828 / -3.5% 0.09 / 0.09 / +6.1%
clickbench_q01/duckdb:vortex-file-compressed 7684140 / 7612362 / +0.9% 27154726 / 27570446 / -1.5% 0.28 / 0.28 / +2.5%
clickbench_q02/duckdb:vortex-file-compressed 9512944 / 8955066 / +6.2% 33769583 / 35286118 / -4.3% 0.28 / 0.25 / +11.0%
clickbench_q03/duckdb:vortex-file-compressed 14469071 / 14248936 / +1.5% 50585228 / 52216942 / -3.1% 0.29 / 0.27 / +4.8%
clickbench_q04/duckdb:vortex-file-compressed 56563774 / 58104275 / -2.7% 91842408 / 92470080 / -0.7% 0.62 / 0.63 / -2.0%
clickbench_q05/duckdb:vortex-file-compressed 63229134 / 64657906 / -2.2% 95882535 / 95177701 / +0.7% 0.66 / 0.68 / -2.9%
clickbench_q06/duckdb:vortex-file-compressed 2666492 / 2703474 / -1.4% 32451024 / 31007170 / +4.7% 0.08 / 0.09 / -5.8%
clickbench_q07/duckdb:vortex-file-compressed 9329598 / 9579114 / -2.6% 29869945 / 31815161 / -6.1% 0.31 / 0.30 / +3.7%
clickbench_q08/duckdb:vortex-file-compressed 70148622 / 69709164 / +0.6% 106834065 / 106513332 / +0.3% 0.66 / 0.65 / +0.3%
clickbench_q09/duckdb:vortex-file-compressed 92741394 / 91790526 / +1.0% 127914078 / 128038059 / -0.1% 0.73 / 0.72 / +1.1%
clickbench_q10/duckdb:vortex-file-compressed 27240438 / 27449552 / -0.8% 70487845 / 70633742 / -0.2% 0.39 / 0.39 / -0.6%
clickbench_q11/duckdb:vortex-file-compressed 30015282 / 29742802 / +0.9% 73397237 / 74580099 / -1.6% 0.41 / 0.40 / +2.5%
clickbench_q12/duckdb:vortex-file-compressed 68269577 / 68314645 / -0.1% 93091616 / 101588585 / -8.4% 0.73 / 0.67 / +9.1%
clickbench_q13/duckdb:vortex-file-compressed 118398744 / 117681350 / +0.6% 168526638 / 167304335 / +0.7% 0.70 / 0.70 / -0.1%
clickbench_q14/duckdb:vortex-file-compressed 73617598 / 71707574 / +2.7% 102523815 / 104097981 / -1.5% 0.72 / 0.69 / +4.2%
clickbench_q15/duckdb:vortex-file-compressed 75482038 / 76256368 / -1.0% 111359799 / 109430960 / +1.8% 0.68 / 0.70 / -2.7%
clickbench_q16/duckdb:vortex-file-compressed 133173897 / 136865666 / -2.7% 171635401 / 173157180 / -0.9% 0.78 / 0.79 / -1.8%
clickbench_q17/duckdb:vortex-file-compressed 139211874 / 136309250 / +2.1% 175084292 / 167679771 / +4.4% 0.80 / 0.81 / -2.2%
clickbench_q18/duckdb:vortex-file-compressed 254024708 / 253680418 / +0.1% 308588568 / 304490936 / +1.3% 0.82 / 0.83 / -1.2%
clickbench_q19/duckdb:vortex-file-compressed 8842516 / 9195282 / -3.8% 40693427 / 41073291 / -0.9% 0.22 / 0.22 / -2.9%
clickbench_q20/duckdb:vortex-file-compressed 68710692 / 68396690 / +0.5% 170368235 / 175446093 / -2.9% 0.40 / 0.39 / +3.5%
clickbench_q21/duckdb:vortex-file-compressed 77184098 / 78139710 / -1.2% 185562389 / 193510866 / -4.1% 0.42 / 0.40 / +3.0%
clickbench_q22/duckdb:vortex-file-compressed 129596371 / 130674448 / -0.8% 334115744 / 331574805 / +0.8% 0.39 / 0.39 / -1.6%
clickbench_q23/duckdb:vortex-file-compressed 59024696 / 59653655 / -1.1% 183621849 / 184899542 / -0.7% 0.32 / 0.32 / -0.4%
clickbench_q24/duckdb:vortex-file-compressed 16531314 / 17394194 / -5.0% 38820025 / 48703041 / -20.3% 🟢 0.43 / 0.36 / +19.2%
clickbench_q25/duckdb:vortex-file-compressed 18646657 / 18446944 / +1.1% 53092643 / 54178597 / -2.0% 0.35 / 0.34 / +3.2%
clickbench_q26/duckdb:vortex-file-compressed 13649420 / 14287748 / -4.5% 40834075 / 49047912 / -16.7% 🟢 0.33 / 0.29 / +14.7%
clickbench_q27/duckdb:vortex-file-compressed 53891627 / 53905176 / -0.0% 178850878 / 177354906 / +0.8% 0.30 / 0.30 / -0.9%
clickbench_q28/duckdb:vortex-file-compressed 508993632 / 514093187 / -1.0% 564523622 / 559504615 / +0.9% 0.90 / 0.92 / -1.9%
clickbench_q29/duckdb:vortex-file-compressed 17119775 / 17208508 / -0.5% 47156905 / 42958313 / +9.8% 0.36 / 0.40 / -9.4%
clickbench_q30/duckdb:vortex-file-compressed 59137563 / 59435691 / -0.5% 109082903 / 108956696 / +0.1% 0.54 / 0.55 / -0.6%
clickbench_q31/duckdb:vortex-file-compressed 109836700 / 109401092 / +0.4% 178990776 / 174239306 / +2.7% 0.61 / 0.63 / -2.3%
clickbench_q32/duckdb:vortex-file-compressed 356309210 / 385910546 / -7.7% 393116450 / 410231765 / -4.2% 0.91 / 0.94 / -3.7%
clickbench_q33/duckdb:vortex-file-compressed 346930148 / 342599656 / +1.3% 406849130 / 396100171 / +2.7% 0.85 / 0.86 / -1.4%
clickbench_q34/duckdb:vortex-file-compressed 359140863 / 353396204 / +1.6% 411894646 / 412222797 / -0.1% 0.87 / 0.86 / +1.7%
clickbench_q35/duckdb:vortex-file-compressed 57936262 / 57161666 / +1.4% 88413620 / 88929172 / -0.6% 0.66 / 0.64 / +1.9%
clickbench_q36/duckdb:vortex-file-compressed 11097568 / 11640787 / -4.7% 34203840 / 33117280 / +3.3% 0.32 / 0.35 / -7.7%
clickbench_q37/duckdb:vortex-file-compressed 7779842 / 7579217 / +2.6% 29619040 / 29023829 / +2.1% 0.26 / 0.26 / +0.6%
clickbench_q38/duckdb:vortex-file-compressed 8299956 / 8249762 / +0.6% 29115569 / 27872473 / +4.5% 0.29 / 0.30 / -3.7%
clickbench_q39/duckdb:vortex-file-compressed 18642450 / 18512246 / +0.7% 40872402 / 39648155 / +3.1% 0.46 / 0.47 / -2.3%
clickbench_q40/duckdb:vortex-file-compressed 6751102 / 6788686 / -0.6% 30225481 / 29122522 / +3.8% 0.22 / 0.23 / -4.2%
clickbench_q41/duckdb:vortex-file-compressed 7863178 / 7935220 / -0.9% 29446163 / 31671742 / -7.0% 0.27 / 0.25 / +6.6%
clickbench_q42/duckdb:vortex-file-compressed 7017555 / 7022668 / -0.1% 25820807 / 27458837 / -6.0% 0.27 / 0.26 / +6.3%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9072508 / 9394832 / -3.4% 14348109 / 14721122 / -2.5% 0.63 / 0.64 / -0.9%
clickbench_q01/duckdb:parquet 15257938 / 15255306 / +0.0% 20662737 / 20612271 / +0.2% 0.74 / 0.74 / -0.2%
clickbench_q02/duckdb:parquet 22333684 / 23202924 / -3.7% 33600905 / 34409503 / -2.3% 0.66 / 0.67 / -1.4%
clickbench_q03/duckdb:parquet 22586488 / 22805660 / -1.0% 34491168 / 37416814 / -7.8% 0.65 / 0.61 / +7.4%
clickbench_q04/duckdb:parquet 60891054 / 62729622 / -2.9% 72445522 / 74237821 / -2.4% 0.84 / 0.84 / -0.5%
clickbench_q05/duckdb:parquet 81874636 / 82553121 / -0.8% 98231195 / 95555827 / +2.8% 0.83 / 0.86 / -3.5%
clickbench_q06/duckdb:parquet 20584250 / 20223452 / +1.8% 30559971 / 27478087 / +11.2% 🔴 0.67 / 0.74 / -8.5%
clickbench_q07/duckdb:parquet 17302983 / 17993160 / -3.8% 22603070 / 22337709 / +1.2% 0.77 / 0.81 / -5.0%
clickbench_q08/duckdb:parquet 74975574 / 75074766 / -0.1% 86710638 / 93024452 / -6.8% 0.86 / 0.81 / +7.1%
clickbench_q09/duckdb:parquet 102106276 / 103794619 / -1.6% 116531318 / 121917219 / -4.4% 0.88 / 0.85 / +2.9%
clickbench_q10/duckdb:parquet 41741145 / 41383818 / +0.9% 53200789 / 53619651 / -0.8% 0.78 / 0.77 / +1.7%
clickbench_q11/duckdb:parquet 46986827 / 46643339 / +0.7% 59289919 / 61615297 / -3.8% 0.79 / 0.76 / +4.7%
clickbench_q12/duckdb:parquet 92540842 / 93595602 / -1.1% 107737496 / 108115697 / -0.3% 0.86 / 0.87 / -0.8%
clickbench_q13/duckdb:parquet 148476436 / 148244281 / +0.2% 167199335 / 168231324 / -0.6% 0.89 / 0.88 / +0.8%
clickbench_q14/duckdb:parquet 100469351 / 101682435 / -1.2% 116052837 / 114164311 / +1.7% 0.87 / 0.89 / -2.8%
clickbench_q15/duckdb:parquet 85166042 / 85946628 / -0.9% 97854197 / 100644448 / -2.8% 0.87 / 0.85 / +1.9%
clickbench_q16/duckdb:parquet 164647310 / 165498386 / -0.5% 177327999 / 179975882 / -1.5% 0.93 / 0.92 / +1.0%
clickbench_q17/duckdb:parquet 161023534 / 171531960 / -6.1% 178554629 / 178665714 / -0.1% 0.90 / 0.96 / -6.1%
clickbench_q18/duckdb:parquet 292095900 / 291016272 / +0.4% 319412229 / 315607081 / +1.2% 0.91 / 0.92 / -0.8%
clickbench_q19/duckdb:parquet 19689763 / 19859715 / -0.9% 26555771 / 25786255 / +3.0% 0.74 / 0.77 / -3.7%
clickbench_q20/duckdb:parquet 187043203 / 180420120 / +3.7% 220549743 / 232480084 / -5.1% 0.85 / 0.78 / +9.3%
clickbench_q21/duckdb:parquet 215893324 / 218477350 / -1.2% 271397692 / 262983512 / +3.2% 0.80 / 0.83 / -4.2%
clickbench_q22/duckdb:parquet 309702210 / 304926990 / +1.6% 358505326 / 357379579 / +0.3% 0.86 / 0.85 / +1.2%
clickbench_q23/duckdb:parquet 164726956 / 171775762 / -4.1% 249043811 / 253121056 / -1.6% 0.66 / 0.68 / -2.5%
clickbench_q24/duckdb:parquet 29470372 / 29958716 / -1.6% 47453629 / 42482462 / +11.7% 🔴 0.62 / 0.71 / -11.9%
clickbench_q25/duckdb:parquet 43362852 / 42463750 / +2.1% 58019323 / 60982131 / -4.9% 0.75 / 0.70 / +7.3%
clickbench_q26/duckdb:parquet 30005181 / 32739711 / -8.4% 50602438 / 47017556 / +7.6% 0.59 / 0.70 / -14.8%
clickbench_q27/duckdb:parquet 192809968 / 191541398 / +0.7% 228775394 / 230295986 / -0.7% 0.84 / 0.83 / +1.3%
clickbench_q28/duckdb:parquet 954291528 / 950006560 / +0.5% 941893907 / 983079731 / -4.2% 1.01 / 0.97 / +4.8%
clickbench_q29/duckdb:parquet 23452611 / 24317362 / -3.6% 30699732 / 30925214 / -0.7% 0.76 / 0.79 / -2.8%
clickbench_q30/duckdb:parquet 105451974 / 104622488 / +0.8% 128078962 / 129419189 / -1.0% 0.82 / 0.81 / +1.8%
clickbench_q31/duckdb:parquet 145741369 / 160480217 / -9.2% 198729218 / 174417616 / +13.9% 🔴 0.73 / 0.92 / -20.3%
clickbench_q32/duckdb:parquet 378764141 / 385925739 / -1.9% 397704512 / 407659843 / -2.4% 0.95 / 0.95 / +0.6%
clickbench_q33/duckdb:parquet 466222758 / 468922366 / -0.6% 464401708 / 442695781 / +4.9% 1.00 / 1.06 / -5.2%
clickbench_q34/duckdb:parquet 457224552 / 462238432 / -1.1% 461663209 / 447629696 / +3.1% 0.99 / 1.03 / -4.1%
clickbench_q35/duckdb:parquet 61573152 / 61543474 / +0.0% 75728869 / 77479685 / -2.3% 0.81 / 0.79 / +2.4%
clickbench_q36/duckdb:parquet 29809652 / 30172014 / -1.2% 38006027 / 36925558 / +2.9% 0.78 / 0.82 / -4.0%
clickbench_q37/duckdb:parquet 23378872 / 23204022 / +0.8% 29683461 / 30425350 / -2.4% 0.79 / 0.76 / +3.3%
clickbench_q38/duckdb:parquet 23824712 / 23431136 / +1.7% 29187394 / 30912378 / -5.6% 0.82 / 0.76 / +7.7%
clickbench_q39/duckdb:parquet 52151866 / 52956229 / -1.5% 61375835 / 60047399 / +2.2% 0.85 / 0.88 / -3.7%
clickbench_q40/duckdb:parquet 14632086 / 14924840 / -2.0% 20228275 / 20066747 / +0.8% 0.72 / 0.74 / -2.7%
clickbench_q41/duckdb:parquet 15702512 / 15331596 / +2.4% 20967179 / 23069987 / -9.1% 0.75 / 0.66 / +12.7%
clickbench_q42/duckdb:parquet 14592256 / 14130908 / +3.3% 20801481 / 20120985 / +3.4% 0.70 / 0.70 / -0.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR da10665e vs base ab5a0046
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (+15.7%, environment too noisy confidence) · DuckDB No clear signal (-0.0%, environment too noisy confidence)
Vortex (geomean): hot 1.112x ➖ · cold 1.094x ➖
Parquet (geomean): hot 1.034x ➖ · cold 1.103x ➖
Shifts: Parquet (control) +3.4% · Median polish +3.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.193x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 209450506 / 213717821 / -2.0% 866559978 / 764398977 / +13.4% 0.24 / 0.28 / -13.6%
tpch_q02/datafusion:vortex-file-compressed 349058311 / 320984758 / +8.7% 696261990 / 553448858 / +25.8% 0.50 / 0.58 / -13.6%
tpch_q03/datafusion:vortex-file-compressed 335518416 / 310450262 / +8.1% 968491303 / 854530904 / +13.3% 0.35 / 0.36 / -4.6%
tpch_q04/datafusion:vortex-file-compressed 204662311 / 159007585 / +28.7% 493337166 / 372572808 / +32.4% 🔴 0.41 / 0.43 / -2.8%
tpch_q05/datafusion:vortex-file-compressed 381159100 / 344078558 / +10.8% 557368040 / 546047746 / +2.1% 0.68 / 0.63 / +8.5%
tpch_q06/datafusion:vortex-file-compressed 145907350 / 123668516 / +18.0% 279141973 / 317073449 / -12.0% 0.52 / 0.39 / +34.0%
tpch_q07/datafusion:vortex-file-compressed 414990093 / 426177142 / -2.6% 890291318 / 586012416 / +51.9% 🔴 0.47 / 0.73 / -35.9%
tpch_q08/datafusion:vortex-file-compressed 456362469 / 410714646 / +11.1% 589976337 / 541459260 / +9.0% 0.77 / 0.76 / +2.0%
tpch_q09/datafusion:vortex-file-compressed 322778700 / 301899395 / +6.9% 557204940 / 455403137 / +22.4% 0.58 / 0.66 / -12.6%
tpch_q10/datafusion:vortex-file-compressed 510080315 / 361036359 / +41.3% 🔴 568451819 / 525406226 / +8.2% 0.90 / 0.69 / +30.6%
tpch_q11/datafusion:vortex-file-compressed 302852666 / 272228443 / +11.2% 572844554 / 382260665 / +49.9% 🔴 0.53 / 0.71 / -25.8%
tpch_q12/datafusion:vortex-file-compressed 265010174 / 203460731 / +30.3% 🔴 435455615 / 338106908 / +28.8% 0.61 / 0.60 / +1.1%
tpch_q13/datafusion:vortex-file-compressed 125964227 / 116217877 / +8.4% 334160888 / 309114444 / +8.1% 0.38 / 0.38 / +0.3%
tpch_q14/datafusion:vortex-file-compressed 184570470 / 181074526 / +1.9% 366294816 / 354128334 / +3.4% 0.50 / 0.51 / -1.5%
tpch_q15/datafusion:vortex-file-compressed 315444394 / 306125584 / +3.0% 600362703 / 727209626 / -17.4% 0.53 / 0.42 / +24.8%
tpch_q16/datafusion:vortex-file-compressed 148087502 / 134848492 / +9.8% 249447022 / 285978767 / -12.8% 0.59 / 0.47 / +25.9%
tpch_q17/datafusion:vortex-file-compressed 292203076 / 252865916 / +15.6% 651329398 / 494400127 / +31.7% 🔴 0.45 / 0.51 / -12.3%
tpch_q18/datafusion:vortex-file-compressed 630132163 / 222278514 / +183.5% 🔴 1230611937 / 389005809 / +216.3% 🔴 0.51 / 0.57 / -10.4%
tpch_q19/datafusion:vortex-file-compressed 217878312 / 226209017 / -3.7% 420833166 / 296515885 / +41.9% 🔴 0.52 / 0.76 / -32.1%
tpch_q20/datafusion:vortex-file-compressed 553473580 / 248686849 / +122.6% 🔴 486646972 / 477297666 / +2.0% 1.14 / 0.52 / +118.3%
tpch_q21/datafusion:vortex-file-compressed 424107290 / 384422617 / +10.3% 606968341 / 739838656 / -18.0% 0.70 / 0.52 / +34.5%
tpch_q22/datafusion:vortex-file-compressed 161074443 / 147475449 / +9.2% 446954755 / 337385924 / +32.5% 🔴 0.36 / 0.44 / -17.6%
datafusion / parquet / ns (1.031x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 145761174 / 143033960 / +1.9% 537005189 / 425422516 / +26.2% 0.27 / 0.34 / -19.3%
tpch_q02/datafusion:parquet 283310267 / 274389077 / +3.3% 528492036 / 421418541 / +25.4% 0.54 / 0.65 / -17.7%
tpch_q03/datafusion:parquet 236471783 / 240153039 / -1.5% 663664533 / 656104536 / +1.2% 0.36 / 0.37 / -2.7%
tpch_q04/datafusion:parquet 127904349 / 129091170 / -0.9% 367531727 / 262434371 / +40.0% 🔴 0.35 / 0.49 / -29.3%
tpch_q05/datafusion:parquet 365054304 / 325560808 / +12.1% 556443353 / 708712744 / -21.5% 0.66 / 0.46 / +42.8%
tpch_q06/datafusion:parquet 116556528 / 104623731 / +11.4% 261042631 / 202039421 / +29.2% 0.45 / 0.52 / -13.8%
tpch_q07/datafusion:parquet 325737059 / 326115720 / -0.1% 478058311 / 439408571 / +8.8% 0.68 / 0.74 / -8.2%
tpch_q08/datafusion:parquet 402287987 / 383031456 / +5.0% 549577548 / 487777150 / +12.7% 0.73 / 0.79 / -6.8%
tpch_q09/datafusion:parquet 385018603 / 507741508 / -24.2% 565353616 / 948722124 / -40.4% 🟢 0.68 / 0.54 / +27.3%
tpch_q10/datafusion:parquet 322480732 / 318225993 / +1.3% 456992802 / 431490793 / +5.9% 0.71 / 0.74 / -4.3%
tpch_q11/datafusion:parquet 255936011 / 245309101 / +4.3% 347514021 / 324804219 / +7.0% 0.74 / 0.76 / -2.5%
tpch_q12/datafusion:parquet 178234549 / 160703746 / +10.9% 419215125 / 262477140 / +59.7% 🔴 0.43 / 0.61 / -30.6%
tpch_q13/datafusion:parquet 271894124 / 274764633 / -1.0% 431839239 / 387802001 / +11.4% 0.63 / 0.71 / -11.1%
tpch_q14/datafusion:parquet 144852691 / 141590102 / +2.3% 333734099 / 264823133 / +26.0% 0.43 / 0.53 / -18.8%
tpch_q15/datafusion:parquet 340333155 / 297935495 / +14.2% 573870720 / 444599102 / +29.1% 0.59 / 0.67 / -11.5%
tpch_q16/datafusion:parquet 95546233 / 96864793 / -1.4% 246049869 / 207092637 / +18.8% 0.39 / 0.47 / -17.0%
tpch_q17/datafusion:parquet 318231109 / 268630342 / +18.5% 462545043 / 416939497 / +10.9% 0.69 / 0.64 / +6.8%
tpch_q18/datafusion:parquet 303136563 / 305302634 / -0.7% 464259482 / 465639400 / -0.3% 0.65 / 0.66 / -0.4%
tpch_q19/datafusion:parquet 164890232 / 149310744 / +10.4% 305528730 / 274137368 / +11.5% 0.54 / 0.54 / -0.9%
tpch_q20/datafusion:parquet 231130194 / 228071243 / +1.3% 389679095 / 424446687 / -8.2% 0.59 / 0.54 / +10.4%
tpch_q21/datafusion:parquet 300681700 / 291483866 / +3.2% 488308245 / 469762099 / +3.9% 0.62 / 0.62 / -0.8%
tpch_q22/datafusion:parquet 153533901 / 145366900 / +5.6% 342448832 / 299750221 / +14.2% 0.45 / 0.48 / -7.6%
duckdb / vortex-file-compressed / ns (1.036x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 250133988 / 237695207 / +5.2% 260517661 / 298096331 / -12.6% 0.96 / 0.80 / +20.4%
tpch_q02/duckdb:vortex-file-compressed 382878043 / 394665672 / -3.0% 494159053 / 474795024 / +4.1% 0.77 / 0.83 / -6.8%
tpch_q03/duckdb:vortex-file-compressed 412862370 / 398939371 / +3.5% 521443483 / 460688509 / +13.2% 0.79 / 0.87 / -8.6%
tpch_q04/duckdb:vortex-file-compressed 283901208 / 255227345 / +11.2% 288659099 / 296337544 / -2.6% 0.98 / 0.86 / +14.2%
tpch_q05/duckdb:vortex-file-compressed 543980473 / 709957932 / -23.4% 579296061 / 785337665 / -26.2% 0.94 / 0.90 / +3.9%
tpch_q06/duckdb:vortex-file-compressed 165878038 / 148777224 / +11.5% 221957894 / 208058114 / +6.7% 0.75 / 0.72 / +4.5%
tpch_q07/duckdb:vortex-file-compressed 574816141 / 387859027 / +48.2% 🔴 538632094 / 510621725 / +5.5% 1.07 / 0.76 / +40.5%
tpch_q08/duckdb:vortex-file-compressed 610308953 / 617848086 / -1.2% 647388808 / 732855328 / -11.7% 0.94 / 0.84 / +11.8%
tpch_q09/duckdb:vortex-file-compressed 450903826 / 392528875 / +14.9% 806595064 / 482201706 / +67.3% 🔴 0.56 / 0.81 / -31.3%
tpch_q10/duckdb:vortex-file-compressed 508855221 / 526138612 / -3.3% 550157825 / 576801469 / -4.6% 0.92 / 0.91 / +1.4%
tpch_q11/duckdb:vortex-file-compressed 269907102 / 288496302 / -6.4% 323745837 / 270775100 / +19.6% 0.83 / 1.07 / -21.8%
tpch_q12/duckdb:vortex-file-compressed 247142430 / 271105721 / -8.8% 295509748 / 407392913 / -27.5% 0.84 / 0.67 / +25.7%
tpch_q13/duckdb:vortex-file-compressed 231931196 / 247871881 / -6.4% 252449048 / 208806747 / +20.9% 0.92 / 1.19 / -22.6%
tpch_q14/duckdb:vortex-file-compressed 245822840 / 224785869 / +9.4% 331608919 / 273953898 / +21.0% 0.74 / 0.82 / -9.7%
tpch_q15/duckdb:vortex-file-compressed 257517369 / 237917836 / +8.2% 349636637 / 453417020 / -22.9% 0.74 / 0.52 / +40.4%
tpch_q16/duckdb:vortex-file-compressed 221862173 / 206543544 / +7.4% 232121474 / 287344280 / -19.2% 0.96 / 0.72 / +33.0%
tpch_q17/duckdb:vortex-file-compressed 295869297 / 454602893 / -34.9% 🟢 375271356 / 443734007 / -15.4% 0.79 / 1.02 / -23.0%
tpch_q18/duckdb:vortex-file-compressed 533553463 / 339736454 / +57.0% 🔴 488567263 / 418339259 / +16.8% 1.09 / 0.81 / +34.5%
tpch_q19/duckdb:vortex-file-compressed 308524714 / 320978677 / -3.9% 331472526 / 349847295 / -5.3% 0.93 / 0.92 / +1.4%
tpch_q20/duckdb:vortex-file-compressed 401181865 / 334782469 / +19.8% 418871017 / 412936083 / +1.4% 0.96 / 0.81 / +18.1%
tpch_q21/duckdb:vortex-file-compressed 625890854 / 558602915 / +12.0% 906368878 / 630439819 / +43.8% 🔴 0.69 / 0.89 / -22.1%
tpch_q22/duckdb:vortex-file-compressed 252584759 / 253794094 / -0.5% 257168765 / 269551763 / -4.6% 0.98 / 0.94 / +4.3%
duckdb / parquet / ns (1.036x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 180489596 / 178327142 / +1.2% 206121588 / 188180852 / +9.5% 0.88 / 0.95 / -7.6%
tpch_q02/duckdb:parquet 452795300 / 428571834 / +5.7% 527816432 / 421258354 / +25.3% 0.86 / 1.02 / -15.7%
tpch_q03/duckdb:parquet 398291445 / 384797319 / +3.5% 492897702 / 402689855 / +22.4% 0.81 / 0.96 / -15.4%
tpch_q04/duckdb:parquet 240175609 / 278868438 / -13.9% 325311301 / 290411092 / +12.0% 0.74 / 0.96 / -23.1%
tpch_q05/duckdb:parquet 510386699 / 512960026 / -0.5% 604457015 / 589908823 / +2.5% 0.84 / 0.87 / -2.9%
tpch_q06/duckdb:parquet 144166896 / 154774655 / -6.9% 203235550 / 188086085 / +8.1% 0.71 / 0.82 / -13.8%
tpch_q07/duckdb:parquet 452909647 / 419672939 / +7.9% 504994353 / 421853390 / +19.7% 0.90 / 0.99 / -9.8%
tpch_q08/duckdb:parquet 604608176 / 588960652 / +2.7% 759696170 / 658661231 / +15.3% 0.80 / 0.89 / -11.0%
tpch_q09/duckdb:parquet 575284310 / 557378838 / +3.2% 589271975 / 656390425 / -10.2% 0.98 / 0.85 / +15.0%
tpch_q10/duckdb:parquet 574070000 / 517349035 / +11.0% 592468363 / 581884894 / +1.8% 0.97 / 0.89 / +9.0%
tpch_q11/duckdb:parquet 301476661 / 279247336 / +8.0% 347502230 / 301469405 / +15.3% 0.87 / 0.93 / -6.3%
tpch_q12/duckdb:parquet 236680540 / 244321025 / -3.1% 288493780 / 281145014 / +2.6% 0.82 / 0.87 / -5.6%
tpch_q13/duckdb:parquet 402928476 / 382703043 / +5.3% 463417400 / 463219570 / +0.0% 0.87 / 0.83 / +5.2%
tpch_q14/duckdb:parquet 224052901 / 255047143 / -12.2% 315253175 / 301222259 / +4.7% 0.71 / 0.85 / -16.1%
tpch_q15/duckdb:parquet 211052052 / 191438501 / +10.2% 252561697 / 220554518 / +14.5% 0.84 / 0.87 / -3.7%
tpch_q16/duckdb:parquet 270520108 / 287313946 / -5.8% 296020623 / 301984087 / -2.0% 0.91 / 0.95 / -3.9%
tpch_q17/duckdb:parquet 296024365 / 258007938 / +14.7% 358099850 / 314199718 / +14.0% 0.83 / 0.82 / +0.7%
tpch_q18/duckdb:parquet 364769231 / 306425002 / +19.0% 433051042 / 355418381 / +21.8% 0.84 / 0.86 / -2.3%
tpch_q19/duckdb:parquet 251043423 / 241485587 / +4.0% 319171838 / 285468394 / +11.8% 0.79 / 0.85 / -7.0%
tpch_q20/duckdb:parquet 469982528 / 432599380 / +8.6% 538102859 / 540117093 / -0.4% 0.87 / 0.80 / +9.0%
tpch_q21/duckdb:parquet 466003482 / 417617294 / +11.6% 509788052 / 463876894 / +9.9% 0.91 / 0.90 / +1.5%
tpch_q22/duckdb:parquet 324340568 / 287438341 / +12.8% 349033912 / 253402369 / +37.7% 🔴 0.93 / 1.13 / -18.1%

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR da10665e vs base 4598f857
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.998x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 35577585 / 35836658 / -0.7% 63464651 / 59839649 / +6.1% 0.56 / 0.60 / -6.4%
tpcds_q02/datafusion:vortex-file-compressed 52212674 / 51540980 / +1.3% 74251198 / 75356430 / -1.5% 0.70 / 0.68 / +2.8%
tpcds_q03/datafusion:vortex-file-compressed 20349784 / 20246396 / +0.5% 44315841 / 46166223 / -4.0% 0.46 / 0.44 / +4.7%
tpcds_q04/datafusion:vortex-file-compressed 292630110 / 293432920 / -0.3% 351990319 / 354050198 / -0.6% 0.83 / 0.83 / +0.3%
tpcds_q05/datafusion:vortex-file-compressed 70405062 / 71656747 / -1.7% 100088536 / 107692212 / -7.1% 0.70 / 0.67 / +5.7%
tpcds_q06/datafusion:vortex-file-compressed 42199688 / 42258217 / -0.1% 70221712 / 70535607 / -0.4% 0.60 / 0.60 / +0.3%
tpcds_q07/datafusion:vortex-file-compressed 42308685 / 42156216 / +0.4% 77616676 / 80613054 / -3.7% 0.55 / 0.52 / +4.2%
tpcds_q08/datafusion:vortex-file-compressed 28789118 / 28614063 / +0.6% 55118753 / 57730721 / -4.5% 0.52 / 0.50 / +5.4%
tpcds_q09/datafusion:vortex-file-compressed 42734472 / 44012164 / -2.9% 74348204 / 77101674 / -3.6% 0.57 / 0.57 / +0.7%
tpcds_q10/datafusion:vortex-file-compressed 36032558 / 37189576 / -3.1% 62745803 / 63021635 / -0.4% 0.57 / 0.59 / -2.7%
tpcds_q11/datafusion:vortex-file-compressed 175249810 / 174495550 / +0.4% 217877082 / 221987691 / -1.9% 0.80 / 0.79 / +2.3%
tpcds_q12/datafusion:vortex-file-compressed 17307826 / 17549844 / -1.4% 37594947 / 38571171 / -2.5% 0.46 / 0.45 / +1.2%
tpcds_q13/datafusion:vortex-file-compressed 39807900 / 38899632 / +2.3% 82531018 / 85520203 / -3.5% 0.48 / 0.45 / +6.0%
tpcds_q14/datafusion:vortex-file-compressed 233674734 / 231725092 / +0.8% 270792995 / 271215982 / -0.2% 0.86 / 0.85 / +1.0%
tpcds_q15/datafusion:vortex-file-compressed 40181668 / 40095029 / +0.2% 58102273 / 54164984 / +7.3% 0.69 / 0.74 / -6.6%
tpcds_q16/datafusion:vortex-file-compressed 22865257 / 22869641 / -0.0% 43625410 / 42034772 / +3.8% 0.52 / 0.54 / -3.7%
tpcds_q17/datafusion:vortex-file-compressed 60287750 / 64808376 / -7.0% 103020937 / 89558176 / +15.0% 🔴 0.59 / 0.72 / -19.1%
tpcds_q18/datafusion:vortex-file-compressed 69914916 / 69097730 / +1.2% 95931279 / 94787906 / +1.2% 0.73 / 0.73 / -0.0%
tpcds_q19/datafusion:vortex-file-compressed 22470228 / 22408799 / +0.3% 53931600 / 55496169 / -2.8% 0.42 / 0.40 / +3.2%
tpcds_q20/datafusion:vortex-file-compressed 23935258 / 23702741 / +1.0% 40366369 / 40220803 / +0.4% 0.59 / 0.59 / +0.6%
tpcds_q21/datafusion:vortex-file-compressed 46706966 / 47542674 / -1.8% 62870682 / 64058585 / -1.9% 0.74 / 0.74 / +0.1%
tpcds_q22/datafusion:vortex-file-compressed 431335297 / 431366016 / -0.0% 460178251 / 465284097 / -1.1% 0.94 / 0.93 / +1.1%
tpcds_q23/datafusion:vortex-file-compressed 302122352 / 299587271 / +0.8% 359957097 / 351318540 / +2.5% 0.84 / 0.85 / -1.6%
tpcds_q24/datafusion:vortex-file-compressed 117428541 / 120023524 / -2.2% 158547776 / 159982078 / -0.9% 0.74 / 0.75 / -1.3%
tpcds_q25/datafusion:vortex-file-compressed 63760235 / 63311010 / +0.7% 92661777 / 102454935 / -9.6% 0.69 / 0.62 / +11.4%
tpcds_q26/datafusion:vortex-file-compressed 36971550 / 37429288 / -1.2% 59339898 / 59331611 / +0.0% 0.62 / 0.63 / -1.2%
tpcds_q27/datafusion:vortex-file-compressed 75400796 / 72377160 / +4.2% 103722969 / 104225546 / -0.5% 0.73 / 0.69 / +4.7%
tpcds_q28/datafusion:vortex-file-compressed 43696136 / 42296916 / +3.3% 90647678 / 82755038 / +9.5% 0.48 / 0.51 / -5.7%
tpcds_q29/datafusion:vortex-file-compressed 62847496 / 61922299 / +1.5% 105482852 / 97201813 / +8.5% 0.60 / 0.64 / -6.5%
tpcds_q30/datafusion:vortex-file-compressed 51190464 / 51311054 / -0.2% 80107789 / 79114003 / +1.3% 0.64 / 0.65 / -1.5%
tpcds_q31/datafusion:vortex-file-compressed 199387458 / 196557266 / +1.4% 232949457 / 235875877 / -1.2% 0.86 / 0.83 / +2.7%
tpcds_q32/datafusion:vortex-file-compressed 15061788 / 15236954 / -1.1% 32603641 / 31554300 / +3.3% 0.46 / 0.48 / -4.3%
tpcds_q33/datafusion:vortex-file-compressed 34029718 / 33321710 / +2.1% 67659008 / 67027574 / +0.9% 0.50 / 0.50 / +1.2%
tpcds_q34/datafusion:vortex-file-compressed 40400488 / 41148345 / -1.8% 69357384 / 68234625 / +1.6% 0.58 / 0.60 / -3.4%
tpcds_q35/datafusion:vortex-file-compressed 93298272 / 92443260 / +0.9% 122840031 / 120652799 / +1.8% 0.76 / 0.77 / -0.9%
tpcds_q36/datafusion:vortex-file-compressed 69511518 / 65946206 / +5.4% 103414495 / 100250170 / +3.2% 0.67 / 0.66 / +2.2%
tpcds_q37/datafusion:vortex-file-compressed 26229512 / 23553139 / +11.4% 🔴 40961865 / 43598667 / -6.0% 0.64 / 0.54 / +18.5%
tpcds_q38/datafusion:vortex-file-compressed 79065162 / 76507711 / +3.3% 110096202 / 106221269 / +3.6% 0.72 / 0.72 / -0.3%
tpcds_q39/datafusion:vortex-file-compressed 884210984 / 887680404 / -0.4% 904657671 / 906829393 / -0.2% 0.98 / 0.98 / -0.2%
tpcds_q40/datafusion:vortex-file-compressed 28611156 / 28735451 / -0.4% 48641470 / 47789817 / +1.8% 0.59 / 0.60 / -2.2%
tpcds_q41/datafusion:vortex-file-compressed 19476862 / 19056672 / +2.2% 33172854 / 30560191 / +8.5% 0.59 / 0.62 / -5.8%
tpcds_q42/datafusion:vortex-file-compressed 13925018 / 14306364 / -2.7% 39470083 / 39330916 / +0.4% 0.35 / 0.36 / -3.0%
tpcds_q43/datafusion:vortex-file-compressed 17607770 / 17123520 / +2.8% 42149275 / 40887604 / +3.1% 0.42 / 0.42 / -0.3%
tpcds_q44/datafusion:vortex-file-compressed 43808119 / 42841783 / +2.3% 70327819 / 73034215 / -3.7% 0.62 / 0.59 / +6.2%
tpcds_q45/datafusion:vortex-file-compressed 43038221 / 42716522 / +0.8% 67304957 / 64325351 / +4.6% 0.64 / 0.66 / -3.7%
tpcds_q46/datafusion:vortex-file-compressed 71915174 / 70770951 / +1.6% 103978518 / 103002911 / +0.9% 0.69 / 0.69 / +0.7%
tpcds_q47/datafusion:vortex-file-compressed 176220895 / 176930862 / -0.4% 223798252 / 217533458 / +2.9% 0.79 / 0.81 / -3.2%
tpcds_q48/datafusion:vortex-file-compressed 35450790 / 35477019 / -0.1% 71510615 / 70167195 / +1.9% 0.50 / 0.51 / -2.0%
tpcds_q49/datafusion:vortex-file-compressed 79991577 / 79901468 / +0.1% 123501372 / 120233831 / +2.7% 0.65 / 0.66 / -2.5%
tpcds_q50/datafusion:vortex-file-compressed 55955089 / 56310110 / -0.6% 88548556 / 89046429 / -0.6% 0.63 / 0.63 / -0.1%
tpcds_q51/datafusion:vortex-file-compressed 241548716 / 241461239 / +0.0% 273189772 / 280306123 / -2.5% 0.88 / 0.86 / +2.6%
tpcds_q52/datafusion:vortex-file-compressed 14665249 / 14942948 / -1.9% 40504632 / 41146983 / -1.6% 0.36 / 0.36 / -0.3%
tpcds_q53/datafusion:vortex-file-compressed 23093414 / 23025893 / +0.3% 51944954 / 52394142 / -0.9% 0.44 / 0.44 / +1.2%
tpcds_q54/datafusion:vortex-file-compressed 59418673 / 59630808 / -0.4% 93097354 / 92798502 / +0.3% 0.64 / 0.64 / -0.7%
tpcds_q55/datafusion:vortex-file-compressed 14430910 / 15209610 / -5.1% 38072827 / 39200802 / -2.9% 0.38 / 0.39 / -2.3%
tpcds_q56/datafusion:vortex-file-compressed 33113582 / 34211642 / -3.2% 64606385 / 63579406 / +1.6% 0.51 / 0.54 / -4.7%
tpcds_q57/datafusion:vortex-file-compressed 131826121 / 130827096 / +0.8% 162369130 / 162474233 / -0.1% 0.81 / 0.81 / +0.8%
tpcds_q58/datafusion:vortex-file-compressed 48434852 / 49071762 / -1.3% 87026173 / 84738612 / +2.7% 0.56 / 0.58 / -3.9%
tpcds_q59/datafusion:vortex-file-compressed 54864505 / 54936949 / -0.1% 82582879 / 85696270 / -3.6% 0.66 / 0.64 / +3.6%
tpcds_q60/datafusion:vortex-file-compressed 34167939 / 34485962 / -0.9% 65358289 / 66114270 / -1.1% 0.52 / 0.52 / +0.2%
tpcds_q61/datafusion:vortex-file-compressed 43986504 / 45202724 / -2.7% 68430707 / 70916447 / -3.5% 0.64 / 0.64 / +0.8%
tpcds_q62/datafusion:vortex-file-compressed 18898453 / 19841460 / -4.8% 42914248 / 43084349 / -0.4% 0.44 / 0.46 / -4.4%
tpcds_q63/datafusion:vortex-file-compressed 23042153 / 22619521 / +1.9% 49995968 / 49716174 / +0.6% 0.46 / 0.45 / +1.3%
tpcds_q64/datafusion:vortex-file-compressed 335751462 / 332776120 / +0.9% 405702219 / 399340320 / +1.6% 0.83 / 0.83 / -0.7%
tpcds_q65/datafusion:vortex-file-compressed 74350804 / 73751860 / +0.8% 111568579 / 110569158 / +0.9% 0.67 / 0.67 / -0.1%
tpcds_q66/datafusion:vortex-file-compressed 53573792 / 52486634 / +2.1% 77453121 / 77837826 / -0.5% 0.69 / 0.67 / +2.6%
tpcds_q67/datafusion:vortex-file-compressed 420058886 / 420503111 / -0.1% 530341426 / 528828691 / +0.3% 0.79 / 0.80 / -0.4%
tpcds_q68/datafusion:vortex-file-compressed 68647488 / 66831493 / +2.7% 100957498 / 99391180 / +1.6% 0.68 / 0.67 / +1.1%
tpcds_q69/datafusion:vortex-file-compressed 35003506 / 36278824 / -3.5% 62268262 / 63625322 / -2.1% 0.56 / 0.57 / -1.4%
tpcds_q70/datafusion:vortex-file-compressed 194872944 / 194497137 / +0.2% 226859538 / 232217411 / -2.3% 0.86 / 0.84 / +2.6%
tpcds_q71/datafusion:vortex-file-compressed 25832348 / 25424784 / +1.6% 58156946 / 61267492 / -5.1% 0.44 / 0.41 / +7.0%
tpcds_q72/datafusion:vortex-file-compressed 1554396659 / 1575229677 / -1.3% 1611834253 / 1696144047 / -5.0% 0.96 / 0.93 / +3.8%
tpcds_q73/datafusion:vortex-file-compressed 38832766 / 38589712 / +0.6% 67149233 / 62969996 / +6.6% 0.58 / 0.61 / -5.6%
tpcds_q74/datafusion:vortex-file-compressed 135007906 / 134601274 / +0.3% 170017276 / 173765353 / -2.2% 0.79 / 0.77 / +2.5%
tpcds_q75/datafusion:vortex-file-compressed 159372145 / 155633299 / +2.4% 197844486 / 198511793 / -0.3% 0.81 / 0.78 / +2.7%
tpcds_q76/datafusion:vortex-file-compressed 33981938 / 34722660 / -2.1% 74415102 / 73189101 / +1.7% 0.46 / 0.47 / -3.7%
tpcds_q77/datafusion:vortex-file-compressed 54855922 / 54175824 / +1.3% 90246341 / 87493805 / +3.1% 0.61 / 0.62 / -1.8%
tpcds_q78/datafusion:vortex-file-compressed 140711953 / 140889933 / -0.1% 192100786 / 191779256 / +0.2% 0.73 / 0.73 / -0.3%
tpcds_q79/datafusion:vortex-file-compressed 54810062 / 53408896 / +2.6% 82803342 / 83137730 / -0.4% 0.66 / 0.64 / +3.0%
tpcds_q80/datafusion:vortex-file-compressed 79206714 / 80795658 / -2.0% 127683832 / 127799771 / -0.1% 0.62 / 0.63 / -1.9%
tpcds_q81/datafusion:vortex-file-compressed 56214066 / 55975548 / +0.4% 82608256 / 83846761 / -1.5% 0.68 / 0.67 / +1.9%
tpcds_q82/datafusion:vortex-file-compressed 32221584 / 30549740 / +5.5% 44976637 / 48106493 / -6.5% 0.72 / 0.64 / +12.8%
tpcds_q83/datafusion:vortex-file-compressed 42131065 / 42358020 / -0.5% 67588950 / 65597866 / +3.0% 0.62 / 0.65 / -3.5%
tpcds_q84/datafusion:vortex-file-compressed 12708921 / 12799204 / -0.7% 32301144 / 30970538 / +4.3% 0.39 / 0.41 / -4.8%
tpcds_q85/datafusion:vortex-file-compressed 60246087 / 60660052 / -0.7% 90199792 / 90654953 / -0.5% 0.67 / 0.67 / -0.2%
tpcds_q86/datafusion:vortex-file-compressed 18178015 / 18272155 / -0.5% 39963873 / 40425570 / -1.1% 0.45 / 0.45 / +0.6%
tpcds_q87/datafusion:vortex-file-compressed 78085088 / 79615489 / -1.9% 110079698 / 107689679 / +2.2% 0.71 / 0.74 / -4.1%
tpcds_q88/datafusion:vortex-file-compressed 55002599 / 56206700 / -2.1% 90841933 / 93094539 / -2.4% 0.61 / 0.60 / +0.3%
tpcds_q89/datafusion:vortex-file-compressed 27138431 / 26931306 / +0.8% 53854615 / 56072635 / -4.0% 0.50 / 0.48 / +4.9%
tpcds_q90/datafusion:vortex-file-compressed 12899107 / 12758200 / +1.1% 33583854 / 34107490 / -1.5% 0.38 / 0.37 / +2.7%
tpcds_q91/datafusion:vortex-file-compressed 18969784 / 19519254 / -2.8% 42395399 / 42141655 / +0.6% 0.45 / 0.46 / -3.4%
tpcds_q92/datafusion:vortex-file-compressed 15033822 / 15245025 / -1.4% 35463309 / 33922326 / +4.5% 0.42 / 0.45 / -5.7%
tpcds_q93/datafusion:vortex-file-compressed 55153826 / 54842766 / +0.6% 93942676 / 88696680 / +5.9% 0.59 / 0.62 / -5.0%
tpcds_q94/datafusion:vortex-file-compressed 21811326 / 21620928 / +0.9% 46083726 / 46231785 / -0.3% 0.47 / 0.47 / +1.2%
tpcds_q95/datafusion:vortex-file-compressed 94199283 / 95000299 / -0.8% 126640912 / 123858370 / +2.2% 0.74 / 0.77 / -3.0%
tpcds_q96/datafusion:vortex-file-compressed 11714620 / 11533278 / +1.6% 32106588 / 31102793 / +3.2% 0.36 / 0.37 / -1.6%
tpcds_q97/datafusion:vortex-file-compressed 40076628 / 39467840 / +1.5% 67268509 / 66425488 / +1.3% 0.60 / 0.59 / +0.3%
tpcds_q98/datafusion:vortex-file-compressed 21044404 / 20665282 / +1.8% 48361281 / 48509099 / -0.3% 0.44 / 0.43 / +2.1%
tpcds_q99/datafusion:vortex-file-compressed 29380862 / 29545800 / -0.6% 48695591 / 48862458 / -0.3% 0.60 / 0.60 / -0.2%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59672482 / 59408052 / +0.4% 79838284 / 82373568 / -3.1% 0.75 / 0.72 / +3.6%
tpcds_q02/datafusion:parquet 69737352 / 69761366 / -0.0% 93766368 / 90812813 / +3.3% 0.74 / 0.77 / -3.2%
tpcds_q03/datafusion:parquet 27791448 / 28478768 / -2.4% 54122545 / 49334251 / +9.7% 0.51 / 0.58 / -11.0%
tpcds_q04/datafusion:parquet 642866714 / 642610250 / +0.0% 708593927 / 708231753 / +0.1% 0.91 / 0.91 / -0.0%
tpcds_q05/datafusion:parquet 80593852 / 81388832 / -1.0% 111762072 / 113800720 / -1.8% 0.72 / 0.72 / +0.8%
tpcds_q06/datafusion:parquet 90453712 / 90852955 / -0.4% 115361224 / 115952402 / -0.5% 0.78 / 0.78 / +0.1%
tpcds_q07/datafusion:parquet 101694800 / 101418282 / +0.3% 138653431 / 133695330 / +3.7% 0.73 / 0.76 / -3.3%
tpcds_q08/datafusion:parquet 47773042 / 48684130 / -1.9% 76394638 / 74133519 / +3.1% 0.63 / 0.66 / -4.8%
tpcds_q09/datafusion:parquet 75293332 / 75160834 / +0.2% 101828285 / 102849415 / -1.0% 0.74 / 0.73 / +1.2%
tpcds_q10/datafusion:parquet 59641898 / 60416750 / -1.3% 85850295 / 84947233 / +1.1% 0.69 / 0.71 / -2.3%
tpcds_q11/datafusion:parquet 413518452 / 412444870 / +0.3% 455715363 / 461294550 / -1.2% 0.91 / 0.89 / +1.5%
tpcds_q12/datafusion:parquet 40590104 / 39871562 / +1.8% 59402395 / 57128529 / +4.0% 0.68 / 0.70 / -2.1%
tpcds_q13/datafusion:parquet 86510170 / 84637846 / +2.2% 135978957 / 130466094 / +4.2% 0.64 / 0.65 / -1.9%
tpcds_q14/datafusion:parquet 375555654 / 378360104 / -0.7% 426125132 / 433388374 / -1.7% 0.88 / 0.87 / +1.0%
tpcds_q15/datafusion:parquet 50977409 / 51502606 / -1.0% 73127084 / 72303263 / +1.1% 0.70 / 0.71 / -2.1%
tpcds_q16/datafusion:parquet 45193394 / 45710882 / -1.1% 64225761 / 63650471 / +0.9% 0.70 / 0.72 / -2.0%
tpcds_q17/datafusion:parquet 137012050 / 138067928 / -0.8% 175572664 / 172187136 / +2.0% 0.78 / 0.80 / -2.7%
tpcds_q18/datafusion:parquet 108700377 / 110369917 / -1.5% 144131639 / 144952536 / -0.6% 0.75 / 0.76 / -1.0%
tpcds_q19/datafusion:parquet 47660020 / 48384048 / -1.5% 78740664 / 75539146 / +4.2% 0.61 / 0.64 / -5.5%
tpcds_q20/datafusion:parquet 41197934 / 41512735 / -0.8% 55274435 / 55090816 / +0.3% 0.75 / 0.75 / -1.1%
tpcds_q21/datafusion:parquet 61084586 / 61141701 / -0.1% 75325153 / 73095747 / +3.0% 0.81 / 0.84 / -3.1%
tpcds_q22/datafusion:parquet 462930990 / 464195324 / -0.3% 480242696 / 478139930 / +0.4% 0.96 / 0.97 / -0.7%
tpcds_q23/datafusion:parquet 364282295 / 357626356 / +1.9% 406726780 / 417833459 / -2.7% 0.90 / 0.86 / +4.6%
tpcds_q24/datafusion:parquet 240258009 / 241331307 / -0.4% 280531666 / 278266611 / +0.8% 0.86 / 0.87 / -1.2%
tpcds_q25/datafusion:parquet 144855868 / 146902811 / -1.4% 184942630 / 196039200 / -5.7% 0.78 / 0.75 / +4.5%
tpcds_q26/datafusion:parquet 54417154 / 53821080 / +1.1% 76398564 / 80565923 / -5.2% 0.71 / 0.67 / +6.6%
tpcds_q27/datafusion:parquet 210493930 / 210089836 / +0.2% 230972169 / 235911774 / -2.1% 0.91 / 0.89 / +2.3%
tpcds_q28/datafusion:parquet 88026154 / 86784142 / +1.4% 115713251 / 119280232 / -3.0% 0.76 / 0.73 / +4.6%
tpcds_q29/datafusion:parquet 141133270 / 145820741 / -3.2% 173951462 / 175411233 / -0.8% 0.81 / 0.83 / -2.4%
tpcds_q30/datafusion:parquet 98741290 / 99608501 / -0.9% 118341330 / 120071149 / -1.4% 0.83 / 0.83 / +0.6%
tpcds_q31/datafusion:parquet 319729446 / 319058792 / +0.2% 346638944 / 344041143 / +0.8% 0.92 / 0.93 / -0.5%
tpcds_q32/datafusion:parquet 29093119 / 29399552 / -1.0% 43362086 / 43643939 / -0.6% 0.67 / 0.67 / -0.4%
tpcds_q33/datafusion:parquet 54686684 / 51971680 / +5.2% 81564323 / 76538194 / +6.6% 0.67 / 0.68 / -1.3%
tpcds_q34/datafusion:parquet 64303014 / 65511648 / -1.8% 86777348 / 85276600 / +1.8% 0.74 / 0.77 / -3.5%
tpcds_q35/datafusion:parquet 124599196 / 126922984 / -1.8% 150524499 / 150646646 / -0.1% 0.83 / 0.84 / -1.8%
tpcds_q36/datafusion:parquet 96779809 / 97863638 / -1.1% 122184802 / 126419427 / -3.3% 0.79 / 0.77 / +2.3%
tpcds_q37/datafusion:parquet 50155754 / 50046237 / +0.2% 65684493 / 65033749 / +1.0% 0.76 / 0.77 / -0.8%
tpcds_q38/datafusion:parquet 121235150 / 122147195 / -0.7% 144948272 / 145034869 / -0.1% 0.84 / 0.84 / -0.7%
tpcds_q39/datafusion:parquet 851062526 / 846526498 / +0.5% 862740746 / 859437879 / +0.4% 0.99 / 0.98 / +0.2%
tpcds_q40/datafusion:parquet 34897596 / 35936465 / -2.9% 55022302 / 54650564 / +0.7% 0.63 / 0.66 / -3.5%
tpcds_q41/datafusion:parquet 30435684 / 31200319 / -2.5% 42977419 / 42657926 / +0.7% 0.71 / 0.73 / -3.2%
tpcds_q42/datafusion:parquet 26436212 / 25952126 / +1.9% 46554754 / 43716014 / +6.5% 0.57 / 0.59 / -4.3%
tpcds_q43/datafusion:parquet 27574093 / 27372783 / +0.7% 47171698 / 46844617 / +0.7% 0.58 / 0.58 / +0.0%
tpcds_q44/datafusion:parquet 62990458 / 65006033 / -3.1% 88162419 / 87803178 / +0.4% 0.71 / 0.74 / -3.5%
tpcds_q45/datafusion:parquet 65090910 / 66536274 / -2.2% 88110216 / 87212845 / +1.0% 0.74 / 0.76 / -3.2%
tpcds_q46/datafusion:parquet 107345183 / 106805720 / +0.5% 142000376 / 153607976 / -7.6% 0.76 / 0.70 / +8.7%
tpcds_q47/datafusion:parquet 237049326 / 237808994 / -0.3% 277157905 / 273252482 / +1.4% 0.86 / 0.87 / -1.7%
tpcds_q48/datafusion:parquet 77967568 / 76955857 / +1.3% 114078043 / 105870247 / +7.8% 0.68 / 0.73 / -6.0%
tpcds_q49/datafusion:parquet 115171159 / 118898020 / -3.1% 166419178 / 170084458 / -2.2% 0.69 / 0.70 / -1.0%
tpcds_q50/datafusion:parquet 92095522 / 92705258 / -0.7% 124161765 / 120435148 / +3.1% 0.74 / 0.77 / -3.6%
tpcds_q51/datafusion:parquet 258811440 / 254091982 / +1.9% 289149437 / 289211985 / -0.0% 0.90 / 0.88 / +1.9%
tpcds_q52/datafusion:parquet 26307302 / 26889958 / -2.2% 46107780 / 45469536 / +1.4% 0.57 / 0.59 / -3.5%
tpcds_q53/datafusion:parquet 35866850 / 36382336 / -1.4% 59881695 / 57842390 / +3.5% 0.60 / 0.63 / -4.8%
tpcds_q54/datafusion:parquet 85643335 / 85254806 / +0.5% 111079189 / 109551589 / +1.4% 0.77 / 0.78 / -0.9%
tpcds_q55/datafusion:parquet 25514368 / 26510566 / -3.8% 46239089 / 46645823 / -0.9% 0.55 / 0.57 / -2.9%
tpcds_q56/datafusion:parquet 52753377 / 54094848 / -2.5% 74948858 / 77335323 / -3.1% 0.70 / 0.70 / +0.6%
tpcds_q57/datafusion:parquet 171665963 / 171894920 / -0.1% 198896374 / 193978047 / +2.5% 0.86 / 0.89 / -2.6%
tpcds_q58/datafusion:parquet 97292899 / 98465482 / -1.2% 126143998 / 125032548 / +0.9% 0.77 / 0.79 / -2.1%
tpcds_q59/datafusion:parquet 104818488 / 103659830 / +1.1% 132084601 / 130225505 / +1.4% 0.79 / 0.80 / -0.3%
tpcds_q60/datafusion:parquet 55363962 / 55741260 / -0.7% 76911133 / 78220449 / -1.7% 0.72 / 0.71 / +1.0%
tpcds_q61/datafusion:parquet 75481348 / 78001000 / -3.2% 102387747 / 106432779 / -3.8% 0.74 / 0.73 / +0.6%
tpcds_q62/datafusion:parquet 27437112 / 27762318 / -1.2% 44715694 / 44527940 / +0.4% 0.61 / 0.62 / -1.6%
tpcds_q63/datafusion:parquet 36250125 / 36196190 / +0.1% 57515479 / 58834211 / -2.2% 0.63 / 0.62 / +2.4%
tpcds_q64/datafusion:parquet 660773432 / 659557758 / +0.2% 739506152 / 742173662 / -0.4% 0.89 / 0.89 / +0.5%
tpcds_q65/datafusion:parquet 101611170 / 100715906 / +0.9% 133047908 / 133981634 / -0.7% 0.76 / 0.75 / +1.6%
tpcds_q66/datafusion:parquet 75842082 / 76575936 / -1.0% 104597744 / 104374000 / +0.2% 0.73 / 0.73 / -1.2%
tpcds_q67/datafusion:parquet 431590880 / 430912350 / +0.2% 504299399 / 500297658 / +0.8% 0.86 / 0.86 / -0.6%
tpcds_q68/datafusion:parquet 109584780 / 108700552 / +0.8% 158700352 / 156742031 / +1.2% 0.69 / 0.69 / -0.4%
tpcds_q69/datafusion:parquet 60136480 / 61003348 / -1.4% 79115025 / 84325988 / -6.2% 0.76 / 0.72 / +5.1%
tpcds_q70/datafusion:parquet 212702398 / 212975306 / -0.1% 244209676 / 246017700 / -0.7% 0.87 / 0.87 / +0.6%
tpcds_q71/datafusion:parquet 39401076 / 39083124 / +0.8% 64835015 / 64662143 / +0.3% 0.61 / 0.60 / +0.5%
tpcds_q72/datafusion:parquet 1777547994 / 1794732356 / -1.0% 1900234375 / 1806078341 / +5.2% 0.94 / 0.99 / -5.9%
tpcds_q73/datafusion:parquet 62148034 / 62856255 / -1.1% 85825616 / 84855052 / +1.1% 0.72 / 0.74 / -2.2%
tpcds_q74/datafusion:parquet 293755444 / 292768250 / +0.3% 326974805 / 331483495 / -1.4% 0.90 / 0.88 / +1.7%
tpcds_q75/datafusion:parquet 196889324 / 193794623 / +1.6% 237246230 / 239131737 / -0.8% 0.83 / 0.81 / +2.4%
tpcds_q76/datafusion:parquet 50406476 / 49958244 / +0.9% 78640972 / 78897199 / -0.3% 0.64 / 0.63 / +1.2%
tpcds_q77/datafusion:parquet 71331252 / 73280301 / -2.7% 102799382 / 98096657 / +4.8% 0.69 / 0.75 / -7.1%
tpcds_q78/datafusion:parquet 213394656 / 211119866 / +1.1% 272121593 / 273491694 / -0.5% 0.78 / 0.77 / +1.6%
tpcds_q79/datafusion:parquet 78142345 / 77375078 / +1.0% 111252350 / 112413871 / -1.0% 0.70 / 0.69 / +2.0%
tpcds_q80/datafusion:parquet 142755671 / 143104068 / -0.2% 192161620 / 191975662 / +0.1% 0.74 / 0.75 / -0.3%
tpcds_q81/datafusion:parquet 107230347 / 106756472 / +0.4% 131699452 / 129378123 / +1.8% 0.81 / 0.83 / -1.3%
tpcds_q82/datafusion:parquet 53826100 / 53582485 / +0.5% 68981125 / 70410662 / -2.0% 0.78 / 0.76 / +2.5%
tpcds_q83/datafusion:parquet 65765800 / 66630048 / -1.3% 82666414 / 85136032 / -2.9% 0.80 / 0.78 / +1.7%
tpcds_q84/datafusion:parquet 35479304 / 36220898 / -2.0% 49129078 / 49805351 / -1.4% 0.72 / 0.73 / -0.7%
tpcds_q85/datafusion:parquet 106495818 / 103848480 / +2.5% 134419217 / 129149354 / +4.1% 0.79 / 0.80 / -1.5%
tpcds_q86/datafusion:parquet 22399726 / 22112695 / +1.3% 39641315 / 39672664 / -0.1% 0.57 / 0.56 / +1.4%
tpcds_q87/datafusion:parquet 123651875 / 122470358 / +1.0% 143445246 / 148224625 / -3.2% 0.86 / 0.83 / +4.3%
tpcds_q88/datafusion:parquet 85404014 / 86047137 / -0.7% 107638522 / 108358632 / -0.7% 0.79 / 0.79 / -0.1%
tpcds_q89/datafusion:parquet 38313170 / 38401756 / -0.2% 63828166 / 64923770 / -1.7% 0.60 / 0.59 / +1.5%
tpcds_q90/datafusion:parquet 17339773 / 18100802 / -4.2% 30683614 / 32273520 / -4.9% 0.57 / 0.56 / +0.8%
tpcds_q91/datafusion:parquet 42979906 / 41738000 / +3.0% 59277630 / 57454843 / +3.2% 0.73 / 0.73 / -0.2%
tpcds_q92/datafusion:parquet 28329270 / 28604120 / -1.0% 46204862 / 47460689 / -2.6% 0.61 / 0.60 / +1.7%
tpcds_q93/datafusion:parquet 61102850 / 63722030 / -4.1% 92956110 / 87405909 / +6.3% 0.66 / 0.73 / -9.8%
tpcds_q94/datafusion:parquet 38165876 / 37847109 / +0.8% 58419120 / 58549059 / -0.2% 0.65 / 0.65 / +1.1%
tpcds_q95/datafusion:parquet 126234904 / 128012922 / -1.4% 156509393 / 149910916 / +4.4% 0.81 / 0.85 / -5.5%
tpcds_q96/datafusion:parquet 20628403 / 20691258 / -0.3% 37223560 / 36951345 / +0.7% 0.55 / 0.56 / -1.0%
tpcds_q97/datafusion:parquet 55799964 / 54645566 / +2.1% 79684192 / 80351616 / -0.8% 0.70 / 0.68 / +3.0%
tpcds_q98/datafusion:parquet 61524662 / 61965680 / -0.7% 85693074 / 83775704 / +2.3% 0.72 / 0.74 / -2.9%
tpcds_q99/datafusion:parquet 42492669 / 42461627 / +0.1% 57729373 / 57802802 / -0.1% 0.74 / 0.73 / +0.2%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32726360 / 32726779 / -0.0% 45448772 / 45377689 / +0.2% 0.72 / 0.72 / -0.2%
tpcds_q02/duckdb:vortex-file-compressed 29249668 / 30267290 / -3.4% 43790967 / 44087004 / -0.7% 0.67 / 0.69 / -2.7%
tpcds_q03/duckdb:vortex-file-compressed 13168780 / 13779130 / -4.4% 29172835 / 30718899 / -5.0% 0.45 / 0.45 / +0.6%
tpcds_q04/duckdb:vortex-file-compressed 127956813 / 130206338 / -1.7% 158860351 / 157201556 / +1.1% 0.81 / 0.83 / -2.8%
tpcds_q05/duckdb:vortex-file-compressed 54359438 / 53727511 / +1.2% 79696160 / 83478676 / -4.5% 0.68 / 0.64 / +6.0%
tpcds_q06/duckdb:vortex-file-compressed 58501392 / 58800986 / -0.5% 80181549 / 79094008 / +1.4% 0.73 / 0.74 / -1.9%
tpcds_q07/duckdb:vortex-file-compressed 30800787 / 31168844 / -1.2% 53103053 / 54099517 / -1.8% 0.58 / 0.58 / +0.7%
tpcds_q08/duckdb:vortex-file-compressed 30891918 / 31134683 / -0.8% 41358308 / 41772800 / -1.0% 0.75 / 0.75 / +0.2%
tpcds_q09/duckdb:vortex-file-compressed 56330192 / 55235330 / +2.0% 79267059 / 79107779 / +0.2% 0.71 / 0.70 / +1.8%
tpcds_q10/duckdb:vortex-file-compressed 39590435 / 39038430 / +1.4% 59630336 / 58236826 / +2.4% 0.66 / 0.67 / -1.0%
tpcds_q11/duckdb:vortex-file-compressed 95929344 / 96226126 / -0.3% 114827320 / 112266994 / +2.3% 0.84 / 0.86 / -2.5%
tpcds_q12/duckdb:vortex-file-compressed 17317310 / 17276975 / +0.2% 30523462 / 30254952 / +0.9% 0.57 / 0.57 / -0.6%
tpcds_q13/duckdb:vortex-file-compressed 38281142 / 38940578 / -1.7% 71271521 / 71103229 / +0.2% 0.54 / 0.55 / -1.9%
tpcds_q14/duckdb:vortex-file-compressed 121532766 / 119983268 / +1.3% 137043143 / 140641737 / -2.6% 0.89 / 0.85 / +4.0%
tpcds_q15/duckdb:vortex-file-compressed 61385532 / 60759281 / +1.0% 74868661 / 76171754 / -1.7% 0.82 / 0.80 / +2.8%
tpcds_q16/duckdb:vortex-file-compressed 34959126 / 34771337 / +0.5% 52713341 / 53890958 / -2.2% 0.66 / 0.65 / +2.8%
tpcds_q17/duckdb:vortex-file-compressed 58753150 / 57289182 / +2.6% 84829112 / 81955246 / +3.5% 0.69 / 0.70 / -0.9%
tpcds_q18/duckdb:vortex-file-compressed 83187255 / 82993345 / +0.2% 105017999 / 104424434 / +0.6% 0.79 / 0.79 / -0.3%
tpcds_q19/duckdb:vortex-file-compressed 45174635 / 43899722 / +2.9% 64924657 / 65276395 / -0.5% 0.70 / 0.67 / +3.5%
tpcds_q20/duckdb:vortex-file-compressed 22087235 / 21520304 / +2.6% 36480382 / 34931964 / +4.4% 0.61 / 0.62 / -1.7%
tpcds_q21/duckdb:vortex-file-compressed 27957788 / 28120830 / -0.6% 60001521 / 62004166 / -3.2% 0.47 / 0.45 / +2.7%
tpcds_q22/duckdb:vortex-file-compressed 163140546 / 165099230 / -1.2% 172859462 / 170541662 / +1.4% 0.94 / 0.97 / -2.5%
tpcds_q23/duckdb:vortex-file-compressed 182035012 / 185876490 / -2.1% 199704409 / 199673618 / +0.0% 0.91 / 0.93 / -2.1%
tpcds_q24/duckdb:vortex-file-compressed 52416703 / 52636914 / -0.4% 75894619 / 77254623 / -1.8% 0.69 / 0.68 / +1.4%
tpcds_q25/duckdb:vortex-file-compressed 53218830 / 53220034 / -0.0% 78238692 / 75302591 / +3.9% 0.68 / 0.71 / -3.8%
tpcds_q26/duckdb:vortex-file-compressed 25935638 / 26713063 / -2.9% 41256722 / 42934826 / -3.9% 0.63 / 0.62 / +1.0%
tpcds_q27/duckdb:vortex-file-compressed 31923791 / 32585874 / -2.0% 53613689 / 53424233 / +0.4% 0.60 / 0.61 / -2.4%
tpcds_q28/duckdb:vortex-file-compressed 41742566 / 41342696 / +1.0% 63608021 / 66089322 / -3.8% 0.66 / 0.63 / +4.9%
tpcds_q29/duckdb:vortex-file-compressed 51802356 / 51866994 / -0.1% 75974037 / 74066949 / +2.6% 0.68 / 0.70 / -2.6%
tpcds_q30/duckdb:vortex-file-compressed 38893530 / 37914817 / +2.6% 52623775 / 52960815 / -0.6% 0.74 / 0.72 / +3.2%
tpcds_q31/duckdb:vortex-file-compressed 37038192 / 37512062 / -1.3% 55173568 / 53392186 / +3.3% 0.67 / 0.70 / -4.5%
tpcds_q32/duckdb:vortex-file-compressed 14309445 / 13855892 / +3.3% 29155840 / 28855272 / +1.0% 0.49 / 0.48 / +2.2%
tpcds_q33/duckdb:vortex-file-compressed 34627698 / 33813963 / +2.4% 57168549 / 59046480 / -3.2% 0.61 / 0.57 / +5.8%
tpcds_q34/duckdb:vortex-file-compressed 23081134 / 22811725 / +1.2% 39660601 / 39776812 / -0.3% 0.58 / 0.57 / +1.5%
tpcds_q35/duckdb:vortex-file-compressed 67545896 / 66786588 / +1.1% 87911404 / 85242000 / +3.1% 0.77 / 0.78 / -1.9%
tpcds_q36/duckdb:vortex-file-compressed 29240357 / 29806828 / -1.9% 47296795 / 49308472 / -4.1% 0.62 / 0.60 / +2.3%
tpcds_q37/duckdb:vortex-file-compressed 25938944 / 25605208 / +1.3% 72000605 / 74457214 / -3.3% 0.36 / 0.34 / +4.8%
tpcds_q38/duckdb:vortex-file-compressed 59891228 / 62408870 / -4.0% 75061739 / 81156842 / -7.5% 0.80 / 0.77 / +3.8%
tpcds_q39/duckdb:vortex-file-compressed 54960716 / 56168904 / -2.2% 90285356 / 85127364 / +6.1% 0.61 / 0.66 / -7.7%
tpcds_q40/duckdb:vortex-file-compressed 18929031 / 19238372 / -1.6% 34748174 / 35099919 / -1.0% 0.54 / 0.55 / -0.6%
tpcds_q41/duckdb:vortex-file-compressed 19212738 / 18720698 / +2.6% 25773189 / 25500417 / +1.1% 0.75 / 0.73 / +1.5%
tpcds_q42/duckdb:vortex-file-compressed 14641296 / 14015144 / +4.5% 31599141 / 30966847 / +2.0% 0.46 / 0.45 / +2.4%
tpcds_q43/duckdb:vortex-file-compressed 19699418 / 19403602 / +1.5% 34651759 / 32011378 / +8.2% 0.57 / 0.61 / -6.2%
tpcds_q44/duckdb:vortex-file-compressed 28019984 / 28307018 / -1.0% 48466054 / 51668551 / -6.2% 0.58 / 0.55 / +5.5%
tpcds_q45/duckdb:vortex-file-compressed 45793882 / 46586273 / -1.7% 59278181 / 60370446 / -1.8% 0.77 / 0.77 / +0.1%
tpcds_q46/duckdb:vortex-file-compressed 51060988 / 51192653 / -0.3% 76382195 / 75043524 / +1.8% 0.67 / 0.68 / -2.0%
tpcds_q47/duckdb:vortex-file-compressed 80668044 / 80927444 / -0.3% 95214751 / 97094785 / -1.9% 0.85 / 0.83 / +1.6%
tpcds_q48/duckdb:vortex-file-compressed 53181120 / 53155386 / +0.0% 81756535 / 81823473 / -0.1% 0.65 / 0.65 / +0.1%
tpcds_q49/duckdb:vortex-file-compressed 38728806 / 37950044 / +2.1% 78144310 / 78847393 / -0.9% 0.50 / 0.48 / +3.0%
tpcds_q50/duckdb:vortex-file-compressed 32662143 / 32675461 / -0.0% 56398539 / 57051911 / -1.1% 0.58 / 0.57 / +1.1%
tpcds_q51/duckdb:vortex-file-compressed 205529830 / 204779876 / +0.4% 219302232 / 217736852 / +0.7% 0.94 / 0.94 / -0.4%
tpcds_q52/duckdb:vortex-file-compressed 14993691 / 15384257 / -2.5% 30611170 / 31876748 / -4.0% 0.49 / 0.48 / +1.5%
tpcds_q53/duckdb:vortex-file-compressed 21827298 / 22960290 / -4.9% 37991796 / 39000657 / -2.6% 0.57 / 0.59 / -2.4%
tpcds_q54/duckdb:vortex-file-compressed 44544884 / 44886930 / -0.8% 65772275 / 65481173 / +0.4% 0.68 / 0.69 / -1.2%
tpcds_q55/duckdb:vortex-file-compressed 14962321 / 14612501 / +2.4% 30354036 / 30570651 / -0.7% 0.49 / 0.48 / +3.1%
tpcds_q56/duckdb:vortex-file-compressed 33414428 / 32462078 / +2.9% 56173518 / 57717193 / -2.7% 0.59 / 0.56 / +5.8%
tpcds_q57/duckdb:vortex-file-compressed 66501174 / 64171452 / +3.6% 78844364 / 78496038 / +0.4% 0.84 / 0.82 / +3.2%
tpcds_q58/duckdb:vortex-file-compressed 37716610 / 37835588 / -0.3% 60839630 / 64016051 / -5.0% 0.62 / 0.59 / +4.9%
tpcds_q59/duckdb:vortex-file-compressed 52743166 / 53810956 / -2.0% 68637857 / 71107629 / -3.5% 0.77 / 0.76 / +1.5%
tpcds_q60/duckdb:vortex-file-compressed 35667587 / 35369636 / +0.8% 59382872 / 59793701 / -0.7% 0.60 / 0.59 / +1.5%
tpcds_q61/duckdb:vortex-file-compressed 33891378 / 34298255 / -1.2% 52537039 / 53069753 / -1.0% 0.65 / 0.65 / -0.2%
tpcds_q62/duckdb:vortex-file-compressed 16678532 / 14822514 / +12.5% 🔴 27713076 / 26421769 / +4.9% 0.60 / 0.56 / +7.3%
tpcds_q63/duckdb:vortex-file-compressed 20612894 / 20828409 / -1.0% 37937732 / 38114655 / -0.5% 0.54 / 0.55 / -0.6%
tpcds_q64/duckdb:vortex-file-compressed 118887584 / 118342334 / +0.5% 150877060 / 152181613 / -0.9% 0.79 / 0.78 / +1.3%
tpcds_q65/duckdb:vortex-file-compressed 51848804 / 51466061 / +0.7% 60811029 / 58907342 / +3.2% 0.85 / 0.87 / -2.4%
tpcds_q66/duckdb:vortex-file-compressed 41149394 / 40998564 / +0.4% 58259175 / 58858579 / -1.0% 0.71 / 0.70 / +1.4%
tpcds_q67/duckdb:vortex-file-compressed 279902552 / 277425812 / +0.9% 285938085 / 283678837 / +0.8% 0.98 / 0.98 / +0.1%
tpcds_q68/duckdb:vortex-file-compressed 44954841 / 44593714 / +0.8% 73182702 / 72079771 / +1.5% 0.61 / 0.62 / -0.7%
tpcds_q69/duckdb:vortex-file-compressed 38142709 / 38356528 / -0.6% 59487000 / 59755970 / -0.5% 0.64 / 0.64 / -0.1%
tpcds_q70/duckdb:vortex-file-compressed 25066120 / 25085070 / -0.1% 40792381 / 41516746 / -1.7% 0.61 / 0.60 / +1.7%
tpcds_q71/duckdb:vortex-file-compressed 28030662 / 27715436 / +1.1% 50718448 / 50902781 / -0.4% 0.55 / 0.54 / +1.5%
tpcds_q72/duckdb:vortex-file-compressed 138877470 / 135900823 / +2.2% 160111691 / 164226936 / -2.5% 0.87 / 0.83 / +4.8%
tpcds_q73/duckdb:vortex-file-compressed 21226678 / 20089200 / +5.7% 35698929 / 37315276 / -4.3% 0.59 / 0.54 / +10.4%
tpcds_q74/duckdb:vortex-file-compressed 82892106 / 82722980 / +0.2% 96062908 / 99629718 / -3.6% 0.86 / 0.83 / +3.9%
tpcds_q75/duckdb:vortex-file-compressed 111990441 / 111929736 / +0.1% 144116788 / 139908352 / +3.0% 0.78 / 0.80 / -2.9%
tpcds_q76/duckdb:vortex-file-compressed 27953166 / 27219565 / +2.7% 57902404 / 58492855 / -1.0% 0.48 / 0.47 / +3.7%
tpcds_q77/duckdb:vortex-file-compressed 36420012 / 36316546 / +0.3% 59884027 / 62103115 / -3.6% 0.61 / 0.58 / +4.0%
tpcds_q78/duckdb:vortex-file-compressed 136280428 / 137442428 / -0.8% 159458336 / 159793923 / -0.2% 0.85 / 0.86 / -0.6%
tpcds_q79/duckdb:vortex-file-compressed 38896318 / 37665982 / +3.3% 62563247 / 59874325 / +4.5% 0.62 / 0.63 / -1.2%
tpcds_q80/duckdb:vortex-file-compressed 58441415 / 57541290 / +1.6% 92130261 / 89399248 / +3.1% 0.63 / 0.64 / -1.4%
tpcds_q81/duckdb:vortex-file-compressed 58369422 / 57777750 / +1.0% 69898410 / 71231569 / -1.9% 0.84 / 0.81 / +3.0%
tpcds_q82/duckdb:vortex-file-compressed 26605170 / 26860434 / -1.0% 74777390 / 77804956 / -3.9% 0.36 / 0.35 / +3.1%
tpcds_q83/duckdb:vortex-file-compressed 21581320 / 21694036 / -0.5% 31833238 / 32263861 / -1.3% 0.68 / 0.67 / +0.8%
tpcds_q84/duckdb:vortex-file-compressed 13660439 / 13366814 / +2.2% 23972407 / 23226339 / +3.2% 0.57 / 0.58 / -1.0%
tpcds_q85/duckdb:vortex-file-compressed 36913800 / 36707151 / +0.6% 54706798 / 56348206 / -2.9% 0.67 / 0.65 / +3.6%
tpcds_q86/duckdb:vortex-file-compressed 17044713 / 16411782 / +3.9% 29282939 / 28182293 / +3.9% 0.58 / 0.58 / -0.0%
tpcds_q87/duckdb:vortex-file-compressed 75418326 / 75201770 / +0.3% 85176715 / 87749398 / -2.9% 0.89 / 0.86 / +3.3%
tpcds_q88/duckdb:vortex-file-compressed 38890455 / 37878092 / +2.7% 49582522 / 49979733 / -0.8% 0.78 / 0.76 / +3.5%
tpcds_q89/duckdb:vortex-file-compressed 24125132 / 24974289 / -3.4% 38887732 / 41888285 / -7.2% 0.62 / 0.60 / +4.1%
tpcds_q90/duckdb:vortex-file-compressed 9663938 / 9843474 / -1.8% 19565683 / 20353435 / -3.9% 0.49 / 0.48 / +2.1%
tpcds_q91/duckdb:vortex-file-compressed 19599313 / 19617013 / -0.1% 29704494 / 29081972 / +2.1% 0.66 / 0.67 / -2.2%
tpcds_q92/duckdb:vortex-file-compressed 13450682 / 13643566 / -1.4% 27413721 / 27682975 / -1.0% 0.49 / 0.49 / -0.4%
tpcds_q93/duckdb:vortex-file-compressed 25763436 / 25876894 / -0.4% 51988459 / 52613864 / -1.2% 0.50 / 0.49 / +0.8%
tpcds_q94/duckdb:vortex-file-compressed 33047217 / 32152022 / +2.8% 46826670 / 47204449 / -0.8% 0.71 / 0.68 / +3.6%
tpcds_q95/duckdb:vortex-file-compressed 96289544 / 97513786 / -1.3% 107999523 / 117615692 / -8.2% 0.89 / 0.83 / +7.5%
tpcds_q96/duckdb:vortex-file-compressed 11912581 / 11752061 / +1.4% 24886569 / 24570663 / +1.3% 0.48 / 0.48 / +0.1%
tpcds_q97/duckdb:vortex-file-compressed 62403950 / 62178961 / +0.4% 80189586 / 82766588 / -3.1% 0.78 / 0.75 / +3.6%
tpcds_q98/duckdb:vortex-file-compressed 27108980 / 26889542 / +0.8% 43358789 / 43917859 / -1.3% 0.63 / 0.61 / +2.1%
tpcds_q99/duckdb:vortex-file-compressed 22102269 / 26072871 / -15.2% 🟢 34433792 / 35980286 / -4.3% 0.64 / 0.72 / -11.4%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 43570754 / 43748750 / -0.4% 49711667 / 50433867 / -1.4% 0.88 / 0.87 / +1.0%
tpcds_q02/duckdb:parquet 39821518 / 39630168 / +0.5% 47263119 / 50715675 / -6.8% 0.84 / 0.78 / +7.8%
tpcds_q03/duckdb:parquet 26073365 / 25995732 / +0.3% 37097789 / 36796166 / +0.8% 0.70 / 0.71 / -0.5%
tpcds_q04/duckdb:parquet 206780268 / 203957459 / +1.4% 230589878 / 234181220 / -1.5% 0.90 / 0.87 / +3.0%
tpcds_q05/duckdb:parquet 70542882 / 68357342 / +3.2% 83723574 / 87464497 / -4.3% 0.84 / 0.78 / +7.8%
tpcds_q06/duckdb:parquet 74862443 / 75115975 / -0.3% 86352660 / 89166769 / -3.2% 0.87 / 0.84 / +2.9%
tpcds_q07/duckdb:parquet 62073886 / 62193874 / -0.2% 76158772 / 76707973 / -0.7% 0.82 / 0.81 / +0.5%
tpcds_q08/duckdb:parquet 38188692 / 38663366 / -1.2% 43000994 / 46394278 / -7.3% 0.89 / 0.83 / +6.6%
tpcds_q09/duckdb:parquet 86694720 / 87080988 / -0.4% 97601496 / 101981323 / -4.3% 0.89 / 0.85 / +4.0%
tpcds_q10/duckdb:parquet 52444532 / 52520572 / -0.1% 62261451 / 62695229 / -0.7% 0.84 / 0.84 / +0.6%
tpcds_q11/duckdb:parquet 159442562 / 159415788 / +0.0% 169807192 / 164104249 / +3.5% 0.94 / 0.97 / -3.3%
tpcds_q12/duckdb:parquet 41180562 / 40814548 / +0.9% 47958687 / 48941959 / -2.0% 0.86 / 0.83 / +3.0%
tpcds_q13/duckdb:parquet 72748920 / 69804706 / +4.2% 85216534 / 87793121 / -2.9% 0.85 / 0.80 / +7.4%
tpcds_q14/duckdb:parquet 191148397 / 185753765 / +2.9% 199020470 / 202864595 / -1.9% 0.96 / 0.92 / +4.9%
tpcds_q15/duckdb:parquet 60892468 / 60934452 / -0.1% 69266194 / 69050398 / +0.3% 0.88 / 0.88 / -0.4%
tpcds_q16/duckdb:parquet 38239904 / 37850674 / +1.0% 46356463 / 45839434 / +1.1% 0.82 / 0.83 / -0.1%
tpcds_q17/duckdb:parquet 83222310 / 84076050 / -1.0% 88885413 / 89860905 / -1.1% 0.94 / 0.94 / +0.1%
tpcds_q18/duckdb:parquet 87137320 / 87775860 / -0.7% 99300917 / 98136096 / +1.2% 0.88 / 0.89 / -1.9%
tpcds_q19/duckdb:parquet 48510332 / 47466565 / +2.2% 61926087 / 63007623 / -1.7% 0.78 / 0.75 / +4.0%
tpcds_q20/duckdb:parquet 42278274 / 42342882 / -0.2% 48854376 / 48573403 / +0.6% 0.87 / 0.87 / -0.7%
tpcds_q21/duckdb:parquet 24112638 / 23962194 / +0.6% 28429352 / 28440652 / -0.0% 0.85 / 0.84 / +0.7%
tpcds_q22/duckdb:parquet 165746128 / 166072912 / -0.2% 168243477 / 167098902 / +0.7% 0.99 / 0.99 / -0.9%
tpcds_q23/duckdb:parquet 186691392 / 188036546 / -0.7% 195717776 / 193148517 / +1.3% 0.95 / 0.97 / -2.0%
tpcds_q24/duckdb:parquet 72512856 / 71146241 / +1.9% 82548111 / 82487151 / +0.1% 0.88 / 0.86 / +1.8%
tpcds_q25/duckdb:parquet 50891006 / 51215258 / -0.6% 60852913 / 61288817 / -0.7% 0.84 / 0.84 / +0.1%
tpcds_q26/duckdb:parquet 42467268 / 42361802 / +0.2% 52068087 / 51343370 / +1.4% 0.82 / 0.83 / -1.1%
tpcds_q27/duckdb:parquet 56770632 / 57111037 / -0.6% 77984993 / 81608147 / -4.4% 0.73 / 0.70 / +4.0%
tpcds_q28/duckdb:parquet 93499576 / 93252698 / +0.3% 110012174 / 112178597 / -1.9% 0.85 / 0.83 / +2.2%
tpcds_q29/duckdb:parquet 85647074 / 83041768 / +3.1% 98460588 / 96583021 / +1.9% 0.87 / 0.86 / +1.2%
tpcds_q30/duckdb:parquet 72069700 / 72470468 / -0.6% 80708103 / 81148208 / -0.5% 0.89 / 0.89 / -0.0%
tpcds_q31/duckdb:parquet 99224744 / 98601462 / +0.6% 110288634 / 111465299 / -1.1% 0.90 / 0.88 / +1.7%
tpcds_q32/duckdb:parquet 18200148 / 18353748 / -0.8% 25719623 / 26590155 / -3.3% 0.71 / 0.69 / +2.5%
tpcds_q33/duckdb:parquet 63027714 / 62367010 / +1.1% 77795688 / 73989561 / +5.1% 0.81 / 0.84 / -3.9%
tpcds_q34/duckdb:parquet 32525894 / 33006494 / -1.5% 44225223 / 41889230 / +5.6% 0.74 / 0.79 / -6.7%
tpcds_q35/duckdb:parquet 76938216 / 77399391 / -0.6% 85027508 / 86087567 / -1.2% 0.90 / 0.90 / +0.6%
tpcds_q36/duckdb:parquet 97768492 / 99335950 / -1.6% 114125898 / 112263590 / +1.7% 0.86 / 0.88 / -3.2%
tpcds_q37/duckdb:parquet 41822164 / 41378236 / +1.1% 46345363 / 47554095 / -2.5% 0.90 / 0.87 / +3.7%
tpcds_q38/duckdb:parquet 74146840 / 76468258 / -3.0% 81468597 / 85294747 / -4.5% 0.91 / 0.90 / +1.5%
tpcds_q39/duckdb:parquet 62053234 / 61661639 / +0.6% 66824897 / 67797634 / -1.4% 0.93 / 0.91 / +2.1%
tpcds_q40/duckdb:parquet 28021873 / 27952642 / +0.2% 35155288 / 36118029 / -2.7% 0.80 / 0.77 / +3.0%
tpcds_q41/duckdb:parquet 20124440 / 20143537 / -0.1% 26150759 / 26266476 / -0.4% 0.77 / 0.77 / +0.3%
tpcds_q42/duckdb:parquet 26897250 / 26999602 / -0.4% 36588864 / 36451419 / +0.4% 0.74 / 0.74 / -0.8%
tpcds_q43/duckdb:parquet 28408480 / 28272378 / +0.5% 39368337 / 35793884 / +10.0% 0.72 / 0.79 / -8.6%
tpcds_q44/duckdb:parquet 60640246 / 60736375 / -0.2% 75231533 / 74562633 / +0.9% 0.81 / 0.81 / -1.0%
tpcds_q45/duckdb:parquet 60190502 / 60622120 / -0.7% 68300331 / 67027287 / +1.9% 0.88 / 0.90 / -2.6%
tpcds_q46/duckdb:parquet 70761950 / 72394963 / -2.3% 85400999 / 88023341 / -3.0% 0.83 / 0.82 / +0.7%
tpcds_q47/duckdb:parquet 90548196 / 90830810 / -0.3% 103240025 / 105146923 / -1.8% 0.88 / 0.86 / +1.5%
tpcds_q48/duckdb:parquet 67914438 / 67648746 / +0.4% 80294889 / 85359866 / -5.9% 0.85 / 0.79 / +6.7%
tpcds_q49/duckdb:parquet 72115501 / 67399774 / +7.0% 92436487 / 92020170 / +0.5% 0.78 / 0.73 / +6.5%
tpcds_q50/duckdb:parquet 43182040 / 45228659 / -4.5% 54865321 / 50910629 / +7.8% 0.79 / 0.89 / -11.4%
tpcds_q51/duckdb:parquet 217828857 / 217340788 / +0.2% 224978948 / 225257376 / -0.1% 0.97 / 0.96 / +0.3%
tpcds_q52/duckdb:parquet 27183890 / 26490668 / +2.6% 38841053 / 37218058 / +4.4% 0.70 / 0.71 / -1.7%
tpcds_q53/duckdb:parquet 35749418 / 34202255 / +4.5% 45058257 / 48232701 / -6.6% 0.79 / 0.71 / +11.9%
tpcds_q54/duckdb:parquet 55651020 / 55357348 / +0.5% 62810246 / 63307482 / -0.8% 0.89 / 0.87 / +1.3%
tpcds_q55/duckdb:parquet 27197664 / 26580602 / +2.3% 36468551 / 38734658 / -5.9% 0.75 / 0.69 / +8.7%
tpcds_q56/duckdb:parquet 69833402 / 68450543 / +2.0% 83070194 / 84208264 / -1.4% 0.84 / 0.81 / +3.4%
tpcds_q57/duckdb:parquet 69203150 / 67905272 / +1.9% 76381784 / 75530496 / +1.1% 0.91 / 0.90 / +0.8%
tpcds_q58/duckdb:parquet 54561951 / 55351262 / -1.4% 66405659 / 67300961 / -1.3% 0.82 / 0.82 / -0.1%
tpcds_q59/duckdb:parquet 60059468 / 61543058 / -2.4% 69013673 / 67498896 / +2.2% 0.87 / 0.91 / -4.6%
tpcds_q60/duckdb:parquet 80849402 / 81154691 / -0.4% 95104933 / 95719978 / -0.6% 0.85 / 0.85 / +0.3%
tpcds_q61/duckdb:parquet 82043685 / 78725636 / +4.2% 98971194 / 94693948 / +4.5% 0.83 / 0.83 / -0.3%
tpcds_q62/duckdb:parquet 20121999 / 21271646 / -5.4% 24432224 / 24742108 / -1.3% 0.82 / 0.86 / -4.2%
tpcds_q63/duckdb:parquet 34028272 / 33973322 / +0.2% 41781496 / 44293841 / -5.7% 0.81 / 0.77 / +6.2%
tpcds_q64/duckdb:parquet 134278565 / 134987804 / -0.5% 151695492 / 149714203 / +1.3% 0.89 / 0.90 / -1.8%
tpcds_q65/duckdb:parquet 93705926 / 92507762 / +1.3% 102316637 / 106732283 / -4.1% 0.92 / 0.87 / +5.7%
tpcds_q66/duckdb:parquet 46310441 / 45574203 / +1.6% 52144333 / 52408182 / -0.5% 0.89 / 0.87 / +2.1%
tpcds_q67/duckdb:parquet 294427351 / 294181831 / +0.1% 295720360 / 294225942 / +0.5% 1.00 / 1.00 / -0.4%
tpcds_q68/duckdb:parquet 62727894 / 61610444 / +1.8% 76626459 / 77643526 / -1.3% 0.82 / 0.79 / +3.2%
tpcds_q69/duckdb:parquet 65415526 / 65821270 / -0.6% 77708067 / 75369095 / +3.1% 0.84 / 0.87 / -3.6%
tpcds_q70/duckdb:parquet 41770904 / 42560156 / -1.9% 55377667 / 50824609 / +9.0% 0.75 / 0.84 / -9.9%
tpcds_q71/duckdb:parquet 40845765 / 41353862 / -1.2% 54701453 / 54241063 / +0.8% 0.75 / 0.76 / -2.1%
tpcds_q72/duckdb:parquet 171111948 / 172146606 / -0.6% 185187755 / 189350126 / -2.2% 0.92 / 0.91 / +1.6%
tpcds_q73/duckdb:parquet 28327722 / 27072398 / +4.6% 34321454 / 37030456 / -7.3% 0.83 / 0.73 / +12.9%
tpcds_q74/duckdb:parquet 215086170 / 216089249 / -0.5% 223243479 / 223017657 / +0.1% 0.96 / 0.97 / -0.6%
tpcds_q75/duckdb:parquet 133265764 / 131891024 / +1.0% 148125763 / 152249842 / -2.7% 0.90 / 0.87 / +3.9%
tpcds_q76/duckdb:parquet 52690353 / 51285484 / +2.7% 64797601 / 65205448 / -0.6% 0.81 / 0.79 / +3.4%
tpcds_q77/duckdb:parquet 54610218 / 54841040 / -0.4% 76098382 / 67440836 / +12.8% 🔴 0.72 / 0.81 / -11.7%
tpcds_q78/duckdb:parquet 148464892 / 155747874 / -4.7% 161542495 / 168363678 / -4.1% 0.92 / 0.93 / -0.7%
tpcds_q79/duckdb:parquet 54045650 / 51430181 / +5.1% 65417402 / 64568583 / +1.3% 0.83 / 0.80 / +3.7%
tpcds_q80/duckdb:parquet 82205673 / 82941310 / -0.9% 104552907 / 103690804 / +0.8% 0.79 / 0.80 / -1.7%
tpcds_q81/duckdb:parquet 98041460 / 98572923 / -0.5% 105019054 / 104274293 / +0.7% 0.93 / 0.95 / -1.2%
tpcds_q82/duckdb:parquet 45444802 / 46604344 / -2.5% 53484098 / 52315928 / +2.2% 0.85 / 0.89 / -4.6%
tpcds_q83/duckdb:parquet 28330014 / 28152398 / +0.6% 33215068 / 33185714 / +0.1% 0.85 / 0.85 / +0.5%
tpcds_q84/duckdb:parquet 22715660 / 22751552 / -0.2% 29546837 / 29406408 / +0.5% 0.77 / 0.77 / -0.6%
tpcds_q85/duckdb:parquet 51123440 / 52752074 / -3.1% 59436026 / 62960389 / -5.6% 0.86 / 0.84 / +2.7%
tpcds_q86/duckdb:parquet 25158685 / 25146913 / +0.0% 32798940 / 33004413 / -0.6% 0.77 / 0.76 / +0.7%
tpcds_q87/duckdb:parquet 89146185 / 88695797 / +0.5% 95338704 / 92564858 / +3.0% 0.94 / 0.96 / -2.4%
tpcds_q88/duckdb:parquet 101955266 / 106796080 / -4.5% 113959510 / 111229279 / +2.5% 0.89 / 0.96 / -6.8%
tpcds_q89/duckdb:parquet 37937024 / 37846748 / +0.2% 48747603 / 48196620 / +1.1% 0.78 / 0.79 / -0.9%
tpcds_q90/duckdb:parquet 15871628 / 15015242 / +5.7% 20177210 / 20928242 / -3.6% 0.79 / 0.72 / +9.6%
tpcds_q91/duckdb:parquet 25504484 / 25515043 / -0.0% 33283258 / 33274247 / +0.0% 0.77 / 0.77 / -0.1%
tpcds_q92/duckdb:parquet 21948538 / 22329364 / -1.7% 31159212 / 31995562 / -2.6% 0.70 / 0.70 / +0.9%
tpcds_q93/duckdb:parquet 37032555 / 35799040 / +3.4% 47808492 / 49479404 / -3.4% 0.77 / 0.72 / +7.1%
tpcds_q94/duckdb:parquet 38005105 / 38247234 / -0.6% 48007118 / 46965479 / +2.2% 0.79 / 0.81 / -2.8%
tpcds_q95/duckdb:parquet 81782714 / 81409130 / +0.5% 87252226 / 86595751 / +0.8% 0.94 / 0.94 / -0.3%
tpcds_q96/duckdb:parquet 17563452 / 17012262 / +3.2% 23519551 / 24425947 / -3.7% 0.75 / 0.70 / +7.2%
tpcds_q97/duckdb:parquet 70829826 / 73153984 / -3.2% 81800258 / 78153554 / +4.7% 0.87 / 0.94 / -7.5%
tpcds_q98/duckdb:parquet 54692679 / 55289756 / -1.1% 67051032 / 66788134 / +0.4% 0.82 / 0.83 / -1.5%
tpcds_q99/duckdb:parquet 24466654 / 24402862 / +0.3% 32537589 / 30438057 / +6.9% 0.75 / 0.80 / -6.2%

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@joseph-isaacs