Skip to content

perf(compressor): Improve string dictionary selection - #9762

Merged
robert3005 merged 6 commits into
developfrom
wm/string-dictionary-selection
Nov 11, 2026
Merged

perf(compressor): Improve string dictionary selection#9762
robert3005 merged 6 commits into
developfrom
wm/string-dictionary-selection

Conversation

@lwwmanning

@lwwmanning lwwmanning commented Sep 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

String Dictionary selection now probes a distributed sample before building an exact candidate. The previous estimator missed profitable dictionaries when columns contained thousands of repeated strings. Samples above 75% distinct values reject Dictionary; an incomplete probe uses the existing estimator. Admitted candidates have explicit limits for dictionary entries, value bytes, code bytes, and input bytes. The compressor compares the candidate's actual size and reuses it if it wins.

The probe reads at most 8,192 rows and 1 MiB of values. A row that exceeds the byte budget is excluded from the completed-row count, including the final sampled row. String samples compact their payload before size estimates so unrelated retained bytes do not distort the score.

Merged develop, preserving explicit allocator use and updating the integration tests and benchmark for the current compressor APIs. Adversarial review covered probe boundaries, null handling, candidate work/storage limits, sampling fallback, and candidate reuse. The final-row byte-budget regression fails with the previous code and passes with the fix.

Validation: 165 targeted and golden tests passed; formatting passed with nightly-2026-09-10; clippy passed for vortex-array, vortex-compressor, and vortex-btrblocks with all targets, all features, and warnings denied. No golden snapshots changed.

Fresh CI compression results compare ab167f77 with develop at 05d0cba3. HashTags used 1.2% fewer bytes, with write time +0.8% and full materialization time +3.3%. Euro2016 used 0.1% fewer bytes, with write time +2.0% and full materialization time -4.1%. These percentages come from one CI comparison; the report flagged no runtime regressions. Dictionary expansion still carries a materialization tradeoff, while engines preserving Dictionary can retain the encoded form.

All current build, lint, test, compatibility, coverage, sanitizer, compression benchmark, SQL benchmark, and CodSpeed Performance Analysis checks passed. The PR is ready for human review; the approval policy awaits a human reviewer.

@lwwmanning lwwmanning added changelog/performance A performance improvement action/bench-compress Run only the compression benchmark on this PR labels Sep 3, 2026
@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Sep 3, 2026
@codspeed

ghost commented Sep 3, 2026 •
edited by codspeed Bot
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 10.84%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 2 benchmarks are dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 2 improved benchmarks
✅ 1914 untouched benchmarks
⏩ 48 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ CPU Simulation encode_primitives[f32, (2000, 512)] 271.2 µs 244.2 µs +11.06%
⚡ CPU Simulation null_count_run_end[(32000, 256, 0.01)] 8.9 µs 8 µs +10.63%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.

Comparing wm/string-dictionary-selection (524ac05) with develop (0ab0321)

Open in CodSpeed

Footnotes

  1. 48 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@github-actions

ghost commented Sep 3, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 85fbc04 compress-bench 1 Explore Profiling Data
Previous Runs (14)
Status Commit Job Attempt Link
🟢 Done 90f08fa compress-bench 1 Explore Profiling Data
🟢 Done 26ea413 compress-bench 1 Explore Profiling Data
🟢 Done ab167f7 statpopgen 1 Explore Profiling Data
🟢 Done ab167f7 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ab167f7 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ab167f7 tpcds-nvme 1 Explore Profiling Data
🟢 Done ab167f7 fineweb-s3 1 Explore Profiling Data
🟢 Done ab167f7 clickbench-nvme 1 Explore Profiling Data
🟢 Done ab167f7 fineweb 1 Explore Profiling Data
🟢 Done ab167f7 polarsignals 1 Explore Profiling Data
🟢 Done ab167f7 tpch-s3 1 Explore Profiling Data
🟢 Done ab167f7 tpch-nvme 1 Explore Profiling Data
🟢 Done ab167f7 compress-bench 1 Explore Profiling Data
🟢 Done 2d35497 compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Sep 3, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 85fbc041 vs base 96fc43df

vortex / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 482525224 / 484184736 / -0.3% 481653127 / 484435645 / -0.6% 1.00 / 1.00 / +0.2%
compress time/bimbo 2264325275 / 2290642920 / -1.1% 2215848472 / 2265192197 / -2.2% 1.02 / 1.01 / +1.1%
compress time/cmsprovider 1020267466 / 1030264734 / -1.0% 997977377 / 1015514725 / -1.7% 1.02 / 1.01 / +0.8%
compress time/euro2016 177828463 / 173695852 / +2.4% 175864972 / 175244894 / +0.4% 1.01 / 0.99 / +2.0%
compress time/food 218720718 / 220242306 / -0.7% 218754780 / 220993281 / -1.0% 1.00 / 1.00 / +0.3%
compress time/hashtags 368946320 / 391589626 / -5.8% 360522331 / 384690126 / -6.3% 1.02 / 1.02 / +0.5%
compress time/taxi 203327371 / 206560584 / -1.6% 203713640 / 209308897 / -2.7% 1.00 / 0.99 / +1.1%
compress time/tpc-h l_comment canonical 403471560 / 414622131 / -2.7% 400118689 / 413031202 / -3.1% 1.01 / 1.00 / +0.5%
compress time/tpc-h l_comment chunked 402708744 / 413080861 / -2.5% 402192170 / 413998149 / -2.9% 1.00 / 1.00 / +0.4%
compress time/wide table cols=100 chunks=1 rows=1000 5312481 / 5418666 / -2.0% 6602135 / 7126067 / -7.4% 0.80 / 0.76 / +5.8%
compress time/wide table cols=100 chunks=50 rows=1000 5356554 / 5443018 / -1.6% 6656335 / 7135459 / -6.7% 0.80 / 0.76 / +5.5%
compress time/wide table cols=1000 chunks=1 rows=1000 51576481 / 51507627 / +0.1% 53434603 / 54862739 / -2.6% 0.97 / 0.94 / +2.8%
compress time/wide table cols=1000 chunks=50 rows=1000 51174895 / 52273992 / -2.1% 52578449 / 54071740 / -2.8% 0.97 / 0.97 / +0.7%
compress time/wide table cols=10000 chunks=1 rows=1000 589983604 / 604186856 / -2.4% 589625760 / 605613996 / -2.6% 1.00 / 1.00 / +0.3%
compress time/wide table cols=10000 chunks=50 rows=1000 593463192 / 597262606 / -0.6% 595474270 / 602026561 / -1.1% 1.00 / 0.99 / +0.5%
decompress time/arade 14028908 / 14221674 / -1.4% 14911823 / 15170090 / -1.7% 0.94 / 0.94 / +0.4%
decompress time/bimbo 68290778 / 67586558 / +1.0% 73185610 / 76240448 / -4.0% 0.93 / 0.89 / +5.3%
decompress time/cmsprovider 39150506 / 39064006 / +0.2% 40385941 / 44306739 / -8.8% 0.97 / 0.88 / +10.0%
decompress time/euro2016 12425343 / 14365171 / -13.5% 🟢 13000900 / 15929696 / -18.4% 🟢 0.96 / 0.90 / +6.0%
decompress time/food 3905370 / 3842789 / +1.6% 5680749 / 4668637 / +21.7% 🔴 0.69 / 0.82 / -16.5%
decompress time/hashtags 41977456 / 39539300 / +6.2% 42129859 / 39573505 / +6.5% 1.00 / 1.00 / -0.3%
decompress time/taxi 9857764 / 9969698 / -1.1% 11980123 / 11052358 / +8.4% 0.82 / 0.90 / -8.8%
decompress time/tpc-h l_comment canonical 15145463 / 14926204 / +1.5% 14947186 / 17295191 / -13.6% 🟢 1.01 / 0.86 / +17.4%
decompress time/tpc-h l_comment chunked 14789872 / 15069774 / -1.9% 14796198 / 15574306 / -5.0% 1.00 / 0.97 / +3.3%
decompress time/wide table cols=100 chunks=1 rows=1000 1484840 / 1533264 / -3.2% 1569967 / 1639197 / -4.2% 0.95 / 0.94 / +1.1%
decompress time/wide table cols=100 chunks=50 rows=1000 1493511 / 1507924 / -1.0% 1562792 / 1707443 / -8.5% 0.96 / 0.88 / +8.2%
decompress time/wide table cols=1000 chunks=1 rows=1000 13465372 / 13200685 / +2.0% 13674194 / 13619411 / +0.4% 0.98 / 0.97 / +1.6%
decompress time/wide table cols=1000 chunks=50 rows=1000 13362050 / 13296331 / +0.5% 13839658 / 13685231 / +1.1% 0.97 / 0.97 / -0.6%
decompress time/wide table cols=10000 chunks=1 rows=1000 137112999 / 136433210 / +0.5% 140338809 / 136822797 / +2.6% 0.98 / 1.00 / -2.0%
decompress time/wide table cols=10000 chunks=50 rows=1000 136898456 / 136990564 / -0.1% 139678316 / 138152672 / +1.1% 0.98 / 0.99 / -1.2%
vortex / vortex-file-compressed / bytes (0.997x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/arade 142213596 / 142213596 / +0.0%
vortex-file-compressed size/bimbo 458580972 / 458580972 / +0.0%
vortex-file-compressed size/cmsprovider 420807812 / 420807812 / +0.0%
vortex-file-compressed size/euro2016 164279740 / 164571036 / -0.2%
vortex-file-compressed size/food 38951096 / 38950912 / +0.0%
vortex-file-compressed size/hashtags 187767420 / 195463068 / -3.9%
vortex-file-compressed size/taxi 49997700 / 49997700 / +0.0%
vortex-file-compressed size/tpc-h l_comment canonical 178708512 / 178708512 / +0.0%
vortex-file-compressed size/tpc-h l_comment chunked 178708512 / 178708512 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934080 / 934080 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9325680 / 9325680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93277680 / 93277680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93277680 / 93277680 / +0.0%
vortex / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 1193929296 / 1191922416 / +0.2% 1191365461 / 1202759362 / -0.9% 1.00 / 0.99 / +1.1%
compress time/bimbo 2205597890 / 2226230749 / -0.9% 2227988583 / 2247560485 / -0.9% 0.99 / 0.99 / -0.1%
compress time/cmsprovider 1716239760 / 1713468630 / +0.2% 1721779389 / 1722335585 / -0.0% 1.00 / 0.99 / +0.2%
compress time/euro2016 1045666676 / 1039655842 / +0.6% 1045095181 / 1041430136 / +0.4% 1.00 / 1.00 / +0.2%
compress time/food 413619768 / 414172702 / -0.1% 419347302 / 415872768 / +0.8% 0.99 / 1.00 / -1.0%
compress time/hashtags 558469112 / 556888640 / +0.3% 562289861 / 555601919 / +1.2% 0.99 / 1.00 / -0.9%
compress time/taxi 243551448 / 244928897 / -0.6% 247170430 / 248534016 / -0.5% 0.99 / 0.99 / -0.0%
compress time/tpc-h l_comment canonical 1245685870 / 1249813758 / -0.3% 1252159996 / 1253173388 / -0.1% 0.99 / 1.00 / -0.2%
compress time/tpc-h l_comment chunked 1251031093 / 1246509886 / +0.4% 1252531196 / 1250478163 / +0.2% 1.00 / 1.00 / +0.2%
compress time/wide table cols=100 chunks=1 rows=1000 3718006 / 4026006 / -7.7% 5339598 / 4931747 / +8.3% 0.70 / 0.82 / -14.7%
compress time/wide table cols=100 chunks=50 rows=1000 3915244 / 3960816 / -1.2% 5164067 / 4710720 / +9.6% 0.76 / 0.84 / -9.8%
compress time/wide table cols=1000 chunks=1 rows=1000 39323445 / 38844066 / +1.2% 41437268 / 40758547 / +1.7% 0.95 / 0.95 / -0.4%
compress time/wide table cols=1000 chunks=50 rows=1000 38550502 / 37774571 / +2.1% 40978734 / 40074115 / +2.3% 0.94 / 0.94 / -0.2%
compress time/wide table cols=10000 chunks=1 rows=1000 390349211 / 394161050 / -1.0% 401833867 / 401936865 / -0.0% 0.97 / 0.98 / -0.9%
compress time/wide table cols=10000 chunks=50 rows=1000 392424572 / 389742900 / +0.7% 405493894 / 399220807 / +1.6% 0.97 / 0.98 / -0.9%
decompress time/arade 57440358 / 57287332 / +0.3% 57875296 / 58379259 / -0.9% 0.99 / 0.98 / +1.1%
decompress time/bimbo 94455078 / 94611850 / -0.2% 94972581 / 95906685 / -1.0% 0.99 / 0.99 / +0.8%
decompress time/cmsprovider 107038002 / 107132461 / -0.1% 106866711 / 107294236 / -0.4% 1.00 / 1.00 / +0.3%
decompress time/euro2016 167930671 / 168340296 / -0.2% 168335459 / 169390752 / -0.6% 1.00 / 0.99 / +0.4%
decompress time/food 26816005 / 26823458 / -0.0% 26969563 / 27666237 / -2.5% 0.99 / 0.97 / +2.6%
decompress time/hashtags 473062132 / 473338714 / -0.1% 473787613 / 473665513 / +0.0% 1.00 / 1.00 / -0.1%
decompress time/taxi 61266314 / 61444298 / -0.3% 61480382 / 61772924 / -0.5% 1.00 / 0.99 / +0.2%
decompress time/tpc-h l_comment canonical 84486546 / 84698694 / -0.3% 85021929 / 85607267 / -0.7% 0.99 / 0.99 / +0.4%
decompress time/tpc-h l_comment chunked 84513168 / 84499613 / +0.0% 84866350 / 85760958 / -1.0% 1.00 / 0.99 / +1.1%
decompress time/wide table cols=100 chunks=1 rows=1000 2084393 / 2090946 / -0.3% 2280829 / 2446568 / -6.8% 0.91 / 0.85 / +6.9%
decompress time/wide table cols=100 chunks=50 rows=1000 2108359 / 2083291 / +1.2% 2217452 / 2407958 / -7.9% 0.95 / 0.87 / +9.9%
decompress time/wide table cols=1000 chunks=1 rows=1000 24266711 / 23718522 / +2.3% 24846421 / 23972605 / +3.6% 0.98 / 0.99 / -1.3%
decompress time/wide table cols=1000 chunks=50 rows=1000 23963200 / 23392184 / +2.4% 24563948 / 25184553 / -2.5% 0.98 / 0.93 / +5.0%
decompress time/wide table cols=10000 chunks=1 rows=1000 255122778 / 249187426 / +2.4% 261710266 / 255012816 / +2.6% 0.97 / 0.98 / -0.2%
decompress time/wide table cols=10000 chunks=50 rows=1000 254490694 / 250449104 / +1.6% 258256623 / 255393137 / +1.1% 0.99 / 0.98 / +0.5%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/arade 210020851 / 210020851 / +0.0%
parquet size/bimbo 376187078 / 376187078 / +0.0%
parquet size/cmsprovider 364268159 / 364268159 / +0.0%
parquet size/euro2016 111035158 / 111035158 / +0.0%
parquet size/food 34903783 / 34903783 / +0.0%
parquet size/hashtags 126189203 / 126189203 / +0.0%
parquet size/taxi 52142534 / 52142534 / +0.0%
parquet size/tpc-h l_comment canonical 153403836 / 153403836 / +0.0%
parquet size/tpc-h l_comment chunked 153403836 / 153403836 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 95537969 / 97640960 / -2.2% 119358047 / 123967374 / -3.7% 0.80 / 0.79 / +1.6%
compress time/bimbo 600227642 / 609532636 / -1.5% 662520366 / 675166136 / -1.9% 0.91 / 0.90 / +0.4%
compress time/cmsprovider 379846082 / 383262683 / -0.9% 442889364 / 449120907 / -1.4% 0.86 / 0.85 / +0.5%
compress time/euro2016 38220660 / 38570138 / -0.9% 52092938 / 53188969 / -2.1% 0.73 / 0.73 / +1.2%
compress time/food 40132072 / 40757892 / -1.5% 53911313 / 54890267 / -1.8% 0.74 / 0.74 / +0.3%
compress time/hashtags 78064272 / 78192262 / -0.2% 105765642 / 106851079 / -1.0% 0.74 / 0.73 / +0.9%
compress time/taxi 59290382 / 60065753 / -1.3% 75363224 / 76847312 / -1.9% 0.79 / 0.78 / +0.7%
compress time/tpc-h l_comment canonical 128910938 / 129824810 / -0.7% 165482029 / 167973022 / -1.5% 0.78 / 0.77 / +0.8%
compress time/tpc-h l_comment chunked 129405692 / 129377256 / +0.0% 165259741 / 167487626 / -1.3% 0.78 / 0.77 / +1.4%
compress time/wide table cols=100 chunks=1 rows=1000 195323.5 / 197806.5 / -1.3% 416996 / 602668 / -30.8% 🟢 0.47 / 0.33 / +42.7%
compress time/wide table cols=100 chunks=50 rows=1000 199333.5 / 203381 / -2.0% 387310 / 588432 / -34.2% 🟢 0.51 / 0.35 / +48.9%
compress time/wide table cols=1000 chunks=1 rows=1000 2361710 / 2392747 / -1.3% 2825647 / 3304255 / -14.5% 🟢 0.84 / 0.72 / +15.4%
compress time/wide table cols=1000 chunks=50 rows=1000 2327498 / 2366292 / -1.6% 2805786 / 3112878 / -9.9% 0.83 / 0.76 / +9.1%
compress time/wide table cols=10000 chunks=1 rows=1000 25196818 / 25226840 / -0.1% 31316507 / 31620395 / -1.0% 0.80 / 0.80 / +0.9%
compress time/wide table cols=10000 chunks=50 rows=1000 25032377 / 25230966 / -0.8% 31392491 / 31651343 / -0.8% 0.80 / 0.80 / +0.0%
decompress time/arade 218767830 / 218800134 / -0.0% 218865539 / 218749711 / +0.1% 1.00 / 1.00 / -0.1%
decompress time/bimbo 417313232 / 412761966 / +1.1% 418211761 / 416047582 / +0.5% 1.00 / 0.99 / +0.6%
decompress time/cmsprovider 674760495 / 699513954 / -3.5% 676372608 / 700171788 / -3.4% 1.00 / 1.00 / -0.1%
decompress time/euro2016 85736426 / 85792748 / -0.1% 85974913 / 86157899 / -0.2% 1.00 / 1.00 / +0.1%
decompress time/food 67552664 / 65923482 / +2.5% 67895753 / 66078522 / +2.8% 0.99 / 1.00 / -0.3%
decompress time/hashtags 164931648 / 164798894 / +0.1% 164793397 / 165108482 / -0.2% 1.00 / 1.00 / +0.3%
decompress time/taxi 51146456 / 51006168 / +0.3% 51427841 / 51265997 / +0.3% 0.99 / 0.99 / -0.0%
decompress time/tpc-h l_comment canonical 191723860 / 190515877 / +0.6% 191924151 / 190913568 / +0.5% 1.00 / 1.00 / +0.1%
decompress time/tpc-h l_comment chunked 189754528 / 190600091 / -0.4% 190030013 / 190869819 / -0.4% 1.00 / 1.00 / -0.0%
decompress time/wide table cols=100 chunks=1 rows=1000 321666 / 320801 / +0.3% 371814 / 374925 / -0.8% 0.87 / 0.86 / +1.1%
decompress time/wide table cols=100 chunks=50 rows=1000 318685 / 321001.5 / -0.7% 349857 / 347464 / +0.7% 0.91 / 0.92 / -1.4%
decompress time/wide table cols=1000 chunks=1 rows=1000 3758720 / 3688782 / +1.9% 3702196 / 3678281 / +0.7% 1.02 / 1.00 / +1.2%
decompress time/wide table cols=1000 chunks=50 rows=1000 3788690 / 3761558 / +0.7% 3813540 / 3866869 / -1.4% 0.99 / 0.97 / +2.1%
decompress time/wide table cols=10000 chunks=1 rows=1000 36315891 / 35610023 / +2.0% 36568355 / 36091020 / +1.3% 0.99 / 0.99 / +0.7%
decompress time/wide table cols=10000 chunks=50 rows=1000 35635960 / 35676798 / -0.1% 35884870 / 36011871 / -0.4% 0.99 / 0.99 / +0.2%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/arade 680639722 / 680639722 / +0.0%
arrow-ipc size/bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/cmsprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/food 252069442 / 252069442 / +0.0%
arrow-ipc size/hashtags 700364562 / 700364562 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/tpc-h l_comment canonical 1021072290 / 1021072290 / +0.0%
arrow-ipc size/tpc-h l_comment chunked 1021072290 / 1021072290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@gatesn gatesn mentioned this pull request Sep 8, 2026
Merged
@github-actions

ghost commented Sep 21, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Sep 21, 2026
@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

This PR was closed because it has been inactive for 7 days since being marked as stale.

@github-actions github-actions Bot closed this Oct 1, 2026
@lwwmanning lwwmanning reopened this Oct 1, 2026
@lwwmanning lwwmanning added action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR and removed stale This PR is stale and will be auto-closed soon labels Oct 1, 2026
@github-actions github-actions Bot removed action/bench-compress Run only the compression benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 1, 2026
@lwwmanning
lwwmanning marked this pull request as ready for review October 1, 2026 05:52
@chatgpt-codex-connector

ghost commented Oct 1, 2026 •
edited by chatgpt-codex-connector Bot
Loading

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-01T05:55:17.019023Z ab167f7 Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ab167f77 vs base 05d0cba3
Vortex (geomean): hot 0.998x ➖ · cold 1.053x ➖

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57987568 / 57257047 / +1.3% 104115219 / 101321509 / +2.8% 0.56 / 0.57 / -1.4%
polarsignals_q01/datafusion:vortex-file-compressed 63861486 / 62995688 / +1.4% 124819035 / 124625798 / +0.2% 0.51 / 0.51 / +1.2%
polarsignals_q02/datafusion:vortex-file-compressed 62337590 / 62973865 / -1.0% 107846034 / 104617416 / +3.1% 0.58 / 0.60 / -4.0%
polarsignals_q03/datafusion:vortex-file-compressed 79466427 / 79731364 / -0.3% 141464506 / 138264861 / +2.3% 0.56 / 0.58 / -2.6%
polarsignals_q04/datafusion:vortex-file-compressed 9493898 / 9469918 / +0.3% 51284522 / 46004318 / +11.5% 🔴 0.19 / 0.21 / -10.1%
polarsignals_q05/datafusion:vortex-file-compressed 23980778 / 24443414 / -1.9% 67251309 / 62557232 / +7.5% 0.36 / 0.39 / -8.7%
polarsignals_q06/datafusion:vortex-file-compressed 21731948 / 21398846 / +1.6% 63871410 / 60477998 / +5.6% 0.34 / 0.35 / -3.8%
polarsignals_q07/datafusion:vortex-file-compressed 39018581 / 39752300 / -1.8% 81081929 / 77031813 / +5.3% 0.48 / 0.52 / -6.7%
polarsignals_q08/datafusion:vortex-file-compressed 98726418 / 98151486 / +0.6% 166410620 / 160223633 / +3.9% 0.59 / 0.61 / -3.2%
polarsignals_q09/datafusion:vortex-file-compressed 9832506 / 9978887 / -1.5% 52534384 / 46914670 / +12.0% 🔴 0.19 / 0.21 / -12.0%
File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.88 MB 685.89 MB +1.84 KB +0.0%

Totals:

  • vortex-file-compressed: 685.88 MB → 685.89 MB (+0.0%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+4.9%, medium confidence)
Vortex (geomean): hot 1.035x ➖ · cold 1.067x ➖
Parquet (geomean): hot 1.009x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +0.9% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7161501 / 6964450 / +2.8% 21891708 / 21191890 / +3.3% 0.33 / 0.33 / -0.5%
fineweb_q01/datafusion:vortex-file-compressed 12151251 / 11878450 / +2.3% 50283206 / 58162822 / -13.5% 🟢 0.24 / 0.20 / +18.3%
fineweb_q02/datafusion:vortex-file-compressed 12909136 / 13343386 / -3.3% 58950902 / 58709650 / +0.4% 0.22 / 0.23 / -3.7%
fineweb_q03/datafusion:vortex-file-compressed 20129104 / 20417406 / -1.4% 107406640 / 113213007 / -5.1% 0.19 / 0.18 / +3.9%
fineweb_q04/datafusion:vortex-file-compressed 76876330 / 79274053 / -3.0% 163076999 / 166610299 / -2.1% 0.47 / 0.48 / -0.9%
fineweb_q05/datafusion:vortex-file-compressed 60513158 / 60235043 / +0.5% 145608612 / 145867787 / -0.2% 0.42 / 0.41 / +0.6%
fineweb_q06/datafusion:vortex-file-compressed 19144290 / 18988355 / +0.8% 110971028 / 111466050 / -0.4% 0.17 / 0.17 / +1.3%
fineweb_q07/datafusion:vortex-file-compressed 17140873 / 18569940 / -7.7% 106425555 / 103531746 / +2.8% 0.16 / 0.18 / -10.2%
fineweb_q08/datafusion:vortex-file-compressed 11050812 / 10136520 / +9.0% 55410178 / 51382739 / +7.8% 0.20 / 0.20 / +1.1%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9530996 / 9383444 / +1.6% 34532018 / 36183905 / -4.6% 0.28 / 0.26 / +6.4%
fineweb_q01/datafusion:parquet 76693094 / 76097298 / +0.8% 157524683 / 164000327 / -3.9% 0.49 / 0.46 / +4.9%
fineweb_q02/datafusion:parquet 73822576 / 73956558 / -0.2% 166595737 / 163603302 / +1.8% 0.44 / 0.45 / -2.0%
fineweb_q03/datafusion:parquet 73097632 / 74732458 / -2.2% 155020622 / 158973211 / -2.5% 0.47 / 0.47 / +0.3%
fineweb_q04/datafusion:parquet 81020399 / 81711132 / -0.8% 158986276 / 164119632 / -3.1% 0.51 / 0.50 / +2.4%
fineweb_q05/datafusion:parquet 79997336 / 81256787 / -1.5% 154679876 / 163398545 / -5.3% 0.52 / 0.50 / +4.0%
fineweb_q06/datafusion:parquet 74747772 / 75839390 / -1.4% 159245632 / 160539536 / -0.8% 0.47 / 0.47 / -0.6%
fineweb_q07/datafusion:parquet 74849762 / 74949917 / -0.1% 158750450 / 161825296 / -1.9% 0.47 / 0.46 / +1.8%
fineweb_q08/datafusion:parquet 72719264 / 72714810 / +0.0% 157064410 / 157408812 / -0.2% 0.46 / 0.46 / +0.2%
duckdb / vortex-file-compressed / ns (1.072x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1873644 / 1915768 / -2.2% 7620822 / 5180163 / +47.1% 🔴 0.25 / 0.37 / -33.5%
fineweb_q01/duckdb:vortex-file-compressed 18338122 / 20205204 / -9.2% 60573360 / 55476693 / +9.2% 0.30 / 0.36 / -16.9%
fineweb_q02/duckdb:vortex-file-compressed 17857340 / 20253124 / -11.8% 🟢 49941399 / 58356314 / -14.4% 🟢 0.36 / 0.35 / +3.0%
fineweb_q03/duckdb:vortex-file-compressed 34475682 / 28193018 / +22.3% 🔴 122964243 / 160923269 / -23.6% 🟢 0.28 / 0.18 / +60.0%
fineweb_q04/duckdb:vortex-file-compressed 98616496 / 75059165 / +31.4% 🔴 214000035 / 118157477 / +81.1% 🔴 0.46 / 0.64 / -27.5%
fineweb_q05/duckdb:vortex-file-compressed 90340182 / 60470546 / +49.4% 🔴 194132445 / 108706225 / +78.6% 🔴 0.47 / 0.56 / -16.3%
fineweb_q06/duckdb:vortex-file-compressed 50725402 / 37367290 / +35.7% 🔴 160657343 / 117991089 / +36.2% 🔴 0.32 / 0.32 / -0.3%
fineweb_q07/duckdb:vortex-file-compressed 27054373 / 31245894 / -13.4% 🟢 117321026 / 130773226 / -10.3% 🟢 0.23 / 0.24 / -3.5%
fineweb_q08/duckdb:vortex-file-compressed 6541468 / 7715734 / -15.2% 🟢 15653321 / 18671859 / -16.2% 🟢 0.42 / 0.41 / +1.1%
duckdb / parquet / ns (1.022x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23519977 / 22411082 / +4.9% 26887118 / 23104981 / +16.4% 🔴 0.87 / 0.97 / -9.8%
fineweb_q01/duckdb:parquet 46545940 / 44478879 / +4.6% 55855612 / 55032923 / +1.5% 0.83 / 0.81 / +3.1%
fineweb_q02/duckdb:parquet 43581894 / 43724316 / -0.3% 58190466 / 55809185 / +4.3% 0.75 / 0.78 / -4.4%
fineweb_q03/duckdb:parquet 94839460 / 94292866 / +0.6% 173489007 / 187795471 / -7.6% 0.55 / 0.50 / +8.9%
fineweb_q04/duckdb:parquet 155215187 / 151659373 / +2.3% 202857651 / 216619541 / -6.4% 0.77 / 0.70 / +9.3%
fineweb_q05/duckdb:parquet 143477026 / 144073210 / -0.4% 184448006 / 191762939 / -3.8% 0.78 / 0.75 / +3.5%
fineweb_q06/duckdb:parquet 70626162 / 71764558 / -1.6% 131201742 / 132134403 / -0.7% 0.54 / 0.54 / -0.9%
fineweb_q07/duckdb:parquet 72353048 / 72429842 / -0.1% 154512576 / 166433400 / -7.2% 0.47 / 0.44 / +7.6%
fineweb_q08/duckdb:parquet 25261711 / 22840519 / +10.6% 🔴 24664828 / 24598580 / +0.3% 1.02 / 0.93 / +10.3%

No file size changes detected.

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.024x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.021x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16697771 / 16506814 / +1.2% 45798791 / 44080781 / +3.9% 0.36 / 0.37 / -2.6%
tpch_q02/datafusion:vortex-file-compressed 17463617 / 17597763 / -0.8% 38760505 / 35881551 / +8.0% 0.45 / 0.49 / -8.1%
tpch_q03/datafusion:vortex-file-compressed 19431246 / 19630128 / -1.0% 51361201 / 43635779 / +17.7% 🔴 0.38 / 0.45 / -15.9%
tpch_q04/datafusion:vortex-file-compressed 10176596 / 10137160 / +0.4% 34135426 / 34945951 / -2.3% 0.30 / 0.29 / +2.8%
tpch_q05/datafusion:vortex-file-compressed 37003172 / 37421482 / -1.1% 66778625 / 63896144 / +4.5% 0.55 / 0.59 / -5.4%
tpch_q06/datafusion:vortex-file-compressed 6118713 / 6309431 / -3.0% 31647627 / 27358852 / +15.7% 🔴 0.19 / 0.23 / -16.2%
tpch_q07/datafusion:vortex-file-compressed 51780463 / 52075982 / -0.6% 82322603 / 83178540 / -1.0% 0.63 / 0.63 / +0.5%
tpch_q08/datafusion:vortex-file-compressed 52335535 / 51785099 / +1.1% 85753004 / 83334964 / +2.9% 0.61 / 0.62 / -1.8%
tpch_q09/datafusion:vortex-file-compressed 49505257 / 49171308 / +0.7% 79179081 / 77583729 / +2.1% 0.63 / 0.63 / -1.3%
tpch_q10/datafusion:vortex-file-compressed 17080569 / 17937512 / -4.8% 52813001 / 47893623 / +10.3% 🔴 0.32 / 0.37 / -13.6%
tpch_q11/datafusion:vortex-file-compressed 15177861 / 15333024 / -1.0% 36245232 / 33308609 / +8.8% 0.42 / 0.46 / -9.0%
tpch_q12/datafusion:vortex-file-compressed 22311954 / 22198203 / +0.5% 50144112 / 43888332 / +14.3% 🔴 0.44 / 0.51 / -12.0%
tpch_q13/datafusion:vortex-file-compressed 20352785 / 20211056 / +0.7% 43684716 / 39695532 / +10.0% 🔴 0.47 / 0.51 / -8.5%
tpch_q14/datafusion:vortex-file-compressed 15026921 / 15038893 / -0.1% 41487101 / 39806217 / +4.2% 0.36 / 0.38 / -4.1%
tpch_q15/datafusion:vortex-file-compressed 19078588 / 18501130 / +3.1% 48496797 / 46355840 / +4.6% 0.39 / 0.40 / -1.4%
tpch_q16/datafusion:vortex-file-compressed 19041096 / 18980464 / +0.3% 40463431 / 39108463 / +3.5% 0.47 / 0.49 / -3.0%
tpch_q17/datafusion:vortex-file-compressed 28615941 / 27853350 / +2.7% 60603854 / 57916690 / +4.6% 0.47 / 0.48 / -1.8%
tpch_q18/datafusion:vortex-file-compressed 36810886 / 36828979 / -0.0% 61440300 / 57248926 / +7.3% 0.60 / 0.64 / -6.9%
tpch_q19/datafusion:vortex-file-compressed 13468698 / 13843712 / -2.7% 41879616 / 38213275 / +9.6% 0.32 / 0.36 / -11.2%
tpch_q20/datafusion:vortex-file-compressed 21087512 / 20973122 / +0.5% 46768580 / 46540239 / +0.5% 0.45 / 0.45 / +0.1%
tpch_q21/datafusion:vortex-file-compressed 39420754 / 38969895 / +1.2% 70735587 / 66505496 / +6.4% 0.56 / 0.59 / -4.9%
tpch_q22/datafusion:vortex-file-compressed 11423276 / 11109385 / +2.8% 34156503 / 31338408 / +9.0% 0.33 / 0.35 / -5.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72407115 / 72559208 / -0.2% 92636834 / 88886472 / +4.2% 0.78 / 0.82 / -4.2%
tpch_q02/datafusion:parquet 57014214 / 57451992 / -0.8% 78408929 / 76270980 / +2.8% 0.73 / 0.75 / -3.5%
tpch_q03/datafusion:parquet 84174926 / 84683981 / -0.6% 111743047 / 105950839 / +5.5% 0.75 / 0.80 / -5.8%
tpch_q04/datafusion:parquet 47022290 / 46825293 / +0.4% 66802349 / 65640774 / +1.8% 0.70 / 0.71 / -1.3%
tpch_q05/datafusion:parquet 99647489 / 99422987 / +0.2% 128367498 / 126573544 / +1.4% 0.78 / 0.79 / -1.2%
tpch_q06/datafusion:parquet 32100687 / 32123724 / -0.1% 52924673 / 49725084 / +6.4% 0.61 / 0.65 / -6.1%
tpch_q07/datafusion:parquet 109077157 / 106375768 / +2.5% 133575372 / 131520879 / +1.6% 0.82 / 0.81 / +1.0%
tpch_q08/datafusion:parquet 114585380 / 114064536 / +0.5% 139975516 / 136012245 / +2.9% 0.82 / 0.84 / -2.4%
tpch_q09/datafusion:parquet 130765690 / 131032894 / -0.2% 162679468 / 160594346 / +1.3% 0.80 / 0.82 / -1.5%
tpch_q10/datafusion:parquet 104154866 / 104212419 / -0.1% 136901658 / 131310644 / +4.3% 0.76 / 0.79 / -4.1%
tpch_q11/datafusion:parquet 42163775 / 43402149 / -2.9% 65841114 / 63783567 / +3.2% 0.64 / 0.68 / -5.9%
tpch_q12/datafusion:parquet 69287311 / 68882466 / +0.6% 95435054 / 92887517 / +2.7% 0.73 / 0.74 / -2.1%
tpch_q13/datafusion:parquet 185359739 / 185616545 / -0.1% 210357488 / 206098649 / +2.1% 0.88 / 0.90 / -2.2%
tpch_q14/datafusion:parquet 48171279 / 48296595 / -0.3% 76368055 / 72284810 / +5.6% 0.63 / 0.67 / -5.6%
tpch_q15/datafusion:parquet 54374091 / 54004254 / +0.7% 77274568 / 74621304 / +3.6% 0.70 / 0.72 / -2.8%
tpch_q16/datafusion:parquet 40976323 / 40611858 / +0.9% 61513992 / 58165153 / +5.8% 0.67 / 0.70 / -4.6%
tpch_q17/datafusion:parquet 129916584 / 129744377 / +0.1% 157381804 / 154690929 / +1.7% 0.83 / 0.84 / -1.6%
tpch_q18/datafusion:parquet 130353997 / 130072327 / +0.2% 154833655 / 154318283 / +0.3% 0.84 / 0.84 / -0.1%
tpch_q19/datafusion:parquet 59752518 / 59737151 / +0.0% 90386375 / 87849980 / +2.9% 0.66 / 0.68 / -2.8%
tpch_q20/datafusion:parquet 68020736 / 69226368 / -1.7% 95129806 / 91714057 / +3.7% 0.72 / 0.75 / -5.3%
tpch_q21/datafusion:parquet 108150360 / 108773908 / -0.6% 133764794 / 131917843 / +1.4% 0.81 / 0.82 / -1.9%
tpch_q22/datafusion:parquet 47717185 / 47251318 / +1.0% 66262843 / 64628991 / +2.5% 0.72 / 0.73 / -1.5%
duckdb / vortex-file-compressed / ns (0.990x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11133439 / 11067081 / +0.6% 20713482 / 22147216 / -6.5% 0.54 / 0.50 / +7.6%
tpch_q02/duckdb:vortex-file-compressed 17198772 / 17465819 / -1.5% 26464795 / 27424753 / -3.5% 0.65 / 0.64 / +2.0%
tpch_q03/duckdb:vortex-file-compressed 18384430 / 18449717 / -0.4% 34250208 / 37426158 / -8.5% 0.54 / 0.49 / +8.9%
tpch_q04/duckdb:vortex-file-compressed 16939490 / 17037125 / -0.6% 30998889 / 31764998 / -2.4% 0.55 / 0.54 / +1.9%
tpch_q05/duckdb:vortex-file-compressed 21815218 / 22133718 / -1.4% 36551660 / 38145726 / -4.2% 0.60 / 0.58 / +2.9%
tpch_q06/duckdb:vortex-file-compressed 5178414 / 6019186 / -14.0% 🟢 15078685 / 16651571 / -9.4% 0.34 / 0.36 / -5.0%
tpch_q07/duckdb:vortex-file-compressed 20495905 / 20440699 / +0.3% 37413902 / 37841025 / -1.1% 0.55 / 0.54 / +1.4%
tpch_q08/duckdb:vortex-file-compressed 23497827 / 23271179 / +1.0% 40219410 / 38984406 / +3.2% 0.58 / 0.60 / -2.1%
tpch_q09/duckdb:vortex-file-compressed 29231058 / 29442784 / -0.7% 52978983 / 49916673 / +6.1% 0.55 / 0.59 / -6.5%
tpch_q10/duckdb:vortex-file-compressed 28419543 / 27888497 / +1.9% 43315326 / 47813225 / -9.4% 0.66 / 0.58 / +12.5%
tpch_q11/duckdb:vortex-file-compressed 8669081 / 8927345 / -2.9% 14706345 / 14817283 / -0.7% 0.59 / 0.60 / -2.2%
tpch_q12/duckdb:vortex-file-compressed 16075795 / 16688463 / -3.7% 31339637 / 34564570 / -9.3% 0.51 / 0.48 / +6.2%
tpch_q13/duckdb:vortex-file-compressed 22164551 / 21985324 / +0.8% 41508781 / 42502997 / -2.3% 0.53 / 0.52 / +3.2%
tpch_q14/duckdb:vortex-file-compressed 12706719 / 13021964 / -2.4% 24392758 / 25558296 / -4.6% 0.52 / 0.51 / +2.2%
tpch_q15/duckdb:vortex-file-compressed 9165463 / 9527548 / -3.8% 20273554 / 18229332 / +11.2% 🔴 0.45 / 0.52 / -13.5%
tpch_q16/duckdb:vortex-file-compressed 18481453 / 18402331 / +0.4% 24357810 / 25076394 / -2.9% 0.76 / 0.73 / +3.4%
tpch_q17/duckdb:vortex-file-compressed 14536683 / 14526472 / +0.1% 37915531 / 32326788 / +17.3% 🔴 0.38 / 0.45 / -14.7%
tpch_q18/duckdb:vortex-file-compressed 25885708 / 24252089 / +6.7% 39535035 / 38379086 / +3.0% 0.65 / 0.63 / +3.6%
tpch_q19/duckdb:vortex-file-compressed 23676945 / 22884283 / +3.5% 37058634 / 35425050 / +4.6% 0.64 / 0.65 / -1.1%
tpch_q20/duckdb:vortex-file-compressed 16597415 / 17194175 / -3.5% 36234600 / 38455797 / -5.8% 0.46 / 0.45 / +2.4%
tpch_q21/duckdb:vortex-file-compressed 66181376 / 67267427 / -1.6% 81499766 / 83315713 / -2.2% 0.81 / 0.81 / +0.6%
tpch_q22/duckdb:vortex-file-compressed 12360225 / 12169510 / +1.6% 21452595 / 21892165 / -2.0% 0.58 / 0.56 / +3.6%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62963819 / 63086837 / -0.2% 71356433 / 68970216 / +3.5% 0.88 / 0.91 / -3.5%
tpch_q02/duckdb:parquet 37688979 / 38198944 / -1.3% 45674426 / 49764615 / -8.2% 0.83 / 0.77 / +7.5%
tpch_q03/duckdb:parquet 70783423 / 67924766 / +4.2% 81039490 / 77490569 / +4.6% 0.87 / 0.88 / -0.4%
tpch_q04/duckdb:parquet 49020821 / 46709317 / +4.9% 63961349 / 55621657 / +15.0% 🔴 0.77 / 0.84 / -8.7%
tpch_q05/duckdb:parquet 65594993 / 65766525 / -0.3% 76243248 / 75973684 / +0.4% 0.86 / 0.87 / -0.6%
tpch_q06/duckdb:parquet 21749673 / 21733890 / +0.1% 27798298 / 25682891 / +8.2% 0.78 / 0.85 / -7.5%
tpch_q07/duckdb:parquet 64913973 / 65386801 / -0.7% 74754524 / 76818962 / -2.7% 0.87 / 0.85 / +2.0%
tpch_q08/duckdb:parquet 80005639 / 80401977 / -0.5% 92526742 / 91446396 / +1.2% 0.86 / 0.88 / -1.7%
tpch_q09/duckdb:parquet 119982133 / 120408961 / -0.4% 133474274 / 133946340 / -0.4% 0.90 / 0.90 / -0.0%
tpch_q10/duckdb:parquet 119225053 / 119619949 / -0.3% 134983613 / 130703055 / +3.3% 0.88 / 0.92 / -3.5%
tpch_q11/duckdb:parquet 21282424 / 21245429 / +0.2% 25027161 / 25503614 / -1.9% 0.85 / 0.83 / +2.1%
tpch_q12/duckdb:parquet 44709296 / 44277583 / +1.0% 51559605 / 51131191 / +0.8% 0.87 / 0.87 / +0.1%
tpch_q13/duckdb:parquet 243901538 / 243560268 / +0.1% 254225152 / 252985860 / +0.5% 0.96 / 0.96 / -0.3%
tpch_q14/duckdb:parquet 47206942 / 47401593 / -0.4% 55977866 / 55521518 / +0.8% 0.84 / 0.85 / -1.2%
tpch_q15/duckdb:parquet 26468194 / 26602602 / -0.5% 33071286 / 32853271 / +0.7% 0.80 / 0.81 / -1.2%
tpch_q16/duckdb:parquet 51586942 / 52574463 / -1.9% 57838086 / 58571113 / -1.3% 0.89 / 0.90 / -0.6%
tpch_q17/duckdb:parquet 49012187 / 49277212 / -0.5% 58919384 / 58634542 / +0.5% 0.83 / 0.84 / -1.0%
tpch_q18/duckdb:parquet 95883023 / 98127818 / -2.3% 104529932 / 104672742 / -0.1% 0.92 / 0.94 / -2.2%
tpch_q19/duckdb:parquet 64931517 / 65138726 / -0.3% 74342207 / 74275525 / +0.1% 0.87 / 0.88 / -0.4%
tpch_q20/duckdb:parquet 61448854 / 61948492 / -0.8% 76258091 / 73724998 / +3.4% 0.81 / 0.84 / -4.1%
tpch_q21/duckdb:parquet 141704153 / 142290232 / -0.4% 152660010 / 151921545 / +0.5% 0.93 / 0.94 / -0.9%
tpch_q22/duckdb:parquet 51574118 / 54410344 / -5.2% 59465836 / 61518937 / -3.3% 0.87 / 0.88 / -1.9%
File Size Changes (5 files changed, -0.0% overall, 4↑ 1↓)
File Scale Format Base HEAD Change %
supplier.vortex 1.0 vortex-file-compressed 624.71 KB 624.84 KB +128 B +0.0%
customer.vortex 1.0 vortex-file-compressed 9.17 MB 9.17 MB +136 B +0.0%
orders.vortex 1.0 vortex-file-compressed 42.78 MB 42.78 MB +16 B +0.0%
lineitem.vortex 1.0 vortex-file-compressed 171.51 MB 171.51 MB +16 B +0.0%
region.vortex 1.0 vortex-file-compressed 6.52 KB 6.13 KB 392 B -5.9%

Totals:

  • vortex-file-compressed: 254.70 MB → 254.70 MB (-0.0%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Engines: DataFusion No clear signal (+0.9%, low confidence) · DuckDB No clear signal (-4.8%, environment too noisy confidence)
Vortex (geomean): hot 0.984x ➖ · cold 1.017x ➖
Parquet (geomean): hot 1.005x ➖ · cold 1.033x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 194902677 / 192053602 / +1.5% 539013228 / 539411315 / -0.1% 0.36 / 0.36 / +1.6%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10997728 / 10266252 / +7.1% 52153743 / 49715379 / +4.9% 0.21 / 0.21 / +2.1%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12298460 / 11713330 / +5.0% 51789066 / 52862122 / -2.0% 0.24 / 0.22 / +7.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23481986 / 22549275 / +4.1% 72372680 / 73540954 / -1.6% 0.32 / 0.31 / +5.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 17836386 / 18543684 / -3.8% 63903482 / 62580376 / +2.1% 0.28 / 0.30 / -5.8%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17553705 / 17934928 / -2.1% 65152528 / 65202785 / -0.1% 0.27 / 0.28 / -2.1%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40771983 / 40833176 / -0.1% 96458093 / 94850345 / +1.7% 0.42 / 0.43 / -1.8%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12110704 / 12051430 / +0.5% 47787976 / 48093204 / -0.6% 0.25 / 0.25 / +1.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11968508 / 11756688 / +1.8% 50099993 / 47996728 / +4.4% 0.24 / 0.24 / -2.5%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10054756 / 10149512 / -0.9% 39548695 / 37496859 / +5.5% 0.25 / 0.27 / -6.1%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 761772118 / 766725292 / -0.6% 974755320 / 967205951 / +0.8% 0.78 / 0.79 / -1.4%
clickbench-sorted_q24/datafusion:parquet 9358010 / 9284720 / +0.8% 74532942 / 74219488 / +0.4% 0.13 / 0.13 / +0.4%
clickbench-sorted_q26/datafusion:parquet 8952331 / 9074328 / -1.3% 76991120 / 75338357 / +2.2% 0.12 / 0.12 / -3.5%
clickbench-sorted_q36/datafusion:parquet 94388287 / 93753396 / +0.7% 176760881 / 174219807 / +1.5% 0.53 / 0.54 / -0.8%
clickbench-sorted_q37/datafusion:parquet 64580068 / 64304836 / +0.4% 138649741 / 132761987 / +4.4% 0.47 / 0.48 / -3.8%
clickbench-sorted_q38/datafusion:parquet 88094724 / 87810526 / +0.3% 168803443 / 165110274 / +2.2% 0.52 / 0.53 / -1.9%
clickbench-sorted_q39/datafusion:parquet 160714046 / 160052063 / +0.4% 242229561 / 241249621 / +0.4% 0.66 / 0.66 / +0.0%
clickbench-sorted_q40/datafusion:parquet 44806182 / 44317393 / +1.1% 118889084 / 118681850 / +0.2% 0.38 / 0.37 / +0.9%
clickbench-sorted_q41/datafusion:parquet 42327534 / 41951104 / +0.9% 115929012 / 111712234 / +3.8% 0.37 / 0.38 / -2.8%
clickbench-sorted_q42/datafusion:parquet 26336438 / 25987996 / +1.3% 90713468 / 87313879 / +3.9% 0.29 / 0.30 / -2.5%
duckdb / vortex-file-compressed / ns (0.957x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 61292958 / 55711562 / +10.0% 🔴 91711735 / 96302129 / -4.8% 0.67 / 0.58 / +15.5%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18744420 / 22523583 / -16.8% 🟢 33994195 / 33618436 / +1.1% 0.55 / 0.67 / -17.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 15187861 / 16731198 / -9.2% 27392079 / 29639196 / -7.6% 0.55 / 0.56 / -1.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29137309 / 28932747 / +0.7% 66735892 / 64472797 / +3.5% 0.44 / 0.45 / -2.7%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23849501 / 23588247 / +1.1% 55633340 / 51563802 / +7.9% 0.43 / 0.46 / -6.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed 24748317 / 30149804 / -17.9% 🟢 59797231 / 60050338 / -0.4% 0.41 / 0.50 / -17.6%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48155611 / 48237740 / -0.2% 103188602 / 99337299 / +3.9% 0.47 / 0.49 / -3.9%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15563119 / 16827282 / -7.5% 46063981 / 38412655 / +19.9% 🔴 0.34 / 0.44 / -22.9%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15362438 / 15616864 / -1.6% 40190943 / 39327474 / +2.2% 0.38 / 0.40 / -3.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12271293 / 12040854 / +1.9% 30130950 / 30982295 / -2.7% 0.41 / 0.39 / +4.8%
duckdb / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 122856484 / 127507804 / -3.6% 154876018 / 139912790 / +10.7% 🔴 0.79 / 0.91 / -13.0%
clickbench-sorted_q24/duckdb:parquet 18562401 / 17884596 / +3.8% 30759860 / 30235672 / +1.7% 0.60 / 0.59 / +2.0%
clickbench-sorted_q26/duckdb:parquet 13591658 / 12358866 / +10.0% 27657541 / 23179380 / +19.3% 🔴 0.49 / 0.53 / -7.8%
clickbench-sorted_q36/duckdb:parquet 42579970 / 44860146 / -5.1% 65748946 / 64702690 / +1.6% 0.65 / 0.69 / -6.6%
clickbench-sorted_q37/duckdb:parquet 31190696 / 31154766 / +0.1% 52755300 / 50131041 / +5.2% 0.59 / 0.62 / -4.9%
clickbench-sorted_q38/duckdb:parquet 38175107 / 41209774 / -7.4% 64498352 / 63322327 / +1.9% 0.59 / 0.65 / -9.1%
clickbench-sorted_q39/duckdb:parquet 72623636 / 72693996 / -0.1% 93142779 / 95965603 / -2.9% 0.78 / 0.76 / +2.9%
clickbench-sorted_q40/duckdb:parquet 16921564 / 16682490 / +1.4% 44130004 / 42430935 / +4.0% 0.38 / 0.39 / -2.5%
clickbench-sorted_q41/duckdb:parquet 16907062 / 16362416 / +3.3% 42540178 / 40801109 / +4.3% 0.40 / 0.40 / -0.9%
clickbench-sorted_q42/duckdb:parquet 11207461 / 10752238 / +4.2% 23811992 / 23082054 / +3.2% 0.47 / 0.47 / +1.0%
File Size Changes (100 files changed, +0.1% overall, 67↑ 33↓)
File Scale Format Base HEAD Change %
hits_074.vortex 1.0 vortex-file-compressed 198.75 MB 201.16 MB +2.40 MB +1.2%
hits_029.vortex 1.0 vortex-file-compressed 199.43 MB 201.80 MB +2.37 MB +1.2%
hits_022.vortex 1.0 vortex-file-compressed 198.76 MB 200.94 MB +2.19 MB +1.1%
hits_055.vortex 1.0 vortex-file-compressed 200.59 MB 201.83 MB +1.24 MB +0.6%
hits_096.vortex 1.0 vortex-file-compressed 200.27 MB 201.50 MB +1.23 MB +0.6%
hits_018.vortex 1.0 vortex-file-compressed 200.71 MB 201.94 MB +1.23 MB +0.6%
hits_011.vortex 1.0 vortex-file-compressed 200.14 MB 201.36 MB +1.21 MB +0.6%
hits_033.vortex 1.0 vortex-file-compressed 200.91 MB 202.10 MB +1.19 MB +0.6%
hits_081.vortex 1.0 vortex-file-compressed 200.91 MB 202.04 MB +1.13 MB +0.6%
hits_085.vortex 1.0 vortex-file-compressed 200.58 MB 201.69 MB +1.10 MB +0.6%
hits_092.vortex 1.0 vortex-file-compressed 200.66 MB 201.58 MB +946.28 KB +0.5%
hits_048.vortex 1.0 vortex-file-compressed 200.69 MB 201.59 MB +925.52 KB +0.5%
hits_059.vortex 1.0 vortex-file-compressed 200.22 MB 201.11 MB +918.09 KB +0.4%
hits_007.vortex 1.0 vortex-file-compressed 201.22 MB 202.08 MB +876.92 KB +0.4%
hits_070.vortex 1.0 vortex-file-compressed 201.07 MB 201.93 MB +875.48 KB +0.4%
hits_044.vortex 1.0 vortex-file-compressed 201.18 MB 202.04 MB +874.47 KB +0.4%
hits_088.vortex 1.0 vortex-file-compressed 172.66 MB 173.19 MB +550.03 KB +0.3%
hits_014.vortex 1.0 vortex-file-compressed 172.81 MB 173.33 MB +533.23 KB +0.3%
hits_099.vortex 1.0 vortex-file-compressed 171.80 MB 172.31 MB +519.55 KB +0.3%
hits_080.vortex 1.0 vortex-file-compressed 126.70 MB 127.08 MB +382.82 KB +0.3%
hits_036.vortex 1.0 vortex-file-compressed 171.97 MB 172.42 MB +460.74 KB +0.3%
hits_025.vortex 1.0 vortex-file-compressed 172.28 MB 172.68 MB +403.57 KB +0.2%
hits_093.vortex 1.0 vortex-file-compressed 130.71 MB 130.99 MB +289.73 KB +0.2%
hits_068.vortex 1.0 vortex-file-compressed 160.15 MB 160.49 MB +344.32 KB +0.2%
hits_040.vortex 1.0 vortex-file-compressed 143.91 MB 144.19 MB +291.17 KB +0.2%
hits_077.vortex 1.0 vortex-file-compressed 172.96 MB 173.26 MB +312.38 KB +0.2%
hits_053.vortex 1.0 vortex-file-compressed 189.41 MB 189.73 MB +332.01 KB +0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.04 MB 102.21 MB +178.70 KB +0.2%
hits_008.vortex 1.0 vortex-file-compressed 139.30 MB 139.53 MB +233.30 KB +0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.21 MB 130.40 MB +202.49 KB +0.2%
hits_073.vortex 1.0 vortex-file-compressed 173.16 MB 173.42 MB +261.18 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.57 MB 180.82 MB +255.61 KB +0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.53 MB 189.77 MB +251.44 KB +0.1%
hits_075.vortex 1.0 vortex-file-compressed 189.07 MB 189.31 MB +237.18 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.18 MB 152.35 MB +175.17 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.43 MB 189.61 MB +182.50 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.22 MB 156.36 MB +145.92 KB +0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.65 MB 153.78 MB +132.53 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.86 MB 101.94 MB +87.31 KB +0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.14 MB 161.27 MB +135.88 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.11 MB 130.22 MB +108.62 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.06 MB 202.21 MB +154.98 KB +0.1%
hits_050.vortex 1.0 vortex-file-compressed 161.55 MB 161.66 MB +107.01 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.54 MB 161.64 MB +105.92 KB +0.1%
hits_006.vortex 1.0 vortex-file-compressed 126.56 MB 126.64 MB +81.09 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.75 MB 130.82 MB +73.23 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.16 MB 139.24 MB +77.64 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.03 MB 191.13 MB +105.24 KB +0.1%
hits_091.vortex 1.0 vortex-file-compressed 147.37 MB 147.44 MB +78.76 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.54 MB 130.60 MB +68.01 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.97 MB 131.04 MB +66.98 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.62 MB 161.70 MB +80.57 KB +0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.11 MB 159.18 MB +78.12 KB +0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.74 MB 100.79 MB +48.98 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.34 MB 161.41 MB +72.77 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.05 MB 135.11 MB +57.20 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.17 MB 147.23 MB +61.56 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.99 MB 154.05 MB +61.59 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.72 MB 181.79 MB +70.08 KB +0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.15 MB 167.21 MB +58.33 KB +0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.28 MB 147.33 MB +47.48 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.76 MB 191.81 MB +56.12 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.95 MB 153.99 MB +40.38 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.71 MB 161.75 MB +34.80 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.09 MB 131.12 MB +25.90 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.81 MB 153.84 MB +28.10 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.91 MB 161.92 MB +9.59 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.68 MB 126.68 MB 2.87 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.63 MB 192.62 MB 4.62 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.53 MB 130.53 MB 5.47 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.85 MB 142.84 MB 10.12 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.31 MB 130.31 MB 9.32 KB -0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.14 MB 101.13 MB 8.91 KB -0.0%
hits_045.vortex 1.0 vortex-file-compressed 139.16 MB 139.14 MB 24.42 KB -0.0%
hits_051.vortex 1.0 vortex-file-compressed 173.32 MB 173.28 MB 36.80 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.59 MB 190.54 MB 45.66 KB -0.0%
hits_071.vortex 1.0 vortex-file-compressed 139.38 MB 139.34 MB 36.20 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.07 MB 140.04 MB 37.23 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.66 MB 161.61 MB 53.30 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.81 MB 179.75 MB 63.58 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.93 MB 159.87 MB 60.70 KB -0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.06 MB 177.97 MB 97.86 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 171.75 MB 171.65 MB 100.17 KB -0.1%
hits_023.vortex 1.0 vortex-file-compressed 194.91 MB 194.79 MB 120.72 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.33 MB 158.23 MB 101.93 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.82 MB 130.71 MB 114.06 KB -0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.34 MB 130.23 MB 115.70 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.99 MB 137.87 MB 122.93 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.63 MB 136.50 MB 137.27 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.13 MB 192.93 MB 206.30 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 162.04 MB 161.83 MB 217.23 KB -0.1%
hits_020.vortex 1.0 vortex-file-compressed 160.08 MB 159.87 MB 220.15 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.98 MB 153.73 MB 252.51 KB -0.2%
hits_001.vortex 1.0 vortex-file-compressed 189.08 MB 188.76 MB 331.61 KB -0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.78 MB 190.45 MB 335.62 KB -0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.93 MB 130.66 MB 269.80 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 155.10 MB 154.50 MB 616.58 KB -0.4%
hits_066.vortex 1.0 vortex-file-compressed 164.13 MB 162.91 MB 1.22 MB -0.7%
hits_090.vortex 1.0 vortex-file-compressed 194.01 MB 192.44 MB 1.56 MB -0.8%
hits_010.vortex 1.0 vortex-file-compressed 168.84 MB 166.66 MB 2.18 MB -1.3%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.98 GB (+0.1%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -11.0%
Engines: DataFusion No clear signal (-3.8%, environment too noisy confidence) · DuckDB No clear signal (-17.7%, environment too noisy confidence)
Vortex (geomean): hot 0.839x ➖ · cold 0.853x ➖
Parquet (geomean): hot 0.943x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -5.7% · Median polish -4.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.914x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 46794841 / 51975320 / -10.0% 144510269 / 142283902 / +1.6% 0.32 / 0.37 / -11.4%
fineweb_q01/datafusion:vortex-file-compressed 400862773 / 423984611 / -5.5% 689253485 / 681176216 / +1.2% 0.58 / 0.62 / -6.6%
fineweb_q02/datafusion:vortex-file-compressed 412727782 / 389586946 / +5.9% 585252582 / 594832755 / -1.6% 0.71 / 0.65 / +7.7%
fineweb_q03/datafusion:vortex-file-compressed 844165302 / 466500044 / +81.0% 🔴 886150725 / 761018692 / +16.4% 0.95 / 0.61 / +55.4%
fineweb_q04/datafusion:vortex-file-compressed 444517151 / 401397127 / +10.7% 489425874 / 443939064 / +10.2% 0.91 / 0.90 / +0.5%
fineweb_q05/datafusion:vortex-file-compressed 399552375 / 456780090 / -12.5% 418284693 / 486436849 / -14.0% 0.96 / 0.94 / +1.7%
fineweb_q06/datafusion:vortex-file-compressed 1004975362 / 768843208 / +30.7% 🔴 1165418198 / 759902611 / +53.4% 🔴 0.86 / 1.01 / -14.8%
fineweb_q07/datafusion:vortex-file-compressed 436497627 / 874144576 / -50.1% 🟢 443470986 / 639895076 / -30.7% 🟢 0.98 / 1.37 / -27.9%
fineweb_q08/datafusion:vortex-file-compressed 173177744 / 402582349 / -57.0% 🟢 192597477 / 800484539 / -75.9% 🟢 0.90 / 0.50 / +78.8%
datafusion / parquet / ns (0.949x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 395559628 / 725686872 / -45.5% 🟢 724462202 / 720931636 / +0.5% 0.55 / 1.01 / -45.8%
fineweb_q01/datafusion:parquet 781808042 / 724732096 / +7.9% 750575243 / 706108644 / +6.3% 1.04 / 1.03 / +1.5%
fineweb_q02/datafusion:parquet 811976937 / 721763666 / +12.5% 926193998 / 643349526 / +44.0% 🔴 0.88 / 1.12 / -21.9%
fineweb_q03/datafusion:parquet 899406628 / 705659158 / +27.5% 770644389 / 655498553 / +17.6% 1.17 / 1.08 / +8.4%
fineweb_q04/datafusion:parquet 698700980 / 782644326 / -10.7% 624840692 / 771903928 / -19.1% 1.12 / 1.01 / +10.3%
fineweb_q05/datafusion:parquet 705609960 / 774173874 / -8.9% 754081994 / 776923519 / -2.9% 0.94 / 1.00 / -6.1%
fineweb_q06/datafusion:parquet 702201296 / 715840636 / -1.9% 791505143 / 715523053 / +10.6% 0.89 / 1.00 / -11.3%
fineweb_q07/datafusion:parquet 735386144 / 699009562 / +5.2% 839782092 / 716186559 / +17.3% 0.88 / 0.98 / -10.3%
fineweb_q08/datafusion:parquet 759958967 / 858653421 / -11.5% 780113469 / 1299341385 / -40.0% 🟢 0.97 / 0.66 / +47.4%
duckdb / vortex-file-compressed / ns (0.770x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 60429554 / 60830550 / -0.7% 56707353 / 51899953 / +9.3% 1.07 / 1.17 / -9.1%
fineweb_q01/duckdb:vortex-file-compressed 409462698 / 684897394 / -40.2% 🟢 556446782 / 545933076 / +1.9% 0.74 / 1.25 / -41.3%
fineweb_q02/duckdb:vortex-file-compressed 571400427 / 867603564 / -34.1% 🟢 596928319 / 855242982 / -30.2% 🟢 0.96 / 1.01 / -5.6%
fineweb_q03/duckdb:vortex-file-compressed 1005258516 / 1067379346 / -5.8% 1081210385 / 1128561600 / -4.2% 0.93 / 0.95 / -1.7%
fineweb_q04/duckdb:vortex-file-compressed 1084239744 / 1075527310 / +0.8% 1026124885 / 1041844104 / -1.5% 1.06 / 1.03 / +2.4%
fineweb_q05/duckdb:vortex-file-compressed 1192132216 / 922704773 / +29.2% 1118807168 / 973704332 / +14.9% 1.07 / 0.95 / +12.4%
fineweb_q06/duckdb:vortex-file-compressed 1204052199 / 1208543100 / -0.4% 1178886150 / 1199804695 / -1.7% 1.02 / 1.01 / +1.4%
fineweb_q07/duckdb:vortex-file-compressed 999915425 / 992804126 / +0.7% 1046999322 / 1059370755 / -1.2% 0.96 / 0.94 / +1.9%
fineweb_q08/duckdb:vortex-file-compressed 393408812 / 1992491310 / -80.3% 🟢 470908530 / 1938162199 / -75.7% 🟢 0.84 / 1.03 / -18.7%
duckdb / parquet / ns (0.936x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 498554104 / 521009394 / -4.3% 545932797 / 514302675 / +6.2% 0.91 / 1.01 / -9.9%
fineweb_q01/duckdb:parquet 617294613 / 594776574 / +3.8% 566997670 / 572087461 / -0.9% 1.09 / 1.04 / +4.7%
fineweb_q02/duckdb:parquet 535030262 / 736832094 / -27.4% 563850922 / 661382679 / -14.7% 0.95 / 1.11 / -14.8%
fineweb_q03/duckdb:parquet 1459909021 / 1483300592 / -1.6% 1323335172 / 1428762220 / -7.4% 1.10 / 1.04 / +6.3%
fineweb_q04/duckdb:parquet 741287023 / 855454748 / -13.3% 819288490 / 826630580 / -0.9% 0.90 / 1.03 / -12.6%
fineweb_q05/duckdb:parquet 859028270 / 912088205 / -5.8% 893612908 / 934123778 / -4.3% 0.96 / 0.98 / -1.5%
fineweb_q06/duckdb:parquet 1611892795 / 1755927811 / -8.2% 1552380105 / 1652631454 / -6.1% 1.04 / 1.06 / -2.3%
fineweb_q07/duckdb:parquet 1016416400 / 1081262690 / -6.0% 1056674860 / 1092889361 / -3.3% 0.96 / 0.99 / -2.8%
fineweb_q08/duckdb:parquet 563454452 / 511340504 / +10.2% 631028459 / 565487499 / +11.6% 0.89 / 0.90 / -1.3%

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-1.1%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.035x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.022x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1214666 / 1264968 / -4.0% 22443032 / 20543417 / +9.2% 0.05 / 0.06 / -12.1%
clickbench_q01/datafusion:vortex-file-compressed 5720570 / 5978129 / -4.3% 36697726 / 33685502 / +8.9% 0.16 / 0.18 / -12.2%
clickbench_q02/datafusion:vortex-file-compressed 10685916 / 10279396 / +4.0% 37432591 / 37452341 / -0.1% 0.29 / 0.27 / +4.0%
clickbench_q03/datafusion:vortex-file-compressed 11630582 / 11450357 / +1.6% 58877675 / 49723014 / +18.4% 🔴 0.20 / 0.23 / -14.2%
clickbench_q04/datafusion:vortex-file-compressed 58374514 / 58447390 / -0.1% 89055907 / 92743657 / -4.0% 0.66 / 0.63 / +4.0%
clickbench_q05/datafusion:vortex-file-compressed 77613578 / 72256583 / +7.4% 116854089 / 117854641 / -0.8% 0.66 / 0.61 / +8.3%
clickbench_q06/datafusion:vortex-file-compressed 1242361 / 1245722 / -0.3% 23823040 / 20394697 / +16.8% 🔴 0.05 / 0.06 / -14.6%
clickbench_q07/datafusion:vortex-file-compressed 9830858 / 9553254 / +2.9% 35592875 / 32880141 / +8.3% 0.28 / 0.29 / -4.9%
clickbench_q08/datafusion:vortex-file-compressed 79322648 / 76564540 / +3.6% 118124261 / 114206314 / +3.4% 0.67 / 0.67 / +0.2%
clickbench_q09/datafusion:vortex-file-compressed 168610477 / 171033566 / -1.4% 211468763 / 213850889 / -1.1% 0.80 / 0.80 / -0.3%
clickbench_q10/datafusion:vortex-file-compressed 23703947 / 23480505 / +1.0% 68838504 / 64894051 / +6.1% 0.34 / 0.36 / -4.8%
clickbench_q11/datafusion:vortex-file-compressed 26937054 / 27319092 / -1.4% 69622567 / 67953477 / +2.5% 0.39 / 0.40 / -3.8%
clickbench_q12/datafusion:vortex-file-compressed 73869446 / 72960008 / +1.2% 122532965 / 117141654 / +4.6% 0.60 / 0.62 / -3.2%
clickbench_q13/datafusion:vortex-file-compressed 117913267 / 117614588 / +0.3% 185168388 / 176697730 / +4.8% 0.64 / 0.67 / -4.3%
clickbench_q14/datafusion:vortex-file-compressed 77684216 / 74883936 / +3.7% 124921040 / 117747363 / +6.1% 0.62 / 0.64 / -2.2%
clickbench_q15/datafusion:vortex-file-compressed 61881042 / 61970957 / -0.1% 96083889 / 93917061 / +2.3% 0.64 / 0.66 / -2.4%
clickbench_q16/datafusion:vortex-file-compressed 150737237 / 150365374 / +0.2% 210206138 / 204765127 / +2.7% 0.72 / 0.73 / -2.3%
clickbench_q17/datafusion:vortex-file-compressed 150434199 / 146851505 / +2.4% 219389690 / 212332993 / +3.3% 0.69 / 0.69 / -0.9%
clickbench_q18/datafusion:vortex-file-compressed 298024803 / 298568573 / -0.2% 380962329 / 379170069 / +0.5% 0.78 / 0.79 / -0.7%
clickbench_q19/datafusion:vortex-file-compressed 7518540 / 7483262 / +0.5% 49417552 / 50098557 / -1.4% 0.15 / 0.15 / +1.9%
clickbench_q20/datafusion:vortex-file-compressed 61869146 / 60807012 / +1.7% 228631768 / 231796746 / -1.4% 0.27 / 0.26 / +3.2%
clickbench_q21/datafusion:vortex-file-compressed 87201305 / 87933320 / -0.8% 265292072 / 269227310 / -1.5% 0.33 / 0.33 / +0.6%
clickbench_q22/datafusion:vortex-file-compressed 94286267 / 103353294 / -8.8% 345798784 / 344600429 / +0.3% 0.27 / 0.30 / -9.1%
clickbench_q23/datafusion:vortex-file-compressed 211724866 / 197509650 / +7.2% 539531250 / 526444924 / +2.5% 0.39 / 0.38 / +4.6%
clickbench_q24/datafusion:vortex-file-compressed 15881273 / 16089670 / -1.3% 66807589 / 60923342 / +9.7% 0.24 / 0.26 / -10.0%
clickbench_q25/datafusion:vortex-file-compressed 17552390 / 18252264 / -3.8% 57090487 / 57270788 / -0.3% 0.31 / 0.32 / -3.5%
clickbench_q26/datafusion:vortex-file-compressed 16111110 / 16351458 / -1.5% 68589529 / 62852906 / +9.1% 0.23 / 0.26 / -9.7%
clickbench_q27/datafusion:vortex-file-compressed 99100362 / 98095538 / +1.0% 241892714 / 239832465 / +0.9% 0.41 / 0.41 / +0.2%
clickbench_q28/datafusion:vortex-file-compressed 559505819 / 565249990 / -1.0% 619952024 / 627042178 / -1.1% 0.90 / 0.90 / +0.1%
clickbench_q29/datafusion:vortex-file-compressed 23102639 / 23433523 / -1.4% 58014895 / 48721684 / +19.1% 🔴 0.40 / 0.48 / -17.2%
clickbench_q30/datafusion:vortex-file-compressed 58252582 / 59338193 / -1.8% 106194611 / 110465230 / -3.9% 0.55 / 0.54 / +2.1%
clickbench_q31/datafusion:vortex-file-compressed 70592370 / 69577681 / +1.5% 154874444 / 148511348 / +4.3% 0.46 / 0.47 / -2.7%
clickbench_q32/datafusion:vortex-file-compressed 307816522 / 308524475 / -0.2% 386062673 / 383783453 / +0.6% 0.80 / 0.80 / -0.8%
clickbench_q33/datafusion:vortex-file-compressed 333421728 / 323596106 / +3.0% 419847708 / 421352670 / -0.4% 0.79 / 0.77 / +3.4%
clickbench_q34/datafusion:vortex-file-compressed 328778298 / 331295406 / -0.8% 434633579 / 424085191 / +2.5% 0.76 / 0.78 / -3.2%
clickbench_q35/datafusion:vortex-file-compressed 54335183 / 55178666 / -1.5% 92976949 / 87612737 / +6.1% 0.58 / 0.63 / -7.2%
clickbench_q36/datafusion:vortex-file-compressed 36979188 / 37263372 / -0.8% 67108957 / 65512041 / +2.4% 0.55 / 0.57 / -3.1%
clickbench_q37/datafusion:vortex-file-compressed 21984866 / 21493334 / +2.3% 50075218 / 47334590 / +5.8% 0.44 / 0.45 / -3.3%
clickbench_q38/datafusion:vortex-file-compressed 11703992 / 11676367 / +0.2% 42386701 / 37922723 / +11.8% 🔴 0.28 / 0.31 / -10.3%
clickbench_q39/datafusion:vortex-file-compressed 77938348 / 77684833 / +0.3% 113293715 / 109786004 / +3.2% 0.69 / 0.71 / -2.8%
clickbench_q40/datafusion:vortex-file-compressed 11577330 / 11223540 / +3.2% 39658725 / 35534951 / +11.6% 🔴 0.29 / 0.32 / -7.6%
clickbench_q41/datafusion:vortex-file-compressed 10665864 / 10885915 / -2.0% 38847011 / 35236695 / +10.2% 🔴 0.27 / 0.31 / -11.1%
clickbench_q42/datafusion:vortex-file-compressed 10894417 / 10940712 / -0.4% 38360911 / 35443592 / +8.2% 0.28 / 0.31 / -8.0%
datafusion / parquet / ns (1.014x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1239542 / 1255637 / -1.3% 51402929 / 46916395 / +9.6% 0.02 / 0.03 / -9.9%
clickbench_q01/datafusion:parquet 16183326 / 15641626 / +3.5% 75368616 / 65972974 / +14.2% 🔴 0.21 / 0.24 / -9.4%
clickbench_q02/datafusion:parquet 18601996 / 19328174 / -3.8% 84246538 / 83002596 / +1.5% 0.22 / 0.23 / -5.2%
clickbench_q03/datafusion:parquet 26748750 / 17048584 / +56.9% 🔴 83725386 / 78720061 / +6.4% 0.32 / 0.22 / +47.5%
clickbench_q04/datafusion:parquet 63624984 / 64161676 / -0.8% 132180902 / 125199967 / +5.6% 0.48 / 0.51 / -6.1%
clickbench_q05/datafusion:parquet 89514346 / 88539130 / +1.1% 163804416 / 155660352 / +5.2% 0.55 / 0.57 / -3.9%
clickbench_q06/datafusion:parquet 1263602 / 1287186 / -1.8% 51562159 / 47638647 / +8.2% 0.02 / 0.03 / -9.3%
clickbench_q07/datafusion:parquet 16625826 / 16680610 / -0.3% 69817398 / 68300596 / +2.2% 0.24 / 0.24 / -2.5%
clickbench_q08/datafusion:parquet 88205414 / 84792438 / +4.0% 169094438 / 159477434 / +6.0% 0.52 / 0.53 / -1.9%
clickbench_q09/datafusion:parquet 190939729 / 188404342 / +1.3% 277611218 / 254615783 / +9.0% 0.69 / 0.74 / -7.0%
clickbench_q10/datafusion:parquet 36026113 / 37407628 / -3.7% 102621177 / 97357065 / +5.4% 0.35 / 0.38 / -8.6%
clickbench_q11/datafusion:parquet 42906902 / 42969331 / -0.1% 114020719 / 105393447 / +8.2% 0.38 / 0.41 / -7.7%
clickbench_q12/datafusion:parquet 96759962 / 96473668 / +0.3% 164520347 / 159796015 / +3.0% 0.59 / 0.60 / -2.6%
clickbench_q13/datafusion:parquet 148151420 / 149575320 / -1.0% 233598330 / 227028893 / +2.9% 0.63 / 0.66 / -3.7%
clickbench_q14/datafusion:parquet 101524935 / 101135396 / +0.4% 174569369 / 171125610 / +2.0% 0.58 / 0.59 / -1.6%
clickbench_q15/datafusion:parquet 70627584 / 72602015 / -2.7% 135419461 / 129752375 / +4.4% 0.52 / 0.56 / -6.8%
clickbench_q16/datafusion:parquet 156983912 / 156635833 / +0.2% 237061982 / 237918595 / -0.4% 0.66 / 0.66 / +0.6%
clickbench_q17/datafusion:parquet 159799639 / 156224682 / +2.3% 239061022 / 238576936 / +0.2% 0.67 / 0.65 / +2.1%
clickbench_q18/datafusion:parquet 323974912 / 314509670 / +3.0% 426042003 / 423028286 / +0.7% 0.76 / 0.74 / +2.3%
clickbench_q19/datafusion:parquet 19024244 / 19052976 / -0.2% 79621706 / 73964210 / +7.6% 0.24 / 0.26 / -7.2%
clickbench_q20/datafusion:parquet 179861948 / 178020798 / +1.0% 286314574 / 281007769 / +1.9% 0.63 / 0.63 / -0.8%
clickbench_q21/datafusion:parquet 176394362 / 176291616 / +0.1% 297281001 / 293381163 / +1.3% 0.59 / 0.60 / -1.3%
clickbench_q22/datafusion:parquet 262142338 / 260259676 / +0.7% 428058136 / 413442616 / +3.5% 0.61 / 0.63 / -2.7%
clickbench_q23/datafusion:parquet 1143456929 / 1102183092 / +3.7% 1240930354 / 1237504629 / +0.3% 0.92 / 0.89 / +3.5%
clickbench_q24/datafusion:parquet 30659664 / 29815131 / +2.8% 90640879 / 86666726 / +4.6% 0.34 / 0.34 / -1.7%
clickbench_q25/datafusion:parquet 36432389 / 36485442 / -0.1% 105343493 / 99848974 / +5.5% 0.35 / 0.37 / -5.4%
clickbench_q26/datafusion:parquet 30559466 / 31292471 / -2.3% 89633455 / 88148734 / +1.7% 0.34 / 0.35 / -4.0%
clickbench_q27/datafusion:parquet 197254532 / 196688188 / +0.3% 294959705 / 288775173 / +2.1% 0.67 / 0.68 / -1.8%
clickbench_q28/datafusion:parquet 624486716 / 626425299 / -0.3% 702109637 / 703317867 / -0.2% 0.89 / 0.89 / -0.1%
clickbench_q29/datafusion:parquet 29377264 / 28888224 / +1.7% 94312944 / 90982524 / +3.7% 0.31 / 0.32 / -1.9%
clickbench_q30/datafusion:parquet 90921714 / 91579306 / -0.7% 173876970 / 171566198 / +1.3% 0.52 / 0.53 / -2.0%
clickbench_q31/datafusion:parquet 103541886 / 103540813 / +0.0% 198851562 / 190316685 / +4.5% 0.52 / 0.54 / -4.3%
clickbench_q32/datafusion:parquet 328654736 / 320110285 / +2.7% 432502591 / 427209425 / +1.2% 0.76 / 0.75 / +1.4%
clickbench_q33/datafusion:parquet 382180894 / 384490202 / -0.6% 478989932 / 476413236 / +0.5% 0.80 / 0.81 / -1.1%
clickbench_q34/datafusion:parquet 386028736 / 384893132 / +0.3% 480928135 / 477312480 / +0.8% 0.80 / 0.81 / -0.5%
clickbench_q35/datafusion:parquet 64615045 / 63130183 / +2.4% 127613905 / 122674535 / +4.0% 0.51 / 0.51 / -1.6%
clickbench_q36/datafusion:parquet 73249041 / 73571310 / -0.4% 137116876 / 135417122 / +1.3% 0.53 / 0.54 / -1.7%
clickbench_q37/datafusion:parquet 35441089 / 35541609 / -0.3% 92244387 / 91078073 / +1.3% 0.38 / 0.39 / -1.5%
clickbench_q38/datafusion:parquet 48072594 / 47604350 / +1.0% 112169235 / 106050833 / +5.8% 0.43 / 0.45 / -4.5%
clickbench_q39/datafusion:parquet 143975933 / 144141286 / -0.1% 212858437 / 206216893 / +3.2% 0.68 / 0.70 / -3.2%
clickbench_q40/datafusion:parquet 20000012 / 20170159 / -0.8% 79549635 / 76865800 / +3.5% 0.25 / 0.26 / -4.2%
clickbench_q41/datafusion:parquet 18936560 / 18759956 / +0.9% 78246699 / 75487651 / +3.7% 0.24 / 0.25 / -2.6%
clickbench_q42/datafusion:parquet 19520926 / 19147706 / +1.9% 77494601 / 75271905 / +3.0% 0.25 / 0.25 / -1.0%
duckdb / vortex-file-compressed / ns (0.990x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1499305 / 1598942 / -6.2% 28159477 / 29119196 / -3.3% 0.05 / 0.05 / -3.0%
clickbench_q01/duckdb:vortex-file-compressed 15000870 / 14773100 / +1.5% 31220336 / 29410445 / +6.2% 0.48 / 0.50 / -4.3%
clickbench_q02/duckdb:vortex-file-compressed 12913499 / 12649782 / +2.1% 33565393 / 32001082 / +4.9% 0.38 / 0.40 / -2.7%
clickbench_q03/duckdb:vortex-file-compressed 17620554 / 17618837 / +0.0% 52039983 / 48160629 / +8.1% 0.34 / 0.37 / -7.4%
clickbench_q04/duckdb:vortex-file-compressed 68373575 / 68862850 / -0.7% 110480947 / 98186828 / +12.5% 🔴 0.62 / 0.70 / -11.8%
clickbench_q05/duckdb:vortex-file-compressed 68063690 / 66328206 / +2.6% 94405293 / 94914874 / -0.5% 0.72 / 0.70 / +3.2%
clickbench_q06/duckdb:vortex-file-compressed 1816141 / 1828508 / -0.7% 27332907 / 28167475 / -3.0% 0.07 / 0.06 / +2.4%
clickbench_q07/duckdb:vortex-file-compressed 13757012 / 13986509 / -1.6% 32099059 / 35550513 / -9.7% 0.43 / 0.39 / +8.9%
clickbench_q08/duckdb:vortex-file-compressed 87964100 / 82803234 / +6.2% 128547874 / 122302254 / +5.1% 0.68 / 0.68 / +1.1%
clickbench_q09/duckdb:vortex-file-compressed 113623910 / 112445058 / +1.0% 153956086 / 153129924 / +0.5% 0.74 / 0.73 / +0.5%
clickbench_q10/duckdb:vortex-file-compressed 33255756 / 32733034 / +1.6% 70017876 / 64166612 / +9.1% 0.47 / 0.51 / -6.9%
clickbench_q11/duckdb:vortex-file-compressed 36318446 / 35331944 / +2.8% 78119908 / 66224711 / +18.0% 🔴 0.46 / 0.53 / -12.9%
clickbench_q12/duckdb:vortex-file-compressed 76018680 / 78872336 / -3.6% 106828917 / 107307901 / -0.4% 0.71 / 0.74 / -3.2%
clickbench_q13/duckdb:vortex-file-compressed 133009746 / 137621369 / -3.4% 182782613 / 170383770 / +7.3% 0.73 / 0.81 / -9.9%
clickbench_q14/duckdb:vortex-file-compressed 81302986 / 78928400 / +3.0% 110200110 / 117558211 / -6.3% 0.74 / 0.67 / +9.9%
clickbench_q15/duckdb:vortex-file-compressed 92672750 / 92900694 / -0.2% 134345741 / 127500045 / +5.4% 0.69 / 0.73 / -5.3%
clickbench_q16/duckdb:vortex-file-compressed 158767440 / 160428092 / -1.0% 217110922 / 204955429 / +5.9% 0.73 / 0.78 / -6.6%
clickbench_q17/duckdb:vortex-file-compressed 159840866 / 162246486 / -1.5% 210002859 / 206222362 / +1.8% 0.76 / 0.79 / -3.3%
clickbench_q18/duckdb:vortex-file-compressed 318670660 / 312546774 / +2.0% 375173982 / 377495964 / -0.6% 0.85 / 0.83 / +2.6%
clickbench_q19/duckdb:vortex-file-compressed 15465410 / 15768359 / -1.9% 41818860 / 39957093 / +4.7% 0.37 / 0.39 / -6.3%
clickbench_q20/duckdb:vortex-file-compressed 107021841 / 112348506 / -4.7% 192670942 / 191632190 / +0.5% 0.56 / 0.59 / -5.3%
clickbench_q21/duckdb:vortex-file-compressed 153145750 / 162144944 / -5.6% 298282418 / 290689122 / +2.6% 0.51 / 0.56 / -8.0%
clickbench_q22/duckdb:vortex-file-compressed 224168986 / 241333490 / -7.1% 460612723 / 421747452 / +9.2% 0.49 / 0.57 / -14.9%
clickbench_q23/duckdb:vortex-file-compressed 59966662 / 56768126 / +5.6% 108788650 / 98438538 / +10.5% 🔴 0.55 / 0.58 / -4.4%
clickbench_q24/duckdb:vortex-file-compressed 26799808 / 27912697 / -4.0% 43566243 / 44801980 / -2.8% 0.62 / 0.62 / -1.3%
clickbench_q25/duckdb:vortex-file-compressed 32271692 / 33465665 / -3.6% 56068298 / 54744241 / +2.4% 0.58 / 0.61 / -5.8%
clickbench_q26/duckdb:vortex-file-compressed 19383992 / 20273965 / -4.4% 35748932 / 34432509 / +3.8% 0.54 / 0.59 / -7.9%
clickbench_q27/duckdb:vortex-file-compressed 136627610 / 145306148 / -6.0% 248419667 / 238110546 / +4.3% 0.55 / 0.61 / -9.9%
clickbench_q28/duckdb:vortex-file-compressed 579592663 / 688144608 / -15.8% 🟢 692823486 / 659262286 / +5.1% 0.84 / 1.04 / -19.9%
clickbench_q29/duckdb:vortex-file-compressed 18143253 / 17734998 / +2.3% 39061648 / 40556146 / -3.7% 0.46 / 0.44 / +6.2%
clickbench_q30/duckdb:vortex-file-compressed 65745390 / 69124562 / -4.9% 116932716 / 106860393 / +9.4% 0.56 / 0.65 / -13.1%
clickbench_q31/duckdb:vortex-file-compressed 122391298 / 124506664 / -1.7% 215649908 / 175402242 / +22.9% 🔴 0.57 / 0.71 / -20.0%
clickbench_q32/duckdb:vortex-file-compressed 463252818 / 430330594 / +7.7% 554364337 / 480907129 / +15.3% 🔴 0.84 / 0.89 / -6.6%
clickbench_q33/duckdb:vortex-file-compressed 385346940 / 386709042 / -0.4% 500802458 / 490536397 / +2.1% 0.77 / 0.79 / -2.4%
clickbench_q34/duckdb:vortex-file-compressed 408003130 / 421683124 / -3.2% 527177184 / 527389378 / -0.0% 0.77 / 0.80 / -3.2%
clickbench_q35/duckdb:vortex-file-compressed 102294810 / 102960298 / -0.6% 136328510 / 134026870 / +1.7% 0.75 / 0.77 / -2.3%
clickbench_q36/duckdb:vortex-file-compressed 15506924 / 15583803 / -0.5% 33648017 / 34782422 / -3.3% 0.46 / 0.45 / +2.9%
clickbench_q37/duckdb:vortex-file-compressed 10990667 / 11327405 / -3.0% 27616180 / 29876504 / -7.6% 0.40 / 0.38 / +5.0%
clickbench_q38/duckdb:vortex-file-compressed 12836334 / 12434181 / +3.2% 28434458 / 31615113 / -10.1% 🟢 0.45 / 0.39 / +14.8%
clickbench_q39/duckdb:vortex-file-compressed 22368036 / 22109426 / +1.2% 38989027 / 41171191 / -5.3% 0.57 / 0.54 / +6.8%
clickbench_q40/duckdb:vortex-file-compressed 12299700 / 10708510 / +14.9% 🔴 28623338 / 27203338 / +5.2% 0.43 / 0.39 / +9.2%
clickbench_q41/duckdb:vortex-file-compressed 10752158 / 11905436 / -9.7% 27924446 / 28647513 / -2.5% 0.39 / 0.42 / -7.3%
clickbench_q42/duckdb:vortex-file-compressed 12119834 / 12232025 / -0.9% 27653460 / 28523995 / -3.1% 0.44 / 0.43 / +2.2%
duckdb / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10847720 / 10963072 / -1.1% 25519195 / 22214844 / +14.9% 🔴 0.43 / 0.49 / -13.9%
clickbench_q01/duckdb:parquet 9619288 / 9640147 / -0.2% 21655937 / 19929946 / +8.7% 0.44 / 0.48 / -8.2%
clickbench_q02/duckdb:parquet 14864770 / 14937716 / -0.5% 35634993 / 33329410 / +6.9% 0.42 / 0.45 / -6.9%
clickbench_q03/duckdb:parquet 16179206 / 15973016 / +1.3% 54967716 / 51488135 / +6.8% 0.29 / 0.31 / -5.1%
clickbench_q04/duckdb:parquet 69034860 / 69796655 / -1.1% 94666011 / 96475779 / -1.9% 0.73 / 0.72 / +0.8%
clickbench_q05/duckdb:parquet 79006286 / 79266578 / -0.3% 120173865 / 118579405 / +1.3% 0.66 / 0.67 / -1.7%
clickbench_q06/duckdb:parquet 15602619 / 15250982 / +2.3% 26223151 / 22125473 / +18.5% 🔴 0.59 / 0.69 / -13.7%
clickbench_q07/duckdb:parquet 10787450 / 10233272 / +5.4% 21675803 / 23739186 / -8.7% 0.50 / 0.43 / +15.5%
clickbench_q08/duckdb:parquet 85003046 / 83503848 / +1.8% 127989969 / 131511124 / -2.7% 0.66 / 0.63 / +4.6%
clickbench_q09/duckdb:parquet 115358137 / 113632086 / +1.5% 157232753 / 152113657 / +3.4% 0.73 / 0.75 / -1.8%
clickbench_q10/duckdb:parquet 33030910 / 32120540 / +2.8% 69749696 / 68175375 / +2.3% 0.47 / 0.47 / +0.5%
clickbench_q11/duckdb:parquet 37111686 / 38395452 / -3.3% 76459371 / 76950509 / -0.6% 0.49 / 0.50 / -2.7%
clickbench_q12/duckdb:parquet 89688088 / 93488756 / -4.1% 134501814 / 132159210 / +1.8% 0.67 / 0.71 / -5.7%
clickbench_q13/duckdb:parquet 152933630 / 144337705 / +6.0% 215596690 / 216035656 / -0.2% 0.71 / 0.67 / +6.2%
clickbench_q14/duckdb:parquet 94155779 / 95718644 / -1.6% 144579779 / 143101277 / +1.0% 0.65 / 0.67 / -2.6%
clickbench_q15/duckdb:parquet 91602850 / 92691628 / -1.2% 124808532 / 119527560 / +4.4% 0.73 / 0.78 / -5.4%
clickbench_q16/duckdb:parquet 167236720 / 168256384 / -0.6% 238235834 / 236659630 / +0.7% 0.70 / 0.71 / -1.3%
clickbench_q17/duckdb:parquet 171981958 / 186557140 / -7.8% 231004450 / 230932524 / +0.0% 0.74 / 0.81 / -7.8%
clickbench_q18/duckdb:parquet 322800639 / 325087813 / -0.7% 402540366 / 398863478 / +0.9% 0.80 / 0.82 / -1.6%
clickbench_q19/duckdb:parquet 13371358 / 13158270 / +1.6% 40465314 / 45602318 / -11.3% 🟢 0.33 / 0.29 / +14.5%
clickbench_q20/duckdb:parquet 133074034 / 134463822 / -1.0% 240526137 / 246841463 / -2.6% 0.55 / 0.54 / +1.6%
clickbench_q21/duckdb:parquet 175973441 / 184776014 / -4.8% 318518328 / 332379630 / -4.2% 0.55 / 0.56 / -0.6%
clickbench_q22/duckdb:parquet 234736890 / 240823580 / -2.5% 417139189 / 407919185 / +2.3% 0.56 / 0.59 / -4.7%
clickbench_q23/duckdb:parquet 142964210 / 146263228 / -2.3% 166619810 / 186453441 / -10.6% 🟢 0.86 / 0.78 / +9.4%
clickbench_q24/duckdb:parquet 42740856 / 43050846 / -0.7% 60103413 / 60001832 / +0.2% 0.71 / 0.72 / -0.9%
clickbench_q25/duckdb:parquet 39412980 / 40768384 / -3.3% 91478788 / 91489219 / -0.0% 0.43 / 0.45 / -3.3%
clickbench_q26/duckdb:parquet 30644750 / 30305596 / +1.1% 48228223 / 47938791 / +0.6% 0.64 / 0.63 / +0.5%
clickbench_q27/duckdb:parquet 142607390 / 145041848 / -1.7% 260155337 / 262074457 / -0.7% 0.55 / 0.55 / -1.0%
clickbench_q28/duckdb:parquet 897514091 / 903380108 / -0.6% 1008318901 / 989154373 / +1.9% 0.89 / 0.91 / -2.5%
clickbench_q29/duckdb:parquet 16637580 / 17339760 / -4.0% 30664427 / 29916562 / +2.5% 0.54 / 0.58 / -6.4%
clickbench_q30/duckdb:parquet 91039447 / 89806517 / +1.4% 179364007 / 173772679 / +3.2% 0.51 / 0.52 / -1.8%
clickbench_q31/duckdb:parquet 144107570 / 147872303 / -2.5% 268281577 / 292604341 / -8.3% 0.54 / 0.51 / +6.3%
clickbench_q32/duckdb:parquet 444606192 / 467166003 / -4.8% 533208938 / 500457899 / +6.5% 0.83 / 0.93 / -10.7%
clickbench_q33/duckdb:parquet 437436798 / 454676802 / -3.8% 455425894 / 476288603 / -4.4% 0.96 / 0.95 / +0.6%
clickbench_q34/duckdb:parquet 450573022 / 463721232 / -2.8% 518267880 / 489514680 / +5.9% 0.87 / 0.95 / -8.2%
clickbench_q35/duckdb:parquet 99740979 / 103225058 / -3.4% 124705709 / 121195887 / +2.9% 0.80 / 0.85 / -6.1%
clickbench_q36/duckdb:parquet 31742607 / 31654555 / +0.3% 41080102 / 42188193 / -2.6% 0.77 / 0.75 / +3.0%
clickbench_q37/duckdb:parquet 22996583 / 23151008 / -0.7% 31961791 / 32438728 / -1.5% 0.72 / 0.71 / +0.8%
clickbench_q38/duckdb:parquet 24444048 / 24416120 / +0.1% 34129728 / 33627252 / +1.5% 0.72 / 0.73 / -1.4%
clickbench_q39/duckdb:parquet 56226832 / 56988020 / -1.3% 67418041 / 65673925 / +2.7% 0.83 / 0.87 / -3.9%
clickbench_q40/duckdb:parquet 12641654 / 12430775 / +1.7% 22660210 / 21851135 / +3.7% 0.56 / 0.57 / -1.9%
clickbench_q41/duckdb:parquet 12906342 / 13082368 / -1.3% 21984336 / 22228978 / -1.1% 0.59 / 0.59 / -0.2%
clickbench_q42/duckdb:parquet 14305540 / 14460946 / -1.1% 23420248 / 25205855 / -7.1% 0.61 / 0.57 / +6.5%
File Size Changes (99 files changed, +0.1% overall, 85↑ 14↓)
File Scale Format Base HEAD Change %
hits_35.vortex 1.0 vortex-file-compressed 119.39 MB 121.27 MB +1.88 MB +1.6%
hits_43.vortex 1.0 vortex-file-compressed 232.11 MB 235.60 MB +3.49 MB +1.5%
hits_41.vortex 1.0 vortex-file-compressed 228.73 MB 231.89 MB +3.15 MB +1.4%
hits_42.vortex 1.0 vortex-file-compressed 227.69 MB 230.49 MB +2.80 MB +1.2%
hits_77.vortex 1.0 vortex-file-compressed 172.87 MB 174.81 MB +1.94 MB +1.1%
hits_44.vortex 1.0 vortex-file-compressed 191.26 MB 193.29 MB +2.03 MB +1.1%
hits_29.vortex 1.0 vortex-file-compressed 61.81 MB 62.19 MB +392.62 KB +0.6%
hits_4.vortex 1.0 vortex-file-compressed 111.55 MB 112.17 MB +633.27 KB +0.6%
hits_88.vortex 1.0 vortex-file-compressed 113.91 MB 114.49 MB +600.20 KB +0.5%
hits_86.vortex 1.0 vortex-file-compressed 71.03 MB 71.22 MB +190.33 KB +0.3%
hits_75.vortex 1.0 vortex-file-compressed 64.66 MB 64.77 MB +111.23 KB +0.2%
hits_76.vortex 1.0 vortex-file-compressed 117.15 MB 117.34 MB +192.33 KB +0.2%
hits_2.vortex 1.0 vortex-file-compressed 191.95 MB 192.24 MB +296.71 KB +0.2%
hits_33.vortex 1.0 vortex-file-compressed 58.81 MB 58.88 MB +75.59 KB +0.1%
hits_7.vortex 1.0 vortex-file-compressed 95.45 MB 95.55 MB +96.21 KB +0.1%
hits_99.vortex 1.0 vortex-file-compressed 127.94 MB 128.05 MB +121.54 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 81.95 MB 82.02 MB +77.61 KB +0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.75 MB 28.77 MB +21.87 KB +0.1%
hits_11.vortex 1.0 vortex-file-compressed 83.69 MB 83.74 MB +55.98 KB +0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.90 MB 122.97 MB +71.52 KB +0.1%
hits_47.vortex 1.0 vortex-file-compressed 41.95 MB 41.97 MB +23.26 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 103.74 MB 103.79 MB +53.65 KB +0.1%
hits_0.vortex 1.0 vortex-file-compressed 91.02 MB 91.06 MB +46.53 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 120.47 MB 120.52 MB +50.79 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 71.32 MB 71.35 MB +29.10 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 89.21 MB 89.25 MB +36.16 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 105.52 MB 105.56 MB +42.60 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 102.21 MB 102.25 MB +38.12 KB +0.0%
hits_36.vortex 1.0 vortex-file-compressed 70.03 MB 70.05 MB +23.13 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 188.24 MB 188.30 MB +61.40 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 143.29 MB 143.34 MB +43.78 KB +0.0%
hits_58.vortex 1.0 vortex-file-compressed 92.40 MB 92.42 MB +27.57 KB +0.0%
hits_56.vortex 1.0 vortex-file-compressed 126.92 MB 126.95 MB +34.85 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 96.10 MB 96.13 MB +26.34 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 109.80 MB 109.83 MB +28.52 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 143.98 MB 144.01 MB +37.23 KB +0.0%
hits_26.vortex 1.0 vortex-file-compressed 111.64 MB 111.66 MB +28.53 KB +0.0%
hits_62.vortex 1.0 vortex-file-compressed 122.23 MB 122.26 MB +30.30 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 122.65 MB 122.67 MB +29.02 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 96.77 MB 96.79 MB +22.12 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 100.59 MB 100.61 MB +21.45 KB +0.0%
hits_31.vortex 1.0 vortex-file-compressed 92.30 MB 92.32 MB +19.29 KB +0.0%
hits_55.vortex 1.0 vortex-file-compressed 173.90 MB 173.93 MB +34.99 KB +0.0%
hits_15.vortex 1.0 vortex-file-compressed 91.20 MB 91.22 MB +18.16 KB +0.0%
hits_60.vortex 1.0 vortex-file-compressed 108.73 MB 108.75 MB +20.95 KB +0.0%
hits_52.vortex 1.0 vortex-file-compressed 107.27 MB 107.29 MB +20.49 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 103.90 MB 103.92 MB +18.98 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 145.83 MB 145.85 MB +26.10 KB +0.0%
hits_78.vortex 1.0 vortex-file-compressed 167.44 MB 167.47 MB +28.95 KB +0.0%
hits_6.vortex 1.0 vortex-file-compressed 94.80 MB 94.81 MB +15.97 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 94.31 MB 94.33 MB +15.55 KB +0.0%
hits_14.vortex 1.0 vortex-file-compressed 113.62 MB 113.64 MB +17.47 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 90.48 MB 90.50 MB +13.80 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 183.47 MB 183.49 MB +26.36 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 282.30 MB 282.34 MB +38.36 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 142.30 MB 142.32 MB +17.11 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 108.37 MB 108.39 MB +12.63 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 95.37 MB 95.37 MB +8.94 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 185.87 MB 185.88 MB +14.23 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 131.86 MB 131.87 MB +10.05 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 76.46 MB 76.46 MB +5.27 KB +0.0%
hits_64.vortex 1.0 vortex-file-compressed 83.40 MB 83.41 MB +5.75 KB +0.0%
hits_72.vortex 1.0 vortex-file-compressed 88.41 MB 88.41 MB +5.73 KB +0.0%
hits_8.vortex 1.0 vortex-file-compressed 94.66 MB 94.67 MB +4.80 KB +0.0%
hits_13.vortex 1.0 vortex-file-compressed 100.73 MB 100.73 MB +5.02 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 106.13 MB 106.14 MB +5.23 KB +0.0%
hits_82.vortex 1.0 vortex-file-compressed 102.22 MB 102.23 MB +4.69 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 68.72 MB 68.73 MB +2.93 KB +0.0%
hits_25.vortex 1.0 vortex-file-compressed 117.26 MB 117.26 MB +4.01 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 80.65 MB 80.65 MB +2.39 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 102.71 MB 102.72 MB +2.83 KB +0.0%
hits_17.vortex 1.0 vortex-file-compressed 91.91 MB 91.91 MB +2.38 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 119.93 MB 119.93 MB +2.63 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 93.53 MB 93.53 MB +1.95 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 120.82 MB 120.83 MB +2.19 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 125.83 MB 125.83 MB +2.23 KB +0.0%
hits_73.vortex 1.0 vortex-file-compressed 113.32 MB 113.32 MB +1.54 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 101.79 MB 101.79 MB +1.11 KB +0.0%
hits_34.vortex 1.0 vortex-file-compressed 100.90 MB 100.90 MB +656 B +0.0%
hits_53.vortex 1.0 vortex-file-compressed 88.39 MB 88.39 MB +336 B +0.0%
hits_20.vortex 1.0 vortex-file-compressed 64.29 MB 64.29 MB +224 B +0.0%
hits_79.vortex 1.0 vortex-file-compressed 148.70 MB 148.70 MB +440 B +0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.41 MB 122.41 MB +272 B +0.0%
hits_85.vortex 1.0 vortex-file-compressed 95.04 MB 95.04 MB +96 B +0.0%
hits_24.vortex 1.0 vortex-file-compressed 76.74 MB 76.74 MB +8 B +0.0%
hits_87.vortex 1.0 vortex-file-compressed 176.84 MB 176.84 MB 160 B -0.0%
hits_54.vortex 1.0 vortex-file-compressed 225.88 MB 225.88 MB 672 B -0.0%
hits_12.vortex 1.0 vortex-file-compressed 103.73 MB 103.73 MB 312 B -0.0%
hits_22.vortex 1.0 vortex-file-compressed 77.65 MB 77.65 MB 288 B -0.0%
hits_10.vortex 1.0 vortex-file-compressed 72.07 MB 72.07 MB 304 B -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.21 MB 77.21 MB 552 B -0.0%
hits_49.vortex 1.0 vortex-file-compressed 78.38 MB 78.38 MB 624 B -0.0%
hits_3.vortex 1.0 vortex-file-compressed 147.09 MB 147.09 MB 1.16 KB -0.0%
hits_97.vortex 1.0 vortex-file-compressed 111.46 MB 111.38 MB 79.45 KB -0.1%
hits_98.vortex 1.0 vortex-file-compressed 121.51 MB 121.18 MB 332.88 KB -0.3%
hits_92.vortex 1.0 vortex-file-compressed 153.24 MB 151.66 MB 1.58 MB -1.0%
hits_66.vortex 1.0 vortex-file-compressed 93.24 MB 92.28 MB 983.59 KB -1.0%
hits_68.vortex 1.0 vortex-file-compressed 127.52 MB 126.11 MB 1.41 MB -1.1%
hits_89.vortex 1.0 vortex-file-compressed 188.22 MB 183.45 MB 4.76 MB -2.5%

Totals:

  • vortex-file-compressed: 11.31 GB → 11.32 GB (+0.1%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.002x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.996x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24623686 / 24704816 / -0.3% 44699707 / 45177397 / -1.1% 0.55 / 0.55 / +0.7%
tpcds_q02/datafusion:vortex-file-compressed 44896932 / 45693870 / -1.7% 63684804 / 62540364 / +1.8% 0.70 / 0.73 / -3.5%
tpcds_q03/datafusion:vortex-file-compressed 11921414 / 11631766 / +2.5% 29559457 / 29490280 / +0.2% 0.40 / 0.39 / +2.3%
tpcds_q04/datafusion:vortex-file-compressed 115110000 / 112866406 / +2.0% 144972886 / 145166427 / -0.1% 0.79 / 0.78 / +2.1%
tpcds_q05/datafusion:vortex-file-compressed 59477776 / 61008321 / -2.5% 85590294 / 82356849 / +3.9% 0.69 / 0.74 / -6.2%
tpcds_q06/datafusion:vortex-file-compressed 23902414 / 23344857 / +2.4% 48179697 / 45610155 / +5.6% 0.50 / 0.51 / -3.1%
tpcds_q07/datafusion:vortex-file-compressed 32855359 / 33009009 / -0.5% 58595143 / 59481267 / -1.5% 0.56 / 0.55 / +1.0%
tpcds_q08/datafusion:vortex-file-compressed 25794662 / 25555546 / +0.9% 47391129 / 46768442 / +1.3% 0.54 / 0.55 / -0.4%
tpcds_q09/datafusion:vortex-file-compressed 17007148 / 16710408 / +1.8% 36728912 / 36265179 / +1.3% 0.46 / 0.46 / +0.5%
tpcds_q10/datafusion:vortex-file-compressed 28775852 / 28505580 / +0.9% 51751549 / 51900339 / -0.3% 0.56 / 0.55 / +1.2%
tpcds_q11/datafusion:vortex-file-compressed 62352808 / 62579417 / -0.4% 91866641 / 91652094 / +0.2% 0.68 / 0.68 / -0.6%
tpcds_q12/datafusion:vortex-file-compressed 16324985 / 16140294 / +1.1% 33667357 / 33918696 / -0.7% 0.48 / 0.48 / +1.9%
tpcds_q13/datafusion:vortex-file-compressed 34503950 / 34136447 / +1.1% 56499409 / 56199575 / +0.5% 0.61 / 0.61 / +0.5%
tpcds_q14/datafusion:vortex-file-compressed 90952543 / 92785148 / -2.0% 120057723 / 120823147 / -0.6% 0.76 / 0.77 / -1.4%
tpcds_q15/datafusion:vortex-file-compressed 23830364 / 24088198 / -1.1% 45639194 / 44918426 / +1.6% 0.52 / 0.54 / -2.6%
tpcds_q16/datafusion:vortex-file-compressed 20539622 / 21003858 / -2.2% 43052909 / 42946682 / +0.2% 0.48 / 0.49 / -2.5%
tpcds_q17/datafusion:vortex-file-compressed 62525572 / 54547155 / +14.6% 🔴 86173840 / 77795098 / +10.8% 🔴 0.73 / 0.70 / +3.5%
tpcds_q18/datafusion:vortex-file-compressed 68524860 / 69988466 / -2.1% 93129334 / 93070114 / +0.1% 0.74 / 0.75 / -2.2%
tpcds_q19/datafusion:vortex-file-compressed 18196682 / 18296618 / -0.5% 41628756 / 40615350 / +2.5% 0.44 / 0.45 / -3.0%
tpcds_q20/datafusion:vortex-file-compressed 17646103 / 17427654 / +1.3% 35858765 / 35693928 / +0.5% 0.49 / 0.49 / +0.8%
tpcds_q21/datafusion:vortex-file-compressed 17629910 / 16963105 / +3.9% 40871522 / 41600837 / -1.8% 0.43 / 0.41 / +5.8%
tpcds_q22/datafusion:vortex-file-compressed 49560688 / 49962076 / -0.8% 71625151 / 73744066 / -2.9% 0.69 / 0.68 / +2.1%
tpcds_q23/datafusion:vortex-file-compressed 72831354 / 73055689 / -0.3% 100491922 / 102212499 / -1.7% 0.72 / 0.71 / +1.4%
tpcds_q24/datafusion:vortex-file-compressed 71079352 / 71425531 / -0.5% 96500338 / 96809567 / -0.3% 0.74 / 0.74 / -0.2%
tpcds_q25/datafusion:vortex-file-compressed 51032003 / 55876886 / -8.7% 85429481 / 84252552 / +1.4% 0.60 / 0.66 / -9.9%
tpcds_q26/datafusion:vortex-file-compressed 30927912 / 30644151 / +0.9% 52336402 / 54321267 / -3.7% 0.59 / 0.56 / +4.8%
tpcds_q27/datafusion:vortex-file-compressed 64552090 / 63132814 / +2.2% 94506255 / 89507999 / +5.6% 0.68 / 0.71 / -3.2%
tpcds_q28/datafusion:vortex-file-compressed 18002394 / 17924506 / +0.4% 39068369 / 38482212 / +1.5% 0.46 / 0.47 / -1.1%
tpcds_q29/datafusion:vortex-file-compressed 53997610 / 53741500 / +0.5% 87468063 / 87856889 / -0.4% 0.62 / 0.61 / +0.9%
tpcds_q30/datafusion:vortex-file-compressed 27802396 / 27884750 / -0.3% 48615423 / 47426183 / +2.5% 0.57 / 0.59 / -2.7%
tpcds_q31/datafusion:vortex-file-compressed 65419014 / 64227292 / +1.9% 93742421 / 95234955 / -1.6% 0.70 / 0.67 / +3.5%
tpcds_q32/datafusion:vortex-file-compressed 13820580 / 13616872 / +1.5% 31594655 / 31376941 / +0.7% 0.44 / 0.43 / +0.8%
tpcds_q33/datafusion:vortex-file-compressed 27110149 / 27261694 / -0.6% 50141943 / 49694795 / +0.9% 0.54 / 0.55 / -1.4%
tpcds_q34/datafusion:vortex-file-compressed 18319288 / 18199060 / +0.7% 39430264 / 38156829 / +3.3% 0.46 / 0.48 / -2.6%
tpcds_q35/datafusion:vortex-file-compressed 35554202 / 35703424 / -0.4% 60995823 / 57046943 / +6.9% 0.58 / 0.63 / -6.9%
tpcds_q36/datafusion:vortex-file-compressed 47717589 / 48952294 / -2.5% 71515584 / 71774553 / -0.4% 0.67 / 0.68 / -2.2%
tpcds_q37/datafusion:vortex-file-compressed 13600401 / 12689658 / +7.2% 38098854 / 35745265 / +6.6% 0.36 / 0.36 / +0.6%
tpcds_q38/datafusion:vortex-file-compressed 30196156 / 29772047 / +1.4% 53982162 / 53857755 / +0.2% 0.56 / 0.55 / +1.2%
tpcds_q39/datafusion:vortex-file-compressed 66271742 / 65176666 / +1.7% 90774236 / 89615794 / +1.3% 0.73 / 0.73 / +0.4%
tpcds_q40/datafusion:vortex-file-compressed 24935004 / 25471280 / -2.1% 47914907 / 46564028 / +2.9% 0.52 / 0.55 / -4.9%
tpcds_q41/datafusion:vortex-file-compressed 16430994 / 16357310 / +0.5% 31436474 / 33242585 / -5.4% 0.52 / 0.49 / +6.2%
tpcds_q42/datafusion:vortex-file-compressed 11332030 / 11488484 / -1.4% 29766555 / 28485281 / +4.5% 0.38 / 0.40 / -5.6%
tpcds_q43/datafusion:vortex-file-compressed 13601178 / 13035314 / +4.3% 33766692 / 32972348 / +2.4% 0.40 / 0.40 / +1.9%
tpcds_q44/datafusion:vortex-file-compressed 26392218 / 25941288 / +1.7% 52117083 / 52483568 / -0.7% 0.51 / 0.49 / +2.5%
tpcds_q45/datafusion:vortex-file-compressed 27660946 / 27496556 / +0.6% 50259138 / 49229929 / +2.1% 0.55 / 0.56 / -1.5%
tpcds_q46/datafusion:vortex-file-compressed 24698790 / 24233322 / +1.9% 47859992 / 50516736 / -5.3% 0.52 / 0.48 / +7.6%
tpcds_q47/datafusion:vortex-file-compressed 78549723 / 77799984 / +1.0% 109673214 / 108060870 / +1.5% 0.72 / 0.72 / -0.5%
tpcds_q48/datafusion:vortex-file-compressed 31162840 / 32701500 / -4.7% 54120688 / 51418742 / +5.3% 0.58 / 0.64 / -9.5%
tpcds_q49/datafusion:vortex-file-compressed 59963130 / 60319361 / -0.6% 83343999 / 84503988 / -1.4% 0.72 / 0.71 / +0.8%
tpcds_q50/datafusion:vortex-file-compressed 34414102 / 34873510 / -1.3% 57253829 / 55246685 / +3.6% 0.60 / 0.63 / -4.8%
tpcds_q51/datafusion:vortex-file-compressed 61452078 / 60713816 / +1.2% 85143397 / 87860010 / -3.1% 0.72 / 0.69 / +4.4%
tpcds_q52/datafusion:vortex-file-compressed 11783936 / 12056280 / -2.3% 31343691 / 28689297 / +9.3% 0.38 / 0.42 / -10.5%
tpcds_q53/datafusion:vortex-file-compressed 18195302 / 19154354 / -5.0% 39096168 / 39874719 / -2.0% 0.47 / 0.48 / -3.1%
tpcds_q54/datafusion:vortex-file-compressed 33415664 / 34139688 / -2.1% 63672689 / 61563325 / +3.4% 0.52 / 0.55 / -5.4%
tpcds_q55/datafusion:vortex-file-compressed 11269373 / 11642300 / -3.2% 29287075 / 30186537 / -3.0% 0.38 / 0.39 / -0.2%
tpcds_q56/datafusion:vortex-file-compressed 26876470 / 27470051 / -2.2% 50818307 / 50952617 / -0.3% 0.53 / 0.54 / -1.9%
tpcds_q57/datafusion:vortex-file-compressed 74536786 / 73701154 / +1.1% 99728549 / 98842720 / +0.9% 0.75 / 0.75 / +0.2%
tpcds_q58/datafusion:vortex-file-compressed 40411830 / 41110322 / -1.7% 69228972 / 67878643 / +2.0% 0.58 / 0.61 / -3.6%
tpcds_q59/datafusion:vortex-file-compressed 32198366 / 32321862 / -0.4% 54529868 / 53902035 / +1.2% 0.59 / 0.60 / -1.5%
tpcds_q60/datafusion:vortex-file-compressed 27023234 / 26695174 / +1.2% 50020980 / 48585267 / +3.0% 0.54 / 0.55 / -1.7%
tpcds_q61/datafusion:vortex-file-compressed 25494274 / 24607048 / +3.6% 49926401 / 48287845 / +3.4% 0.51 / 0.51 / +0.2%
tpcds_q62/datafusion:vortex-file-compressed 17275883 / 17277092 / -0.0% 37526807 / 36982726 / +1.5% 0.46 / 0.47 / -1.5%
tpcds_q63/datafusion:vortex-file-compressed 18298796 / 18260788 / +0.2% 38739244 / 39994421 / -3.1% 0.47 / 0.46 / +3.5%
tpcds_q64/datafusion:vortex-file-compressed 324803920 / 323556608 / +0.4% 355805848 / 364810068 / -2.5% 0.91 / 0.89 / +2.9%
tpcds_q65/datafusion:vortex-file-compressed 75858661 / 75414830 / +0.6% 94582136 / 94358276 / +0.2% 0.80 / 0.80 / +0.4%
tpcds_q66/datafusion:vortex-file-compressed 53363404 / 53092654 / +0.5% 79692991 / 77540313 / +2.8% 0.67 / 0.68 / -2.2%
tpcds_q67/datafusion:vortex-file-compressed 55561308 / 55893374 / -0.6% 85074759 / 84201130 / +1.0% 0.65 / 0.66 / -1.6%
tpcds_q68/datafusion:vortex-file-compressed 24568757 / 24056062 / +2.1% 46824294 / 49089192 / -4.6% 0.52 / 0.49 / +7.1%
tpcds_q69/datafusion:vortex-file-compressed 28270294 / 27665884 / +2.2% 50997701 / 49615840 / +2.8% 0.55 / 0.56 / -0.6%
tpcds_q70/datafusion:vortex-file-compressed 71650864 / 71443461 / +0.3% 94291114 / 94885387 / -0.6% 0.76 / 0.75 / +0.9%
tpcds_q71/datafusion:vortex-file-compressed 19237522 / 19426098 / -1.0% 40362714 / 40633086 / -0.7% 0.48 / 0.48 / -0.3%
tpcds_q72/datafusion:vortex-file-compressed 457679948 / 462643088 / -1.1% 482216390 / 486437299 / -0.9% 0.95 / 0.95 / -0.2%
tpcds_q73/datafusion:vortex-file-compressed 17761230 / 17111953 / +3.8% 39100332 / 38548316 / +1.4% 0.45 / 0.44 / +2.3%
tpcds_q74/datafusion:vortex-file-compressed 45618470 / 45416210 / +0.4% 72066949 / 70376398 / +2.4% 0.63 / 0.65 / -1.9%
tpcds_q75/datafusion:vortex-file-compressed 132510540 / 132519418 / -0.0% 160415412 / 159733921 / +0.4% 0.83 / 0.83 / -0.4%
tpcds_q76/datafusion:vortex-file-compressed 42943905 / 43794408 / -1.9% 67248601 / 64985083 / +3.5% 0.64 / 0.67 / -5.2%
tpcds_q77/datafusion:vortex-file-compressed 34877222 / 34183614 / +2.0% 59293368 / 58810000 / +0.8% 0.59 / 0.58 / +1.2%
tpcds_q78/datafusion:vortex-file-compressed 80961176 / 80972030 / -0.0% 112980421 / 110631318 / +2.1% 0.72 / 0.73 / -2.1%
tpcds_q79/datafusion:vortex-file-compressed 21425485 / 21215684 / +1.0% 42821992 / 42824239 / -0.0% 0.50 / 0.50 / +1.0%
tpcds_q80/datafusion:vortex-file-compressed 76027552 / 78082080 / -2.6% 110040586 / 107754919 / +2.1% 0.69 / 0.72 / -4.7%
tpcds_q81/datafusion:vortex-file-compressed 27908658 / 28165836 / -0.9% 47125611 / 46583099 / +1.2% 0.59 / 0.60 / -2.1%
tpcds_q82/datafusion:vortex-file-compressed 13357916 / 13221401 / +1.0% 38965533 / 37164554 / +4.8% 0.34 / 0.36 / -3.6%
tpcds_q83/datafusion:vortex-file-compressed 35892440 / 35823302 / +0.2% 60164598 / 58739988 / +2.4% 0.60 / 0.61 / -2.2%
tpcds_q84/datafusion:vortex-file-compressed 11907885 / 12200784 / -2.4% 30040372 / 29851358 / +0.6% 0.40 / 0.41 / -3.0%
tpcds_q85/datafusion:vortex-file-compressed 59687091 / 60295129 / -1.0% 87096975 / 86218397 / +1.0% 0.69 / 0.70 / -2.0%
tpcds_q86/datafusion:vortex-file-compressed 16571024 / 16423910 / +0.9% 33516911 / 34070397 / -1.6% 0.49 / 0.48 / +2.6%
tpcds_q87/datafusion:vortex-file-compressed 29308580 / 29943530 / -2.1% 53337590 / 52951013 / +0.7% 0.55 / 0.57 / -2.8%
tpcds_q88/datafusion:vortex-file-compressed 34000536 / 34520806 / -1.5% 61823081 / 60558098 / +2.1% 0.55 / 0.57 / -3.5%
tpcds_q89/datafusion:vortex-file-compressed 21299684 / 21203026 / +0.5% 43276949 / 41652160 / +3.9% 0.49 / 0.51 / -3.3%
tpcds_q90/datafusion:vortex-file-compressed 10274700 / 10347418 / -0.7% 27066757 / 26469038 / +2.3% 0.38 / 0.39 / -2.9%
tpcds_q91/datafusion:vortex-file-compressed 16564394 / 16993723 / -2.5% 37398716 / 38212483 / -2.1% 0.44 / 0.44 / -0.4%
tpcds_q92/datafusion:vortex-file-compressed 13731352 / 13416198 / +2.3% 32888776 / 32248256 / +2.0% 0.42 / 0.42 / +0.4%
tpcds_q93/datafusion:vortex-file-compressed 23652352 / 23804080 / -0.6% 46700838 / 45929137 / +1.7% 0.51 / 0.52 / -2.3%
tpcds_q94/datafusion:vortex-file-compressed 20006130 / 19913281 / +0.5% 41156348 / 40610396 / +1.3% 0.49 / 0.49 / -0.9%
tpcds_q95/datafusion:vortex-file-compressed 45970904 / 46420608 / -1.0% 70443940 / 68036997 / +3.5% 0.65 / 0.68 / -4.4%
tpcds_q96/datafusion:vortex-file-compressed 9318020 / 9114928 / +2.2% 27062722 / 26559204 / +1.9% 0.34 / 0.34 / +0.3%
tpcds_q97/datafusion:vortex-file-compressed 21129648 / 21493136 / -1.7% 45389802 / 45340497 / +0.1% 0.47 / 0.47 / -1.8%
tpcds_q98/datafusion:vortex-file-compressed 16930188 / 16986553 / -0.3% 37701545 / 37341784 / +1.0% 0.45 / 0.45 / -1.3%
tpcds_q99/datafusion:vortex-file-compressed 19493664 / 19595916 / -0.5% 39424363 / 39969528 / -1.4% 0.49 / 0.49 / +0.9%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31713004 / 31967015 / -0.8% 49699499 / 48085755 / +3.4% 0.64 / 0.66 / -4.0%
tpcds_q02/datafusion:parquet 40318102 / 39937856 / +1.0% 59357811 / 60822150 / -2.4% 0.68 / 0.66 / +3.4%
tpcds_q03/datafusion:parquet 16343456 / 16340040 / +0.0% 32205987 / 33082858 / -2.7% 0.51 / 0.49 / +2.7%
tpcds_q04/datafusion:parquet 202595799 / 200871002 / +0.9% 230060399 / 233812617 / -1.6% 0.88 / 0.86 / +2.5%
tpcds_q05/datafusion:parquet 73099790 / 71418226 / +2.4% 96203996 / 97653815 / -1.5% 0.76 / 0.73 / +3.9%
tpcds_q06/datafusion:parquet 28629932 / 28234408 / +1.4% 52262011 / 49821013 / +4.9% 0.55 / 0.57 / -3.3%
tpcds_q07/datafusion:parquet 47151194 / 47104004 / +0.1% 71202773 / 70815885 / +0.5% 0.66 / 0.67 / -0.4%
tpcds_q08/datafusion:parquet 32328292 / 32239024 / +0.3% 51407946 / 51366391 / +0.1% 0.63 / 0.63 / +0.2%
tpcds_q09/datafusion:parquet 32358615 / 31092266 / +4.1% 44357494 / 45754680 / -3.1% 0.73 / 0.68 / +7.4%
tpcds_q10/datafusion:parquet 42602326 / 44541366 / -4.4% 62825607 / 61579520 / +2.0% 0.68 / 0.72 / -6.3%
tpcds_q11/datafusion:parquet 95197664 / 96530887 / -1.4% 123545423 / 122521140 / +0.8% 0.77 / 0.79 / -2.2%
tpcds_q12/datafusion:parquet 21792093 / 21867570 / -0.3% 38035083 / 37301226 / +2.0% 0.57 / 0.59 / -2.3%
tpcds_q13/datafusion:parquet 42197536 / 43056662 / -2.0% 69205482 / 69729001 / -0.8% 0.61 / 0.62 / -1.3%
tpcds_q14/datafusion:parquet 126610659 / 127108176 / -0.4% 153419218 / 150176026 / +2.2% 0.83 / 0.85 / -2.5%
tpcds_q15/datafusion:parquet 32354880 / 32647952 / -0.9% 52125713 / 51162148 / +1.9% 0.62 / 0.64 / -2.7%
tpcds_q16/datafusion:parquet 38343336 / 37153988 / +3.2% 56018454 / 57760942 / -3.0% 0.68 / 0.64 / +6.4%
tpcds_q17/datafusion:parquet 78038916 / 77492298 / +0.7% 104222708 / 105734520 / -1.4% 0.75 / 0.73 / +2.2%
tpcds_q18/datafusion:parquet 60650238 / 61133214 / -0.8% 80622110 / 82068480 / -1.8% 0.75 / 0.74 / +1.0%
tpcds_q19/datafusion:parquet 26348961 / 26567036 / -0.8% 46277248 / 46840883 / -1.2% 0.57 / 0.57 / +0.4%
tpcds_q20/datafusion:parquet 22453257 / 22911358 / -2.0% 38516937 / 38558086 / -0.1% 0.58 / 0.59 / -1.9%
tpcds_q21/datafusion:parquet 17702261 / 17892556 / -1.1% 33394071 / 33328812 / +0.2% 0.53 / 0.54 / -1.3%
tpcds_q22/datafusion:parquet 75101101 / 75781754 / -0.9% 90717008 / 91582738 / -0.9% 0.83 / 0.83 / +0.0%
tpcds_q23/datafusion:parquet 106079413 / 108675063 / -2.4% 139100057 / 139592464 / -0.4% 0.76 / 0.78 / -2.0%
tpcds_q24/datafusion:parquet 97425296 / 96361020 / +1.1% 125323583 / 125441144 / -0.1% 0.78 / 0.77 / +1.2%
tpcds_q25/datafusion:parquet 79027995 / 79030352 / -0.0% 105077033 / 106700679 / -1.5% 0.75 / 0.74 / +1.5%
tpcds_q26/datafusion:parquet 44067116 / 44491583 / -1.0% 63823634 / 64098733 / -0.4% 0.69 / 0.69 / -0.5%
tpcds_q27/datafusion:parquet 73905646 / 72934434 / +1.3% 100620349 / 102172823 / -1.5% 0.73 / 0.71 / +2.9%
tpcds_q28/datafusion:parquet 27443332 / 27962806 / -1.9% 46784199 / 46656639 / +0.3% 0.59 / 0.60 / -2.1%
tpcds_q29/datafusion:parquet 78336490 / 79952944 / -2.0% 102645453 / 107409497 / -4.4% 0.76 / 0.74 / +2.5%
tpcds_q30/datafusion:parquet 44622394 / 45392376 / -1.7% 64777742 / 64539256 / +0.4% 0.69 / 0.70 / -2.1%
tpcds_q31/datafusion:parquet 80170727 / 80973127 / -1.0% 102522225 / 105245096 / -2.6% 0.78 / 0.77 / +1.6%
tpcds_q32/datafusion:parquet 23440276 / 23716444 / -1.2% 41384494 / 41531413 / -0.4% 0.57 / 0.57 / -0.8%
tpcds_q33/datafusion:parquet 33912018 / 33248443 / +2.0% 53825448 / 53207656 / +1.2% 0.63 / 0.62 / +0.8%
tpcds_q34/datafusion:parquet 23659284 / 23390808 / +1.1% 38992149 / 40403013 / -3.5% 0.61 / 0.58 / +4.8%
tpcds_q35/datafusion:parquet 49520080 / 49732906 / -0.4% 69011496 / 73580785 / -6.2% 0.72 / 0.68 / +6.2%
tpcds_q36/datafusion:parquet 54320124 / 53277057 / +2.0% 73798840 / 75765538 / -2.6% 0.74 / 0.70 / +4.7%
tpcds_q37/datafusion:parquet 23451556 / 22850182 / +2.6% 38024041 / 39689755 / -4.2% 0.62 / 0.58 / +7.1%
tpcds_q38/datafusion:parquet 44245384 / 43864429 / +0.9% 67116266 / 65650496 / +2.2% 0.66 / 0.67 / -1.3%
tpcds_q39/datafusion:parquet 72476278 / 71786764 / +1.0% 91975054 / 90151713 / +2.0% 0.79 / 0.80 / -1.0%
tpcds_q40/datafusion:parquet 31177464 / 30020986 / +3.9% 50199964 / 52158897 / -3.8% 0.62 / 0.58 / +7.9%
tpcds_q41/datafusion:parquet 17425931 / 17838441 / -2.3% 29869597 / 31141999 / -4.1% 0.58 / 0.57 / +1.8%
tpcds_q42/datafusion:parquet 15515164 / 15796197 / -1.8% 30602576 / 32951436 / -7.1% 0.51 / 0.48 / +5.8%
tpcds_q43/datafusion:parquet 17272503 / 17493046 / -1.3% 33051277 / 34419000 / -4.0% 0.52 / 0.51 / +2.8%
tpcds_q44/datafusion:parquet 33266802 / 33238201 / +0.1% 53271115 / 54468621 / -2.2% 0.62 / 0.61 / +2.3%
tpcds_q45/datafusion:parquet 37129630 / 37734272 / -1.6% 55299434 / 57697326 / -4.2% 0.67 / 0.65 / +2.7%
tpcds_q46/datafusion:parquet 28201182 / 28881983 / -2.4% 50804451 / 51132045 / -0.6% 0.56 / 0.56 / -1.7%
tpcds_q47/datafusion:parquet 95465330 / 96243978 / -0.8% 124249817 / 125192517 / -0.8% 0.77 / 0.77 / -0.1%
tpcds_q48/datafusion:parquet 39190118 / 38686886 / +1.3% 60757498 / 60110300 / +1.1% 0.65 / 0.64 / +0.2%
tpcds_q49/datafusion:parquet 77287310 / 73519967 / +5.1% 104933968 / 99271552 / +5.7% 0.74 / 0.74 / -0.5%
tpcds_q50/datafusion:parquet 49553501 / 49424270 / +0.3% 74522081 / 74361554 / +0.2% 0.66 / 0.66 / +0.0%
tpcds_q51/datafusion:parquet 67465545 / 67996989 / -0.8% 92332567 / 91934885 / +0.4% 0.73 / 0.74 / -1.2%
tpcds_q52/datafusion:parquet 16083989 / 15866804 / +1.4% 31160415 / 32475599 / -4.0% 0.52 / 0.49 / +5.6%
tpcds_q53/datafusion:parquet 21896922 / 21984167 / -0.4% 39882705 / 39732445 / +0.4% 0.55 / 0.55 / -0.8%
tpcds_q54/datafusion:parquet 44925502 / 46325141 / -3.0% 67904935 / 65985979 / +2.9% 0.66 / 0.70 / -5.8%
tpcds_q55/datafusion:parquet 15448974 / 15560302 / -0.7% 29778658 / 31104350 / -4.3% 0.52 / 0.50 / +3.7%
tpcds_q56/datafusion:parquet 32095406 / 32307152 / -0.7% 56145624 / 55066299 / +2.0% 0.57 / 0.59 / -2.6%
tpcds_q57/datafusion:parquet 98376516 / 99436534 / -1.1% 123475068 / 123767782 / -0.2% 0.80 / 0.80 / -0.8%
tpcds_q58/datafusion:parquet 64496548 / 65366654 / -1.3% 89945176 / 89665407 / +0.3% 0.72 / 0.73 / -1.6%
tpcds_q59/datafusion:parquet 42683700 / 43159774 / -1.1% 63151244 / 63835214 / -1.1% 0.68 / 0.68 / -0.0%
tpcds_q60/datafusion:parquet 30703037 / 31978194 / -4.0% 54670002 / 56386224 / -3.0% 0.56 / 0.57 / -1.0%
tpcds_q61/datafusion:parquet 35170802 / 34839074 / +1.0% 57866552 / 58160955 / -0.5% 0.61 / 0.60 / +1.5%
tpcds_q62/datafusion:parquet 24143233 / 24135948 / +0.0% 40044857 / 39138051 / +2.3% 0.60 / 0.62 / -2.2%
tpcds_q63/datafusion:parquet 21955290 / 22057580 / -0.5% 39544598 / 40112737 / -1.4% 0.56 / 0.55 / +1.0%
tpcds_q64/datafusion:parquet 210371377 / 207359248 / +1.5% 236566999 / 237891856 / -0.6% 0.89 / 0.87 / +2.0%
tpcds_q65/datafusion:parquet 39089389 / 39190048 / -0.3% 60032475 / 60300517 / -0.4% 0.65 / 0.65 / +0.2%
tpcds_q66/datafusion:parquet 61753140 / 63209407 / -2.3% 79984342 / 79909823 / +0.1% 0.77 / 0.79 / -2.4%
tpcds_q67/datafusion:parquet 69930930 / 69226306 / +1.0% 96899469 / 95767322 / +1.2% 0.72 / 0.72 / -0.2%
tpcds_q68/datafusion:parquet 28766062 / 29347843 / -2.0% 52688155 / 51134564 / +3.0% 0.55 / 0.57 / -4.9%
tpcds_q69/datafusion:parquet 41402010 / 40975524 / +1.0% 60246551 / 59946864 / +0.5% 0.69 / 0.68 / +0.5%
tpcds_q70/datafusion:parquet 33096969 / 33177304 / -0.2% 55798772 / 55928686 / -0.2% 0.59 / 0.59 / -0.0%
tpcds_q71/datafusion:parquet 24094899 / 24192397 / -0.4% 41001187 / 40822633 / +0.4% 0.59 / 0.59 / -0.8%
tpcds_q72/datafusion:parquet 555060382 / 551821990 / +0.6% 586246649 / 586748534 / -0.1% 0.95 / 0.94 / +0.7%
tpcds_q73/datafusion:parquet 21501176 / 22939062 / -6.3% 39002848 / 39034309 / -0.1% 0.55 / 0.59 / -6.2%
tpcds_q74/datafusion:parquet 66565722 / 67787475 / -1.8% 89645755 / 87219056 / +2.8% 0.74 / 0.78 / -4.5%
tpcds_q75/datafusion:parquet 150506069 / 148596806 / +1.3% 178143521 / 174865350 / +1.9% 0.84 / 0.85 / -0.6%
tpcds_q76/datafusion:parquet 48710956 / 48210048 / +1.0% 64731052 / 64349790 / +0.6% 0.75 / 0.75 / +0.4%
tpcds_q77/datafusion:parquet 52600736 / 52364881 / +0.5% 77087658 / 75892725 / +1.6% 0.68 / 0.69 / -1.1%
tpcds_q78/datafusion:parquet 94111874 / 94959232 / -0.9% 123702750 / 124440942 / -0.6% 0.76 / 0.76 / -0.3%
tpcds_q79/datafusion:parquet 25621162 / 26143942 / -2.0% 47656757 / 46649897 / +2.2% 0.54 / 0.56 / -4.1%
tpcds_q80/datafusion:parquet 82973342 / 83640780 / -0.8% 115038669 / 111150629 / +3.5% 0.72 / 0.75 / -4.2%
tpcds_q81/datafusion:parquet 37905232 / 38975716 / -2.7% 61073393 / 61072628 / +0.0% 0.62 / 0.64 / -2.7%
tpcds_q82/datafusion:parquet 24764280 / 24766422 / -0.0% 42627589 / 40649146 / +4.9% 0.58 / 0.61 / -4.6%
tpcds_q83/datafusion:parquet 47591208 / 48282462 / -1.4% 69134897 / 67391262 / +2.6% 0.69 / 0.72 / -3.9%
tpcds_q84/datafusion:parquet 28877314 / 29340342 / -1.6% 43548845 / 48458291 / -10.1% 🟢 0.66 / 0.61 / +9.5%
tpcds_q85/datafusion:parquet 85547384 / 87271017 / -2.0% 110920252 / 108221336 / +2.5% 0.77 / 0.81 / -4.4%
tpcds_q86/datafusion:parquet 20715583 / 21176202 / -2.2% 34951883 / 34448683 / +1.5% 0.59 / 0.61 / -3.6%
tpcds_q87/datafusion:parquet 42463718 / 42314832 / +0.4% 63507915 / 63852730 / -0.5% 0.67 / 0.66 / +0.9%
tpcds_q88/datafusion:parquet 39741920 / 38668768 / +2.8% 57236090 / 63942447 / -10.5% 🟢 0.69 / 0.60 / +14.8%
tpcds_q89/datafusion:parquet 25134200 / 25129456 / +0.0% 43787706 / 43131576 / +1.5% 0.57 / 0.58 / -1.5%
tpcds_q90/datafusion:parquet 16014416 / 15614396 / +2.6% 32698506 / 31464351 / +3.9% 0.49 / 0.50 / -1.3%
tpcds_q91/datafusion:parquet 32209057 / 32198262 / +0.0% 52284401 / 51045337 / +2.4% 0.62 / 0.63 / -2.3%
tpcds_q92/datafusion:parquet 24057372 / 23819802 / +1.0% 41057539 / 40893625 / +0.4% 0.59 / 0.58 / +0.6%
tpcds_q93/datafusion:parquet 28157398 / 27844996 / +1.1% 50654444 / 47221329 / +7.3% 0.56 / 0.59 / -5.7%
tpcds_q94/datafusion:parquet 32245374 / 32020626 / +0.7% 51383936 / 50660777 / +1.4% 0.63 / 0.63 / -0.7%
tpcds_q95/datafusion:parquet 66037598 / 65128760 / +1.4% 83844755 / 82202442 / +2.0% 0.79 / 0.79 / -0.6%
tpcds_q96/datafusion:parquet 13032849 / 13138048 / -0.8% 28391058 / 28510828 / -0.4% 0.46 / 0.46 / -0.4%
tpcds_q97/datafusion:parquet 32120523 / 32583482 / -1.4% 53904123 / 53205134 / +1.3% 0.60 / 0.61 / -2.7%
tpcds_q98/datafusion:parquet 22619089 / 22811214 / -0.8% 39953265 / 38411566 / +4.0% 0.57 / 0.59 / -4.7%
tpcds_q99/datafusion:parquet 28977370 / 28719054 / +0.9% 43250862 / 43476865 / -0.5% 0.67 / 0.66 / +1.4%
duckdb / vortex-file-compressed / ns (0.988x ➖, 6↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 14958030 / 15581770 / -4.0% 22830940 / 23453165 / -2.7% 0.66 / 0.66 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed 14873177 / 15108431 / -1.6% 20232399 / 20557582 / -1.6% 0.74 / 0.73 / +0.0%
tpcds_q03/duckdb:vortex-file-compressed 11866656 / 14117311 / -15.9% 🟢 21997827 / 22592571 / -2.6% 0.54 / 0.62 / -13.7%
tpcds_q04/duckdb:vortex-file-compressed 50022914 / 50390175 / -0.7% 61054964 / 62039841 / -1.6% 0.82 / 0.81 / +0.9%
tpcds_q05/duckdb:vortex-file-compressed 18892056 / 18647316 / +1.3% 26701926 / 27356319 / -2.4% 0.71 / 0.68 / +3.8%
tpcds_q06/duckdb:vortex-file-compressed 26911075 / 26629704 / +1.1% 39536741 / 40498468 / -2.4% 0.68 / 0.66 / +3.5%
tpcds_q07/duckdb:vortex-file-compressed 16049259 / 16712817 / -4.0% 29676444 / 33661107 / -11.8% 🟢 0.54 / 0.50 / +8.9%
tpcds_q08/duckdb:vortex-file-compressed 18931208 / 18934726 / -0.0% 28322544 / 28283923 / +0.1% 0.67 / 0.67 / -0.2%
tpcds_q09/duckdb:vortex-file-compressed 13874932 / 13948212 / -0.5% 21777655 / 23382589 / -6.9% 0.64 / 0.60 / +6.8%
tpcds_q10/duckdb:vortex-file-compressed 27243200 / 28023151 / -2.8% 41386999 / 44827883 / -7.7% 0.66 / 0.63 / +5.3%
tpcds_q11/duckdb:vortex-file-compressed 40056418 / 40138676 / -0.2% 52320009 / 56487513 / -7.4% 0.77 / 0.71 / +7.7%
tpcds_q12/duckdb:vortex-file-compressed 11965020 / 10169046 / +17.7% 🔴 16599215 / 17035315 / -2.6% 0.72 / 0.60 / +20.8%
tpcds_q13/duckdb:vortex-file-compressed 21063934 / 23458212 / -10.2% 🟢 38340643 / 42289169 / -9.3% 0.55 / 0.55 / -1.0%
tpcds_q14/duckdb:vortex-file-compressed 58678700 / 58040228 / +1.1% 72442210 / 72816935 / -0.5% 0.81 / 0.80 / +1.6%
tpcds_q15/duckdb:vortex-file-compressed 20856106 / 20780874 / +0.4% 26903642 / 31948451 / -15.8% 🟢 0.78 / 0.65 / +19.2%
tpcds_q16/duckdb:vortex-file-compressed 17416889 / 18933322 / -8.0% 30502568 / 27281823 / +11.8% 🔴 0.57 / 0.69 / -17.7%
tpcds_q17/duckdb:vortex-file-compressed 29053540 / 30177420 / -3.7% 44972511 / 46183751 / -2.6% 0.65 / 0.65 / -1.1%
tpcds_q18/duckdb:vortex-file-compressed 28044424 / 28560454 / -1.8% 39176078 / 43393808 / -9.7% 0.72 / 0.66 / +8.8%
tpcds_q19/duckdb:vortex-file-compressed 24436938 / 23629594 / +3.4% 35212889 / 36208896 / -2.8% 0.69 / 0.65 / +6.3%
tpcds_q20/duckdb:vortex-file-compressed 10589652 / 10555944 / +0.3% 18066850 / 17767282 / +1.7% 0.59 / 0.59 / -1.3%
tpcds_q21/duckdb:vortex-file-compressed 9638304 / 11672315 / -17.4% 🟢 22189668 / 24451084 / -9.2% 0.43 / 0.48 / -9.0%
tpcds_q22/duckdb:vortex-file-compressed 29135059 / 29010972 / +0.4% 38574421 / 40452086 / -4.6% 0.76 / 0.72 / +5.3%
tpcds_q23/duckdb:vortex-file-compressed 36240326 / 36962132 / -2.0% 46931511 / 47515329 / -1.2% 0.77 / 0.78 / -0.7%
tpcds_q24/duckdb:vortex-file-compressed 28222186 / 28071563 / +0.5% 39901026 / 39658114 / +0.6% 0.71 / 0.71 / -0.1%
tpcds_q25/duckdb:vortex-file-compressed 24996803 / 25390380 / -1.6% 42537825 / 42786516 / -0.6% 0.59 / 0.59 / -1.0%
tpcds_q26/duckdb:vortex-file-compressed 13487174 / 15562195 / -13.3% 🟢 20028993 / 21043899 / -4.8% 0.67 / 0.74 / -8.9%
tpcds_q27/duckdb:vortex-file-compressed 17614651 / 18221493 / -3.3% 31571793 / 31965471 / -1.2% 0.56 / 0.57 / -2.1%
tpcds_q28/duckdb:vortex-file-compressed 13852836 / 11807777 / +17.3% 🔴 20492995 / 19490556 / +5.1% 0.68 / 0.61 / +11.6%
tpcds_q29/duckdb:vortex-file-compressed 28040285 / 28608162 / -2.0% 44006222 / 44788077 / -1.7% 0.64 / 0.64 / -0.2%
tpcds_q30/duckdb:vortex-file-compressed 21275299 / 19274308 / +10.4% 🔴 28496713 / 30562694 / -6.8% 0.75 / 0.63 / +18.4%
tpcds_q31/duckdb:vortex-file-compressed 19173786 / 19317326 / -0.7% 26985616 / 26872562 / +0.4% 0.71 / 0.72 / -1.2%
tpcds_q32/duckdb:vortex-file-compressed 10061495 / 10114054 / -0.5% 16479286 / 17010749 / -3.1% 0.61 / 0.59 / +2.7%
tpcds_q33/duckdb:vortex-file-compressed 16786724 / 16798120 / -0.1% 29516351 / 28339070 / +4.2% 0.57 / 0.59 / -4.1%
tpcds_q34/duckdb:vortex-file-compressed 15504330 / 15624082 / -0.8% 26554512 / 21592440 / +23.0% 🔴 0.58 / 0.72 / -19.3%
tpcds_q35/duckdb:vortex-file-compressed 45606055 / 46077409 / -1.0% 63319236 / 61032194 / +3.7% 0.72 / 0.75 / -4.6%
tpcds_q36/duckdb:vortex-file-compressed 15186672 / 17309698 / -12.3% 🟢 27798847 / 29337940 / -5.2% 0.55 / 0.59 / -7.4%
tpcds_q37/duckdb:vortex-file-compressed 13951974 / 13803930 / +1.1% 23364430 / 22825115 / +2.4% 0.60 / 0.60 / -1.3%
tpcds_q38/duckdb:vortex-file-compressed 22320150 / 22217107 / +0.5% 29373251 / 30440569 / -3.5% 0.76 / 0.73 / +4.1%
tpcds_q39/duckdb:vortex-file-compressed 18337369 / 20824465 / -11.9% 🟢 28147897 / 28492254 / -1.2% 0.65 / 0.73 / -10.9%
tpcds_q40/duckdb:vortex-file-compressed 13283101 / 13212288 / +0.5% 21721985 / 20190791 / +7.6% 0.61 / 0.65 / -6.6%
tpcds_q41/duckdb:vortex-file-compressed 6511546 / 6525300 / -0.2% 9192372 / 10019097 / -8.3% 0.71 / 0.65 / +8.8%
tpcds_q42/duckdb:vortex-file-compressed 8220466 / 8194456 / +0.3% 20559916 / 18305662 / +12.3% 🔴 0.40 / 0.45 / -10.7%
tpcds_q43/duckdb:vortex-file-compressed 9983970 / 10070818 / -0.9% 18297021 / 20947597 / -12.7% 🟢 0.55 / 0.48 / +13.5%
tpcds_q44/duckdb:vortex-file-compressed 15606194 / 15832826 / -1.4% 27238559 / 28997357 / -6.1% 0.57 / 0.55 / +4.9%
tpcds_q45/duckdb:vortex-file-compressed 22532511 / 22441842 / +0.4% 29953187 / 29827137 / +0.4% 0.75 / 0.75 / -0.0%
tpcds_q46/duckdb:vortex-file-compressed 18203594 / 18359032 / -0.8% 33226237 / 31977158 / +3.9% 0.55 / 0.57 / -4.6%
tpcds_q47/duckdb:vortex-file-compressed 31669246 / 32284622 / -1.9% 42443753 / 47721383 / -11.1% 🟢 0.75 / 0.68 / +10.3%
tpcds_q48/duckdb:vortex-file-compressed 19688670 / 19568732 / +0.6% 32539978 / 33244467 / -2.1% 0.61 / 0.59 / +2.8%
tpcds_q49/duckdb:vortex-file-compressed 16868074 / 16766392 / +0.6% 31280024 / 32014407 / -2.3% 0.54 / 0.52 / +3.0%
tpcds_q50/duckdb:vortex-file-compressed 16686173 / 18256934 / -8.6% 28869128 / 29515537 / -2.2% 0.58 / 0.62 / -6.6%
tpcds_q51/duckdb:vortex-file-compressed 63830891 / 65071110 / -1.9% 88104861 / 61961378 / +42.2% 🔴 0.72 / 1.05 / -31.0%
tpcds_q52/duckdb:vortex-file-compressed 8272912 / 8375452 / -1.2% 17855611 / 19015256 / -6.1% 0.46 / 0.44 / +5.2%
tpcds_q53/duckdb:vortex-file-compressed 14681056 / 14702470 / -0.1% 24546520 / 25741140 / -4.6% 0.60 / 0.57 / +4.7%
tpcds_q54/duckdb:vortex-file-compressed 20614837 / 20762111 / -0.7% 32996553 / 31228930 / +5.7% 0.62 / 0.66 / -6.0%
tpcds_q55/duckdb:vortex-file-compressed 8220158 / 8389346 / -2.0% 18173867 / 21059389 / -13.7% 🟢 0.45 / 0.40 / +13.5%
tpcds_q56/duckdb:vortex-file-compressed 17691220 / 17633340 / +0.3% 30300712 / 30465468 / -0.5% 0.58 / 0.58 / +0.9%
tpcds_q57/duckdb:vortex-file-compressed 25192760 / 24208057 / +4.1% 32458811 / 33473953 / -3.0% 0.78 / 0.72 / +7.3%
tpcds_q58/duckdb:vortex-file-compressed 18076753 / 17730908 / +2.0% 27281804 / 28634143 / -4.7% 0.66 / 0.62 / +7.0%
tpcds_q59/duckdb:vortex-file-compressed 18394882 / 19633719 / -6.3% 24790993 / 25092662 / -1.2% 0.74 / 0.78 / -5.2%
tpcds_q60/duckdb:vortex-file-compressed 17737127 / 18267716 / -2.9% 28831597 / 31321281 / -7.9% 0.62 / 0.58 / +5.5%
tpcds_q61/duckdb:vortex-file-compressed 19826802 / 19895408 / -0.3% 34108195 / 32317550 / +5.5% 0.58 / 0.62 / -5.6%
tpcds_q62/duckdb:vortex-file-compressed 10091644 / 10519588 / -4.1% 17506300 / 17164186 / +2.0% 0.58 / 0.61 / -5.9%
tpcds_q63/duckdb:vortex-file-compressed 13749763 / 13628496 / +0.9% 22468458 / 24405266 / -7.9% 0.61 / 0.56 / +9.6%
tpcds_q64/duckdb:vortex-file-compressed 62574802 / 62737522 / -0.3% 82939062 / 82767326 / +0.2% 0.75 / 0.76 / -0.5%
tpcds_q65/duckdb:vortex-file-compressed 16213708 / 15506167 / +4.6% 29220814 / 26705710 / +9.4% 0.55 / 0.58 / -4.4%
tpcds_q66/duckdb:vortex-file-compressed 21147636 / 21371932 / -1.0% 31007106 / 30923492 / +0.3% 0.68 / 0.69 / -1.3%
tpcds_q67/duckdb:vortex-file-compressed 65199366 / 66234884 / -1.6% 99244067 / 83156361 / +19.3% 🔴 0.66 / 0.80 / -17.5%
tpcds_q68/duckdb:vortex-file-compressed 18001294 / 18358911 / -1.9% 32707954 / 35733115 / -8.5% 0.55 / 0.51 / +7.1%
tpcds_q69/duckdb:vortex-file-compressed 28726330 / 28849356 / -0.4% 51402432 / 45488921 / +13.0% 🔴 0.56 / 0.63 / -11.9%
tpcds_q70/duckdb:vortex-file-compressed 18608084 / 18606254 / +0.0% 28712643 / 28084118 / +2.2% 0.65 / 0.66 / -2.2%
tpcds_q71/duckdb:vortex-file-compressed 12699970 / 12822909 / -1.0% 23302121 / 22556793 / +3.3% 0.55 / 0.57 / -4.1%
tpcds_q72/duckdb:vortex-file-compressed 60721909 / 61703068 / -1.6% 75586879 / 81653001 / -7.4% 0.80 / 0.76 / +6.3%
tpcds_q73/duckdb:vortex-file-compressed 15027375 / 14800789 / +1.5% 23472703 / 23423513 / +0.2% 0.64 / 0.63 / +1.3%
tpcds_q74/duckdb:vortex-file-compressed 27274238 / 27554189 / -1.0% 37569806 / 38996875 / -3.7% 0.73 / 0.71 / +2.7%
tpcds_q75/duckdb:vortex-file-compressed 28767386 / 29368002 / -2.0% 41344741 / 40508255 / +2.1% 0.70 / 0.72 / -4.0%
tpcds_q76/duckdb:vortex-file-compressed 12349846 / 12172534 / +1.5% 23825583 / 24635054 / -3.3% 0.52 / 0.49 / +4.9%
tpcds_q77/duckdb:vortex-file-compressed 16041258 / 16266398 / -1.4% 26061531 / 26078326 / -0.1% 0.62 / 0.62 / -1.3%
tpcds_q78/duckdb:vortex-file-compressed 38263757 / 37671414 / +1.6% 46770889 / 45427888 / +3.0% 0.82 / 0.83 / -1.3%
tpcds_q79/duckdb:vortex-file-compressed 14569877 / 15673241 / -7.0% 28538179 / 28506682 / +0.1% 0.51 / 0.55 / -7.1%
tpcds_q80/duckdb:vortex-file-compressed 27299668 / 27545791 / -0.9% 43329346 / 44602074 / -2.9% 0.63 / 0.62 / +2.0%
tpcds_q81/duckdb:vortex-file-compressed 22304262 / 22470146 / -0.7% 30819037 / 30225937 / +2.0% 0.72 / 0.74 / -2.6%
tpcds_q82/duckdb:vortex-file-compressed 32320821 / 32239004 / +0.3% 40437445 / 40277105 / +0.4% 0.80 / 0.80 / -0.1%
tpcds_q83/duckdb:vortex-file-compressed 19934876 / 20126508 / -1.0% 26238162 / 29493200 / -11.0% 🟢 0.76 / 0.68 / +11.3%
tpcds_q84/duckdb:vortex-file-compressed 12660494 / 12890775 / -1.8% 21988769 / 21736393 / +1.2% 0.58 / 0.59 / -2.9%
tpcds_q85/duckdb:vortex-file-compressed 30958474 / 31601490 / -2.0% 41413089 / 42195833 / -1.9% 0.75 / 0.75 / -0.2%
tpcds_q86/duckdb:vortex-file-compressed 10844668 / 11010326 / -1.5% 17226139 / 17633304 / -2.3% 0.63 / 0.62 / +0.8%
tpcds_q87/duckdb:vortex-file-compressed 24288741 / 24101558 / +0.8% 31080110 / 33748179 / -7.9% 0.78 / 0.71 / +9.4%
tpcds_q88/duckdb:vortex-file-compressed 32874352 / 32360512 / +1.6% 46511264 / 46110617 / +0.9% 0.71 / 0.70 / +0.7%
tpcds_q89/duckdb:vortex-file-compressed 13904158 / 14016132 / -0.8% 27578084 / 23961735 / +15.1% 🔴 0.50 / 0.58 / -13.8%
tpcds_q90/duckdb:vortex-file-compressed 8003410 / 8319089 / -3.8% 16530324 / 12814077 / +29.0% 🔴 0.48 / 0.65 / -25.4%
tpcds_q91/duckdb:vortex-file-compressed 15827192 / 15270618 / +3.6% 22342513 / 22045921 / +1.3% 0.71 / 0.69 / +2.3%
tpcds_q92/duckdb:vortex-file-compressed 13081136 / 13202099 / -0.9% 25148350 / 23069361 / +9.0% 0.52 / 0.57 / -9.1%
tpcds_q93/duckdb:vortex-file-compressed 16630900 / 17031442 / -2.4% 24919372 / 24198523 / +3.0% 0.67 / 0.70 / -5.2%
tpcds_q94/duckdb:vortex-file-compressed 16157644 / 16435748 / -1.7% 26175074 / 26438794 / -1.0% 0.62 / 0.62 / -0.7%
tpcds_q95/duckdb:vortex-file-compressed 44576300 / 43159716 / +3.3% 55854700 / 54712834 / +2.1% 0.80 / 0.79 / +1.2%
tpcds_q96/duckdb:vortex-file-compressed 7416002 / 7171068 / +3.4% 16530118 / 15185556 / +8.9% 0.45 / 0.47 / -5.0%
tpcds_q97/duckdb:vortex-file-compressed 22324046 / 22405853 / -0.4% 29012001 / 29967831 / -3.2% 0.77 / 0.75 / +2.9%
tpcds_q98/duckdb:vortex-file-compressed 13423506 / 13254438 / +1.3% 23092473 / 23044814 / +0.2% 0.58 / 0.58 / +1.1%
tpcds_q99/duckdb:vortex-file-compressed 13392918 / 13444962 / -0.4% 20564283 / 22235415 / -7.5% 0.65 / 0.60 / +7.7%
duckdb / parquet / ns (0.998x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24877258 / 25210900 / -1.3% 34060169 / 35064539 / -2.9% 0.73 / 0.72 / +1.6%
tpcds_q02/duckdb:parquet 15798924 / 16258037 / -2.8% 21810225 / 23998084 / -9.1% 0.72 / 0.68 / +6.9%
tpcds_q03/duckdb:parquet 9024920 / 12225538 / -26.2% 🟢 15604864 / 17789390 / -12.3% 🟢 0.58 / 0.69 / -15.8%
tpcds_q04/duckdb:parquet 129769442 / 130335396 / -0.4% 134567031 / 136418128 / -1.4% 0.96 / 0.96 / +0.9%
tpcds_q05/duckdb:parquet 21963688 / 22235480 / -1.2% 27539364 / 26430400 / +4.2% 0.80 / 0.84 / -5.2%
tpcds_q06/duckdb:parquet 26960566 / 27451294 / -1.8% 36270683 / 36282453 / -0.0% 0.74 / 0.76 / -1.8%
tpcds_q07/duckdb:parquet 17748834 / 15654190 / +13.4% 🔴 22654993 / 28427889 / -20.3% 🟢 0.78 / 0.55 / +42.3%
tpcds_q08/duckdb:parquet 25961780 / 26485422 / -2.0% 33856694 / 34079724 / -0.7% 0.77 / 0.78 / -1.3%
tpcds_q09/duckdb:parquet 19289685 / 18898205 / +2.1% 23316048 / 22928520 / +1.7% 0.83 / 0.82 / +0.4%
tpcds_q10/duckdb:parquet 27871095 / 31477348 / -11.5% 🟢 37830570 / 39391412 / -4.0% 0.74 / 0.80 / -7.8%
tpcds_q11/duckdb:parquet 72833423 / 73583882 / -1.0% 78259223 / 78089798 / +0.2% 0.93 / 0.94 / -1.2%
tpcds_q12/duckdb:parquet 13127478 / 13138739 / -0.1% 18559002 / 18756935 / -1.1% 0.71 / 0.70 / +1.0%
tpcds_q13/duckdb:parquet 25014510 / 24401021 / +2.5% 33859263 / 31509324 / +7.5% 0.74 / 0.77 / -4.6%
tpcds_q14/duckdb:parquet 61613836 / 62094631 / -0.8% 67328067 / 67770222 / -0.7% 0.92 / 0.92 / -0.1%
tpcds_q15/duckdb:parquet 25413705 / 25585942 / -0.7% 30177469 / 30224581 / -0.2% 0.84 / 0.85 / -0.5%
tpcds_q16/duckdb:parquet 20751756 / 21281487 / -2.5% 28811224 / 28930008 / -0.4% 0.72 / 0.74 / -2.1%
tpcds_q17/duckdb:parquet 33066572 / 33425006 / -1.1% 40583336 / 40109494 / +1.2% 0.81 / 0.83 / -2.2%
tpcds_q18/duckdb:parquet 40580639 / 41113322 / -1.3% 50677919 / 52957410 / -4.3% 0.80 / 0.78 / +3.1%
tpcds_q19/duckdb:parquet 25127583 / 25121444 / +0.0% 31869931 / 32429281 / -1.7% 0.79 / 0.77 / +1.8%
tpcds_q20/duckdb:parquet 13846552 / 13782726 / +0.5% 18732208 / 19411354 / -3.5% 0.74 / 0.71 / +4.1%
tpcds_q21/duckdb:parquet 9494802 / 9578169 / -0.9% 12117896 / 12905948 / -6.1% 0.78 / 0.74 / +5.6%
tpcds_q22/duckdb:parquet 35276746 / 36261570 / -2.7% 39347914 / 39589747 / -0.6% 0.90 / 0.92 / -2.1%
tpcds_q23/duckdb:parquet 41766732 / 41447848 / +0.8% 48208852 / 49998184 / -3.6% 0.87 / 0.83 / +4.5%
tpcds_q24/duckdb:parquet 33706980 / 34151323 / -1.3% 42429632 / 45427456 / -6.6% 0.79 / 0.75 / +5.7%
tpcds_q25/duckdb:parquet 31224619 / 31615478 / -1.2% 39456817 / 39651783 / -0.5% 0.79 / 0.80 / -0.7%
tpcds_q26/duckdb:parquet 31465627 / 31784840 / -1.0% 38264353 / 38551123 / -0.7% 0.82 / 0.82 / -0.3%
tpcds_q27/duckdb:parquet 32084888 / 31981271 / +0.3% 39939008 / 40078535 / -0.3% 0.80 / 0.80 / +0.7%
tpcds_q28/duckdb:parquet 17554006 / 17339625 / +1.2% 31758329 / 22212932 / +43.0% 🔴 0.55 / 0.78 / -29.2%
tpcds_q29/duckdb:parquet 31171052 / 31557696 / -1.2% 38642493 / 39631037 / -2.5% 0.81 / 0.80 / +1.3%
tpcds_q30/duckdb:parquet 34195084 / 34525734 / -1.0% 46098378 / 45454604 / +1.4% 0.74 / 0.76 / -2.3%
tpcds_q31/duckdb:parquet 20612884 / 21002049 / -1.9% 26109088 / 26668681 / -2.1% 0.79 / 0.79 / +0.3%
tpcds_q32/duckdb:parquet 12098182 / 12299742 / -1.6% 18062258 / 18459053 / -2.1% 0.67 / 0.67 / +0.5%
tpcds_q33/duckdb:parquet 16540267 / 16235494 / +1.9% 23504396 / 23372653 / +0.6% 0.70 / 0.69 / +1.3%
tpcds_q34/duckdb:parquet 18696591 / 16677356 / +12.1% 🔴 22014388 / 22314977 / -1.3% 0.85 / 0.75 / +13.6%
tpcds_q35/duckdb:parquet 48612827 / 47818500 / +1.7% 60903022 / 56888183 / +7.1% 0.80 / 0.84 / -5.0%
tpcds_q36/duckdb:parquet 15878398 / 16096770 / -1.4% 23450676 / 23550221 / -0.4% 0.68 / 0.68 / -0.9%
tpcds_q37/duckdb:parquet 12012382 / 11620782 / +3.4% 16965084 / 20081736 / -15.5% 🟢 0.71 / 0.58 / +22.4%
tpcds_q38/duckdb:parquet 26861019 / 27242780 / -1.4% 32951952 / 31234125 / +5.5% 0.82 / 0.87 / -6.5%
tpcds_q39/duckdb:parquet 24662331 / 24447796 / +0.9% 30760219 / 28108845 / +9.4% 0.80 / 0.87 / -7.8%
tpcds_q40/duckdb:parquet 16463996 / 16776556 / -1.9% 21353685 / 21425734 / -0.3% 0.77 / 0.78 / -1.5%
tpcds_q41/duckdb:parquet 7760294 / 7913870 / -1.9% 12589850 / 16117664 / -21.9% 🟢 0.62 / 0.49 / +25.5%
tpcds_q42/duckdb:parquet 8674015 / 8820670 / -1.7% 15257757 / 14924319 / +2.2% 0.57 / 0.59 / -3.8%
tpcds_q43/duckdb:parquet 10619637 / 10683511 / -0.6% 15077699 / 15135980 / -0.4% 0.70 / 0.71 / -0.2%
tpcds_q44/duckdb:parquet 16327780 / 15919624 / +2.6% 25802341 / 21109321 / +22.2% 🔴 0.63 / 0.75 / -16.1%
tpcds_q45/duckdb:parquet 23452172 / 23772788 / -1.3% 29599878 / 29194382 / +1.4% 0.79 / 0.81 / -2.7%
tpcds_q46/duckdb:parquet 36884880 / 37496280 / -1.6% 45364068 / 46101063 / -1.6% 0.81 / 0.81 / -0.0%
tpcds_q47/duckdb:parquet 31092958 / 37150606 / -16.3% 🟢 36970641 / 40653800 / -9.1% 0.84 / 0.91 / -8.0%
tpcds_q48/duckdb:parquet 21217706 / 21334146 / -0.5% 27443951 / 27941190 / -1.8% 0.77 / 0.76 / +1.3%
tpcds_q49/duckdb:parquet 20251244 / 20167309 / +0.4% 27683501 / 28209284 / -1.9% 0.73 / 0.71 / +2.3%
tpcds_q50/duckdb:parquet 17906584 / 18473668 / -3.1% 23654651 / 23821260 / -0.7% 0.76 / 0.78 / -2.4%
tpcds_q51/duckdb:parquet 53630612 / 53718526 / -0.2% 60289929 / 62221684 / -3.1% 0.89 / 0.86 / +3.0%
tpcds_q52/duckdb:parquet 10876566 / 8928711 / +21.8% 🔴 16082825 / 15664958 / +2.7% 0.68 / 0.57 / +18.7%
tpcds_q53/duckdb:parquet 11891027 / 11959340 / -0.6% 18283353 / 19805705 / -7.7% 0.65 / 0.60 / +7.7%
tpcds_q54/duckdb:parquet 20675016 / 20567038 / +0.5% 29707416 / 30061062 / -1.2% 0.70 / 0.68 / +1.7%
tpcds_q55/duckdb:parquet 8957714 / 8937466 / +0.2% 15967337 / 15559287 / +2.6% 0.56 / 0.57 / -2.3%
tpcds_q56/duckdb:parquet 17025086 / 17089008 / -0.4% 23740499 / 24402214 / -2.7% 0.72 / 0.70 / +2.4%
tpcds_q57/duckdb:parquet 29205262 / 29253840 / -0.2% 36054091 / 34685596 / +3.9% 0.81 / 0.84 / -4.0%
tpcds_q58/duckdb:parquet 18960588 / 20248228 / -6.4% 26449327 / 26772682 / -1.2% 0.72 / 0.76 / -5.2%
tpcds_q59/duckdb:parquet 20029336 / 20326734 / -1.5% 25646638 / 27803788 / -7.8% 0.78 / 0.73 / +6.8%
tpcds_q60/duckdb:parquet 17349755 / 17646092 / -1.7% 24367040 / 24913400 / -2.2% 0.71 / 0.71 / +0.5%
tpcds_q61/duckdb:parquet 22456985 / 22292512 / +0.7% 34391092 / 29375108 / +17.1% 🔴 0.65 / 0.76 / -14.0%
tpcds_q62/duckdb:parquet 10906664 / 10891160 / +0.1% 15056534 / 15145326 / -0.6% 0.72 / 0.72 / +0.7%
tpcds_q63/duckdb:parquet 11228474 / 11431351 / -1.8% 16492863 / 16988247 / -2.9% 0.68 / 0.67 / +1.2%
tpcds_q64/duckdb:parquet 56144714 / 53114618 / +5.7% 65481336 / 65472666 / +0.0% 0.86 / 0.81 / +5.7%
tpcds_q65/duckdb:parquet 14774438 / 14787766 / -0.1% 20819988 / 21074713 / -1.2% 0.71 / 0.70 / +1.1%
tpcds_q66/duckdb:parquet 24772145 / 25168540 / -1.6% 32901502 / 32295654 / +1.9% 0.75 / 0.78 / -3.4%
tpcds_q67/duckdb:parquet 76992342 / 77761970 / -1.0% 87414127 / 86097180 / +1.5% 0.88 / 0.90 / -2.5%
tpcds_q68/duckdb:parquet 30402512 / 30577612 / -0.6% 39850653 / 40440193 / -1.5% 0.76 / 0.76 / +0.9%
tpcds_q69/duckdb:parquet 29211863 / 29304568 / -0.3% 39209563 / 38901653 / +0.8% 0.75 / 0.75 / -1.1%
tpcds_q70/duckdb:parquet 16161220 / 16177888 / -0.1% 22888501 / 23348038 / -2.0% 0.71 / 0.69 / +1.9%
tpcds_q71/duckdb:parquet 15037966 / 15336206 / -1.9% 22028476 / 21806107 / +1.0% 0.68 / 0.70 / -2.9%
tpcds_q72/duckdb:parquet 81727066 / 81637718 / +0.1% 89874851 / 87112594 / +3.2% 0.91 / 0.94 / -3.0%
tpcds_q73/duckdb:parquet 14394491 / 13945122 / +3.2% 18970191 / 19470601 / -2.6% 0.76 / 0.72 / +5.9%
tpcds_q74/duckdb:parquet 100240990 / 100278092 / -0.0% 106348714 / 108392083 / -1.9% 0.94 / 0.93 / +1.9%
tpcds_q75/duckdb:parquet 40816828 / 41025722 / -0.5% 50833732 / 51270538 / -0.9% 0.80 / 0.80 / +0.3%
tpcds_q76/duckdb:parquet 13990780 / 14004308 / -0.1% 22692875 / 22231384 / +2.1% 0.62 / 0.63 / -2.1%
tpcds_q77/duckdb:parquet 17460280 / 17471878 / -0.1% 25699309 / 26564230 / -3.3% 0.68 / 0.66 / +3.3%
tpcds_q78/duckdb:parquet 48393228 / 48733156 / -0.7% 54107377 / 54702447 / -1.1% 0.89 / 0.89 / +0.4%
tpcds_q79/duckdb:parquet 21046810 / 21263570 / -1.0% 29333867 / 29256648 / +0.3% 0.72 / 0.73 / -1.3%
tpcds_q80/duckdb:parquet 32986814 / 33063043 / -0.2% 40053162 / 40761842 / -1.7% 0.82 / 0.81 / +1.5%
tpcds_q81/duckdb:parquet 34242871 / 31527690 / +8.6% 43703888 / 40295010 / +8.5% 0.78 / 0.78 / +0.1%
tpcds_q82/duckdb:parquet 13232570 / 13308511 / -0.6% 17696594 / 19779348 / -10.5% 🟢 0.75 / 0.67 / +11.1%
tpcds_q83/duckdb:parquet 16561386 / 16717095 / -0.9% 20650717 / 21895710 / -5.7% 0.80 / 0.76 / +5.0%
tpcds_q84/duckdb:parquet 18603152 / 18599864 / +0.0% 23634265 / 24293858 / -2.7% 0.79 / 0.77 / +2.8%
tpcds_q85/duckdb:parquet 35497696 / 35531999 / -0.1% 44952486 / 44983720 / -0.1% 0.79 / 0.79 / -0.0%
tpcds_q86/duckdb:parquet 11520514 / 11438665 / +0.7% 18888993 / 16642036 / +13.5% 🔴 0.61 / 0.69 / -11.3%
tpcds_q87/duckdb:parquet 28687071 / 28817630 / -0.5% 32719968 / 33130426 / -1.2% 0.88 / 0.87 / +0.8%
tpcds_q88/duckdb:parquet 27221569 / 26853166 / +1.4% 31694445 / 31058774 / +2.0% 0.86 / 0.86 / -0.7%
tpcds_q89/duckdb:parquet 13125582 / 13030337 / +0.7% 18960608 / 19025009 / -0.3% 0.69 / 0.68 / +1.1%
tpcds_q90/duckdb:parquet 7742033 / 7067298 / +9.5% 11138129 / 11312471 / -1.5% 0.70 / 0.62 / +11.3%
tpcds_q91/duckdb:parquet 22993348 / 22008236 / +4.5% 28040343 / 28621865 / -2.0% 0.82 / 0.77 / +6.6%
tpcds_q92/duckdb:parquet 13987386 / 12515406 / +11.8% 🔴 22864931 / 20085768 / +13.8% 🔴 0.61 / 0.62 / -1.8%
tpcds_q93/duckdb:parquet 21738701 / 22017456 / -1.3% 26850199 / 27370306 / -1.9% 0.81 / 0.80 / +0.6%
tpcds_q94/duckdb:parquet 17000048 / 17099202 / -0.6% 26423085 / 26822729 / -1.5% 0.64 / 0.64 / +0.9%
tpcds_q95/duckdb:parquet 91186320 / 91332595 / -0.2% 98691048 / 98519362 / +0.2% 0.92 / 0.93 / -0.3%
tpcds_q96/duckdb:parquet 7034209 / 7110925 / -1.1% 10677192 / 10802399 / -1.2% 0.66 / 0.66 / +0.1%
tpcds_q97/duckdb:parquet 26700090 / 26006041 / +2.7% 32712556 / 32924627 / -0.6% 0.82 / 0.79 / +3.3%
tpcds_q98/duckdb:parquet 15224106 / 15397452 / -1.1% 23049348 / 22400642 / +2.9% 0.66 / 0.69 / -3.9%
tpcds_q99/duckdb:parquet 17266476 / 17500766 / -1.3% 21211428 / 21403608 / -0.9% 0.81 / 0.82 / -0.4%
File Size Changes (12 files changed, -0.1% overall, 8↑ 4↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-file-compressed 52.39 KB 54.38 KB +1.98 KB +3.8%
store.vortex 1.0 vortex-file-compressed 47.99 KB 49.47 KB +1.48 KB +3.1%
ship_mode.vortex 1.0 vortex-file-compressed 13.14 KB 13.18 KB +40 B +0.3%
household_demographics.vortex 1.0 vortex-file-compressed 16.20 KB 16.22 KB +16 B +0.1%
customer_address.vortex 1.0 vortex-file-compressed 882.78 KB 883.09 KB +312 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.29 MB 4.29 MB +352 B +0.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.48 MB 1.48 MB +24 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 585.52 KB 585.52 KB +8 B +0.0%
warehouse.vortex 1.0 vortex-file-compressed 23.66 KB 23.41 KB 256 B -1.1%
web_site.vortex 1.0 vortex-file-compressed 53.72 KB 52.39 KB 1.34 KB -2.5%
reason.vortex 1.0 vortex-file-compressed 7.49 KB 7.25 KB 248 B -3.2%
item.vortex 1.0 vortex-file-compressed 1.69 MB 1.50 MB 193.93 KB -11.2%

Totals:

  • vortex-file-compressed: 272.94 MB → 272.75 MB (-0.1%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.047x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.007x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95059889 / 94682170 / +0.4% 165505930 / 152151499 / +8.8% 0.57 / 0.62 / -7.7%
tpch_q02/datafusion:vortex-file-compressed 64418999 / 64867686 / -0.7% 96589580 / 95700895 / +0.9% 0.67 / 0.68 / -1.6%
tpch_q03/datafusion:vortex-file-compressed 64986736 / 65173414 / -0.3% 119809299 / 116398039 / +2.9% 0.54 / 0.56 / -3.1%
tpch_q04/datafusion:vortex-file-compressed 35411626 / 35743729 / -0.9% 79786725 / 81958862 / -2.7% 0.44 / 0.44 / +1.8%
tpch_q05/datafusion:vortex-file-compressed 118540313 / 119942819 / -1.2% 186897722 / 178092232 / +4.9% 0.63 / 0.67 / -5.8%
tpch_q06/datafusion:vortex-file-compressed 14502361 / 14754662 / -1.7% 78869880 / 67595542 / +16.7% 🔴 0.18 / 0.22 / -15.8%
tpch_q07/datafusion:vortex-file-compressed 139944298 / 139642528 / +0.2% 198408504 / 189974580 / +4.4% 0.71 / 0.74 / -4.0%
tpch_q08/datafusion:vortex-file-compressed 143140428 / 141255660 / +1.3% 212841502 / 211472669 / +0.6% 0.67 / 0.67 / +0.7%
tpch_q09/datafusion:vortex-file-compressed 187589910 / 186944569 / +0.3% 271157384 / 262511394 / +3.3% 0.69 / 0.71 / -2.9%
tpch_q10/datafusion:vortex-file-compressed 73535231 / 73743704 / -0.3% 144209090 / 139598619 / +3.3% 0.51 / 0.53 / -3.5%
tpch_q11/datafusion:vortex-file-compressed 43016109 / 43172170 / -0.4% 66547518 / 69921529 / -4.8% 0.65 / 0.62 / +4.7%
tpch_q12/datafusion:vortex-file-compressed 45158407 / 45217467 / -0.1% 102268290 / 88413913 / +15.7% 🔴 0.44 / 0.51 / -13.7%
tpch_q13/datafusion:vortex-file-compressed 46751142 / 47172027 / -0.9% 82906520 / 75761974 / +9.4% 0.56 / 0.62 / -9.4%
tpch_q14/datafusion:vortex-file-compressed 24405548 / 25683438 / -5.0% 103725194 / 99190644 / +4.6% 0.24 / 0.26 / -9.1%
tpch_q15/datafusion:vortex-file-compressed 37083368 / 36491273 / +1.6% 106833401 / 99412782 / +7.5% 0.35 / 0.37 / -5.4%
tpch_q16/datafusion:vortex-file-compressed 37674517 / 37552263 / +0.3% 66149459 / 72246528 / -8.4% 0.57 / 0.52 / +9.6%
tpch_q17/datafusion:vortex-file-compressed 176840764 / 177067410 / -0.1% 223343516 / 224771484 / -0.6% 0.79 / 0.79 / +0.5%
tpch_q18/datafusion:vortex-file-compressed 205277620 / 202217151 / +1.5% 267024858 / 260017744 / +2.7% 0.77 / 0.78 / -1.2%
tpch_q19/datafusion:vortex-file-compressed 34668774 / 34892915 / -0.6% 101724018 / 95751304 / +6.2% 0.34 / 0.36 / -6.5%
tpch_q20/datafusion:vortex-file-compressed 63424883 / 63206327 / +0.3% 125839869 / 119273282 / +5.5% 0.50 / 0.53 / -4.9%
tpch_q21/datafusion:vortex-file-compressed 182962240 / 184237756 / -0.7% 252848488 / 242059578 / +4.5% 0.72 / 0.76 / -4.9%
tpch_q22/datafusion:vortex-file-compressed 25637583 / 25750481 / -0.4% 55269446 / 57512409 / -3.9% 0.46 / 0.45 / +3.6%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87572309 / 87131520 / +0.5% 129398954 / 135056707 / -4.2% 0.68 / 0.65 / +4.9%
tpch_q02/datafusion:parquet 158472199 / 159387504 / -0.6% 186578787 / 186524190 / +0.0% 0.85 / 0.85 / -0.6%
tpch_q03/datafusion:parquet 142773296 / 143560200 / -0.5% 196653768 / 196515533 / +0.1% 0.73 / 0.73 / -0.6%
tpch_q04/datafusion:parquet 59463597 / 59825916 / -0.6% 98916659 / 99036596 / -0.1% 0.60 / 0.60 / -0.5%
tpch_q05/datafusion:parquet 183117241 / 183249145 / -0.1% 242372042 / 240402038 / +0.8% 0.76 / 0.76 / -0.9%
tpch_q06/datafusion:parquet 35377223 / 35488236 / -0.3% 78428521 / 82834643 / -5.3% 0.45 / 0.43 / +5.3%
tpch_q07/datafusion:parquet 229975490 / 231344440 / -0.6% 295247655 / 297003217 / -0.6% 0.78 / 0.78 / -0.0%
tpch_q08/datafusion:parquet 233965716 / 235997311 / -0.9% 304786940 / 299136095 / +1.9% 0.77 / 0.79 / -2.7%
tpch_q09/datafusion:parquet 311309311 / 313305108 / -0.6% 384844723 / 377621907 / +1.9% 0.81 / 0.83 / -2.5%
tpch_q10/datafusion:parquet 408214301 / 410463008 / -0.5% 473950363 / 455316587 / +4.1% 0.86 / 0.90 / -4.5%
tpch_q11/datafusion:parquet 104984551 / 105181609 / -0.2% 130331072 / 127722467 / +2.0% 0.81 / 0.82 / -2.2%
tpch_q12/datafusion:parquet 84738726 / 85193473 / -0.5% 128202548 / 124095354 / +3.3% 0.66 / 0.69 / -3.7%
tpch_q13/datafusion:parquet 226565883 / 226176881 / +0.2% 256933423 / 254544534 / +0.9% 0.88 / 0.89 / -0.8%
tpch_q14/datafusion:parquet 87712655 / 87592944 / +0.1% 202396767 / 196177620 / +3.2% 0.43 / 0.45 / -2.9%
tpch_q15/datafusion:parquet 90468308 / 91044053 / -0.6% 142301661 / 139425003 / +2.1% 0.64 / 0.65 / -2.6%
tpch_q16/datafusion:parquet 95803615 / 95723177 / +0.1% 124369978 / 120915308 / +2.9% 0.77 / 0.79 / -2.7%
tpch_q17/datafusion:parquet 215894659 / 214328007 / +0.7% 273211030 / 266549832 / +2.5% 0.79 / 0.80 / -1.7%
tpch_q18/datafusion:parquet 291898412 / 291079975 / +0.3% 338709232 / 331003789 / +2.3% 0.86 / 0.88 / -2.0%
tpch_q19/datafusion:parquet 110183852 / 110935368 / -0.7% 178471387 / 174550590 / +2.2% 0.62 / 0.64 / -2.9%
tpch_q20/datafusion:parquet 183810005 / 183782027 / +0.0% 245401587 / 240209893 / +2.2% 0.75 / 0.77 / -2.1%
tpch_q21/datafusion:parquet 247531267 / 244539407 / +1.2% 316459173 / 319676814 / -1.0% 0.78 / 0.76 / +2.3%
tpch_q22/datafusion:parquet 199504991 / 200176462 / -0.3% 224787773 / 220813216 / +1.8% 0.89 / 0.91 / -2.1%
duckdb / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 52664258 / 54706219 / -3.7% 103108195 / 101920319 / +1.2% 0.51 / 0.54 / -4.8%
tpch_q02/duckdb:vortex-file-compressed 32196375 / 33081865 / -2.7% 48173809 / 46009448 / +4.7% 0.67 / 0.72 / -7.0%
tpch_q03/duckdb:vortex-file-compressed 57591960 / 56918689 / +1.2% 115828514 / 108122851 / +7.1% 0.50 / 0.53 / -5.5%
tpch_q04/duckdb:vortex-file-compressed 78654700 / 80134532 / -1.8% 123450312 / 114821783 / +7.5% 0.64 / 0.70 / -8.7%
tpch_q05/duckdb:vortex-file-compressed 63150074 / 63331857 / -0.3% 124946568 / 114087098 / +9.5% 0.51 / 0.56 / -9.0%
tpch_q06/duckdb:vortex-file-compressed 21906856 / 20390546 / +7.4% 66684013 / 60139594 / +10.9% 🔴 0.33 / 0.34 / -3.1%
tpch_q07/duckdb:vortex-file-compressed 59366519 / 59343345 / +0.0% 137435193 / 125180574 / +9.8% 0.43 / 0.47 / -8.9%
tpch_q08/duckdb:vortex-file-compressed 85449376 / 85190026 / +0.3% 154097247 / 145088264 / +6.2% 0.55 / 0.59 / -5.6%
tpch_q09/duckdb:vortex-file-compressed 169094662 / 169460794 / -0.2% 243732777 / 231996463 / +5.1% 0.69 / 0.73 / -5.0%
tpch_q10/duckdb:vortex-file-compressed 107356326 / 110001468 / -2.4% 184352377 / 173604067 / +6.2% 0.58 / 0.63 / -8.1%
tpch_q11/duckdb:vortex-file-compressed 16950328 / 17215584 / -1.5% 30032703 / 31861148 / -5.7% 0.56 / 0.54 / +4.5%
tpch_q12/duckdb:vortex-file-compressed 54924461 / 55788953 / -1.5% 111310575 / 101031237 / +10.2% 🔴 0.49 / 0.55 / -10.6%
tpch_q13/duckdb:vortex-file-compressed 89292620 / 90257953 / -1.1% 141767510 / 142517424 / -0.5% 0.63 / 0.63 / -0.5%
tpch_q14/duckdb:vortex-file-compressed 32311921 / 32335583 / -0.1% 81794570 / 81876267 / -0.1% 0.40 / 0.39 / +0.0%
tpch_q15/duckdb:vortex-file-compressed 38578063 / 36295814 / +6.3% 95175067 / 85476053 / +11.3% 🔴 0.41 / 0.42 / -4.5%
tpch_q16/duckdb:vortex-file-compressed 42189514 / 42294870 / -0.2% 59086129 / 53176563 / +11.1% 🔴 0.71 / 0.80 / -10.2%
tpch_q17/duckdb:vortex-file-compressed 62877648 / 60067666 / +4.7% 138190763 / 119616618 / +15.5% 🔴 0.46 / 0.50 / -9.4%
tpch_q18/duckdb:vortex-file-compressed 132166484 / 142468012 / -7.2% 160718106 / 176297335 / -8.8% 0.82 / 0.81 / +1.8%
tpch_q19/duckdb:vortex-file-compressed 43365551 / 39915493 / +8.6% 101845982 / 92135626 / +10.5% 🔴 0.43 / 0.43 / -1.7%
tpch_q20/duckdb:vortex-file-compressed 59312920 / 59218440 / +0.2% 125541310 / 109149278 / +15.0% 🔴 0.47 / 0.54 / -12.9%
tpch_q21/duckdb:vortex-file-compressed 236518897 / 234995742 / +0.6% 286671145 / 263039623 / +9.0% 0.83 / 0.89 / -7.6%
tpch_q22/duckdb:vortex-file-compressed 41705962 / 41733376 / -0.1% 62104580 / 64103720 / -3.1% 0.67 / 0.65 / +3.2%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 73788152 / 72535928 / +1.7% 96953303 / 118954721 / -18.5% 🟢 0.76 / 0.61 / +24.8%
tpch_q02/duckdb:parquet 79929145 / 80749281 / -1.0% 91619457 / 89421207 / +2.5% 0.87 / 0.90 / -3.4%
tpch_q03/duckdb:parquet 123945700 / 120662577 / +2.7% 153885615 / 147737834 / +4.2% 0.81 / 0.82 / -1.4%
tpch_q04/duckdb:parquet 75877680 / 75876906 / +0.0% 99953762 / 89127822 / +12.1% 🔴 0.76 / 0.85 / -10.8%
tpch_q05/duckdb:parquet 129881562 / 129852543 / +0.0% 161477339 / 161432870 / +0.0% 0.80 / 0.80 / -0.0%
tpch_q06/duckdb:parquet 33920876 / 34147927 / -0.7% 48462307 / 46361969 / +4.5% 0.70 / 0.74 / -5.0%
tpch_q07/duckdb:parquet 92852505 / 93766576 / -1.0% 128774800 / 130336805 / -1.2% 0.72 / 0.72 / +0.2%
tpch_q08/duckdb:parquet 150334793 / 150021852 / +0.2% 198503794 / 187273794 / +6.0% 0.76 / 0.80 / -5.5%
tpch_q09/duckdb:parquet 228479155 / 229080363 / -0.3% 262460497 / 263915708 / -0.6% 0.87 / 0.87 / +0.3%
tpch_q10/duckdb:parquet 513283039 / 510809058 / +0.5% 545214486 / 542853412 / +0.4% 0.94 / 0.94 / +0.0%
tpch_q11/duckdb:parquet 33676713 / 33536267 / +0.4% 38613229 / 39278527 / -1.7% 0.87 / 0.85 / +2.1%
tpch_q12/duckdb:parquet 76357701 / 75903637 / +0.6% 88444666 / 89318651 / -1.0% 0.86 / 0.85 / +1.6%
tpch_q13/duckdb:parquet 322235410 / 320719918 / +0.5% 335954512 / 333581689 / +0.7% 0.96 / 0.96 / -0.2%
tpch_q14/duckdb:parquet 108625740 / 108399350 / +0.2% 132072995 / 133107552 / -0.8% 0.82 / 0.81 / +1.0%
tpch_q15/duckdb:parquet 42886631 / 43068253 / -0.4% 70428481 / 65891056 / +6.9% 0.61 / 0.65 / -6.8%
tpch_q16/duckdb:parquet 118579263 / 117991855 / +0.5% 128316501 / 129046466 / -0.6% 0.92 / 0.91 / +1.1%
tpch_q17/duckdb:parquet 80229639 / 82584771 / -2.9% 104101436 / 105891668 / -1.7% 0.77 / 0.78 / -1.2%
tpch_q18/duckdb:parquet 208949434 / 210863840 / -0.9% 169693831 / 169005727 / +0.4% 1.23 / 1.25 / -1.3%
tpch_q19/duckdb:parquet 166059635 / 166451229 / -0.2% 192897739 / 198831325 / -3.0% 0.86 / 0.84 / +2.8%
tpch_q20/duckdb:parquet 136159921 / 135325808 / +0.6% 170536072 / 167648544 / +1.7% 0.80 / 0.81 / -1.1%
tpch_q21/duckdb:parquet 273263709 / 279929343 / -2.4% 288031688 / 292404099 / -1.5% 0.95 / 0.96 / -0.9%
tpch_q22/duckdb:parquet 267559297 / 267096496 / +0.2% 282519158 / 277826680 / +1.7% 0.95 / 0.96 / -1.5%
File Size Changes (5 files changed, -1.9% overall, 3↑ 2↓)
File Scale Format Base HEAD Change %
supplier.vortex 10.0 vortex-file-compressed 5.92 MB 5.92 MB +128 B +0.0%
customer.vortex 10.0 vortex-file-compressed 91.33 MB 91.33 MB +16 B +0.0%
lineitem.vortex 10.0 vortex-file-compressed 1.71 GB 1.71 GB +16 B +0.0%
region.vortex 10.0 vortex-file-compressed 6.52 KB 6.13 KB 392 B -5.9%
orders.vortex 10.0 vortex-file-compressed 491.43 MB 440.12 MB 51.31 MB -10.4%

Totals:

  • vortex-file-compressed: 2.59 GB → 2.54 GB (-1.9%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.971x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9058324 / 9067653 / -0.1% 9524644 / 9502654 / +0.2% 0.95 / 0.95 / -0.3%
statpopgen_q01/duckdb:vortex-file-compressed 10328386 / 10315282 / +0.1% 13244130 / 13612684 / -2.7% 0.78 / 0.76 / +2.9%
statpopgen_q02/duckdb:vortex-file-compressed 305590452 / 308167250 / -0.8% 337850086 / 349015632 / -3.2% 0.90 / 0.88 / +2.4%
statpopgen_q03/duckdb:vortex-file-compressed 812722877 / 814665694 / -0.2% 833926930 / 825001341 / +1.1% 0.97 / 0.99 / -1.3%
statpopgen_q04/duckdb:vortex-file-compressed 811677302 / 813553920 / -0.2% 828120069 / 820760333 / +0.9% 0.98 / 0.99 / -1.1%
statpopgen_q05/duckdb:vortex-file-compressed 318705764 / 321512786 / -0.9% 342985145 / 359484015 / -4.6% 0.93 / 0.89 / +3.9%
statpopgen_q06/duckdb:vortex-file-compressed 1144054244 / 1135921940 / +0.7% 1157779793 / 1151577187 / +0.5% 0.99 / 0.99 / +0.2%
statpopgen_q07/duckdb:vortex-file-compressed 112127362 / 116091850 / -3.4% 172553788 / 169293533 / +1.9% 0.65 / 0.69 / -5.2%
statpopgen_q08/duckdb:vortex-file-compressed 125640028 / 126007070 / -0.3% 140044706 / 179219932 / -21.9% 🟢 0.90 / 0.70 / +27.6%
statpopgen_q09/duckdb:vortex-file-compressed 611634465 / 616060868 / -0.7% 625832913 / 629090987 / -0.5% 0.98 / 0.98 / -0.2%
statpopgen_q10/duckdb:vortex-file-compressed 1914803696 / 1917395669 / -0.1% 1868551335 / 1881593703 / -0.7% 1.02 / 1.02 / +0.6%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 247340154 / 248071224 / -0.3% 247271099 / 246854824 / +0.2% 1.00 / 1.00 / -0.5%
statpopgen_q01/duckdb:parquet 301560745 / 306838145 / -1.7% 303390714 / 310837758 / -2.4% 0.99 / 0.99 / +0.7%
statpopgen_q02/duckdb:parquet 558399372 / 557939550 / +0.1% 567092074 / 596789810 / -5.0% 0.98 / 0.93 / +5.3%
statpopgen_q03/duckdb:parquet 861735876 / 849866690 / +1.4% 835516371 / 876718448 / -4.7% 1.03 / 0.97 / +6.4%
statpopgen_q04/duckdb:parquet 859474784 / 853204422 / +0.7% 865244738 / 880520533 / -1.7% 0.99 / 0.97 / +2.5%
statpopgen_q05/duckdb:parquet 585809541 / 558677222 / +4.9% 579535827 / 562177047 / +3.1% 1.01 / 0.99 / +1.7%
statpopgen_q06/duckdb:parquet 698820484 / 727713408 / -4.0% 743895422 / 716095287 / +3.9% 0.94 / 1.02 / -7.6%
statpopgen_q07/duckdb:parquet 608636260 / 606940574 / +0.3% 709324810 / 715275316 / -0.8% 0.86 / 0.85 / +1.1%
statpopgen_q08/duckdb:parquet 624121876 / 628542815 / -0.7% 701605005 / 676274947 / +3.7% 0.89 / 0.93 / -4.3%
statpopgen_q09/duckdb:parquet 816805322 / 810164640 / +0.8% 808319383 / 806800863 / +0.2% 1.01 / 1.00 / +0.6%
statpopgen_q10/duckdb:parquet 1477672000 / 1444338430 / +2.3% 1264597140 / 1268098771 / -0.3% 1.17 / 1.14 / +2.6%
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.80 GB 1.80 GB 187.52 KB -0.0%

Totals:

  • vortex-file-compressed: 1.80 GB → 1.80 GB (-0.0%)

@github-actions

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ab167f77 vs base 05d0cba3
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.1%
Engines: DataFusion No clear signal (-13.3%, environment too noisy confidence) · DuckDB No clear signal (+8.4%, environment too noisy confidence)
Vortex (geomean): hot 0.893x ➖ · cold 0.899x ➖
Parquet (geomean): hot 0.921x ➖ · cold 0.908x ➖
Shifts: Parquet (control) -7.9% · Median polish -6.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.819x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 226545088 / 215405884 / +5.2% 694287391 / 772051742 / -10.1% 0.33 / 0.28 / +17.0%
tpch_q02/datafusion:vortex-file-compressed 340265748 / 330656568 / +2.9% 665340926 / 651134414 / +2.2% 0.51 / 0.51 / +0.7%
tpch_q03/datafusion:vortex-file-compressed 366942760 / 368198613 / -0.3% 1178553512 / 1122591438 / +5.0% 0.31 / 0.33 / -5.1%
tpch_q04/datafusion:vortex-file-compressed 194906943 / 211625686 / -7.9% 418898836 / 507954858 / -17.5% 0.47 / 0.42 / +11.7%
tpch_q05/datafusion:vortex-file-compressed 376009335 / 445606357 / -15.6% 582238071 / 660284651 / -11.8% 0.65 / 0.67 / -4.3%
tpch_q06/datafusion:vortex-file-compressed 265614541 / 332079014 / -20.0% 391607042 / 712084184 / -45.0% 🟢 0.68 / 0.47 / +45.4%
tpch_q07/datafusion:vortex-file-compressed 385932857 / 504300696 / -23.5% 515077786 / 637900930 / -19.3% 0.75 / 0.79 / -5.2%
tpch_q08/datafusion:vortex-file-compressed 611161454 / 514858010 / +18.7% 794576772 / 705427675 / +12.6% 0.77 / 0.73 / +5.4%
tpch_q09/datafusion:vortex-file-compressed 438462582 / 456565191 / -4.0% 486393722 / 508550695 / -4.4% 0.90 / 0.90 / +0.4%
tpch_q10/datafusion:vortex-file-compressed 366751677 / 381611792 / -3.9% 764505900 / 546874425 / +39.8% 🔴 0.48 / 0.70 / -31.3%
tpch_q11/datafusion:vortex-file-compressed 274861177 / 294304854 / -6.6% 406461501 / 494701304 / -17.8% 0.68 / 0.59 / +13.7%
tpch_q12/datafusion:vortex-file-compressed 441087541 / 407159124 / +8.3% 510338720 / 745454485 / -31.5% 🟢 0.86 / 0.55 / +58.2%
tpch_q13/datafusion:vortex-file-compressed 137010797 / 155647364 / -12.0% 422884801 / 372948652 / +13.4% 0.32 / 0.42 / -22.4%
tpch_q14/datafusion:vortex-file-compressed 183903826 / 270847062 / -32.1% 🟢 325343352 / 355117854 / -8.4% 0.57 / 0.76 / -25.9%
tpch_q15/datafusion:vortex-file-compressed 281130185 / 355027067 / -20.8% 455609773 / 568439466 / -19.8% 0.62 / 0.62 / -1.2%
tpch_q16/datafusion:vortex-file-compressed 163083147 / 186935554 / -12.8% 313625548 / 316662348 / -1.0% 0.52 / 0.59 / -11.9%
tpch_q17/datafusion:vortex-file-compressed 283727289 / 359739809 / -21.1% 487400212 / 663142924 / -26.5% 0.58 / 0.54 / +7.3%
tpch_q18/datafusion:vortex-file-compressed 243011339 / 258796219 / -6.1% 382524289 / 422828180 / -9.5% 0.64 / 0.61 / +3.8%
tpch_q19/datafusion:vortex-file-compressed 350350636 / 908594718 / -61.4% 🟢 452246200 / 561398451 / -19.4% 0.77 / 1.62 / -52.1%
tpch_q20/datafusion:vortex-file-compressed 261136517 / 278750807 / -6.3% 439986790 / 427673115 / +2.9% 0.59 / 0.65 / -8.9%
tpch_q21/datafusion:vortex-file-compressed 464638374 / 1409498158 / -67.0% 🟢 620955794 / 1935187754 / -67.9% 🟢 0.75 / 0.73 / +2.7%
tpch_q22/datafusion:vortex-file-compressed 181715805 / 307153793 / -40.8% 🟢 354337118 / 442137846 / -19.9% 0.51 / 0.69 / -26.2%
datafusion / parquet / ns (0.945x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 152405912 / 163685960 / -6.9% 493772885 / 515460812 / -4.2% 0.31 / 0.32 / -2.8%
tpch_q02/datafusion:parquet 280631759 / 281440496 / -0.3% 492542198 / 681505185 / -27.7% 0.57 / 0.41 / +38.0%
tpch_q03/datafusion:parquet 263871680 / 231283611 / +14.1% 593121902 / 547508762 / +8.3% 0.44 / 0.42 / +5.3%
tpch_q04/datafusion:parquet 156033534 / 140518791 / +11.0% 379624818 / 353754789 / +7.3% 0.41 / 0.40 / +3.5%
tpch_q05/datafusion:parquet 350272590 / 328787688 / +6.5% 470753008 / 449063539 / +4.8% 0.74 / 0.73 / +1.6%
tpch_q06/datafusion:parquet 120819930 / 198185761 / -39.0% 🟢 232631762 / 312775317 / -25.6% 0.52 / 0.63 / -18.0%
tpch_q07/datafusion:parquet 332121064 / 340534979 / -2.5% 465967650 / 570588396 / -18.3% 0.71 / 0.60 / +19.4%
tpch_q08/datafusion:parquet 379512050 / 617900072 / -38.6% 🟢 470973520 / 713729430 / -34.0% 🟢 0.81 / 0.87 / -6.9%
tpch_q09/datafusion:parquet 381021464 / 379911415 / +0.3% 599212276 / 513180407 / +16.8% 0.64 / 0.74 / -14.1%
tpch_q10/datafusion:parquet 345086363 / 334208455 / +3.3% 435094970 / 538394079 / -19.2% 0.79 / 0.62 / +27.8%
tpch_q11/datafusion:parquet 244064017 / 265559245 / -8.1% 404324755 / 384382544 / +5.2% 0.60 / 0.69 / -12.6%
tpch_q12/datafusion:parquet 159011013 / 193405933 / -17.8% 285537470 / 334027649 / -14.5% 0.56 / 0.58 / -3.8%
tpch_q13/datafusion:parquet 355036068 / 357137796 / -0.6% 462722427 / 499786579 / -7.4% 0.77 / 0.71 / +7.4%
tpch_q14/datafusion:parquet 180171585 / 171705320 / +4.9% 299348435 / 281980876 / +6.2% 0.60 / 0.61 / -1.2%
tpch_q15/datafusion:parquet 284466769 / 305136352 / -6.8% 419636012 / 433805889 / -3.3% 0.68 / 0.70 / -3.6%
tpch_q16/datafusion:parquet 117231206 / 121355487 / -3.4% 300465836 / 232604925 / +29.2% 0.39 / 0.52 / -25.2%
tpch_q17/datafusion:parquet 283805724 / 284236729 / -0.2% 410136016 / 435261373 / -5.8% 0.69 / 0.65 / +6.0%
tpch_q18/datafusion:parquet 356504708 / 387676655 / -8.0% 515957350 / 563260569 / -8.4% 0.69 / 0.69 / +0.4%
tpch_q19/datafusion:parquet 182754271 / 172142146 / +6.2% 360367284 / 295752713 / +21.8% 0.51 / 0.58 / -12.9%
tpch_q20/datafusion:parquet 251581930 / 309315577 / -18.7% 397107835 / 464620994 / -14.5% 0.63 / 0.67 / -4.8%
tpch_q21/datafusion:parquet 432582665 / 339716733 / +27.3% 521425963 / 565088582 / -7.7% 0.83 / 0.60 / +38.0%
tpch_q22/datafusion:parquet 139753134 / 165601256 / -15.6% 315836018 / 499240308 / -36.7% 🟢 0.44 / 0.33 / +33.4%
duckdb / vortex-file-compressed / ns (0.974x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 207393900 / 212969044 / -2.6% 264480488 / 402545659 / -34.3% 🟢 0.78 / 0.53 / +48.2%
tpch_q02/duckdb:vortex-file-compressed 400728959 / 386283536 / +3.7% 515990544 / 537564473 / -4.0% 0.78 / 0.72 / +8.1%
tpch_q03/duckdb:vortex-file-compressed 436359776 / 451499529 / -3.4% 510262636 / 587606112 / -13.2% 0.86 / 0.77 / +11.3%
tpch_q04/duckdb:vortex-file-compressed 261519851 / 386969313 / -32.4% 🟢 301166802 / 317436570 / -5.1% 0.87 / 1.22 / -28.8%
tpch_q05/duckdb:vortex-file-compressed 513261774 / 435657404 / +17.8% 434088638 / 443520785 / -2.1% 1.18 / 0.98 / +20.4%
tpch_q06/duckdb:vortex-file-compressed 268094949 / 316054023 / -15.2% 259505934 / 344214001 / -24.6% 1.03 / 0.92 / +12.5%
tpch_q07/duckdb:vortex-file-compressed 464644691 / 468732548 / -0.9% 532965840 / 511445985 / +4.2% 0.87 / 0.92 / -4.9%
tpch_q08/duckdb:vortex-file-compressed 646872217 / 636605032 / +1.6% 665155989 / 879485103 / -24.4% 0.97 / 0.72 / +34.4%
tpch_q09/duckdb:vortex-file-compressed 451021986 / 487084310 / -7.4% 514882648 / 548696401 / -6.2% 0.88 / 0.89 / -1.3%
tpch_q10/duckdb:vortex-file-compressed 481899404 / 454165041 / +6.1% 545352353 / 497963862 / +9.5% 0.88 / 0.91 / -3.1%
tpch_q11/duckdb:vortex-file-compressed 192387895 / 191331126 / +0.6% 233283211 / 207437752 / +12.5% 0.82 / 0.92 / -10.6%
tpch_q12/duckdb:vortex-file-compressed 528094303 / 461547625 / +14.4% 478668784 / 449270970 / +6.5% 1.10 / 1.03 / +7.4%
tpch_q13/duckdb:vortex-file-compressed 336933678 / 413171438 / -18.5% 277311008 / 346327303 / -19.9% 1.22 / 1.19 / +1.8%
tpch_q14/duckdb:vortex-file-compressed 379621953 / 254955488 / +48.9% 🔴 300653022 / 290173019 / +3.6% 1.26 / 0.88 / +43.7%
tpch_q15/duckdb:vortex-file-compressed 173189844 / 168751707 / +2.6% 173756606 / 231929188 / -25.1% 1.00 / 0.73 / +37.0%
tpch_q16/duckdb:vortex-file-compressed 176097971 / 175330837 / +0.4% 201453583 / 198865728 / +1.3% 0.87 / 0.88 / -0.9%
tpch_q17/duckdb:vortex-file-compressed 424822736 / 428362581 / -0.8% 448371420 / 443789278 / +1.0% 0.95 / 0.97 / -1.8%
tpch_q18/duckdb:vortex-file-compressed 359330867 / 319125677 / +12.6% 479405774 / 416559289 / +15.1% 0.75 / 0.77 / -2.2%
tpch_q19/duckdb:vortex-file-compressed 326122696 / 467747688 / -30.3% 🟢 406495170 / 427085988 / -4.8% 0.80 / 1.10 / -26.7%
tpch_q20/duckdb:vortex-file-compressed 383228228 / 367750329 / +4.2% 463762370 / 450713548 / +2.9% 0.83 / 0.82 / +1.3%
tpch_q21/duckdb:vortex-file-compressed 628206927 / 913347822 / -31.2% 🟢 705458711 / 709656132 / -0.6% 0.89 / 1.29 / -30.8%
tpch_q22/duckdb:vortex-file-compressed 197252762 / 185156236 / +6.5% 244911123 / 217640325 / +12.5% 0.81 / 0.85 / -5.3%
duckdb / parquet / ns (0.899x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 268911773 / 286303336 / -6.1% 268931498 / 291885714 / -7.9% 1.00 / 0.98 / +1.9%
tpch_q02/duckdb:parquet 605233950 / 648442498 / -6.7% 641059020 / 706155419 / -9.2% 0.94 / 0.92 / +2.8%
tpch_q03/duckdb:parquet 643886073 / 785667918 / -18.0% 659637146 / 933082366 / -29.3% 0.98 / 0.84 / +15.9%
tpch_q04/duckdb:parquet 451786120 / 511489821 / -11.7% 490012326 / 689913555 / -29.0% 0.92 / 0.74 / +24.4%
tpch_q05/duckdb:parquet 860272651 / 916238799 / -6.1% 912550266 / 1111479698 / -17.9% 0.94 / 0.82 / +14.4%
tpch_q06/duckdb:parquet 281121802 / 325057994 / -13.5% 256275592 / 360373212 / -28.9% 1.10 / 0.90 / +21.6%
tpch_q07/duckdb:parquet 749660088 / 891420347 / -15.9% 831494689 / 938310149 / -11.4% 0.90 / 0.95 / -5.1%
tpch_q08/duckdb:parquet 1029932498 / 1178134535 / -12.6% 1028800063 / 918139000 / +12.1% 1.00 / 1.28 / -22.0%
tpch_q09/duckdb:parquet 920846018 / 1048556696 / -12.2% 1292299344 / 997888062 / +29.5% 0.71 / 1.05 / -32.2%
tpch_q10/duckdb:parquet 913026245 / 992501494 / -8.0% 852611186 / 929033224 / -8.2% 1.07 / 1.07 / +0.2%
tpch_q11/duckdb:parquet 409550956 / 463725387 / -11.7% 429765870 / 480835798 / -10.6% 0.95 / 0.96 / -1.2%
tpch_q12/duckdb:parquet 503351045 / 602092492 / -16.4% 548076884 / 710500098 / -22.9% 0.92 / 0.85 / +8.4%
tpch_q13/duckdb:parquet 691279729 / 727870821 / -5.0% 712080504 / 961240152 / -25.9% 0.97 / 0.76 / +28.2%
tpch_q14/duckdb:parquet 472739412 / 483994459 / -2.3% 473091509 / 480372103 / -1.5% 1.00 / 1.01 / -0.8%
tpch_q15/duckdb:parquet 334706039 / 376264170 / -11.0% 352220145 / 424691505 / -17.1% 0.95 / 0.89 / +7.3%
tpch_q16/duckdb:parquet 467030185 / 494339497 / -5.5% 551034104 / 548378770 / +0.5% 0.85 / 0.90 / -6.0%
tpch_q17/duckdb:parquet 448422635 / 473985212 / -5.4% 438652870 / 451070384 / -2.8% 1.02 / 1.05 / -2.7%
tpch_q18/duckdb:parquet 563079688 / 640594200 / -12.1% 594846123 / 565460723 / +5.2% 0.95 / 1.13 / -16.4%
tpch_q19/duckdb:parquet 510114819 / 612975386 / -16.8% 523663125 / 553229144 / -5.3% 0.97 / 1.11 / -12.1%
tpch_q20/duckdb:parquet 772683142 / 808006578 / -4.4% 715951758 / 799116287 / -10.4% 1.08 / 1.01 / +6.7%
tpch_q21/duckdb:parquet 713593240 / 711891859 / +0.2% 700883696 / 725080235 / -3.3% 1.02 / 0.98 / +3.7%
tpch_q22/duckdb:parquet 370752089 / 454778143 / -18.5% 398845518 / 535942718 / -25.6% 0.93 / 0.85 / +9.5%

@joseph-isaacs

ghost commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Do we know why some files got larger?

@github-actions

ghost commented Oct 17, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Oct 17, 2026
@robert3005 robert3005 removed the stale This PR is stale and will be auto-closed soon label Oct 20, 2026
@robert3005
robert3005 force-pushed the wm/string-dictionary-selection branch from ab167f7 to c87ff2d Compare October 20, 2026 13:05
@robert3005 robert3005 added the action/bench-compress Run only the compression benchmark on this PR label Oct 25, 2026
@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Oct 25, 2026
@robert3005
robert3005 force-pushed the wm/string-dictionary-selection branch from 26ea413 to 90f08fa Compare October 26, 2026 17:18
@robert3005 robert3005 added the action/bench-compress Run only the compression benchmark on this PR label Oct 26, 2026
@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Oct 26, 2026
@TanishGudise TanishGudise mentioned this pull request Oct 28, 2026
Merged
@robert3005
robert3005 force-pushed the wm/string-dictionary-selection branch from 90f08fa to 85fbc04 Compare October 31, 2026 00:37
@robert3005 robert3005 added the action/bench-compress Run only the compression benchmark on this PR label Oct 31, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-compress Run only the compression benchmark on this PR label Oct 31, 2026
@robert3005
robert3005 force-pushed the wm/string-dictionary-selection branch 2 times, most recently from 3ada629 to 72faa09 Compare November 4, 2026 21:07
Will Manning Claude Opus 5.5
perf(compressor): Improve string dictionary selection
4a55853 
Replace the head-based distinct-count heuristic for UTF-8 dictionary
admission with a distributed full-value probe followed by a bounded
trial dictionary built from the complete input. A winning trial is
cached and reused by the compression phase. Inconclusive probes fall
back to the sample estimator, and string samples are compacted before
estimation so unreferenced payload does not inflate their size.

Signed-off-by: Will Manning <[email protected]>
Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
@robert3005
robert3005 enabled auto-merge (squash) November 11, 2026 01:07
Robert Kruszewski and others added 5 commits November 11, 2026 01:15
Robert Kruszewski Claude Opus 5.5
perf(compressor): Admit dictionary trials with a cost model
16425da 
Replace the fixed 75% probe-distinct cutoff with a cost model. The probe
estimates the input's distinct count with Chao1, and an optimistic
dictionary ratio built from that estimate, the input row count, and the
current best estimate decides whether a full trial is worth building.
Columns with more distinct values than an 8192-row probe can see, but
that still compress well as a dictionary, are no longer rejected.

Fall back to sample estimation, rather than skipping, when the trial
would exceed its entry, storage, or work bounds. A one-pass profile
checks the input size before building, so the bytes dictionary builder
no longer needs an input-byte limit.

Score the trial against the compacted input size, matching the
compacted samples other schemes are estimated on.

Evaluate sampled estimates before deferred callbacks so callbacks see
the tightest threshold regardless of registration order.

Apply the same selection to BinaryDictScheme.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
Robert Kruszewski Claude Opus 5.5
perf(layout): Share dictionary selection with DictStrategy's probe
d8d76f1 
DictStrategy decided whether to dictionary-encode a column by fully
compressing a probe sample and checking for a Dict result. Add
`CompressorPlugin::chooses_dictionary`, which defaults to that, and
override it for BtrBlocks to run only scheme selection through the new
`CascadingCompressor::choose_scheme`. The probe and chunk compression
now share one decision path, and the probe no longer compresses the
winning scheme's output just to read its encoding.

Share the code-width rule. `codes_ptype_for_max_len` picks the code
type for the bytes builder and the trial, and the layout documents it.

Measure trial and sample inputs with the compressor's
`exact_uncompressed_size` instead of separate compaction and byte
accounting.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
Robert Kruszewski Claude Opus 5.5
refactor(layout): Drop CompressorPlugin::chooses_dictionary
ffcb180 
A trait method on the public `CompressorPlugin` cannot be private, and
the selection-only probe it enabled saved no measurable time on the
compression benchmarks. Restore DictStrategy's probe to compressing the
sample and checking for a Dict result, and remove the
`CascadingCompressor::choose_scheme` entry point that only it used.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
Robert Kruszewski Claude Opus 5.5
perf(compressor): Skip losing dictionary trials earlier
0b3a354 
Profiling HashTags showed two avoidable costs in dictionary selection.

Trials that lost spent nearly all their time compressing dictionary
values. The cost model assumed the values compress as well as the best
scheme compresses the whole column, but the best scheme often wins by
exploiting repetition the dictionary removes, such as sparse nulls.
Dictionary values are distinct, and FSST and OnPair can compress a
value at most eight-fold, so bound the assumed values ratio by that.

Near-unique columns paid to hash all 8192 probe rows before rejection.
Probe a 2048-row head first, and reject without the full probe when
none of its 1024 or more values repeat and the cost model rejects.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
Robert Kruszewski Claude Fable 5.2
perf(compressor): Stop inflated estimates from beating dictionary trials
524ac05 
A dictionary trial reports the ratio it measured, but it competed
against estimates that could be far better than what their schemes
deliver. Comparing every real string column against a forced dictionary
showed two such estimates costing 1% of all compressed string bytes.

The string NullDominatedSparseScheme estimated the fraction of rows
that are null. It keeps every value's bytes, so on long values it
promised ~25x and delivered 1.3x. Estimate from the bytes it removes
and adds instead.

A 1% sample of a column that is 99.9% null often holds only nulls,
which compress to nothing under any scheme. Give such a sample no
ratio.

Keep a trial's output even when its ratio loses. The compressor now
prefers it to the winner's output when it is smaller, since the trial
was measured and the winner was only estimated.

Signed-off-by: Robert Kruszewski <[email protected]>
Co-Authored-By: Claude Fable 5.2 <[email protected]>
Claude-Session: https://claude.ai/code/session_01RHwz6Q4P43fu8kBhnNFJKf
@robert3005
robert3005 force-pushed the wm/string-dictionary-selection branch from 0640540 to 524ac05 Compare November 11, 2026 01:16
@robert3005
robert3005 merged commit 49acec0 into develop Nov 11, 2026
@robert3005
robert3005 deleted the wm/string-dictionary-selection branch November 11, 2026 01:29
@ChristopherWirt ChristopherWirt mentioned this pull request Nov 11, 2026
Merged
@robert3005 robert3005 mentioned this pull request Nov 13, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@lwwmanning @joseph-isaacs @robert3005