Skip to content

feat: update to DataFusion 56 upgrade - #10309

Open
joseph-isaacs wants to merge 19 commits into
developfrom
ji/datafusion-56
Open

joseph-isaacs wants to merge 19 commits into
developfrom
ji/datafusion-56

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 5, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Prepare Vortex develop for downstream testing of the upcoming DataFusion 56 release, tracked in apache/datafusion#24461.

@joseph-isaacs joseph-isaacs changed the title chore: prepare DataFusion 56 upgrade [reminder] chore: prepare DataFusion 56 upgrade Oct 5, 2026
@codspeed

codspeed Bot commented Oct 5, 2026 •

Copy link
Copy Markdown

Merging this PR will regress 1 benchmark

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 20 improved benchmarks
❌ 1 regressed benchmark
✅ 1962 untouched benchmarks
⏩ 3 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation random_i8[0.01] 98.9 µs 114.7 µs -13.84%
⚡ CPU Simulation set_slices[(16384, 0.01)] 21.9 µs 13.5 µs +61.93%
⚡ CPU Simulation fsl_i32[2, 0.5] 138.5 µs 97.6 µs +41.88%
⚡ CPU Simulation set_slices[(16384, 0.1)] 38.6 µs 29.9 µs +29.13%
⚡ CPU Simulation fsl_i32[16, 0.01] 22.1 µs 18.5 µs +19.26%
⚡ CPU Simulation list_sum_nullable_elements_large 367.4 µs 308.2 µs +19.19%
⚡ CPU Simulation div_decimal_i128_nullable 619.7 µs 532.8 µs +16.31%
⚡ CPU Simulation fsl_i32[2, 0.01] 130.8 µs 113.4 µs +15.31%
⚡ CPU Simulation compare[1] 71.4 µs 61.9 µs +15.28%
⚡ CPU Simulation sum_i32_nulls_scattered 694.6 µs 611.2 µs +13.65%
⚡ CPU Simulation sum_v2_i32_clustered_nulls 133.9 µs 118.1 µs +13.4%
⚡ CPU Simulation sum_v2_i32_nulls_scattered 728.5 µs 645.5 µs +12.86%
⚡ CPU Simulation set_slices[(16384, 0.5)] 83.1 µs 73.8 µs +12.64%
⚡ CPU Simulation max_i32_nulls_scattered 759.5 µs 674.5 µs +12.6%
⚡ CPU Simulation encode_primitives[f32, (2000, 512)] 274.5 µs 244 µs +12.51%
⚡ CPU Simulation list_sum_nullable_elements_medium 262.3 µs 233.5 µs +12.29%
⚡ CPU Simulation sum_v2_f64_clustered_nulls 141.3 µs 126.4 µs +11.79%
⚡ CPU Simulation canonical_sum_v2_i32_clustered_nulls 149.3 µs 134 µs +11.45%
⚡ CPU Simulation new_raw_prim_test_between[i32, 16384] 134.4 µs 121 µs +11.05%
⚡ CPU Simulation sum[msp_i32_p18_nullable] 175.1 µs 157.8 µs +10.99%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/datafusion-56 (4a19002) with develop (d7aa24e)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added the changelog/break A breaking API change label Oct 5, 2026
@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Oct 27, 2026
@joseph-isaacs joseph-isaacs removed the stale This PR is stale and will be auto-closed soon label Oct 27, 2026
Comment on lines +172 to +174
// The Vortex writer doesn't report bytes incrementally, so DataFusion's
// `soft_max_bytes_per_output_file` only sees the final size.
file.size.store(summary.size(), Ordering::Relaxed);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can get a output bytes tracker - this happens in iceberg

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4a19002 vortex-queries 1 Explore Profiling Data
🟢 Done 4a19002 fineweb-s3 1 Explore Profiling Data
🟢 Done 4a19002 tpch-s3-10 1 Explore Profiling Data
🟢 Done 4a19002 tpcds-nvme 1 Explore Profiling Data
🟢 Done 4a19002 random-access-bench 1 Explore Profiling Data
🟢 Done 4a19002 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 4a19002 clickbench-nvme 1 Explore Profiling Data
🟢 Done 4a19002 tpch-nested-nvme 1 Explore Profiling Data
🟢 Done 4a19002 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 4a19002 tpch-nvme 1 Explore Profiling Data
🟢 Done 4a19002 tpch-s3 1 Explore Profiling Data
🟢 Done 4a19002 appian-nvme 1 Explore Profiling Data
🟢 Done 4a19002 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 4a19002 fineweb 1 Explore Profiling Data
🟢 Done 4a19002 job-nvme 1 Explore Profiling Data
🟢 Done 4a19002 polarsignals 1 Explore Profiling Data
🟢 Done 4a19002 statpopgen 1 Explore Profiling Data
🟢 Done 4a19002 string-bench 1 Explore Profiling Data
🟢 Done 4a19002 compress-bench 1 Explore Profiling Data
Previous Runs (24)
Status Commit Job Attempt Link
🟢 Done fba339d random-access-bench 1 Explore Profiling Data
🟢 Done fba339d vortex-queries 1 Explore Profiling Data
🟢 Done fba339d clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done fba339d clickbench-nvme 1 Explore Profiling Data
🟢 Done fba339d tpch-nvme-10 1 Explore Profiling Data
🟢 Done fba339d fineweb-s3 1 Explore Profiling Data
🟢 Done fba339d tpch-s3-10 1 Explore Profiling Data
🟢 Done fba339d job-nvme 1 Explore Profiling Data
🟢 Done fba339d fineweb 1 Explore Profiling Data
🟢 Done fba339d tpch-s3 1 Explore Profiling Data
🟢 Done fba339d appian-nvme 1 Explore Profiling Data
🟢 Done fba339d tpch-nvme 1 Explore Profiling Data
🟢 Done fba339d polarsignals 1 Explore Profiling Data
🟢 Done fba339d statpopgen 1 Explore Profiling Data
🟢 Done fba339d tpcds-nvme 1 Explore Profiling Data
🟢 Done fba339d compress-bench 1 Explore Profiling Data
🟢 Done fba339d string-bench 1 Explore Profiling Data
🟢 Done 9a1dd03 polarsignals 1 Explore Profiling Data
🟢 Done 9a1dd03 clickbench-nvme 1 Explore Profiling Data
🟢 Done 9a1dd03 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 9a1dd03 tpch-nvme 1 Explore Profiling Data
🟢 Done 9a1dd03 tpch-s3 1 Explore Profiling Data
🟢 Done 9a1dd03 tpcds-nvme 1 Explore Profiling Data
🟢 Done 9a1dd03 fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress 9a1dd03 tpcds-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

joseph-isaacs and others added 2 commits November 3, 2026 09:27
Rebase of the DataFusion 56 / Arrow 60 upgrade onto current develop,
squashing the previous branch history (which contained develop merges).

- Pin DataFusion to an upstream development revision.
- Upgrade Arrow, Parquet and Parquet variant crates to 60.
- Upgrade object_store to 0.14.2 and align OpenDAL and Python adapters.
- Pin GeoArrow to its Arrow 60 upgrade and switch the TPC generators to
  their arrow_60 features.
- Adapt vortex-arrow, vortex-datafusion, vortex-bench, vortex-cuda,
  vortex-python-cuda and parquet-variant to the new APIs.
- Update SQL logic test expectations for DataFusion 56 behavior changes.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBD35DwxGJGzhd8A3L7
Signed-off-by: Joe Isaacs <[email protected]>
DataFusion now has a branch-56 release branch (56.0.0-dev). Point every
workspace DataFusion dependency at it instead of the earlier main
snapshot, and bump Arrow and Parquet to 60.1.0 to match it.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBD35DwxGJGzhd8A3L7
Signed-off-by: Joe Isaacs <[email protected]>
- `Metadata::insert` takes `impl Into<String>`, so pass the extension
  metadata key directly instead of the now-ambiguous `key.into()`.
- Arrow 60.1 deprecates `ArrowArrayStreamReader` in favour of
  `RecordBatchStreamReader`; use the new name.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs changed the title [reminder] chore: prepare DataFusion 56 upgrade [reminder] feat: prepare DataFusion 56 upgrade Nov 3, 2026
@joseph-isaacs joseph-isaacs added changelog/feature A new feature and removed changelog/break A breaking API change labels Nov 3, 2026
joseph-isaacs and others added 2 commits November 3, 2026 10:47
Pass metadata keys and values to `Metadata::insert` directly, and use
`RecordBatchStreamReader` in the vortex-uuid test.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
joseph-isaacs and others added 2 commits November 3, 2026 11:10
DataFusion 56 depends on parking_lot 0.13, whose parking_lot_core 0.10
requires smallvec ^1.15.2. Raise the workspace minimum so the
minimal-versions check can resolve.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
DataFusion 56's sqllogictest runner keeps decimal scale when formatting
results (apache/datafusion#24934), so `4.1` prints as `4.10`. Only
trailing zeros change; the values and row order are unchanged.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 3, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 4a19002f vs base d7aa24e8
Vortex (geomean): hot 0.947x ➖ · cold 1.010x ➖


datafusion / vortex-file-compressed / ns (0.947x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 80492084 / 80207008 / +0.4% 121965311 / 122170545 / -0.2% 0.66 / 0.66 / +0.5%
polarsignals_q01/datafusion:vortex-file-compressed 88084198 / 88872104 / -0.9% 147251632 / 149565648 / -1.5% 0.60 / 0.59 / +0.7%
polarsignals_q02/datafusion:vortex-file-compressed 13507714 / 12643154 / +6.8% 48230602 / 42595022 / +13.2% 🔴 0.28 / 0.30 / -5.6%
polarsignals_q03/datafusion:vortex-file-compressed 90214752 / 90806554 / -0.7% 150715983 / 155864427 / -3.3% 0.60 / 0.58 / +2.7%
polarsignals_q04/datafusion:vortex-file-compressed 9049060 / 9359742 / -3.3% 40695231 / 39195029 / +3.8% 0.22 / 0.24 / -6.9%
polarsignals_q05/datafusion:vortex-file-compressed 10636282 / 11584745 / -8.2% 43696984 / 43198399 / +1.2% 0.24 / 0.27 / -9.2%
polarsignals_q06/datafusion:vortex-file-compressed 24371355 / 23150708 / +5.3% 57352866 / 52862560 / +8.5% 0.42 / 0.44 / -3.0%
polarsignals_q07/datafusion:vortex-file-compressed 9170228 / 10706870 / -14.4% 🟢 41224983 / 41186256 / +0.1% 0.22 / 0.26 / -14.4%
polarsignals_q08/datafusion:vortex-file-compressed 125821100 / 135182665 / -6.9% 184541399 / 196070645 / -5.9% 0.68 / 0.69 / -1.1%
polarsignals_q09/datafusion:vortex-file-compressed 8266140 / 10085591 / -18.0% 🟢 38691523 / 39875650 / -3.0% 0.21 / 0.25 / -15.5%
polarsignals_q10/datafusion:vortex-file-compressed 11973594 / 13465176 / -11.1% 🟢 49892324 / 50399441 / -1.0% 0.24 / 0.27 / -10.2%
polarsignals_q11/datafusion:vortex-file-compressed 15047172 / 16149118 / -6.8% 49085765 / 48480200 / +1.2% 0.31 / 0.33 / -8.0%
polarsignals_q12/datafusion:vortex-file-compressed 15513463 / 16923686 / -8.3% 46974441 / 46622608 / +0.8% 0.33 / 0.36 / -9.0%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 4a19002f vs base d7aa24e8


vortex / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/strings/amazon/book_reviews/fsst 553626626 / 553374565 / +0.0% 553743940 / 553348470 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-12 969417956 / 966401221 / +0.3% 969501614 / 966077300 / +0.4% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-16 986117408 / 982786173 / +0.3% 987224955 / 983106497 / +0.4% 1.00 / 1.00 / -0.1%
compress time/strings/amazon/book_titles/fsst 57482986 / 57687337 / -0.4% 57504585 / 57699635 / -0.3% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_titles/onpair-12 87830842 / 87540102 / +0.3% 87868311 / 87512894 / +0.4% 1.00 / 1.00 / -0.1%
compress time/strings/amazon/book_titles/onpair-16 90938099 / 90912359 / +0.0% 90962167 / 90869640 / +0.1% 1.00 / 1.00 / -0.1%
compress time/strings/clickbench/url/shard-0/fsst 426038070 / 425760503 / +0.1% 425952809 / 425734201 / +0.1% 1.00 / 1.00 / +0.0%
compress time/strings/clickbench/url/shard-0/onpair-12 600147214 / 599359861 / +0.1% 599976019 / 599554119 / +0.1% 1.00 / 1.00 / +0.1%
compress time/strings/clickbench/url/shard-0/onpair-16 607916115 / 607350017 / +0.1% 607839225 / 607300641 / +0.1% 1.00 / 1.00 / +0.0%
compress time/strings/fineweb/text/fsst 213089095 / 213043714 / +0.0% 212950029 / 213261916 / -0.1% 1.00 / 1.00 / +0.2%
compress time/strings/fineweb/text/onpair-12 502699886 / 502274569 / +0.1% 503132944 / 502143700 / +0.2% 1.00 / 1.00 / -0.1%
compress time/strings/fineweb/text/onpair-16 518882086 / 519230013 / -0.1% 518118009 / 519544241 / -0.3% 1.00 / 1.00 / +0.2%
compress time/strings/news/headlines/fsst 331631740 / 332273584 / -0.2% 331579259 / 332504300 / -0.3% 1.00 / 1.00 / +0.1%
compress time/strings/news/headlines/onpair-12 462885180 / 461919947 / +0.2% 462709372 / 461777652 / +0.2% 1.00 / 1.00 / +0.0%
compress time/strings/news/headlines/onpair-16 475978671 / 474436622 / +0.3% 475624752 / 474260960 / +0.3% 1.00 / 1.00 / +0.0%
compress time/strings/tinystories/text/fsst 131537605 / 131633868 / -0.1% 131604653 / 131644061 / -0.0% 1.00 / 1.00 / -0.0%
compress time/strings/tinystories/text/onpair-12 217624128 / 216926014 / +0.3% 217552073 / 216939073 / +0.3% 1.00 / 1.00 / +0.0%
compress time/strings/tinystories/text/onpair-16 221594636 / 221067422 / +0.2% 221561711 / 220961874 / +0.3% 1.00 / 1.00 / -0.0%
compress time/strings/tpch/l_comment/fsst 1054510582 / 1056379438 / -0.2% 1054177709 / 1056501256 / -0.2% 1.00 / 1.00 / +0.0%
compress time/strings/tpch/l_comment/onpair-12 1023584549 / 1021085216 / +0.2% 1024278487 / 1021055233 / +0.3% 1.00 / 1.00 / -0.1%
compress time/strings/tpch/l_comment/onpair-16 1036506631 / 1034694384 / +0.2% 1036639360 / 1033955923 / +0.3% 1.00 / 1.00 / -0.1%
compress time/strings/twitter/sentiment140/fsst 554377444 / 555057747 / -0.1% 554322158 / 554666214 / -0.1% 1.00 / 1.00 / -0.1%
compress time/strings/twitter/sentiment140/onpair-12 940242816 / 936962547 / +0.4% 940464827 / 936762399 / +0.4% 1.00 / 1.00 / -0.0%
compress time/strings/twitter/sentiment140/onpair-16 1034415559 / 1031205912 / +0.3% 1034586192 / 1030910335 / +0.4% 1.00 / 1.00 / -0.0%
decompress time/strings/amazon/book_reviews/fsst 41538898 / 41473314 / +0.2% 41521169 / 41472563 / +0.1% 1.00 / 1.00 / +0.0%
decompress time/strings/amazon/book_reviews/onpair-12 30574271 / 30454503 / +0.4% 30485359 / 30485378 / -0.0% 1.00 / 1.00 / +0.4%
decompress time/strings/amazon/book_reviews/onpair-16 34300113 / 34114411 / +0.5% 34362282 / 34206116 / +0.5% 1.00 / 1.00 / +0.1%
decompress time/strings/amazon/book_titles/fsst 3442056 / 3437738 / +0.1% 3452166 / 3448620 / +0.1% 1.00 / 1.00 / +0.0%
decompress time/strings/amazon/book_titles/onpair-12 3141246 / 3133319 / +0.3% 3152138 / 3130386 / +0.7% 1.00 / 1.00 / -0.4%
decompress time/strings/amazon/book_titles/onpair-16 3022123 / 3011192 / +0.4% 3002251 / 3005280 / -0.1% 1.01 / 1.00 / +0.5%
decompress time/strings/clickbench/url/shard-0/fsst 31944110 / 31966234 / -0.1% 31905581 / 31997224 / -0.3% 1.00 / 1.00 / +0.2%
decompress time/strings/clickbench/url/shard-0/onpair-12 18927375 / 18936958 / -0.1% 19018424 / 18894714 / +0.7% 1.00 / 1.00 / -0.7%
decompress time/strings/clickbench/url/shard-0/onpair-16 18332189 / 18439157 / -0.6% 18363616 / 18479676 / -0.6% 1.00 / 1.00 / +0.0%
decompress time/strings/fineweb/text/fsst 10368855 / 10335152 / +0.3% 10374764 / 10366475 / +0.1% 1.00 / 1.00 / +0.2%
decompress time/strings/fineweb/text/onpair-12 9572646 / 9611226 / -0.4% 9607732 / 9645222 / -0.4% 1.00 / 1.00 / -0.0%
decompress time/strings/fineweb/text/onpair-16 8482148 / 8491077 / -0.1% 8492747 / 8487839 / +0.1% 1.00 / 1.00 / -0.2%
decompress time/strings/news/headlines/fsst 17833265 / 17766065 / +0.4% 17818680 / 17757991 / +0.3% 1.00 / 1.00 / +0.0%
decompress time/strings/news/headlines/onpair-12 17163146 / 17068960 / +0.6% 17211095 / 17083623 / +0.7% 1.00 / 1.00 / -0.2%
decompress time/strings/news/headlines/onpair-16 16183871 / 16109239 / +0.5% 16122063 / 16105281 / +0.1% 1.00 / 1.00 / +0.4%
decompress time/strings/tinystories/text/fsst 8905129 / 8896131 / +0.1% 8836196 / 8904089 / -0.8% 1.01 / 1.00 / +0.9%
decompress time/strings/tinystories/text/onpair-12 5940790 / 5943480 / -0.0% 5919738 / 5981648 / -1.0% 1.00 / 0.99 / +1.0%
decompress time/strings/tinystories/text/onpair-16 6674408 / 6599956 / +1.1% 6714264 / 6656086 / +0.9% 0.99 / 0.99 / +0.3%
decompress time/strings/tpch/l_comment/fsst 50989714 / 50823639 / +0.3% 51223857 / 50926364 / +0.6% 1.00 / 1.00 / -0.3%
decompress time/strings/tpch/l_comment/onpair-12 42922418 / 42657473 / +0.6% 42969537 / 42665125 / +0.7% 1.00 / 1.00 / -0.1%
decompress time/strings/tpch/l_comment/onpair-16 42732782 / 42393336 / +0.8% 42628612 / 42570812 / +0.1% 1.00 / 1.00 / +0.7%
decompress time/strings/twitter/sentiment140/fsst 36985634 / 36909527 / +0.2% 37013442 / 36875674 / +0.4% 1.00 / 1.00 / -0.2%
decompress time/strings/twitter/sentiment140/onpair-12 33900617 / 33716908 / +0.5% 33869191 / 33698469 / +0.5% 1.00 / 1.00 / +0.0%
decompress time/strings/twitter/sentiment140/onpair-16 34380911 / 34270679 / +0.3% 34363594 / 34212915 / +0.4% 1.00 / 1.00 / -0.1%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/strings/amazon/book_reviews/fsst 66249788 / 66249788 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-12 48618844 / 48618844 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-16 48243532 / 48243532 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/fsst 5434916 / 5434916 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-12 4765620 / 4765620 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-16 4892932 / 4892932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/fsst 49404124 / 49404124 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-12 29634068 / 29634068 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-16 30002076 / 30002076 / +0.0%
vortex-file-compressed size/strings/fineweb/text/fsst 17098836 / 17098836 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-12 13554932 / 13554932 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-16 12265644 / 12265644 / +0.0%
vortex-file-compressed size/strings/news/headlines/fsst 30677948 / 30677948 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-12 26430660 / 26430660 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-16 26907604 / 26907604 / +0.0%
vortex-file-compressed size/strings/tinystories/text/fsst 14908372 / 14908372 / +0.0%
vortex-file-compressed size/strings/tinystories/text/onpair-12 9300532 / 9300532 / +0.0%
vortex-file-compressed size/strings/tinystories/text/onpair-16 9201148 / 9201148 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/fsst 75050292 / 75050292 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-12 57417388 / 57417388 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-16 57453556 / 57453556 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/fsst 63507044 / 63507044 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-12 54111996 / 54111996 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-16 56471812 / 56471812 / +0.0%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 4a19002f vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Engines: DataFusion No clear signal (+7.0%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.028x ➖
Parquet (geomean): hot 0.982x ➖ · cold 1.027x ➖
Shifts: Parquet (control) -1.8% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.012x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 5961303 / 6067278 / -1.7% 22262971 / 21059985 / +5.7% 0.27 / 0.29 / -7.1%
fineweb_q01/datafusion:vortex-file-compressed 10458047 / 9633082 / +8.6% 39629788 / 36781752 / +7.7% 0.26 / 0.26 / +0.8%
fineweb_q02/datafusion:vortex-file-compressed 11077954 / 11351798 / -2.4% 44055925 / 43148426 / +2.1% 0.25 / 0.26 / -4.4%
fineweb_q03/datafusion:vortex-file-compressed 17867426 / 17431408 / +2.5% 102045783 / 107562391 / -5.1% 0.18 / 0.16 / +8.0%
fineweb_q04/datafusion:vortex-file-compressed 66114576 / 65366990 / +1.1% 145003328 / 146428576 / -1.0% 0.46 / 0.45 / +2.1%
fineweb_q05/datafusion:vortex-file-compressed 62397996 / 61808253 / +1.0% 142716043 / 136679897 / +4.4% 0.44 / 0.45 / -3.3%
fineweb_q06/datafusion:vortex-file-compressed 17182481 / 16453021 / +4.4% 108694428 / 106354986 / +2.2% 0.16 / 0.15 / +2.2%
fineweb_q07/datafusion:vortex-file-compressed 18226455 / 17573036 / +3.7% 111399266 / 104436964 / +6.7% 0.16 / 0.17 / -2.8%
fineweb_q08/datafusion:vortex-file-compressed 11061913 / 11710835 / -5.5% 32140878 / 31173220 / +3.1% 0.34 / 0.38 / -8.4%
datafusion / vortex-compact / ns (1.019x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6104226 / 6130294 / -0.4% 24243301 / 21419180 / +13.2% 🔴 0.25 / 0.29 / -12.0%
fineweb_q01/datafusion:vortex-compact 101837222 / 102285114 / -0.4% 140669333 / 130216152 / +8.0% 0.72 / 0.79 / -7.8%
fineweb_q02/datafusion:vortex-compact 102743141 / 102704982 / +0.0% 142638793 / 135510240 / +5.3% 0.72 / 0.76 / -5.0%
fineweb_q03/datafusion:vortex-compact 211882176 / 178973922 / +18.4% 🔴 257211259 / 255171741 / +0.8% 0.82 / 0.70 / +17.4%
fineweb_q04/datafusion:vortex-compact 200459134 / 184990164 / +8.4% 281141459 / 262866692 / +7.0% 0.71 / 0.70 / +1.3%
fineweb_q05/datafusion:vortex-compact 188163142 / 180023220 / +4.5% 260701907 / 256479750 / +1.6% 0.72 / 0.70 / +2.8%
fineweb_q06/datafusion:vortex-compact 117050038 / 116567120 / +0.4% 229205957 / 197309809 / +16.2% 🔴 0.51 / 0.59 / -13.6%
fineweb_q07/datafusion:vortex-compact 123505440 / 119578184 / +3.3% 194226708 / 195256484 / -0.5% 0.64 / 0.61 / +3.8%
fineweb_q08/datafusion:vortex-compact 8429022 / 9842427 / -14.4% 🟢 30334049 / 27555132 / +10.1% 🔴 0.28 / 0.36 / -22.2%
datafusion / parquet / ns (0.949x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 7795729 / 9586358 / -18.7% 🟢 36997031 / 32387687 / +14.2% 🔴 0.21 / 0.30 / -28.8%
fineweb_q01/datafusion:parquet 71364413 / 74831982 / -4.6% 158080437 / 153189573 / +3.2% 0.45 / 0.49 / -7.6%
fineweb_q02/datafusion:parquet 71293960 / 75553682 / -5.6% 153227226 / 154348918 / -0.7% 0.47 / 0.49 / -4.9%
fineweb_q03/datafusion:parquet 71216074 / 74757180 / -4.7% 154927973 / 150439925 / +3.0% 0.46 / 0.50 / -7.5%
fineweb_q04/datafusion:parquet 79950009 / 82348459 / -2.9% 157144492 / 154498118 / +1.7% 0.51 / 0.53 / -4.5%
fineweb_q05/datafusion:parquet 78456736 / 80349672 / -2.4% 155696607 / 152607785 / +2.0% 0.50 / 0.53 / -4.3%
fineweb_q06/datafusion:parquet 73610940 / 74914664 / -1.7% 160313923 / 159496858 / +0.5% 0.46 / 0.47 / -2.2%
fineweb_q07/datafusion:parquet 72542548 / 73287881 / -1.0% 161692514 / 152779595 / +5.8% 0.45 / 0.48 / -6.5%
fineweb_q08/datafusion:parquet 70634982 / 72793622 / -3.0% 150324984 / 152326317 / -1.3% 0.47 / 0.48 / -1.7%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2062654 / 2128975 / -3.1% 8193887 / 8713538 / -6.0% 0.25 / 0.24 / +3.0%
fineweb_q01/duckdb:vortex-file-compressed 8746821 / 9115610 / -4.0% 29785487 / 29315195 / +1.6% 0.29 / 0.31 / -5.6%
fineweb_q02/duckdb:vortex-file-compressed 10933955 / 10649331 / +2.7% 30056514 / 31635082 / -5.0% 0.36 / 0.34 / +8.1%
fineweb_q03/duckdb:vortex-file-compressed 17787584 / 17755047 / +0.2% 98302888 / 96568771 / +1.8% 0.18 / 0.18 / -1.6%
fineweb_q04/duckdb:vortex-file-compressed 69298500 / 70352541 / -1.5% 120317271 / 111997973 / +7.4% 0.58 / 0.63 / -8.3%
fineweb_q05/duckdb:vortex-file-compressed 68344978 / 68742922 / -0.6% 115007880 / 107394828 / +7.1% 0.59 / 0.64 / -7.2%
fineweb_q06/duckdb:vortex-file-compressed 18409959 / 18317284 / +0.5% 89570381 / 88668795 / +1.0% 0.21 / 0.21 / -0.5%
fineweb_q07/duckdb:vortex-file-compressed 19450404 / 19457084 / -0.0% 88147922 / 88817710 / -0.8% 0.22 / 0.22 / +0.7%
fineweb_q08/duckdb:vortex-file-compressed 4552936 / 4311257 / +5.6% 13022067 / 13685961 / -4.9% 0.35 / 0.32 / +11.0%
duckdb / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2280411 / 2241304 / +1.7% 8285764 / 8102671 / +2.3% 0.28 / 0.28 / -0.5%
fineweb_q01/duckdb:vortex-compact 70732722 / 71329661 / -0.8% 90875234 / 90422562 / +0.5% 0.78 / 0.79 / -1.3%
fineweb_q02/duckdb:vortex-compact 72371812 / 72343988 / +0.0% 92952749 / 91559641 / +1.5% 0.78 / 0.79 / -1.5%
fineweb_q03/duckdb:vortex-compact 185786142 / 185160935 / +0.3% 219803848 / 218819193 / +0.4% 0.85 / 0.85 / -0.1%
fineweb_q04/duckdb:vortex-compact 195202546 / 194460758 / +0.4% 233136366 / 232453342 / +0.3% 0.84 / 0.84 / +0.1%
fineweb_q05/duckdb:vortex-compact 188246470 / 188450906 / -0.1% 224339773 / 223605662 / +0.3% 0.84 / 0.84 / -0.4%
fineweb_q06/duckdb:vortex-compact 113891588 / 113660168 / +0.2% 154373740 / 151331343 / +2.0% 0.74 / 0.75 / -1.8%
fineweb_q07/duckdb:vortex-compact 115604271 / 114657804 / +0.8% 155691830 / 153330681 / +1.5% 0.74 / 0.75 / -0.7%
fineweb_q08/duckdb:vortex-compact 4673112 / 4497156 / +3.9% 11778128 / 11247223 / +4.7% 0.40 / 0.40 / -0.8%
duckdb / parquet / ns (1.017x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23874724 / 22859516 / +4.4% 28334653 / 27571377 / +2.8% 0.84 / 0.83 / +1.6%
fineweb_q01/duckdb:parquet 54139377 / 53319876 / +1.5% 75618522 / 73175083 / +3.3% 0.72 / 0.73 / -1.7%
fineweb_q02/duckdb:parquet 58640206 / 56970692 / +2.9% 77210251 / 80112905 / -3.6% 0.76 / 0.71 / +6.8%
fineweb_q03/duckdb:parquet 118582963 / 117366814 / +1.0% 185382814 / 178403413 / +3.9% 0.64 / 0.66 / -2.8%
fineweb_q04/duckdb:parquet 161693021 / 162799730 / -0.7% 209572370 / 201601982 / +4.0% 0.77 / 0.81 / -4.5%
fineweb_q05/duckdb:parquet 158276897 / 156353200 / +1.2% 208794674 / 198611530 / +5.1% 0.76 / 0.79 / -3.7%
fineweb_q06/duckdb:parquet 88163686 / 87204256 / +1.1% 146977122 / 143345903 / +2.5% 0.60 / 0.61 / -1.4%
fineweb_q07/duckdb:parquet 89340182 / 88988136 / +0.4% 148270868 / 145412729 / +2.0% 0.60 / 0.61 / -1.5%
fineweb_q08/duckdb:parquet 28947335 / 28070532 / +3.1% 30540114 / 30041810 / +1.7% 0.95 / 0.93 / +1.4%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 4a19002f vs base d7aa24e8


vortex / vortex-file-compressed / ns (1.003x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 452934294 / 454527430 / -0.4% 452418747 / 451941005 / +0.1% 1.00 / 1.01 / -0.5%
compress time/bimbo 2337250936 / 2341380717 / -0.2% 2314083696 / 2336675440 / -1.0% 1.01 / 1.00 / +0.8%
compress time/cmsprovider 1051842976 / 1056268062 / -0.4% 1039619621 / 1046338108 / -0.6% 1.01 / 1.01 / +0.2%
compress time/euro2016 171958964 / 169973308 / +1.2% 170714287 / 170459897 / +0.1% 1.01 / 1.00 / +1.0%
compress time/food 207555471 / 207647122 / -0.0% 211314074 / 212928999 / -0.8% 0.98 / 0.98 / +0.7%
compress time/hashtags 361945432 / 357279999 / +1.3% 354557279 / 351315599 / +0.9% 1.02 / 1.02 / +0.4%
compress time/sparse-wide-flat-runs 96211717 / 88799985 / +8.3% 90919132 / 92529318 / -1.7% 1.06 / 0.96 / +10.3%
compress time/sparse-wide-lists-runs 663211550 / 654549474 / +1.3% 647329847 / 683398765 / -5.3% 1.02 / 0.96 / +7.0%
compress time/sparse-wide-lists-shuffled 311923906 / 294948908 / +5.8% 277629058 / 294480200 / -5.7% 1.12 / 1.00 / +12.2%
compress time/sparse-wide-nested-child-nulls 601782555 / 624470020 / -3.6% 616952383 / 622438714 / -0.9% 0.98 / 1.00 / -2.8%
compress time/sparse-wide-nested-runs 602448998 / 615069400 / -2.1% 620173376 / 609407933 / +1.8% 0.97 / 1.01 / -3.8%
compress time/statpopgen 631390113 / 547989387 / +15.2% 🔴 558210737 / 549321593 / +1.6% 1.13 / 1.00 / +13.4%
compress time/taxi 205829759 / 206206730 / -0.2% 205411133 / 209696092 / -2.0% 1.00 / 0.98 / +1.9%
compress time/tpc-h l_comment canonical 107462419 / 106651730 / +0.8% 109233997 / 109961277 / -0.7% 0.98 / 0.97 / +1.4%
compress time/tpc-h l_comment chunked 107529002 / 106557425 / +0.9% 109009195 / 109510809 / -0.5% 0.99 / 0.97 / +1.4%
compress time/tpc-h sf1 lineitem 401981292 / 401043886 / +0.2% 397700139 / 401754096 / -1.0% 1.01 / 1.00 / +1.3%
compress time/tpc-h sf1 orders 86442963 / 86108562 / +0.4% 87640815 / 87312504 / +0.4% 0.99 / 0.99 / +0.0%
compress time/tpc-h sf1 partsupp 58504904 / 58167654 / +0.6% 60054255 / 59651514 / +0.7% 0.97 / 0.98 / -0.1%
compress time/wide table cols=100 chunks=1 rows=1000 5667124 / 5607524 / +1.1% 7382553 / 8009054 / -7.8% 0.77 / 0.70 / +9.6%
compress time/wide table cols=100 chunks=50 rows=1000 5635950 / 5798495 / -2.8% 7717861 / 7681615 / +0.5% 0.73 / 0.75 / -3.3%
compress time/wide table cols=1000 chunks=1 rows=1000 55331532 / 55929346 / -1.1% 59171655 / 59025811 / +0.2% 0.94 / 0.95 / -1.3%
compress time/wide table cols=1000 chunks=50 rows=1000 56378055 / 56441294 / -0.1% 58858539 / 60107468 / -2.1% 0.96 / 0.94 / +2.0%
compress time/wide table cols=10000 chunks=1 rows=1000 647411668 / 642746760 / +0.7% 640110760 / 646227683 / -0.9% 1.01 / 0.99 / +1.7%
compress time/wide table cols=10000 chunks=50 rows=1000 646214888 / 645477195 / +0.1% 642873569 / 643697525 / -0.1% 1.01 / 1.00 / +0.2%
decompress time/arade 14890514 / 14969564 / -0.5% 17210678 / 15731086 / +9.4% 0.87 / 0.95 / -9.1%
decompress time/bimbo 67233853 / 67164954 / +0.1% 70888479 / 68400912 / +3.6% 0.95 / 0.98 / -3.4%
decompress time/cmsprovider 39333155 / 38818999 / +1.3% 41238195 / 44242261 / -6.8% 0.95 / 0.88 / +8.7%
decompress time/euro2016 12157736 / 11999394 / +1.3% 12772741 / 12626439 / +1.2% 0.95 / 0.95 / +0.2%
decompress time/food 3918878 / 3800245 / +3.1% 4823458 / 4832322 / -0.2% 0.81 / 0.79 / +3.3%
decompress time/hashtags 42946201 / 42010312 / +2.2% 44129144 / 43016062 / +2.6% 0.97 / 0.98 / -0.4%
decompress time/sparse-wide-flat-runs 11907896 / 11380133 / +4.6% 12705677 / 11944192 / +6.4% 0.94 / 0.95 / -1.6%
decompress time/sparse-wide-lists-runs 16337045 / 16614846 / -1.7% 16806638 / 16706839 / +0.6% 0.97 / 0.99 / -2.3%
decompress time/sparse-wide-lists-shuffled 26570950 / 26707084 / -0.5% 26927541 / 27397422 / -1.7% 0.99 / 0.97 / +1.2%
decompress time/sparse-wide-nested-child-nulls 15715316 / 17149647 / -8.4% 17774787 / 16216399 / +9.6% 0.88 / 1.06 / -16.4%
decompress time/sparse-wide-nested-runs 14151693 / 17346204 / -18.4% 🟢 15867527 / 17276870 / -8.2% 0.89 / 1.00 / -11.2%
decompress time/statpopgen 895357846 / 893523102 / +0.2% 894339309 / 901138681 / -0.8% 1.00 / 0.99 / +1.0%
decompress time/taxi 10548166 / 10260964 / +2.8% 12543672 / 11276489 / +11.2% 🔴 0.84 / 0.91 / -7.6%
decompress time/tpc-h l_comment canonical 5059146 / 5032376 / +0.5% 5116780 / 5387345 / -5.0% 0.99 / 0.93 / +5.8%
decompress time/tpc-h l_comment chunked 5046514 / 5049709 / -0.1% 5289639 / 5393348 / -1.9% 0.95 / 0.94 / +1.9%
decompress time/tpc-h sf1 lineitem 15187430 / 15083704 / +0.7% 15649846 / 15074054 / +3.8% 0.97 / 1.00 / -3.0%
decompress time/tpc-h sf1 orders 3976153 / 3956142 / +0.5% 4509408 / 4349571 / +3.7% 0.88 / 0.91 / -3.1%
decompress time/tpc-h sf1 partsupp 3192241 / 3181786 / +0.3% 3534985 / 3516642 / +0.5% 0.90 / 0.90 / -0.2%
decompress time/wide table cols=100 chunks=1 rows=1000 1547332 / 1535256 / +0.8% 1676877 / 1602877 / +4.6% 0.92 / 0.96 / -3.7%
decompress time/wide table cols=100 chunks=50 rows=1000 1549194 / 1522540 / +1.8% 1672606 / 1686622 / -0.8% 0.93 / 0.90 / +2.6%
decompress time/wide table cols=1000 chunks=1 rows=1000 13805344 / 13821553 / -0.1% 14656017 / 14442364 / +1.5% 0.94 / 0.96 / -1.6%
decompress time/wide table cols=1000 chunks=50 rows=1000 13842114 / 13871034 / -0.2% 14550516 / 14304886 / +1.7% 0.95 / 0.97 / -1.9%
decompress time/wide table cols=10000 chunks=1 rows=1000 144711104 / 142617036 / +1.5% 147422095 / 142916037 / +3.2% 0.98 / 1.00 / -1.6%
decompress time/wide table cols=10000 chunks=50 rows=1000 144605735 / 141822590 / +2.0% 147531526 / 143530129 / +2.8% 0.98 / 0.99 / -0.8%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/arade 142108908 / 142108908 / +0.0%
vortex-file-compressed size/bimbo 425251924 / 425251924 / +0.0%
vortex-file-compressed size/cmsprovider 416254308 / 416254308 / +0.0%
vortex-file-compressed size/euro2016 164044372 / 164044372 / +0.0%
vortex-file-compressed size/food 38951184 / 38951184 / +0.0%
vortex-file-compressed size/hashtags 183585892 / 183585892 / +0.0%
vortex-file-compressed size/sparse-wide-flat-runs 1552392 / 1552392 / +0.0%
vortex-file-compressed size/sparse-wide-lists-runs 3991596 / 3991596 / +0.0%
vortex-file-compressed size/sparse-wide-lists-shuffled 6436476 / 6436476 / +0.0%
vortex-file-compressed size/sparse-wide-nested-child-nulls 1687364 / 1687364 / +0.0%
vortex-file-compressed size/sparse-wide-nested-runs 1298420 / 1298420 / +0.0%
vortex-file-compressed size/statpopgen 251914932 / 251914932 / +0.0%
vortex-file-compressed size/taxi 49091068 / 49091068 / +0.0%
vortex-file-compressed size/tpc-h l_comment canonical 75050436 / 75050436 / +0.0%
vortex-file-compressed size/tpc-h l_comment chunked 75050436 / 75050436 / +0.0%
vortex-file-compressed size/tpc-h sf1 lineitem 173478160 / 173478160 / +0.0%
vortex-file-compressed size/tpc-h sf1 orders 42977780 / 42977780 / +0.0%
vortex-file-compressed size/tpc-h sf1 partsupp 25940480 / 25940480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934856 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934856 / 934856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9333656 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9333656 / 9333656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93357656 / 93357656 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93357656 / 93357656 / +0.0%
vortex / parquet / ns (0.933x ➖, 12↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 1114749322 / 1160980847 / -4.0% 1121964211 / 1164511410 / -3.7% 0.99 / 1.00 / -0.3%
compress time/bimbo 1842536860 / 2132269092 / -13.6% 🟢 1842000604 / 2136919003 / -13.8% 🟢 1.00 / 1.00 / +0.2%
compress time/cmsprovider 1649683245 / 1665852346 / -1.0% 1649115492 / 1673810748 / -1.5% 1.00 / 1.00 / +0.5%
compress time/euro2016 990285328 / 996386076 / -0.6% 994083534 / 1031908599 / -3.7% 1.00 / 0.97 / +3.2%
compress time/food 384794088 / 406503569 / -5.3% 387574294 / 406268761 / -4.6% 0.99 / 1.00 / -0.8%
compress time/hashtags 529116849 / 536436095 / -1.4% 540612572 / 547150148 / -1.2% 0.98 / 0.98 / -0.2%
compress time/sparse-wide-flat-runs 42648477 / 41928002 / +1.7% 42223206 / 42760297 / -1.3% 1.01 / 0.98 / +3.0%
compress time/sparse-wide-lists-runs 82658398 / 81171288 / +1.8% 82912363 / 82213757 / +0.8% 1.00 / 0.99 / +1.0%
compress time/sparse-wide-lists-shuffled 158075390 / 155816614 / +1.4% 156996990 / 155454995 / +1.0% 1.01 / 1.00 / +0.5%
compress time/sparse-wide-nested-child-nulls 55318664 / 54438388 / +1.6% 55864979 / 54789844 / +2.0% 0.99 / 0.99 / -0.3%
compress time/sparse-wide-nested-runs 55963802 / 55325594 / +1.2% 56869867 / 56258579 / +1.1% 0.98 / 0.98 / +0.1%
compress time/statpopgen 980842068 / 1026518314 / -4.4% 993283073 / 1044349280 / -4.9% 0.99 / 0.98 / +0.5%
compress time/taxi 229568603 / 238731866 / -3.8% 230187270 / 242123381 / -4.9% 1.00 / 0.99 / +1.1%
compress time/tpc-h l_comment canonical 712397537 / 721449900 / -1.3% 713228946 / 723438435 / -1.4% 1.00 / 1.00 / +0.2%
compress time/tpc-h l_comment chunked 711948058 / 720705690 / -1.2% 714066979 / 721225666 / -1.0% 1.00 / 1.00 / -0.2%
compress time/tpc-h sf1 lineitem 1189276186 / 1200226508 / -0.9% 1198723555 / 1200048284 / -0.1% 0.99 / 1.00 / -0.8%
compress time/tpc-h sf1 orders 336300937 / 340652835 / -1.3% 339995468 / 348794913 / -2.5% 0.99 / 0.98 / +1.3%
compress time/tpc-h sf1 partsupp 305470497 / 305713314 / -0.1% 306619273 / 307244364 / -0.2% 1.00 / 1.00 / +0.1%
compress time/wide table cols=100 chunks=1 rows=1000 3562888 / 3770865 / -5.5% 3804987 / 4282314 / -11.1% 🟢 0.94 / 0.88 / +6.3%
compress time/wide table cols=100 chunks=50 rows=1000 3526153 / 3819834 / -7.7% 3663721 / 4452856 / -17.7% 🟢 0.96 / 0.86 / +12.2%
compress time/wide table cols=1000 chunks=1 rows=1000 34634338 / 37207866 / -6.9% 36281041 / 38517127 / -5.8% 0.95 / 0.97 / -1.2%
compress time/wide table cols=1000 chunks=50 rows=1000 34614316 / 36467344 / -5.1% 35432342 / 37968323 / -6.7% 0.98 / 0.96 / +1.7%
compress time/wide table cols=10000 chunks=1 rows=1000 352963510 / 375462918 / -6.0% 360556584 / 387263628 / -6.9% 0.98 / 0.97 / +1.0%
compress time/wide table cols=10000 chunks=50 rows=1000 353570148 / 374621006 / -5.6% 358705152 / 375129888 / -4.4% 0.99 / 1.00 / -1.3%
decompress time/arade 54595011 / 54623412 / -0.1% 54754917 / 55227711 / -0.9% 1.00 / 0.99 / +0.8%
decompress time/bimbo 92971816 / 92134340 / +0.9% 93018958 / 93044791 / -0.0% 1.00 / 0.99 / +0.9%
decompress time/cmsprovider 103033659 / 103414818 / -0.4% 102894158 / 103779598 / -0.9% 1.00 / 1.00 / +0.5%
decompress time/euro2016 159096940 / 159432276 / -0.2% 159297634 / 160083005 / -0.5% 1.00 / 1.00 / +0.3%
decompress time/food 26511029 / 26602648 / -0.3% 26585603 / 27270966 / -2.5% 1.00 / 0.98 / +2.2%
decompress time/hashtags 444782052 / 446287218 / -0.3% 444984218 / 447292464 / -0.5% 1.00 / 1.00 / +0.2%
decompress time/sparse-wide-flat-runs 15042036 / 15072244 / -0.2% 15579042 / 15494384 / +0.5% 0.97 / 0.97 / -0.7%
decompress time/sparse-wide-lists-runs 197323727 / 277153844 / -28.8% 🟢 197639838 / 277301160 / -28.7% 🟢 1.00 / 1.00 / -0.1%
decompress time/sparse-wide-lists-shuffled 246057360 / 318723824 / -22.8% 🟢 246076022 / 319100149 / -22.9% 🟢 1.00 / 1.00 / +0.1%
decompress time/sparse-wide-nested-child-nulls 37650040 / 52993318 / -29.0% 🟢 38080625 / 53441472 / -28.7% 🟢 0.99 / 0.99 / -0.3%
decompress time/sparse-wide-nested-runs 37428700 / 52938958 / -29.3% 🟢 37830565 / 53173753 / -28.9% 🟢 0.99 / 1.00 / -0.6%
decompress time/statpopgen 2268815966 / 2906582631 / -21.9% 🟢 2301551740 / 2924912768 / -21.3% 🟢 0.99 / 0.99 / -0.8%
decompress time/taxi 60897200 / 60742935 / +0.3% 61258393 / 60614603 / +1.1% 0.99 / 1.00 / -0.8%
decompress time/tpc-h l_comment canonical 35962288 / 35974300 / -0.0% 36088230 / 36185714 / -0.3% 1.00 / 0.99 / +0.2%
decompress time/tpc-h l_comment chunked 35970939 / 36025964 / -0.2% 36049421 / 36110852 / -0.2% 1.00 / 1.00 / +0.0%
decompress time/tpc-h sf1 lineitem 82256288 / 82126792 / +0.2% 82571676 / 82894262 / -0.4% 1.00 / 0.99 / +0.5%
decompress time/tpc-h sf1 orders 87978260 / 88220689 / -0.3% 88423099 / 88750971 / -0.4% 0.99 / 0.99 / +0.1%
decompress time/tpc-h sf1 partsupp 111035890 / 111217022 / -0.2% 111354004 / 111930856 / -0.5% 1.00 / 0.99 / +0.4%
decompress time/wide table cols=100 chunks=1 rows=1000 1629584 / 1964891 / -17.1% 🟢 1853349 / 2130357 / -13.0% 🟢 0.88 / 0.92 / -4.7%
decompress time/wide table cols=100 chunks=50 rows=1000 1579552 / 1947252 / -18.9% 🟢 1835052 / 2158280 / -15.0% 🟢 0.86 / 0.90 / -4.6%
decompress time/wide table cols=1000 chunks=1 rows=1000 19074826 / 22259180 / -14.3% 🟢 19463627 / 22952654 / -15.2% 🟢 0.98 / 0.97 / +1.1%
decompress time/wide table cols=1000 chunks=50 rows=1000 18571002 / 22064970 / -15.8% 🟢 18935128 / 22625779 / -16.3% 🟢 0.98 / 0.98 / +0.6%
decompress time/wide table cols=10000 chunks=1 rows=1000 195768582 / 231661658 / -15.5% 🟢 198150797 / 234375924 / -15.5% 🟢 0.99 / 0.99 / -0.0%
decompress time/wide table cols=10000 chunks=50 rows=1000 196155774 / 231044347 / -15.1% 🟢 197596131 / 232753130 / -15.1% 🟢 0.99 / 0.99 / +0.0%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/arade 210020851 / 210020851 / +0.0%
parquet size/bimbo 376187078 / 376187078 / +0.0%
parquet size/cmsprovider 364268159 / 364268159 / +0.0%
parquet size/euro2016 111035158 / 111035158 / +0.0%
parquet size/food 34903783 / 34903783 / +0.0%
parquet size/hashtags 126189203 / 126189203 / +0.0%
parquet size/sparse-wide-flat-runs 1388944 / 1388944 / +0.0%
parquet size/sparse-wide-lists-runs 4327813 / 4327813 / +0.0%
parquet size/sparse-wide-lists-shuffled 5710569 / 5710569 / +0.0%
parquet size/sparse-wide-nested-child-nulls 1266042 / 1266042 / +0.0%
parquet size/sparse-wide-nested-runs 1388944 / 1388944 / +0.0%
parquet size/statpopgen 81284006 / 81284006 / +0.0%
parquet size/taxi 52142534 / 52142534 / +0.0%
parquet size/tpc-h l_comment canonical 52204116 / 52204116 / +0.0%
parquet size/tpc-h l_comment chunked 52204116 / 52204116 / +0.0%
parquet size/tpc-h sf1 lineitem 153403836 / 153403836 / +0.0%
parquet size/tpc-h sf1 orders 37029542 / 37029542 / +0.0%
parquet size/tpc-h sf1 partsupp 29200612 / 29200612 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.980x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 95223647 / 95325786 / -0.1% 118374508 / 120894699 / -2.1% 0.80 / 0.79 / +2.0%
compress time/bimbo 604268490 / 605468624 / -0.2% 668376597 / 672187068 / -0.6% 0.90 / 0.90 / +0.4%
compress time/cmsprovider 378241476 / 379189364 / -0.2% 439177785 / 443569798 / -1.0% 0.86 / 0.85 / +0.7%
compress time/euro2016 38306568 / 38431054 / -0.3% 51431008 / 53233130 / -3.4% 0.74 / 0.72 / +3.2%
compress time/food 39989932 / 40302864 / -0.8% 53237566 / 54431863 / -2.2% 0.75 / 0.74 / +1.4%
compress time/hashtags 77899316 / 78196460 / -0.4% 105349447 / 106701310 / -1.3% 0.74 / 0.73 / +0.9%
compress time/sparse-wide-flat-runs 27920730 / 27963923 / -0.2% 36540322 / 37288056 / -2.0% 0.76 / 0.75 / +1.9%
compress time/sparse-wide-lists-runs 44745154 / 45339182 / -1.3% 50953166 / 52874285 / -3.6% 0.88 / 0.86 / +2.4%
compress time/sparse-wide-lists-shuffled 44944506 / 45373602 / -0.9% 51749313 / 50722556 / +2.0% 0.87 / 0.89 / -2.9%
compress time/sparse-wide-nested-child-nulls 40583304 / 40922712 / -0.8% 50214687 / 51186908 / -1.9% 0.81 / 0.80 / +1.1%
compress time/sparse-wide-nested-runs 40721144 / 40857735 / -0.3% 50381285 / 50897249 / -1.0% 0.81 / 0.80 / +0.7%
compress time/statpopgen 215820690 / 216449334 / -0.3% 261577443 / 262474304 / -0.3% 0.83 / 0.82 / +0.1%
compress time/taxi 58789308 / 59161221 / -0.6% 75044278 / 76379683 / -1.7% 0.78 / 0.77 / +1.1%
compress time/tpc-h l_comment canonical 22611874 / 22740962 / -0.6% 30250429 / 31402578 / -3.7% 0.75 / 0.72 / +3.2%
compress time/tpc-h l_comment chunked 22463248 / 22728196 / -1.2% 30234510 / 31431660 / -3.8% 0.74 / 0.72 / +2.7%
compress time/tpc-h sf1 lineitem 127616666 / 128452142 / -0.7% 161666136 / 164822125 / -1.9% 0.79 / 0.78 / +1.3%
compress time/tpc-h sf1 orders 24561256 / 24810072 / -1.0% 33478315 / 34843888 / -3.9% 0.73 / 0.71 / +3.0%
compress time/tpc-h sf1 partsupp 13095802 / 13146375 / -0.4% 18478443 / 19469192 / -5.1% 0.71 / 0.68 / +5.0%
compress time/wide table cols=100 chunks=1 rows=1000 194270.5 / 192580 / +0.9% 381630 / 682506 / -44.1% 🟢 0.51 / 0.28 / +80.4%
compress time/wide table cols=100 chunks=50 rows=1000 196101.5 / 197053.5 / -0.5% 376880 / 645588 / -41.6% 🟢 0.52 / 0.31 / +70.5%
compress time/wide table cols=1000 chunks=1 rows=1000 2314972 / 2346302 / -1.3% 2852945 / 3222546 / -11.5% 🟢 0.81 / 0.73 / +11.4%
compress time/wide table cols=1000 chunks=50 rows=1000 2203926 / 2319638 / -5.0% 2817066 / 3111671 / -9.5% 0.78 / 0.75 / +4.9%
compress time/wide table cols=10000 chunks=1 rows=1000 24489644 / 25078118 / -2.3% 30879312 / 31502768 / -2.0% 0.79 / 0.80 / -0.4%
compress time/wide table cols=10000 chunks=50 rows=1000 24573334 / 25191449 / -2.5% 30953165 / 31460513 / -1.6% 0.79 / 0.80 / -0.9%
decompress time/arade 192475258 / 217556577 / -11.5% 🟢 192744790 / 217830529 / -11.5% 🟢 1.00 / 1.00 / -0.0%
decompress time/bimbo 425470678 / 415286534 / +2.5% 426995050 / 416764238 / +2.5% 1.00 / 1.00 / -0.0%
decompress time/cmsprovider 614389942 / 694918878 / -11.6% 🟢 617166018 / 695944470 / -11.3% 🟢 1.00 / 1.00 / -0.3%
decompress time/euro2016 77868066 / 85557496 / -9.0% 78175659 / 85804002 / -8.9% 1.00 / 1.00 / -0.1%
decompress time/food 67406536 / 67448626 / -0.1% 67545926 / 67584584 / -0.1% 1.00 / 1.00 / -0.0%
decompress time/hashtags 148829503 / 164316418 / -9.4% 149168611 / 164764417 / -9.5% 1.00 / 1.00 / +0.0%
decompress time/sparse-wide-flat-runs 18682685 / 18822500 / -0.7% 19946573 / 19862985 / +0.4% 0.94 / 0.95 / -1.2%
decompress time/sparse-wide-lists-runs 81763057 / 81379676 / +0.5% 82006166 / 81758276 / +0.3% 1.00 / 1.00 / +0.2%
decompress time/sparse-wide-lists-shuffled 81532939 / 81973409 / -0.5% 81777500 / 82251847 / -0.6% 1.00 / 1.00 / +0.0%
decompress time/sparse-wide-nested-child-nulls 26425792 / 26690004 / -1.0% 27042947 / 28446473 / -4.9% 0.98 / 0.94 / +4.1%
decompress time/sparse-wide-nested-runs 26451964 / 26945818 / -1.8% 27847899 / 28620172 / -2.7% 0.95 / 0.94 / +0.9%
decompress time/statpopgen 443922226 / 463167369 / -4.2% 444144637 / 462854491 / -4.0% 1.00 / 1.00 / -0.1%
decompress time/taxi 48976784 / 51411278 / -4.7% 49302009 / 51710123 / -4.7% 0.99 / 0.99 / -0.1%
decompress time/tpc-h l_comment canonical 36879242 / 39961182 / -7.7% 37259207 / 40306160 / -7.6% 0.99 / 0.99 / -0.2%
decompress time/tpc-h l_comment chunked 38548858 / 39986468 / -3.6% 38850113 / 40321147 / -3.6% 0.99 / 0.99 / +0.1%
decompress time/tpc-h sf1 lineitem 181316334 / 190075776 / -4.6% 181800244 / 190424140 / -4.5% 1.00 / 1.00 / -0.1%
decompress time/tpc-h sf1 orders 37206960 / 38613534 / -3.6% 37292472 / 38748735 / -3.8% 1.00 / 1.00 / +0.1%
decompress time/tpc-h sf1 partsupp 13372380 / 13734521 / -2.6% 13493031 / 13867919 / -2.7% 0.99 / 0.99 / +0.1%
decompress time/wide table cols=100 chunks=1 rows=1000 323375 / 314547 / +2.8% 344183 / 340840 / +1.0% 0.94 / 0.92 / +1.8%
decompress time/wide table cols=100 chunks=50 rows=1000 321465 / 319449.5 / +0.6% 342330 / 349593 / -2.1% 0.94 / 0.91 / +2.8%
decompress time/wide table cols=1000 chunks=1 rows=1000 3710018 / 3725082 / -0.4% 3754477 / 3672533 / +2.2% 0.99 / 1.01 / -2.6%
decompress time/wide table cols=1000 chunks=50 rows=1000 3607166 / 3682468 / -2.0% 3767892 / 3793719 / -0.7% 0.96 / 0.97 / -1.4%
decompress time/wide table cols=10000 chunks=1 rows=1000 35701004 / 36085268 / -1.1% 36853784 / 36645223 / +0.6% 0.97 / 0.98 / -1.6%
decompress time/wide table cols=10000 chunks=50 rows=1000 36152086 / 35991296 / +0.4% 36148636 / 36406931 / -0.7% 1.00 / 0.99 / +1.2%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/arade 680639722 / 680639722 / +0.0%
arrow-ipc size/bimbo 3168319202 / 3168319202 / +0.0%
arrow-ipc size/cmsprovider 2394412322 / 2394412322 / +0.0%
arrow-ipc size/euro2016 359300042 / 359300042 / +0.0%
arrow-ipc size/food 252069442 / 252069442 / +0.0%
arrow-ipc size/hashtags 700364562 / 700364562 / +0.0%
arrow-ipc size/sparse-wide-flat-runs 245220370 / 245220370 / +0.0%
arrow-ipc size/sparse-wide-lists-runs 142046306 / 142046306 / +0.0%
arrow-ipc size/sparse-wide-lists-shuffled 142870882 / 142870882 / +0.0%
arrow-ipc size/sparse-wide-nested-child-nulls 251527506 / 251527506 / +0.0%
arrow-ipc size/sparse-wide-nested-runs 251527122 / 251527122 / +0.0%
arrow-ipc size/statpopgen 1890451826 / 1890451826 / +0.0%
arrow-ipc size/taxi 474481242 / 474481242 / +0.0%
arrow-ipc size/tpc-h l_comment canonical 184829074 / 184829074 / +0.0%
arrow-ipc size/tpc-h l_comment chunked 184829074 / 184829074 / +0.0%
arrow-ipc size/tpc-h sf1 lineitem 1021072290 / 1021072290 / +0.0%
arrow-ipc size/tpc-h sf1 orders 194812026 / 194812026 / +0.0%
arrow-ipc size/tpc-h sf1 partsupp 131286562 / 131286562 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / 1231690 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / 12312506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / 123192506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / 123192506 / +0.0%

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 4a19002f vs base d7aa24e8
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (-1.4%, environment too noisy confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.914x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.921x ➖ · cold 0.976x ➖
Shifts: Parquet (control) -7.9% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.829x ✅, 9↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15644173 / 15708166 / -0.4% 45321586 / 42160434 / +7.5% 0.35 / 0.37 / -7.4%
tpch_q02/datafusion:vortex-file-compressed 16114816 / 17735831 / -9.1% 42280378 / 36361044 / +16.3% 🔴 0.38 / 0.49 / -21.9%
tpch_q03/datafusion:vortex-file-compressed 12947968 / 19275996 / -32.8% 🟢 45108187 / 43226363 / +4.4% 0.29 / 0.45 / -35.6%
tpch_q04/datafusion:vortex-file-compressed 10111983 / 10628425 / -4.9% 40124947 / 35280355 / +13.7% 🔴 0.25 / 0.30 / -16.3%
tpch_q05/datafusion:vortex-file-compressed 17407563 / 37162632 / -53.2% 🟢 50743849 / 66420141 / -23.6% 🟢 0.34 / 0.56 / -38.7%
tpch_q06/datafusion:vortex-file-compressed 4296105 / 4595931 / -6.5% 29583119 / 27239354 / +8.6% 0.15 / 0.17 / -13.9%
tpch_q07/datafusion:vortex-file-compressed 29932157 / 52689678 / -43.2% 🟢 64177608 / 82558756 / -22.3% 🟢 0.47 / 0.64 / -26.9%
tpch_q08/datafusion:vortex-file-compressed 32712670 / 51736045 / -36.8% 🟢 68490765 / 77922709 / -12.1% 🟢 0.48 / 0.66 / -28.1%
tpch_q09/datafusion:vortex-file-compressed 40845545 / 47894231 / -14.7% 🟢 80210906 / 80588072 / -0.5% 0.51 / 0.59 / -14.3%
tpch_q10/datafusion:vortex-file-compressed 17223391 / 17382514 / -0.9% 56316361 / 47793642 / +17.8% 🔴 0.31 / 0.36 / -15.9%
tpch_q11/datafusion:vortex-file-compressed 13871540 / 14847615 / -6.6% 37947704 / 33487351 / +13.3% 🔴 0.37 / 0.44 / -17.6%
tpch_q12/datafusion:vortex-file-compressed 19106322 / 18742356 / +1.9% 47906737 / 43214659 / +10.9% 🔴 0.40 / 0.43 / -8.0%
tpch_q13/datafusion:vortex-file-compressed 17873668 / 18991960 / -5.9% 47281928 / 41801647 / +13.1% 🔴 0.38 / 0.45 / -16.8%
tpch_q14/datafusion:vortex-file-compressed 7293113 / 14087291 / -48.2% 🟢 32861674 / 37221952 / -11.7% 🟢 0.22 / 0.38 / -41.4%
tpch_q15/datafusion:vortex-file-compressed 19187461 / 18549551 / +3.4% 46759330 / 45885747 / +1.9% 0.41 / 0.40 / +1.5%
tpch_q16/datafusion:vortex-file-compressed 16664255 / 18348662 / -9.2% 40951601 / 37932680 / +8.0% 0.41 / 0.48 / -15.9%
tpch_q17/datafusion:vortex-file-compressed 25504435 / 29327244 / -13.0% 🟢 56831994 / 56823800 / +0.0% 0.45 / 0.52 / -13.0%
tpch_q18/datafusion:vortex-file-compressed 39541051 / 36406615 / +8.6% 69330886 / 58234292 / +19.1% 🔴 0.57 / 0.63 / -8.8%
tpch_q19/datafusion:vortex-file-compressed 9056198 / 9384463 / -3.5% 39508656 / 32868224 / +20.2% 🔴 0.23 / 0.29 / -19.7%
tpch_q20/datafusion:vortex-file-compressed 13955980 / 20748223 / -32.7% 🟢 45774915 / 45294394 / +1.1% 0.30 / 0.46 / -33.4%
tpch_q21/datafusion:vortex-file-compressed 28319808 / 35152195 / -19.4% 🟢 61846394 / 64155373 / -3.6% 0.46 / 0.55 / -16.4%
tpch_q22/datafusion:vortex-file-compressed 10644657 / 10985616 / -3.1% 34264893 / 30451654 / +12.5% 🔴 0.31 / 0.36 / -13.9%
datafusion / vortex-compact / ns (0.844x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16327592 / 16766557 / -2.6% 48145725 / 40379815 / +19.2% 🔴 0.34 / 0.42 / -18.3%
tpch_q02/datafusion:vortex-compact 18142657 / 19250017 / -5.8% 41568463 / 39140569 / +6.2% 0.44 / 0.49 / -11.3%
tpch_q03/datafusion:vortex-compact 14135341 / 19792731 / -28.6% 🟢 43661115 / 44022311 / -0.8% 0.32 / 0.45 / -28.0%
tpch_q04/datafusion:vortex-compact 11186760 / 11270275 / -0.7% 37253824 / 35358596 / +5.4% 0.30 / 0.32 / -5.8%
tpch_q05/datafusion:vortex-compact 18209110 / 38197225 / -52.3% 🟢 48899605 / 66416323 / -26.4% 🟢 0.37 / 0.58 / -35.3%
tpch_q06/datafusion:vortex-compact 5417156 / 5065623 / +6.9% 29305271 / 25108390 / +16.7% 🔴 0.18 / 0.20 / -8.4%
tpch_q07/datafusion:vortex-compact 31342496 / 54525706 / -42.5% 🟢 63413339 / 78778185 / -19.5% 🟢 0.49 / 0.69 / -28.6%
tpch_q08/datafusion:vortex-compact 33649671 / 53820259 / -37.5% 🟢 66345772 / 76891102 / -13.7% 🟢 0.51 / 0.70 / -27.5%
tpch_q09/datafusion:vortex-compact 42500750 / 51343255 / -17.2% 🟢 82194311 / 72446782 / +13.5% 🔴 0.52 / 0.71 / -27.0%
tpch_q10/datafusion:vortex-compact 18780597 / 19262153 / -2.5% 54313245 / 44648777 / +21.6% 🔴 0.35 / 0.43 / -19.8%
tpch_q11/datafusion:vortex-compact 14468526 / 15193542 / -4.8% 39628457 / 34078300 / +16.3% 🔴 0.37 / 0.45 / -18.1%
tpch_q12/datafusion:vortex-compact 19852070 / 19659553 / +1.0% 46622836 / 40400630 / +15.4% 🔴 0.43 / 0.49 / -12.5%
tpch_q13/datafusion:vortex-compact 18819510 / 20503649 / -8.2% 45846821 / 38203743 / +20.0% 🔴 0.41 / 0.54 / -23.5%
tpch_q14/datafusion:vortex-compact 8403280 / 15164974 / -44.6% 🟢 36898897 / 39418028 / -6.4% 0.23 / 0.38 / -40.8%
tpch_q15/datafusion:vortex-compact 20383903 / 20460017 / -0.4% 51053394 / 46467318 / +9.9% 0.40 / 0.44 / -9.3%
tpch_q16/datafusion:vortex-compact 17345030 / 18314207 / -5.3% 41521117 / 37807076 / +9.8% 0.42 / 0.48 / -13.8%
tpch_q17/datafusion:vortex-compact 26972778 / 29963408 / -10.0% 58807688 / 59010605 / -0.3% 0.46 / 0.51 / -9.7%
tpch_q18/datafusion:vortex-compact 39927738 / 36869499 / +8.3% 66214558 / 56672095 / +16.8% 🔴 0.60 / 0.65 / -7.3%
tpch_q19/datafusion:vortex-compact 11254527 / 11489072 / -2.0% 42857245 / 38964022 / +10.0% 0.26 / 0.29 / -10.9%
tpch_q20/datafusion:vortex-compact 15406152 / 22013786 / -30.0% 🟢 48310367 / 46477064 / +3.9% 0.32 / 0.47 / -32.7%
tpch_q21/datafusion:vortex-compact 30806926 / 37819409 / -18.5% 🟢 63301131 / 66305149 / -4.5% 0.49 / 0.57 / -14.7%
tpch_q22/datafusion:vortex-compact 11190619 / 11321724 / -1.2% 34285597 / 29642796 / +15.7% 🔴 0.33 / 0.38 / -14.5%
datafusion / parquet / ns (0.849x ✅, 14↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67460320 / 71284842 / -5.4% 89458631 / 86857227 / +3.0% 0.75 / 0.82 / -8.1%
tpch_q02/datafusion:parquet 70581042 / 75804481 / -6.9% 93477471 / 91412069 / +2.3% 0.76 / 0.83 / -8.9%
tpch_q03/datafusion:parquet 56732275 / 81763234 / -30.6% 🟢 85119991 / 101305055 / -16.0% 🟢 0.67 / 0.81 / -17.4%
tpch_q04/datafusion:parquet 32504381 / 39496580 / -17.7% 🟢 55790291 / 58009338 / -3.8% 0.58 / 0.68 / -14.4%
tpch_q05/datafusion:parquet 73729488 / 110367841 / -33.2% 🟢 100309083 / 135918063 / -26.2% 🟢 0.74 / 0.81 / -9.5%
tpch_q06/datafusion:parquet 22492049 / 31615700 / -28.9% 🟢 42522463 / 46854849 / -9.2% 0.53 / 0.67 / -21.6%
tpch_q07/datafusion:parquet 91646920 / 112622408 / -18.6% 🟢 124136721 / 138563611 / -10.4% 🟢 0.74 / 0.81 / -9.2%
tpch_q08/datafusion:parquet 95250269 / 117439216 / -18.9% 🟢 124469463 / 141624609 / -12.1% 🟢 0.77 / 0.83 / -7.7%
tpch_q09/datafusion:parquet 127838143 / 137425928 / -7.0% 164787024 / 165735503 / -0.6% 0.78 / 0.83 / -6.4%
tpch_q10/datafusion:parquet 92432155 / 103902783 / -11.0% 🟢 120908761 / 125414392 / -3.6% 0.76 / 0.83 / -7.7%
tpch_q11/datafusion:parquet 58557407 / 62092975 / -5.7% 80356826 / 78137480 / +2.8% 0.73 / 0.79 / -8.3%
tpch_q12/datafusion:parquet 43325707 / 63756924 / -32.0% 🟢 66774873 / 82472865 / -19.0% 🟢 0.65 / 0.77 / -16.1%
tpch_q13/datafusion:parquet 147990100 / 142502979 / +3.9% 169580818 / 161066364 / +5.3% 0.87 / 0.88 / -1.4%
tpch_q14/datafusion:parquet 39834469 / 47966037 / -17.0% 🟢 62086760 / 67550259 / -8.1% 0.64 / 0.71 / -9.6%
tpch_q15/datafusion:parquet 70485583 / 74322916 / -5.2% 94088398 / 94205745 / -0.1% 0.75 / 0.79 / -5.0%
tpch_q16/datafusion:parquet 38228356 / 43765582 / -12.7% 🟢 61329961 / 60751859 / +1.0% 0.62 / 0.72 / -13.5%
tpch_q17/datafusion:parquet 111103677 / 122868920 / -9.6% 134681595 / 144273328 / -6.6% 0.82 / 0.85 / -3.1%
tpch_q18/datafusion:parquet 124468907 / 120858757 / +3.0% 149317561 / 141250777 / +5.7% 0.83 / 0.86 / -2.6%
tpch_q19/datafusion:parquet 50711066 / 56757323 / -10.7% 🟢 77186430 / 79197448 / -2.5% 0.66 / 0.72 / -8.3%
tpch_q20/datafusion:parquet 63954768 / 78514613 / -18.5% 🟢 94087254 / 99742546 / -5.7% 0.68 / 0.79 / -13.6%
tpch_q21/datafusion:parquet 93573652 / 113257373 / -17.4% 🟢 113712248 / 140429738 / -19.0% 🟢 0.82 / 0.81 / +2.0%
tpch_q22/datafusion:parquet 41595777 / 51689426 / -19.5% 🟢 62549246 / 66142217 / -5.4% 0.67 / 0.78 / -14.9%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9399556 / 8943460 / +5.1% 18890975 / 18181383 / +3.9% 0.50 / 0.49 / +1.2%
tpch_q02/duckdb:vortex-file-compressed 14906114 / 14993435 / -0.6% 24676966 / 25230893 / -2.2% 0.60 / 0.59 / +1.6%
tpch_q03/duckdb:vortex-file-compressed 18453435 / 18498894 / -0.2% 34626635 / 34011740 / +1.8% 0.53 / 0.54 / -2.0%
tpch_q04/duckdb:vortex-file-compressed 12417418 / 12181556 / +1.9% 26561408 / 24757368 / +7.3% 0.47 / 0.49 / -5.0%
tpch_q05/duckdb:vortex-file-compressed 20040552 / 19380833 / +3.4% 35512200 / 34750533 / +2.2% 0.56 / 0.56 / +1.2%
tpch_q06/duckdb:vortex-file-compressed 4656190 / 4690955 / -0.7% 14745586 / 13325587 / +10.7% 🔴 0.32 / 0.35 / -10.3%
tpch_q07/duckdb:vortex-file-compressed 24026886 / 24054114 / -0.1% 41721870 / 40325598 / +3.5% 0.58 / 0.60 / -3.5%
tpch_q08/duckdb:vortex-file-compressed 21191022 / 21188863 / +0.0% 35820483 / 36295424 / -1.3% 0.59 / 0.58 / +1.3%
tpch_q09/duckdb:vortex-file-compressed 22921777 / 22488113 / +1.9% 37626362 / 36810285 / +2.2% 0.61 / 0.61 / -0.3%
tpch_q10/duckdb:vortex-file-compressed 27537585 / 27367174 / +0.6% 44457380 / 43452402 / +2.3% 0.62 / 0.63 / -1.7%
tpch_q11/duckdb:vortex-file-compressed 7987373 / 8221511 / -2.8% 17748600 / 16483612 / +7.7% 0.45 / 0.50 / -9.8%
tpch_q12/duckdb:vortex-file-compressed 14664102 / 14374289 / +2.0% 27694649 / 25468796 / +8.7% 0.53 / 0.56 / -6.2%
tpch_q13/duckdb:vortex-file-compressed 19181554 / 19428107 / -1.3% 33054466 / 31974556 / +3.4% 0.58 / 0.61 / -4.5%
tpch_q14/duckdb:vortex-file-compressed 11294163 / 11313066 / -0.2% 23836762 / 23854561 / -0.1% 0.47 / 0.47 / -0.1%
tpch_q15/duckdb:vortex-file-compressed 8203900 / 8319908 / -1.4% 20312877 / 18995256 / +6.9% 0.40 / 0.44 / -7.8%
tpch_q16/duckdb:vortex-file-compressed 16531253 / 16328434 / +1.2% 23162039 / 22777354 / +1.7% 0.71 / 0.72 / -0.4%
tpch_q17/duckdb:vortex-file-compressed 12731350 / 12733002 / -0.0% 28519228 / 26703794 / +6.8% 0.45 / 0.48 / -6.4%
tpch_q18/duckdb:vortex-file-compressed 24152690 / 24327486 / -0.7% 34434537 / 33906009 / +1.6% 0.70 / 0.72 / -2.2%
tpch_q19/duckdb:vortex-file-compressed 11601231 / 11706255 / -0.9% 28308842 / 25054473 / +13.0% 🔴 0.41 / 0.47 / -12.3%
tpch_q20/duckdb:vortex-file-compressed 14268301 / 14250277 / +0.1% 30030746 / 29712006 / +1.1% 0.48 / 0.48 / -0.9%
tpch_q21/duckdb:vortex-file-compressed 48178183 / 48863097 / -1.4% 65492276 / 65067087 / +0.7% 0.74 / 0.75 / -2.0%
tpch_q22/duckdb:vortex-file-compressed 16793468 / 16510478 / +1.7% 26777261 / 26442559 / +1.3% 0.63 / 0.62 / +0.4%
duckdb / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 10438095 / 10383461 / +0.5% 21097474 / 20446519 / +3.2% 0.49 / 0.51 / -2.6%
tpch_q02/duckdb:vortex-compact 17425935 / 17396120 / +0.2% 27222352 / 27111750 / +0.4% 0.64 / 0.64 / -0.2%
tpch_q03/duckdb:vortex-compact 19593506 / 20144606 / -2.7% 35604569 / 34396930 / +3.5% 0.55 / 0.59 / -6.0%
tpch_q04/duckdb:vortex-compact 12387382 / 12621746 / -1.9% 25845433 / 25333400 / +2.0% 0.48 / 0.50 / -3.8%
tpch_q05/duckdb:vortex-compact 20477146 / 20816818 / -1.6% 35721763 / 37428174 / -4.6% 0.57 / 0.56 / +3.1%
tpch_q06/duckdb:vortex-compact 5164774 / 5095584 / +1.4% 16625336 / 15274620 / +8.8% 0.31 / 0.33 / -6.9%
tpch_q07/duckdb:vortex-compact 25512071 / 25408465 / +0.4% 45112500 / 40813999 / +10.5% 🔴 0.57 / 0.62 / -9.2%
tpch_q08/duckdb:vortex-compact 21587123 / 22097220 / -2.3% 37215868 / 38087936 / -2.3% 0.58 / 0.58 / -0.0%
tpch_q09/duckdb:vortex-compact 24285488 / 24371825 / -0.4% 38101341 / 39114457 / -2.6% 0.64 / 0.62 / +2.3%
tpch_q10/duckdb:vortex-compact 30886349 / 31155226 / -0.9% 47807669 / 45230061 / +5.7% 0.65 / 0.69 / -6.2%
tpch_q11/duckdb:vortex-compact 8531450 / 8518485 / +0.2% 18404456 / 17309999 / +6.3% 0.46 / 0.49 / -5.8%
tpch_q12/duckdb:vortex-compact 17082783 / 17461221 / -2.2% 30160996 / 29028379 / +3.9% 0.57 / 0.60 / -5.8%
tpch_q13/duckdb:vortex-compact 19827334 / 20357403 / -2.6% 31591073 / 33654084 / -6.1% 0.63 / 0.60 / +3.8%
tpch_q14/duckdb:vortex-compact 12258800 / 12407404 / -1.2% 27731080 / 25829432 / +7.4% 0.44 / 0.48 / -8.0%
tpch_q15/duckdb:vortex-compact 9428286 / 9662457 / -2.4% 23808664 / 21806435 / +9.2% 0.40 / 0.44 / -10.6%
tpch_q16/duckdb:vortex-compact 17078577 / 17337397 / -1.5% 23361320 / 23644217 / -1.2% 0.73 / 0.73 / -0.3%
tpch_q17/duckdb:vortex-compact 13321009 / 13149862 / +1.3% 28941802 / 29323831 / -1.3% 0.46 / 0.45 / +2.6%
tpch_q18/duckdb:vortex-compact 24952094 / 24496455 / +1.9% 32984284 / 36783214 / -10.3% 🟢 0.76 / 0.67 / +13.6%
tpch_q19/duckdb:vortex-compact 14601793 / 14528059 / +0.5% 32028579 / 29771328 / +7.6% 0.46 / 0.49 / -6.6%
tpch_q20/duckdb:vortex-compact 17628940 / 17286259 / +2.0% 34606642 / 32046439 / +8.0% 0.51 / 0.54 / -5.6%
tpch_q21/duckdb:vortex-compact 49384798 / 49763994 / -0.8% 65644456 / 64504208 / +1.8% 0.75 / 0.77 / -2.5%
tpch_q22/duckdb:vortex-compact 19485797 / 19615738 / -0.7% 28877693 / 28396261 / +1.7% 0.67 / 0.69 / -2.3%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47555572 / 47469901 / +0.2% 53800055 / 53641260 / +0.3% 0.88 / 0.88 / -0.1%
tpch_q02/duckdb:parquet 48283165 / 48252529 / +0.1% 55252568 / 54735397 / +0.9% 0.87 / 0.88 / -0.9%
tpch_q03/duckdb:parquet 59857435 / 60381018 / -0.9% 68961904 / 67552334 / +2.1% 0.87 / 0.89 / -2.9%
tpch_q04/duckdb:parquet 34622568 / 34933178 / -0.9% 42491711 / 42091485 / +1.0% 0.81 / 0.83 / -1.8%
tpch_q05/duckdb:parquet 67156014 / 67183513 / -0.0% 77604229 / 75995137 / +2.1% 0.87 / 0.88 / -2.1%
tpch_q06/duckdb:parquet 21783378 / 21940222 / -0.7% 27078227 / 26184920 / +3.4% 0.80 / 0.84 / -4.0%
tpch_q07/duckdb:parquet 63626824 / 63827685 / -0.3% 73435216 / 71786142 / +2.3% 0.87 / 0.89 / -2.6%
tpch_q08/duckdb:parquet 75726886 / 75570158 / +0.2% 86190623 / 85936262 / +0.3% 0.88 / 0.88 / -0.1%
tpch_q09/duckdb:parquet 107396387 / 107475986 / -0.1% 119513391 / 117606505 / +1.6% 0.90 / 0.91 / -1.7%
tpch_q10/duckdb:parquet 105492263 / 105555143 / -0.1% 117626673 / 115668353 / +1.7% 0.90 / 0.91 / -1.7%
tpch_q11/duckdb:parquet 29251545 / 29454515 / -0.7% 34377100 / 34372343 / +0.0% 0.85 / 0.86 / -0.7%
tpch_q12/duckdb:parquet 37024233 / 37062804 / -0.1% 43800925 / 43474471 / +0.8% 0.85 / 0.85 / -0.8%
tpch_q13/duckdb:parquet 174245123 / 174740981 / -0.3% 181819479 / 180748808 / +0.6% 0.96 / 0.97 / -0.9%
tpch_q14/duckdb:parquet 42329864 / 42239252 / +0.2% 50828403 / 50667472 / +0.3% 0.83 / 0.83 / -0.1%
tpch_q15/duckdb:parquet 32508658 / 32488450 / +0.1% 41292326 / 40555434 / +1.8% 0.79 / 0.80 / -1.7%
tpch_q16/duckdb:parquet 46958695 / 46885581 / +0.2% 52040407 / 51356589 / +1.3% 0.90 / 0.91 / -1.2%
tpch_q17/duckdb:parquet 47833324 / 47757183 / +0.2% 57223637 / 56517768 / +1.2% 0.84 / 0.84 / -1.1%
tpch_q18/duckdb:parquet 73359717 / 73277812 / +0.1% 79767622 / 80222718 / -0.6% 0.92 / 0.91 / +0.7%
tpch_q19/duckdb:parquet 49581626 / 48275460 / +2.7% 62175464 / 56726606 / +9.6% 0.80 / 0.85 / -6.3%
tpch_q20/duckdb:parquet 63414074 / 63333903 / +0.1% 74509237 / 72324816 / +3.0% 0.85 / 0.88 / -2.8%
tpch_q21/duckdb:parquet 106183508 / 106464589 / -0.3% 117258001 / 115133640 / +1.8% 0.91 / 0.92 / -2.1%
tpch_q22/duckdb:parquet 50440618 / 50310482 / +0.3% 58394976 / 57572003 / +1.4% 0.86 / 0.87 / -1.2%
duckdb / duckdb / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6225047 / 6245781 / -0.3% 14330526 / 13001244 / +10.2% 🔴 0.43 / 0.48 / -9.6%
tpch_q02/duckdb:duckdb 8482293 / 8573296 / -1.1% 16367375 / 15719922 / +4.1% 0.52 / 0.55 / -5.0%
tpch_q03/duckdb:duckdb 15588383 / 15577514 / +0.1% 25927321 / 24255568 / +6.9% 0.60 / 0.64 / -6.4%
tpch_q04/duckdb:duckdb 11401022 / 11131792 / +2.4% 21937417 / 19921636 / +10.1% 🔴 0.52 / 0.56 / -7.0%
tpch_q05/duckdb:duckdb 15508303 / 15493171 / +0.1% 27324860 / 24798561 / +10.2% 🔴 0.57 / 0.62 / -9.2%
tpch_q06/duckdb:duckdb 3148671 / 3180297 / -1.0% 9573853 / 8683013 / +10.3% 🔴 0.33 / 0.37 / -10.2%
tpch_q07/duckdb:duckdb 18407854 / 18336870 / +0.4% 29406701 / 28056344 / +4.8% 0.63 / 0.65 / -4.2%
tpch_q08/duckdb:duckdb 17284256 / 17303530 / -0.1% 30390841 / 28114132 / +8.1% 0.57 / 0.62 / -7.6%
tpch_q09/duckdb:duckdb 23691419 / 23804186 / -0.5% 36520016 / 34723566 / +5.2% 0.65 / 0.69 / -5.4%
tpch_q10/duckdb:duckdb 29409655 / 29818952 / -1.4% 42088565 / 40780673 / +3.2% 0.70 / 0.73 / -4.4%
tpch_q11/duckdb:duckdb 5699031 / 5730939 / -0.6% 11830008 / 11275721 / +4.9% 0.48 / 0.51 / -5.2%
tpch_q12/duckdb:duckdb 10768810 / 10760171 / +0.1% 20987352 / 19151091 / +9.6% 0.51 / 0.56 / -8.7%
tpch_q13/duckdb:duckdb 31860647 / 32039235 / -0.6% 40966543 / 39294312 / +4.3% 0.78 / 0.82 / -4.6%
tpch_q14/duckdb:duckdb 12314465 / 12411088 / -0.8% 21569664 / 19816444 / +8.8% 0.57 / 0.63 / -8.8%
tpch_q15/duckdb:duckdb 6834317 / 6979901 / -2.1% 16724597 / 15317892 / +9.2% 0.41 / 0.46 / -10.3%
tpch_q16/duckdb:duckdb 18960516 / 18910809 / +0.3% 24864974 / 24388975 / +2.0% 0.76 / 0.78 / -1.7%
tpch_q17/duckdb:duckdb 8388364 / 8432536 / -0.5% 18128157 / 17234816 / +5.2% 0.46 / 0.49 / -5.4%
tpch_q18/duckdb:duckdb 18174208 / 18225329 / -0.3% 26928506 / 24643545 / +9.3% 0.67 / 0.74 / -8.7%
tpch_q19/duckdb:duckdb 12748206 / 12688369 / +0.5% 22675319 / 20937559 / +8.3% 0.56 / 0.61 / -7.2%
tpch_q20/duckdb:duckdb 14304855 / 14358426 / -0.4% 26597869 / 24925871 / +6.7% 0.54 / 0.58 / -6.6%
tpch_q21/duckdb:duckdb 21820139 / 21998265 / -0.8% 31954116 / 31768770 / +0.6% 0.68 / 0.69 / -1.4%
tpch_q22/duckdb:duckdb 23112806 / 23221216 / -0.5% 31940469 / 30692638 / +4.1% 0.72 / 0.76 / -4.4%

No file size changes detected.

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 4a19002f vs base d7aa24e8
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.5%
Engines: DataFusion No clear signal (+14.5%, environment too noisy confidence) · DuckDB No clear signal (+2.8%, environment too noisy confidence)
Vortex (geomean): hot 1.001x ➖ · cold 1.036x ➖
Parquet (geomean): hot 0.924x ➖ · cold 0.848x ✅
Shifts: Parquet (control) -7.6% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 109595093 / 105873422 / +3.5% 471453211 / 491317898 / -4.0% 0.23 / 0.22 / +7.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed 8572732 / 9062406 / -5.4% 55490520 / 49836216 / +11.3% 🔴 0.15 / 0.18 / -15.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 10988695 / 10432166 / +5.3% 58604812 / 51714094 / +13.3% 🔴 0.19 / 0.20 / -7.1%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22299910 / 22720344 / -1.9% 69890296 / 68604737 / +1.9% 0.32 / 0.33 / -3.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18279092 / 18566628 / -1.5% 58803560 / 63645424 / -7.6% 0.31 / 0.29 / +6.6%
clickbench-sorted_q38/datafusion:vortex-file-compressed 12755423 / 13076862 / -2.5% 63839801 / 59007021 / +8.2% 0.20 / 0.22 / -9.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 36964022 / 37231000 / -0.7% 100084847 / 102076228 / -2.0% 0.37 / 0.36 / +1.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed 10615034 / 10870314 / -2.3% 43778848 / 40334169 / +8.5% 0.24 / 0.27 / -10.0%
clickbench-sorted_q41/datafusion:vortex-file-compressed 10529158 / 10573140 / -0.4% 48020383 / 39964850 / +20.2% 🔴 0.22 / 0.26 / -17.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9304832 / 9175840 / +1.4% 39607130 / 35567576 / +11.4% 🔴 0.23 / 0.26 / -8.9%
datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 300005965 / 273260872 / +9.8% 620674750 / 572307094 / +8.5% 0.48 / 0.48 / +1.2%
clickbench-sorted_q24/datafusion:vortex-compact 12745170 / 13260634 / -3.9% 55367910 / 52795436 / +4.9% 0.23 / 0.25 / -8.4%
clickbench-sorted_q26/datafusion:vortex-compact 18381372 / 18157494 / +1.2% 66452698 / 62197572 / +6.8% 0.28 / 0.29 / -5.2%
clickbench-sorted_q36/datafusion:vortex-compact 33891424 / 33785123 / +0.3% 78139408 / 76244935 / +2.5% 0.43 / 0.44 / -2.1%
clickbench-sorted_q37/datafusion:vortex-compact 29220791 / 30933292 / -5.5% 78929441 / 73611970 / +7.2% 0.37 / 0.42 / -11.9%
clickbench-sorted_q38/datafusion:vortex-compact 23259440 / 22948943 / +1.4% 70252271 / 67821053 / +3.6% 0.33 / 0.34 / -2.2%
clickbench-sorted_q39/datafusion:vortex-compact 45614212 / 43713721 / +4.3% 100011693 / 93766216 / +6.7% 0.46 / 0.47 / -2.2%
clickbench-sorted_q40/datafusion:vortex-compact 12477264 / 13312152 / -6.3% 45246894 / 42234599 / +7.1% 0.28 / 0.32 / -12.5%
clickbench-sorted_q41/datafusion:vortex-compact 12988860 / 12408022 / +4.7% 45086107 / 42021742 / +7.3% 0.29 / 0.30 / -2.4%
clickbench-sorted_q42/datafusion:vortex-compact 10354576 / 10244958 / +1.1% 39235498 / 34772656 / +12.8% 🔴 0.26 / 0.29 / -10.4%
datafusion / parquet / ns (0.874x ✅, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 749727592 / 743073863 / +0.9% 932978131 / 950858223 / -1.9% 0.80 / 0.78 / +2.8%
clickbench-sorted_q24/datafusion:parquet 8518185 / 9152586 / -6.9% 40980681 / 71029141 / -42.3% 🟢 0.21 / 0.13 / +61.3%
clickbench-sorted_q26/datafusion:parquet 8990104 / 9392016 / -4.3% 43828652 / 71935806 / -39.1% 🟢 0.21 / 0.13 / +57.1%
clickbench-sorted_q36/datafusion:parquet 82996439 / 89886900 / -7.7% 128194892 / 162467330 / -21.1% 🟢 0.65 / 0.55 / +17.0%
clickbench-sorted_q37/datafusion:parquet 53187422 / 61830122 / -14.0% 🟢 90028437 / 128025190 / -29.7% 🟢 0.59 / 0.48 / +22.3%
clickbench-sorted_q38/datafusion:parquet 76569396 / 83531304 / -8.3% 121101168 / 153033506 / -20.9% 🟢 0.63 / 0.55 / +15.8%
clickbench-sorted_q39/datafusion:parquet 146090727 / 153687208 / -4.9% 189962342 / 224111025 / -15.2% 🟢 0.77 / 0.69 / +12.1%
clickbench-sorted_q40/datafusion:parquet 32840594 / 41768868 / -21.4% 🟢 68132528 / 107733585 / -36.8% 🟢 0.48 / 0.39 / +24.3%
clickbench-sorted_q41/datafusion:parquet 29908466 / 39430376 / -24.1% 🟢 64808720 / 104478608 / -38.0% 🟢 0.46 / 0.38 / +22.3%
clickbench-sorted_q42/datafusion:parquet 17784262 / 25367264 / -29.9% 🟢 48645999 / 86942688 / -44.0% 🟢 0.37 / 0.29 / +25.3%
duckdb / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 65284560 / 69078928 / -5.5% 282815108 / 234372888 / +20.7% 🔴 0.23 / 0.29 / -21.7%
clickbench-sorted_q24/duckdb:vortex-file-compressed 11595560 / 11543942 / +0.4% 31717812 / 28342041 / +11.9% 🔴 0.37 / 0.41 / -10.2%
clickbench-sorted_q26/duckdb:vortex-file-compressed 11141008 / 11246688 / -0.9% 35693802 / 33066127 / +7.9% 0.31 / 0.34 / -8.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 20195537 / 20020832 / +0.9% 46745704 / 46797389 / -0.1% 0.43 / 0.43 / +1.0%
clickbench-sorted_q37/duckdb:vortex-file-compressed 16458192 / 15640394 / +5.2% 41914803 / 40721012 / +2.9% 0.39 / 0.38 / +2.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 13236052 / 14090328 / -6.1% 44321926 / 45910657 / -3.5% 0.30 / 0.31 / -2.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 32825976 / 32386697 / +1.4% 71496544 / 75989934 / -5.9% 0.46 / 0.43 / +7.7%
clickbench-sorted_q40/duckdb:vortex-file-compressed 9781443 / 9938675 / -1.6% 32286091 / 32684836 / -1.2% 0.30 / 0.30 / -0.4%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11120878 / 11150513 / -0.3% 33861840 / 34863726 / -2.9% 0.33 / 0.32 / +2.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8441112 / 8479852 / -0.5% 29994524 / 28834157 / +4.0% 0.28 / 0.29 / -4.3%
duckdb / vortex-compact / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 81564812 / 78022975 / +4.5% 268164726 / 281582844 / -4.8% 0.30 / 0.28 / +9.8%
clickbench-sorted_q24/duckdb:vortex-compact 16177258 / 16010176 / +1.0% 33212554 / 34840886 / -4.7% 0.49 / 0.46 / +6.0%
clickbench-sorted_q26/duckdb:vortex-compact 16535223 / 16356242 / +1.1% 37997089 / 37212750 / +2.1% 0.44 / 0.44 / -1.0%
clickbench-sorted_q36/duckdb:vortex-compact 30176644 / 29702701 / +1.6% 53694105 / 56036185 / -4.2% 0.56 / 0.53 / +6.0%
clickbench-sorted_q37/duckdb:vortex-compact 25684673 / 24651550 / +4.2% 49297654 / 51470210 / -4.2% 0.52 / 0.48 / +8.8%
clickbench-sorted_q38/duckdb:vortex-compact 20397352 / 20500252 / -0.5% 50971321 / 50405762 / +1.1% 0.40 / 0.41 / -1.6%
clickbench-sorted_q39/duckdb:vortex-compact 44034663 / 43567107 / +1.1% 75528817 / 76037763 / -0.7% 0.58 / 0.57 / +1.8%
clickbench-sorted_q40/duckdb:vortex-compact 11023646 / 11894090 / -7.3% 33698704 / 34950602 / -3.6% 0.33 / 0.34 / -3.9%
clickbench-sorted_q41/duckdb:vortex-compact 12878797 / 12657856 / +1.7% 38029845 / 35738243 / +6.4% 0.34 / 0.35 / -4.4%
clickbench-sorted_q42/duckdb:vortex-compact 9397621 / 9064209 / +3.7% 30908453 / 29626813 / +4.3% 0.30 / 0.31 / -0.6%
duckdb / parquet / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 145576972 / 144724836 / +0.6% 182486714 / 179281768 / +1.8% 0.80 / 0.81 / -1.2%
clickbench-sorted_q24/duckdb:parquet 15005723 / 17211934 / -12.8% 🟢 20510296 / 17457827 / +17.5% 🔴 0.73 / 0.99 / -25.8%
clickbench-sorted_q26/duckdb:parquet 15588122 / 15452434 / +0.9% 21039846 / 19806065 / +6.2% 0.74 / 0.78 / -5.0%
clickbench-sorted_q36/duckdb:parquet 46836260 / 46014560 / +1.8% 58829091 / 55386824 / +6.2% 0.80 / 0.83 / -4.2%
clickbench-sorted_q37/duckdb:parquet 35520259 / 39311302 / -9.6% 46031575 / 45842023 / +0.4% 0.77 / 0.86 / -10.0%
clickbench-sorted_q38/duckdb:parquet 42291434 / 42482866 / -0.5% 53650406 / 53191156 / +0.9% 0.79 / 0.80 / -1.3%
clickbench-sorted_q39/duckdb:parquet 77219866 / 75185393 / +2.7% 84340554 / 86634044 / -2.6% 0.92 / 0.87 / +5.5%
clickbench-sorted_q40/duckdb:parquet 21496975 / 22397291 / -4.0% 29863601 / 28664265 / +4.2% 0.72 / 0.78 / -7.9%
clickbench-sorted_q41/duckdb:parquet 22143129 / 22508534 / -1.6% 29613324 / 29429193 / +0.6% 0.75 / 0.76 / -2.2%
clickbench-sorted_q42/duckdb:parquet 17261204 / 17009285 / +1.5% 23692371 / 24917527 / -4.9% 0.73 / 0.68 / +6.7%
duckdb / duckdb / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 67469858 / 67156668 / +0.5% 117770348 / 114799544 / +2.6% 0.57 / 0.58 / -2.1%
clickbench-sorted_q24/duckdb:duckdb 23352573 / 22383246 / +4.3% 27909952 / 27871920 / +0.1% 0.84 / 0.80 / +4.2%
clickbench-sorted_q26/duckdb:duckdb 24133732 / 24594343 / -1.9% 29603462 / 30325919 / -2.4% 0.82 / 0.81 / +0.5%
clickbench-sorted_q36/duckdb:duckdb 39129884 / 40502936 / -3.4% 67911565 / 70718872 / -4.0% 0.58 / 0.57 / +0.6%
clickbench-sorted_q37/duckdb:duckdb 38241365 / 36936516 / +3.5% 76828753 / 73997018 / +3.8% 0.50 / 0.50 / -0.3%
clickbench-sorted_q38/duckdb:duckdb 30055715 / 29188054 / +3.0% 65061428 / 64062907 / +1.6% 0.46 / 0.46 / +1.4%
clickbench-sorted_q39/duckdb:duckdb 54468366 / 53024756 / +2.7% 105149560 / 105116899 / +0.0% 0.52 / 0.50 / +2.7%
clickbench-sorted_q40/duckdb:duckdb 21761438 / 21245560 / +2.4% 43961568 / 43391122 / +1.3% 0.50 / 0.49 / +1.1%
clickbench-sorted_q41/duckdb:duckdb 20993696 / 20694744 / +1.4% 38566259 / 36936595 / +4.4% 0.54 / 0.56 / -2.8%
clickbench-sorted_q42/duckdb:duckdb 16884300 / 16846634 / +0.2% 26974584 / 27125610 / -0.6% 0.63 / 0.62 / +0.8%

No file size changes detected.

… output

TPC-H, TPC-DS and ClickBench share expected results between DataFusion and
DuckDB. DataFusion 56 prints decimals at full scale (`4.10`), while the
DuckDB adapter strips trailing zeros (`4.1`). Treat numerically equal
decimals as a match so the shared files can hold DataFusion's output.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 3, 2026
Regenerated with the sqllogictest runner's `--complete` mode against
DataFusion 56.

- results: DataFusion 56 prints decimals at full scale
  (apache/datafusion#24934). All 2703 changed lines differ only in
  trailing zeros; values and row order are unchanged.
- plans: DataFusion 56 picks different physical plans, e.g. small build
  sides now use `CollectLeft` hash joins instead of repartitioned
  `Partitioned` joins. File byte ranges keep the `<slt:ignore>`
  placeholders.

Signed-off-by: Joe Isaacs <[email protected]>
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Resolve Cargo.lock by keeping the Arrow 60 / DataFusion 56 pins and
re-resolving develop's dependency changes with cargo. Regenerate the
TPC-DS q34 and q73 DataFusion plans, which combine develop's Float64 cast
pushdown with DataFusion 56's IN-list display.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs
joseph-isaacs marked this pull request as ready for review November 9, 2026 14:21
joseph-isaacs and others added 2 commits November 9, 2026 15:55
Keep both test imports in vortex-datafusion's schema conversion: the
branch's arrow_schema::Metadata and develop's EmptyMetadata. Resolve
Cargo.lock by keeping the Arrow 60 / DataFusion 56 pins and re-resolving
develop's dependency changes (lance 14, new bench dependencies) with cargo.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
DataFusion 56 starts a new output file once a writer reports reaching
`soft_max_bytes_per_output_file`. The Vortex sink only stored the final file
size, so byte-based rolling never triggered. Count written bytes with
`CountingVortexWrite` and add the bytes held by layout strategies, updating
DataFusion's counter before each batch.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq

Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs changed the title [do not merge] feat: prepare DataFusion 56 upgrade feat: update to DataFusion 56 upgrade Nov 9, 2026
joseph-isaacs and others added 3 commits November 9, 2026 19:22
Two tests from develop built field metadata through inference that only
resolved with Arrow 59's HashMap metadata. With Arrow 60's Metadata type the
target is ambiguous, which broke every Rust build job.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
…ckDB doubles

DataFusion 56 prints decimals at full scale (96.075900), while DuckDB prints
its DOUBLE results with more digits (96.075905070942). The prefix check failed
on the padding zeros, so TPC-DS q58 failed on DuckDB. Compare numerically:
truncate the DuckDB value to the expected value's significant scale.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
Keep both sides' imports in vortex-arrow's vortex_id test and the
Arrow 60 Metadata construction for its expected field.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>

Copy link
Copy Markdown
Contributor Author

Two CI failures on 8f1f1ab8d that a code change in this PR can't fix:

  • Rust publish dry-run fails while packaging vortex-datafusion: failed to select a version for the requirement datafusion-catalog = "^56.0.0-dev" (crates.io only has up to 55.2.0). cargo publish drops the git source of the branch-56 DataFusion dependencies and looks for 56.0.0-dev on crates.io. This check stays red until DataFusion 56.0.0 is released and the workspace pins move from branch-56 to the published version.
  • Rust tests (miri) failed before any build: rustup toolchain install timed out connecting to static.rust-lang.org (tcp connect error: Connection timed out). That's a runner network failure, so I'll re-run the job once its workflow run finishes.

The earlier build, lint and test failures came from two tests merged from develop that relied on Arrow 59's HashMap metadata type inference. They're fixed in 768604939. The DuckDB TPC-DS q58 decimal mismatch is fixed in efe92c435.


Generated by Claude Code

joseph-isaacs and others added 4 commits November 13, 2026 21:59
Move the DataFusion dependencies from the branch-56 head to the
56.0.0-rc1 tag, so builds are reproducible while the release vote runs.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
DataFusion 56.0.0-rc1 backports apache/datafusion#27204: IN treats 0.0 and
-0.0 as equal, while other floats still compare by their bits. Vortex's set
lookup compares bits, so a pushed-down `x IN (-0.0)` missed 0.0. Add the
missing signed zero to the converted list, as DataFusion does.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
Keep the Arrow 60.1 workspace pins, dropping arrow-arith, which develop no
longer uses. Keep only the test import of vortex-datafusion's schema
conversion that develop still uses. Read FFI_ArrowSchema's release callback
through Arrow 60's accessor in the new vortex-cuda-ffi tests.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
The release candidate reorders the joins of q33, q56, q60, q61, q74 and q91.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBDc663cPR76jiGX4Xq
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Nov 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Nested TPC-H SF=1 on NVME 📖

Commits: PR 4a19002f vs base d7aa24e8
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +19.9%
Engines: DataFusion No clear signal (+43.9%, environment too noisy confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.968x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.811x ✅ · cold 0.837x ✅
Shifts: Parquet (control) -18.9% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.942x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:vortex-file-compressed 26681820 / 27072273 / -1.4% 64890198 / 63963373 / +1.4% 0.41 / 0.42 / -2.8%
tpch-nested_q02/datafusion:vortex-file-compressed 73520523 / 75575963 / -2.7% 108681725 / 102531984 / +6.0% 0.68 / 0.74 / -8.2%
tpch-nested_q03/datafusion:vortex-file-compressed 28417760 / 29646074 / -4.1% 69048050 / 66955568 / +3.1% 0.41 / 0.44 / -7.0%
tpch-nested_q04/datafusion:vortex-file-compressed 32141110 / 33183551 / -3.1% 72915632 / 73064147 / -0.2% 0.44 / 0.45 / -2.9%
tpch-nested_q05/datafusion:vortex-file-compressed 38956107 / 60003750 / -35.1% 🟢 75780568 / 96898851 / -21.8% 🟢 0.51 / 0.62 / -17.0%
tpch-nested_q06/datafusion:vortex-file-compressed 9372876 / 10414520 / -10.0% 🟢 45004680 / 40723585 / +10.5% 🔴 0.21 / 0.26 / -18.6%
tpch-nested_q07/datafusion:vortex-file-compressed 57039815 / 65652261 / -13.1% 🟢 93123004 / 102214318 / -8.9% 0.61 / 0.64 / -4.6%
tpch-nested_q08/datafusion:vortex-file-compressed 66910784 / 87119685 / -23.2% 🟢 112789837 / 126723651 / -11.0% 🟢 0.59 / 0.69 / -13.7%
tpch-nested_q09/datafusion:vortex-file-compressed 70247839 / 69648756 / +0.9% 108496250 / 110497106 / -1.8% 0.65 / 0.63 / +2.7%
tpch-nested_q10/datafusion:vortex-file-compressed 42550090 / 43323296 / -1.8% 83082919 / 82214250 / +1.1% 0.51 / 0.53 / -2.8%
tpch-nested_q11/datafusion:vortex-file-compressed 33179497 / 33633304 / -1.3% 64208206 / 60585708 / +6.0% 0.52 / 0.56 / -6.9%
tpch-nested_q12/datafusion:vortex-file-compressed 34076731 / 35889350 / -5.1% 68545706 / 69780225 / -1.8% 0.50 / 0.51 / -3.3%
tpch-nested_q13/datafusion:vortex-file-compressed 21268193 / 21249120 / +0.1% 48474681 / 46283541 / +4.7% 0.44 / 0.46 / -4.4%
tpch-nested_q14/datafusion:vortex-file-compressed 18659708 / 19074603 / -2.2% 55592577 / 52198525 / +6.5% 0.34 / 0.37 / -8.1%
tpch-nested_q15/datafusion:vortex-file-compressed 31006044 / 30906128 / +0.3% 62037695 / 66522323 / -6.7% 0.50 / 0.46 / +7.6%
tpch-nested_q16/datafusion:vortex-file-compressed 33110263 / 34693910 / -4.6% 62657564 / 57827606 / +8.4% 0.53 / 0.60 / -11.9%
tpch-nested_q17/datafusion:vortex-file-compressed 57676083 / 58187258 / -0.9% 98182075 / 100570402 / -2.4% 0.59 / 0.58 / +1.5%
tpch-nested_q18/datafusion:vortex-file-compressed 73241917 / 73436141 / -0.3% 123606318 / 121340024 / +1.9% 0.59 / 0.61 / -2.1%
tpch-nested_q19/datafusion:vortex-file-compressed 29938304 / 31730524 / -5.6% 68489135 / 67820056 / +1.0% 0.44 / 0.47 / -6.6%
tpch-nested_q20/datafusion:vortex-file-compressed 51887122 / 52251484 / -0.7% 93559448 / 90129270 / +3.8% 0.55 / 0.58 / -4.3%
tpch-nested_q21/datafusion:vortex-file-compressed 96859341 / 96163958 / +0.7% 142076124 / 141361413 / +0.5% 0.68 / 0.68 / +0.2%
tpch-nested_q22/datafusion:vortex-file-compressed 23235951 / 24540064 / -5.3% 46633898 / 44422116 / +5.0% 0.50 / 0.55 / -9.8%
datafusion / vortex-compact / ns (0.951x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:vortex-compact 30630550 / 30015576 / +2.0% 64567890 / 63407510 / +1.8% 0.47 / 0.47 / +0.2%
tpch-nested_q02/datafusion:vortex-compact 79258215 / 79874283 / -0.8% 106009540 / 102244205 / +3.7% 0.75 / 0.78 / -4.3%
tpch-nested_q03/datafusion:vortex-compact 35755813 / 37195315 / -3.9% 74205006 / 74910947 / -0.9% 0.48 / 0.50 / -3.0%
tpch-nested_q04/datafusion:vortex-compact 37199465 / 38350164 / -3.0% 76807804 / 69681162 / +10.2% 🔴 0.48 / 0.55 / -12.0%
tpch-nested_q05/datafusion:vortex-compact 41521304 / 63418193 / -34.5% 🟢 79091355 / 99542541 / -20.5% 🟢 0.52 / 0.64 / -17.6%
tpch-nested_q06/datafusion:vortex-compact 16394153 / 15968736 / +2.7% 46296142 / 44670663 / +3.6% 0.35 / 0.36 / -0.9%
tpch-nested_q07/datafusion:vortex-compact 63011006 / 72859482 / -13.5% 🟢 98578237 / 103483401 / -4.7% 0.64 / 0.70 / -9.2%
tpch-nested_q08/datafusion:vortex-compact 72869056 / 93465066 / -22.0% 🟢 112911623 / 130452747 / -13.4% 🟢 0.65 / 0.72 / -9.9%
tpch-nested_q09/datafusion:vortex-compact 77122009 / 75817054 / +1.7% 121439075 / 113539986 / +7.0% 0.64 / 0.67 / -4.9%
tpch-nested_q10/datafusion:vortex-compact 46991000 / 49271164 / -4.6% 89296972 / 89472704 / -0.2% 0.53 / 0.55 / -4.4%
tpch-nested_q11/datafusion:vortex-compact 35599198 / 36814605 / -3.3% 63979139 / 60774500 / +5.3% 0.56 / 0.61 / -8.1%
tpch-nested_q12/datafusion:vortex-compact 39150796 / 40159206 / -2.5% 80228902 / 80346578 / -0.1% 0.49 / 0.50 / -2.4%
tpch-nested_q13/datafusion:vortex-compact 21826496 / 22052046 / -1.0% 49857176 / 47846717 / +4.2% 0.44 / 0.46 / -5.0%
tpch-nested_q14/datafusion:vortex-compact 27458124 / 27778905 / -1.2% 59181120 / 58171409 / +1.7% 0.46 / 0.48 / -2.8%
tpch-nested_q15/datafusion:vortex-compact 44327978 / 44557386 / -0.5% 79320290 / 78446943 / +1.1% 0.56 / 0.57 / -1.6%
tpch-nested_q16/datafusion:vortex-compact 37024253 / 38360985 / -3.5% 64388843 / 62529645 / +3.0% 0.58 / 0.61 / -6.3%
tpch-nested_q17/datafusion:vortex-compact 65975361 / 66649144 / -1.0% 100977895 / 110329916 / -8.5% 0.65 / 0.60 / +8.2%
tpch-nested_q18/datafusion:vortex-compact 82052191 / 82531773 / -0.6% 125670794 / 123533372 / +1.7% 0.65 / 0.67 / -2.3%
tpch-nested_q19/datafusion:vortex-compact 34440867 / 36280961 / -5.1% 71053238 / 67696317 / +5.0% 0.48 / 0.54 / -9.6%
tpch-nested_q20/datafusion:vortex-compact 62937210 / 62620159 / +0.5% 95489302 / 95893915 / -0.4% 0.66 / 0.65 / +0.9%
tpch-nested_q21/datafusion:vortex-compact 105281053 / 106318409 / -1.0% 150638654 / 150555856 / +0.1% 0.70 / 0.71 / -1.0%
tpch-nested_q22/datafusion:vortex-compact 30200122 / 31053606 / -2.7% 52250458 / 50428942 / +3.6% 0.58 / 0.62 / -6.1%
datafusion / parquet / ns (0.657x ✅, 21↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/datafusion:parquet 152694152 / 247315441 / -38.3% 🟢 179789183 / 267119267 / -32.7% 🟢 0.85 / 0.93 / -8.3%
tpch-nested_q02/datafusion:parquet 391918860 / 436036296 / -10.1% 🟢 426869652 / 467790902 / -8.7% 0.92 / 0.93 / -1.5%
tpch-nested_q03/datafusion:parquet 236382389 / 378696949 / -37.6% 🟢 269699631 / 407483225 / -33.8% 🟢 0.88 / 0.93 / -5.7%
tpch-nested_q04/datafusion:parquet 192853694 / 327325526 / -41.1% 🟢 225964570 / 354245750 / -36.2% 🟢 0.85 / 0.92 / -7.6%
tpch-nested_q05/datafusion:parquet 163486665 / 289052241 / -43.4% 🟢 194272235 / 317663716 / -38.8% 🟢 0.84 / 0.91 / -7.5%
tpch-nested_q06/datafusion:parquet 91638707 / 186148431 / -50.8% 🟢 117530981 / 208796131 / -43.7% 🟢 0.78 / 0.89 / -12.5%
tpch-nested_q07/datafusion:parquet 192552565 / 304203564 / -36.7% 🟢 229633070 / 333269665 / -31.1% 🟢 0.84 / 0.91 / -8.1%
tpch-nested_q08/datafusion:parquet 230742625 / 362139291 / -36.3% 🟢 265404608 / 393639315 / -32.6% 🟢 0.87 / 0.92 / -5.5%
tpch-nested_q09/datafusion:parquet 383336247 / 506421237 / -24.3% 🟢 426965966 / 542578839 / -21.3% 🟢 0.90 / 0.93 / -3.8%
tpch-nested_q10/datafusion:parquet 177610274 / 281941304 / -37.0% 🟢 214081197 / 313735520 / -31.8% 🟢 0.83 / 0.90 / -7.7%
tpch-nested_q11/datafusion:parquet 325677490 / 356257969 / -8.6% 356250937 / 381131490 / -6.5% 0.91 / 0.93 / -2.2%
tpch-nested_q12/datafusion:parquet 204827205 / 353008889 / -42.0% 🟢 234095394 / 377361133 / -38.0% 🟢 0.87 / 0.94 / -6.5%
tpch-nested_q13/datafusion:parquet 179909199 / 211723475 / -15.0% 🟢 204246266 / 237423199 / -14.0% 🟢 0.88 / 0.89 / -1.2%
tpch-nested_q14/datafusion:parquet 124367492 / 232070070 / -46.4% 🟢 158140119 / 257173242 / -38.5% 🟢 0.79 / 0.90 / -12.8%
tpch-nested_q15/datafusion:parquet 206100748 / 393690486 / -47.6% 🟢 233580363 / 414972804 / -43.7% 🟢 0.88 / 0.95 / -7.0%
tpch-nested_q16/datafusion:parquet 73064806 / 89534850 / -18.4% 🟢 102649940 / 116895159 / -12.2% 🟢 0.71 / 0.77 / -7.1%
tpch-nested_q17/datafusion:parquet 320820731 / 516266186 / -37.9% 🟢 348675492 / 542440140 / -35.7% 🟢 0.92 / 0.95 / -3.3%
tpch-nested_q18/datafusion:parquet 400708082 / 632274313 / -36.6% 🟢 445670398 / 676265371 / -34.1% 🟢 0.90 / 0.93 / -3.8%
tpch-nested_q19/datafusion:parquet 160416327 / 264443245 / -39.3% 🟢 191637573 / 288429129 / -33.6% 🟢 0.84 / 0.92 / -8.7%
tpch-nested_q20/datafusion:parquet 331044351 / 454183939 / -27.1% 🟢 371506077 / 490036798 / -24.2% 🟢 0.89 / 0.93 / -3.9%
tpch-nested_q21/datafusion:parquet 409521055 / 645722326 / -36.6% 🟢 448653192 / 674170101 / -33.5% 🟢 0.91 / 0.96 / -4.7%
tpch-nested_q22/datafusion:parquet 97330431 / 122992793 / -20.9% 🟢 122791998 / 143655455 / -14.5% 🟢 0.79 / 0.86 / -7.4%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:vortex-file-compressed 24417696 / 24635440 / -0.9% 39938297 / 44196858 / -9.6% 0.61 / 0.56 / +9.7%
tpch-nested_q02/duckdb:vortex-file-compressed 24814358 / 24772870 / +0.2% 38514584 / 39929230 / -3.5% 0.64 / 0.62 / +3.8%
tpch-nested_q03/duckdb:vortex-file-compressed 36818561 / 37300037 / -1.3% 62646889 / 63642173 / -1.6% 0.59 / 0.59 / +0.3%
tpch-nested_q04/duckdb:vortex-file-compressed 31464550 / 33179683 / -5.2% 51169344 / 50790004 / +0.7% 0.61 / 0.65 / -5.9%
tpch-nested_q05/duckdb:vortex-file-compressed 36906583 / 37638533 / -1.9% 60812300 / 63238336 / -3.8% 0.61 / 0.60 / +2.0%
tpch-nested_q06/duckdb:vortex-file-compressed 14392885 / 14637601 / -1.7% 27994121 / 30851292 / -9.3% 0.51 / 0.47 / +8.4%
tpch-nested_q07/duckdb:vortex-file-compressed 35952588 / 36210365 / -0.7% 61179336 / 60979733 / +0.3% 0.59 / 0.59 / -1.0%
tpch-nested_q08/duckdb:vortex-file-compressed 38977274 / 37953181 / +2.7% 60552372 / 59352077 / +2.0% 0.64 / 0.64 / +0.7%
tpch-nested_q09/duckdb:vortex-file-compressed 44369589 / 43983292 / +0.9% 72060949 / 73413310 / -1.8% 0.62 / 0.60 / +2.8%
tpch-nested_q10/duckdb:vortex-file-compressed 47143782 / 46816737 / +0.7% 67371408 / 70065855 / -3.8% 0.70 / 0.67 / +4.7%
tpch-nested_q11/duckdb:vortex-file-compressed 14732272 / 14339453 / +2.7% 33747165 / 35079150 / -3.8% 0.44 / 0.41 / +6.8%
tpch-nested_q12/duckdb:vortex-file-compressed 37330025 / 37206268 / +0.3% 55658539 / 57025973 / -2.4% 0.67 / 0.65 / +2.8%
tpch-nested_q13/duckdb:vortex-file-compressed 22667286 / 24461131 / -7.3% 38262009 / 39455162 / -3.0% 0.59 / 0.62 / -4.4%
tpch-nested_q14/duckdb:vortex-file-compressed 21576663 / 21878887 / -1.4% 42105870 / 39770773 / +5.9% 0.51 / 0.55 / -6.9%
tpch-nested_q15/duckdb:vortex-file-compressed 15494245 / 15538338 / -0.3% 30621349 / 31835530 / -3.8% 0.51 / 0.49 / +3.7%
tpch-nested_q16/duckdb:vortex-file-compressed 19733407 / 19556775 / +0.9% 28260723 / 29008614 / -2.6% 0.70 / 0.67 / +3.6%
tpch-nested_q17/duckdb:vortex-file-compressed 41499246 / 42332493 / -2.0% 62280169 / 63416563 / -1.8% 0.67 / 0.67 / -0.2%
tpch-nested_q18/duckdb:vortex-file-compressed 57463108 / 58969056 / -2.6% 75936181 / 77336587 / -1.8% 0.76 / 0.76 / -0.8%
tpch-nested_q19/duckdb:vortex-file-compressed 31823532 / 32278040 / -1.4% 49582424 / 51474234 / -3.7% 0.64 / 0.63 / +2.4%
tpch-nested_q20/duckdb:vortex-file-compressed 29832636 / 29962465 / -0.4% 55310426 / 54907175 / +0.7% 0.54 / 0.55 / -1.2%
tpch-nested_q21/duckdb:vortex-file-compressed 82530595 / 83212691 / -0.8% 102822041 / 106659665 / -3.6% 0.80 / 0.78 / +2.9%
tpch-nested_q22/duckdb:vortex-file-compressed 20512810 / 20425198 / +0.4% 31014434 / 31113869 / -0.3% 0.66 / 0.66 / +0.8%
duckdb / vortex-compact / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:vortex-compact 28589282 / 28490966 / +0.3% 43369142 / 45167164 / -4.0% 0.66 / 0.63 / +4.5%
tpch-nested_q02/duckdb:vortex-compact 32698821 / 32264882 / +1.3% 45446939 / 45433541 / +0.0% 0.72 / 0.71 / +1.3%
tpch-nested_q03/duckdb:vortex-compact 44984393 / 45482118 / -1.1% 70672854 / 66713319 / +5.9% 0.64 / 0.68 / -6.6%
tpch-nested_q04/duckdb:vortex-compact 39307958 / 40275674 / -2.4% 61148800 / 61535961 / -0.6% 0.64 / 0.65 / -1.8%
tpch-nested_q05/duckdb:vortex-compact 45482375 / 44719219 / +1.7% 65211425 / 65692266 / -0.7% 0.70 / 0.68 / +2.5%
tpch-nested_q06/duckdb:vortex-compact 20394880 / 21285206 / -4.2% 37075161 / 38791098 / -4.4% 0.55 / 0.55 / +0.3%
tpch-nested_q07/duckdb:vortex-compact 41375190 / 40984514 / +1.0% 64904945 / 66766995 / -2.8% 0.64 / 0.61 / +3.8%
tpch-nested_q08/duckdb:vortex-compact 47410759 / 46466028 / +2.0% 66966285 / 68141838 / -1.7% 0.71 / 0.68 / +3.8%
tpch-nested_q09/duckdb:vortex-compact 53036186 / 54838101 / -3.3% 74628789 / 74771921 / -0.2% 0.71 / 0.73 / -3.1%
tpch-nested_q10/duckdb:vortex-compact 59544839 / 61478081 / -3.1% 80239783 / 78393888 / +2.4% 0.74 / 0.78 / -5.4%
tpch-nested_q11/duckdb:vortex-compact 18003347 / 17706411 / +1.7% 37793041 / 38603844 / -2.1% 0.48 / 0.46 / +3.9%
tpch-nested_q12/duckdb:vortex-compact 47576333 / 45318044 / +5.0% 65632259 / 65581846 / +0.1% 0.72 / 0.69 / +4.9%
tpch-nested_q13/duckdb:vortex-compact 25945198 / 28459736 / -8.8% 39249842 / 40392600 / -2.8% 0.66 / 0.70 / -6.2%
tpch-nested_q14/duckdb:vortex-compact 31285414 / 32387400 / -3.4% 51049162 / 50865490 / +0.4% 0.61 / 0.64 / -3.8%
tpch-nested_q15/duckdb:vortex-compact 21462339 / 22779011 / -5.8% 38401542 / 37978451 / +1.1% 0.56 / 0.60 / -6.8%
tpch-nested_q16/duckdb:vortex-compact 21955812 / 22369719 / -1.9% 29560178 / 31614075 / -6.5% 0.74 / 0.71 / +5.0%
tpch-nested_q17/duckdb:vortex-compact 56834285 / 57861254 / -1.8% 79627163 / 78502223 / +1.4% 0.71 / 0.74 / -3.2%
tpch-nested_q18/duckdb:vortex-compact 73211693 / 72988902 / +0.3% 91475198 / 95237919 / -4.0% 0.80 / 0.77 / +4.4%
tpch-nested_q19/duckdb:vortex-compact 41255716 / 41193177 / +0.2% 58364383 / 62586127 / -6.7% 0.71 / 0.66 / +7.4%
tpch-nested_q20/duckdb:vortex-compact 42452709 / 42876317 / -1.0% 65032350 / 65713258 / -1.0% 0.65 / 0.65 / +0.0%
tpch-nested_q21/duckdb:vortex-compact 102346115 / 101251450 / +1.1% 118280988 / 123460316 / -4.2% 0.87 / 0.82 / +5.5%
tpch-nested_q22/duckdb:vortex-compact 33018963 / 33176114 / -0.5% 44206552 / 43911470 / +0.7% 0.75 / 0.76 / -1.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:parquet 190628844 / 189644750 / +0.5% 200816260 / 200327790 / +0.2% 0.95 / 0.95 / +0.3%
tpch-nested_q02/duckdb:parquet 319974908 / 319872631 / +0.0% 329529800 / 331079819 / -0.5% 0.97 / 0.97 / +0.5%
tpch-nested_q03/duckdb:parquet 284194866 / 284083602 / +0.0% 299394902 / 299997369 / -0.2% 0.95 / 0.95 / +0.2%
tpch-nested_q04/duckdb:parquet 283900940 / 283698918 / +0.1% 301772952 / 302584664 / -0.3% 0.94 / 0.94 / +0.3%
tpch-nested_q05/duckdb:parquet 195260628 / 195233805 / +0.0% 209751691 / 209676923 / +0.0% 0.93 / 0.93 / -0.0%
tpch-nested_q06/duckdb:parquet 152317930 / 152587486 / -0.2% 163308781 / 164045133 / -0.4% 0.93 / 0.93 / +0.3%
tpch-nested_q07/duckdb:parquet 195805851 / 196303673 / -0.3% 208073242 / 209700245 / -0.8% 0.94 / 0.94 / +0.5%
tpch-nested_q08/duckdb:parquet 195106837 / 194929499 / +0.1% 209255863 / 208967096 / +0.1% 0.93 / 0.93 / -0.0%
tpch-nested_q09/duckdb:parquet 398574977 / 398873663 / -0.1% 417772551 / 418289911 / -0.1% 0.95 / 0.95 / +0.0%
tpch-nested_q10/duckdb:parquet 259537350 / 259373975 / +0.1% 277324968 / 277107831 / +0.1% 0.94 / 0.94 / -0.0%
tpch-nested_q11/duckdb:parquet 157487237 / 158344189 / -0.5% 164808785 / 165704521 / -0.5% 0.96 / 0.96 / -0.0%
tpch-nested_q12/duckdb:parquet 321265332 / 321527727 / -0.1% 338311090 / 337728463 / +0.2% 0.95 / 0.95 / -0.3%
tpch-nested_q13/duckdb:parquet 243906327 / 243275221 / +0.3% 251343848 / 254114268 / -1.1% 0.97 / 0.96 / +1.4%
tpch-nested_q14/duckdb:parquet 204310074 / 204875905 / -0.3% 219496592 / 219024558 / +0.2% 0.93 / 0.94 / -0.5%
tpch-nested_q15/duckdb:parquet 163630699 / 163746638 / -0.1% 177279196 / 177821459 / -0.3% 0.92 / 0.92 / +0.2%
tpch-nested_q16/duckdb:parquet 87088816 / 87340489 / -0.3% 94723232 / 94830845 / -0.1% 0.92 / 0.92 / -0.2%
tpch-nested_q17/duckdb:parquet 336755508 / 337945347 / -0.4% 354023747 / 355945716 / -0.5% 0.95 / 0.95 / +0.2%
tpch-nested_q18/duckdb:parquet 375009567 / 374495161 / +0.1% 389130738 / 390425326 / -0.3% 0.96 / 0.96 / +0.5%
tpch-nested_q19/duckdb:parquet 209313309 / 209709667 / -0.2% 224115999 / 224529744 / -0.2% 0.93 / 0.93 / -0.0%
tpch-nested_q20/duckdb:parquet 363932293 / 364438669 / -0.1% 382099105 / 381019685 / +0.3% 0.95 / 0.96 / -0.4%
tpch-nested_q21/duckdb:parquet 503247042 / 505336152 / -0.4% 521104214 / 521962442 / -0.2% 0.97 / 0.97 / -0.2%
tpch-nested_q22/duckdb:parquet 128945521 / 128890592 / +0.0% 137707582 / 137761072 / -0.0% 0.94 / 0.94 / +0.1%
duckdb / duckdb / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch-nested_q01/duckdb:duckdb 22002958 / 22311886 / -1.4% 29666506 / 30650935 / -3.2% 0.74 / 0.73 / +1.9%
tpch-nested_q02/duckdb:duckdb 32594460 / 32403350 / +0.6% 44744517 / 44267177 / +1.1% 0.73 / 0.73 / -0.5%
tpch-nested_q03/duckdb:duckdb 33216092 / 33241314 / -0.1% 48832660 / 49228632 / -0.8% 0.68 / 0.68 / +0.7%
tpch-nested_q04/duckdb:duckdb 30658229 / 30790917 / -0.4% 46797154 / 46213169 / +1.3% 0.66 / 0.67 / -1.7%
tpch-nested_q05/duckdb:duckdb 27161023 / 27194295 / -0.1% 40126986 / 41268163 / -2.8% 0.68 / 0.66 / +2.7%
tpch-nested_q06/duckdb:duckdb 15450272 / 15665198 / -1.4% 25673560 / 25104945 / +2.3% 0.60 / 0.62 / -3.6%
tpch-nested_q07/duckdb:duckdb 31116997 / 31359134 / -0.8% 44278994 / 44886037 / -1.4% 0.70 / 0.70 / +0.6%
tpch-nested_q08/duckdb:duckdb 30304044 / 30367790 / -0.2% 44758653 / 46894123 / -4.6% 0.68 / 0.65 / +4.6%
tpch-nested_q09/duckdb:duckdb 52364880 / 52830715 / -0.9% 70976741 / 70820864 / +0.2% 0.74 / 0.75 / -1.1%
tpch-nested_q10/duckdb:duckdb 63219208 / 65873019 / -4.0% 78551346 / 79021993 / -0.6% 0.80 / 0.83 / -3.5%
tpch-nested_q11/duckdb:duckdb 14191923 / 14193803 / -0.0% 21661904 / 22084579 / -1.9% 0.66 / 0.64 / +1.9%
tpch-nested_q12/duckdb:duckdb 37486568 / 37629721 / -0.4% 51941842 / 52527245 / -1.1% 0.72 / 0.72 / +0.7%
tpch-nested_q13/duckdb:duckdb 38830807 / 38799165 / +0.1% 47245063 / 47056929 / +0.4% 0.82 / 0.82 / -0.3%
tpch-nested_q14/duckdb:duckdb 34648319 / 34938687 / -0.8% 49779684 / 49765902 / +0.0% 0.70 / 0.70 / -0.9%
tpch-nested_q15/duckdb:duckdb 18939313 / 19134469 / -1.0% 32383089 / 33078977 / -2.1% 0.58 / 0.58 / +1.1%
tpch-nested_q16/duckdb:duckdb 30115261 / 30164081 / -0.2% 38958623 / 39248204 / -0.7% 0.77 / 0.77 / +0.6%
tpch-nested_q17/duckdb:duckdb 37650926 / 37925154 / -0.7% 52903434 / 52427217 / +0.9% 0.71 / 0.72 / -1.6%
tpch-nested_q18/duckdb:duckdb 36080921 / 35842822 / +0.7% 50289357 / 49327547 / +1.9% 0.72 / 0.73 / -1.3%
tpch-nested_q19/duckdb:duckdb 36997442 / 36896875 / +0.3% 51255179 / 50869467 / +0.8% 0.72 / 0.73 / -0.5%
tpch-nested_q20/duckdb:duckdb 44010556 / 43956580 / +0.1% 64079593 / 65688854 / -2.4% 0.69 / 0.67 / +2.6%
tpch-nested_q21/duckdb:duckdb 64135579 / 64672549 / -0.8% 79539670 / 80643018 / -1.4% 0.81 / 0.80 / +0.5%
tpch-nested_q22/duckdb:duckdb 44653250 / 50680030 / -11.9% 🟢 54664794 / 59896688 / -8.7% 0.82 / 0.85 / -3.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 4a19002f vs base d81bd4ce
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.9%
Engines: DataFusion No clear signal (+16.2%, environment too noisy confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.931x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.863x ✅ · cold 0.925x ➖
Shifts: Parquet (control) -13.7% · Median polish -4.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.868x ✅, 41↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 27747856 / 35687064 / -22.2% 🟢 55053371 / 59727902 / -7.8% 0.50 / 0.60 / -15.6%
tpcds_q02/datafusion:vortex-file-compressed 51677597 / 51071520 / +1.2% 80965339 / 73866370 / +9.6% 0.64 / 0.69 / -7.7%
tpcds_q03/datafusion:vortex-file-compressed 19643576 / 20122918 / -2.4% 48670190 / 45522240 / +6.9% 0.40 / 0.44 / -8.7%
tpcds_q04/datafusion:vortex-file-compressed 282128884 / 294488276 / -4.2% 348468575 / 348826657 / -0.1% 0.81 / 0.84 / -4.1%
tpcds_q05/datafusion:vortex-file-compressed 67404276 / 72186978 / -6.6% 104694541 / 98074801 / +6.7% 0.64 / 0.74 / -12.5%
tpcds_q06/datafusion:vortex-file-compressed 36718234 / 42034562 / -12.6% 🟢 70236451 / 71314146 / -1.5% 0.52 / 0.59 / -11.3%
tpcds_q07/datafusion:vortex-file-compressed 25262170 / 41936610 / -39.8% 🟢 66784633 / 81598206 / -18.2% 🟢 0.38 / 0.51 / -26.4%
tpcds_q08/datafusion:vortex-file-compressed 26633414 / 29293898 / -9.1% 54571611 / 54786660 / -0.4% 0.49 / 0.53 / -8.7%
tpcds_q09/datafusion:vortex-file-compressed 40517296 / 43492521 / -6.8% 77246506 / 75585378 / +2.2% 0.52 / 0.58 / -8.8%
tpcds_q10/datafusion:vortex-file-compressed 34605948 / 37575747 / -7.9% 68591920 / 65187408 / +5.2% 0.50 / 0.58 / -12.5%
tpcds_q11/datafusion:vortex-file-compressed 168533326 / 174078024 / -3.2% 215622837 / 212796053 / +1.3% 0.78 / 0.82 / -4.5%
tpcds_q12/datafusion:vortex-file-compressed 16939646 / 17602241 / -3.8% 40347798 / 36804611 / +9.6% 0.42 / 0.48 / -12.2%
tpcds_q13/datafusion:vortex-file-compressed 36331508 / 37777492 / -3.8% 79450290 / 82427050 / -3.6% 0.46 / 0.46 / -0.2%
tpcds_q14/datafusion:vortex-file-compressed 177424548 / 234215656 / -24.2% 🟢 216041151 / 269416137 / -19.8% 🟢 0.82 / 0.87 / -5.5%
tpcds_q15/datafusion:vortex-file-compressed 24827742 / 40700370 / -39.0% 🟢 49117329 / 59132696 / -16.9% 🟢 0.51 / 0.69 / -26.6%
tpcds_q16/datafusion:vortex-file-compressed 22257257 / 24140928 / -7.8% 43811653 / 41799402 / +4.8% 0.51 / 0.58 / -12.0%
tpcds_q17/datafusion:vortex-file-compressed 52633352 / 64613948 / -18.5% 🟢 86776668 / 96825489 / -10.4% 🟢 0.61 / 0.67 / -9.1%
tpcds_q18/datafusion:vortex-file-compressed 37655834 / 68135038 / -44.7% 🟢 69842665 / 96678626 / -27.8% 🟢 0.54 / 0.70 / -23.5%
tpcds_q19/datafusion:vortex-file-compressed 21270456 / 23065796 / -7.8% 58188526 / 53499164 / +8.8% 0.37 / 0.43 / -15.2%
tpcds_q20/datafusion:vortex-file-compressed 22220896 / 23434874 / -5.2% 43899638 / 39490521 / +11.2% 🔴 0.51 / 0.59 / -14.7%
tpcds_q21/datafusion:vortex-file-compressed 46610696 / 46991756 / -0.8% 81305385 / 77561336 / +4.8% 0.57 / 0.61 / -5.4%
tpcds_q22/datafusion:vortex-file-compressed 430318409 / 436213066 / -1.4% 455396445 / 456238601 / -0.2% 0.94 / 0.96 / -1.2%
tpcds_q23/datafusion:vortex-file-compressed 256949805 / 295445526 / -13.0% 🟢 300178690 / 350238393 / -14.3% 🟢 0.86 / 0.84 / +1.5%
tpcds_q24/datafusion:vortex-file-compressed 112311330 / 118209681 / -5.0% 155042743 / 163532003 / -5.2% 0.72 / 0.72 / +0.2%
tpcds_q25/datafusion:vortex-file-compressed 51212292 / 58404091 / -12.3% 🟢 92062735 / 100148037 / -8.1% 0.56 / 0.58 / -4.6%
tpcds_q26/datafusion:vortex-file-compressed 19339306 / 37624965 / -48.6% 🟢 43991407 / 59590326 / -26.2% 🟢 0.44 / 0.63 / -30.4%
tpcds_q27/datafusion:vortex-file-compressed 50433292 / 71638275 / -29.6% 🟢 91047712 / 105343615 / -13.6% 🟢 0.55 / 0.68 / -18.5%
tpcds_q28/datafusion:vortex-file-compressed 42422224 / 42371952 / +0.1% 88959713 / 87727130 / +1.4% 0.48 / 0.48 / -1.3%
tpcds_q29/datafusion:vortex-file-compressed 54442081 / 66811756 / -18.5% 🟢 93313782 / 102564955 / -9.0% 0.58 / 0.65 / -10.4%
tpcds_q30/datafusion:vortex-file-compressed 37442696 / 51119143 / -26.8% 🟢 66286719 / 75743723 / -12.5% 🟢 0.56 / 0.67 / -16.3%
tpcds_q31/datafusion:vortex-file-compressed 147685329 / 200218175 / -26.2% 🟢 187367702 / 233152597 / -19.6% 🟢 0.79 / 0.86 / -8.2%
tpcds_q32/datafusion:vortex-file-compressed 14159340 / 15152590 / -6.6% 32576428 / 31036644 / +5.0% 0.43 / 0.49 / -11.0%
tpcds_q33/datafusion:vortex-file-compressed 31237510 / 33166894 / -5.8% 69587194 / 66312007 / +4.9% 0.45 / 0.50 / -10.3%
tpcds_q34/datafusion:vortex-file-compressed 34096903 / 40800963 / -16.4% 🟢 67643095 / 69572930 / -2.8% 0.50 / 0.59 / -14.0%
tpcds_q35/datafusion:vortex-file-compressed 74896417 / 92953752 / -19.4% 🟢 107980237 / 118717623 / -9.0% 0.69 / 0.78 / -11.4%
tpcds_q36/datafusion:vortex-file-compressed 65063219 / 66188984 / -1.7% 99763556 / 100548488 / -0.8% 0.65 / 0.66 / -0.9%
tpcds_q37/datafusion:vortex-file-compressed 19786786 / 28659362 / -31.0% 🟢 44220606 / 39142184 / +13.0% 🔴 0.45 / 0.73 / -38.9%
tpcds_q38/datafusion:vortex-file-compressed 63094601 / 79029305 / -20.2% 🟢 95930953 / 106760595 / -10.1% 🟢 0.66 / 0.74 / -11.2%
tpcds_q39/datafusion:vortex-file-compressed 232658020 / 884718834 / -73.7% 🟢 259110000 / 908976999 / -71.5% 🟢 0.90 / 0.97 / -7.7%
tpcds_q40/datafusion:vortex-file-compressed 27324334 / 28530688 / -4.2% 52622557 / 48600430 / +8.3% 0.52 / 0.59 / -11.5%
tpcds_q41/datafusion:vortex-file-compressed 19320212 / 19016106 / +1.6% 36196391 / 31973918 / +13.2% 🔴 0.53 / 0.59 / -10.3%
tpcds_q42/datafusion:vortex-file-compressed 13044958 / 14446512 / -9.7% 44476481 / 37086223 / +19.9% 🔴 0.29 / 0.39 / -24.7%
tpcds_q43/datafusion:vortex-file-compressed 17231278 / 17062690 / +1.0% 44590108 / 37710185 / +18.2% 🔴 0.39 / 0.45 / -14.6%
tpcds_q44/datafusion:vortex-file-compressed 40279770 / 43352470 / -7.1% 73188341 / 72038897 / +1.6% 0.55 / 0.60 / -8.5%
tpcds_q45/datafusion:vortex-file-compressed 27073292 / 44364085 / -39.0% 🟢 51747755 / 59556323 / -13.1% 🟢 0.52 / 0.74 / -29.8%
tpcds_q46/datafusion:vortex-file-compressed 56191175 / 70145033 / -19.9% 🟢 92722514 / 104029608 / -10.9% 🟢 0.61 / 0.67 / -10.1%
tpcds_q47/datafusion:vortex-file-compressed 170827571 / 173539465 / -1.6% 214684974 / 216035492 / -0.6% 0.80 / 0.80 / -0.9%
tpcds_q48/datafusion:vortex-file-compressed 31067032 / 35623834 / -12.8% 🟢 68797547 / 70644306 / -2.6% 0.45 / 0.50 / -10.5%
tpcds_q49/datafusion:vortex-file-compressed 66107787 / 77255316 / -14.4% 🟢 112101504 / 116737222 / -4.0% 0.59 / 0.66 / -10.9%
tpcds_q50/datafusion:vortex-file-compressed 50281018 / 55980736 / -10.2% 🟢 85395770 / 86230008 / -1.0% 0.59 / 0.65 / -9.3%
tpcds_q51/datafusion:vortex-file-compressed 241970230 / 247038673 / -2.1% 279601814 / 280421401 / -0.3% 0.87 / 0.88 / -1.8%
tpcds_q52/datafusion:vortex-file-compressed 14122140 / 14714848 / -4.0% 44384132 / 38389598 / +15.6% 🔴 0.32 / 0.38 / -17.0%
tpcds_q53/datafusion:vortex-file-compressed 21685015 / 22346742 / -3.0% 55945487 / 49846122 / +12.2% 🔴 0.39 / 0.45 / -13.5%
tpcds_q54/datafusion:vortex-file-compressed 47696460 / 57426460 / -16.9% 🟢 83319095 / 92580497 / -10.0% 🟢 0.57 / 0.62 / -7.7%
tpcds_q55/datafusion:vortex-file-compressed 13099697 / 13973340 / -6.3% 43321795 / 38808883 / +11.6% 🔴 0.30 / 0.36 / -16.0%
tpcds_q56/datafusion:vortex-file-compressed 27474432 / 33761524 / -18.6% 🟢 56436822 / 63265036 / -10.8% 🟢 0.49 / 0.53 / -8.8%
tpcds_q57/datafusion:vortex-file-compressed 125564527 / 131113802 / -4.2% 155745780 / 161410678 / -3.5% 0.81 / 0.81 / -0.7%
tpcds_q58/datafusion:vortex-file-compressed 46725132 / 48391922 / -3.4% 86829269 / 84580372 / +2.7% 0.54 / 0.57 / -5.9%
tpcds_q59/datafusion:vortex-file-compressed 52072748 / 55056536 / -5.4% 82547847 / 81170032 / +1.7% 0.63 / 0.68 / -7.0%
tpcds_q60/datafusion:vortex-file-compressed 28013563 / 34937748 / -19.8% 🟢 58918192 / 63120098 / -6.7% 0.48 / 0.55 / -14.1%
tpcds_q61/datafusion:vortex-file-compressed 31842632 / 45353798 / -29.8% 🟢 62543903 / 72493548 / -13.7% 🟢 0.51 / 0.63 / -18.6%
tpcds_q62/datafusion:vortex-file-compressed 18366869 / 18948984 / -3.1% 44995544 / 40635590 / +10.7% 🔴 0.41 / 0.47 / -12.5%
tpcds_q63/datafusion:vortex-file-compressed 21636877 / 22886570 / -5.5% 54411521 / 51245739 / +6.2% 0.40 / 0.45 / -11.0%
tpcds_q64/datafusion:vortex-file-compressed 281760127 / 331770842 / -15.1% 🟢 352808766 / 405661127 / -13.0% 🟢 0.80 / 0.82 / -2.4%
tpcds_q65/datafusion:vortex-file-compressed 73933397 / 74188341 / -0.3% 113291795 / 106874319 / +6.0% 0.65 / 0.69 / -6.0%
tpcds_q66/datafusion:vortex-file-compressed 52648915 / 51726748 / +1.8% 75946395 / 75217399 / +1.0% 0.69 / 0.69 / +0.8%
tpcds_q67/datafusion:vortex-file-compressed 403863397 / 425404384 / -5.1% 501538664 / 518487417 / -3.3% 0.81 / 0.82 / -1.9%
tpcds_q68/datafusion:vortex-file-compressed 52442806 / 67065476 / -21.8% 🟢 93549547 / 99957636 / -6.4% 0.56 / 0.67 / -16.4%
tpcds_q69/datafusion:vortex-file-compressed 34006680 / 36411572 / -6.6% 63711087 / 61245093 / +4.0% 0.53 / 0.59 / -10.2%
tpcds_q70/datafusion:vortex-file-compressed 180329229 / 195234258 / -7.6% 216262961 / 223353634 / -3.2% 0.83 / 0.87 / -4.6%
tpcds_q71/datafusion:vortex-file-compressed 22562079 / 24846620 / -9.2% 64066340 / 57873035 / +10.7% 🔴 0.35 / 0.43 / -18.0%
tpcds_q72/datafusion:vortex-file-compressed 980952800 / 1613070819 / -39.2% 🟢 1072512803 / 1672817704 / -35.9% 🟢 0.91 / 0.96 / -5.1%
tpcds_q73/datafusion:vortex-file-compressed 32286196 / 37798150 / -14.6% 🟢 65442514 / 63097488 / +3.7% 0.49 / 0.60 / -17.6%
tpcds_q74/datafusion:vortex-file-compressed 130584856 / 134609600 / -3.0% 173169220 / 169107950 / +2.4% 0.75 / 0.80 / -5.3%
tpcds_q75/datafusion:vortex-file-compressed 137029218 / 157283038 / -12.9% 🟢 186517667 / 199539779 / -6.5% 0.73 / 0.79 / -6.8%
tpcds_q76/datafusion:vortex-file-compressed 33484196 / 34141944 / -1.9% 75672490 / 76790189 / -1.5% 0.44 / 0.44 / -0.5%
tpcds_q77/datafusion:vortex-file-compressed 46688145 / 54578544 / -14.5% 🟢 83176082 / 87907886 / -5.4% 0.56 / 0.62 / -9.6%
tpcds_q78/datafusion:vortex-file-compressed 122084628 / 139945221 / -12.8% 🟢 174375942 / 191111158 / -8.8% 0.70 / 0.73 / -4.4%
tpcds_q79/datafusion:vortex-file-compressed 45517463 / 54551104 / -16.6% 🟢 81281829 / 83695427 / -2.9% 0.56 / 0.65 / -14.1%
tpcds_q80/datafusion:vortex-file-compressed 74644732 / 81251883 / -8.1% 125391385 / 126092347 / -0.6% 0.60 / 0.64 / -7.6%
tpcds_q81/datafusion:vortex-file-compressed 53908827 / 57217203 / -5.8% 84949036 / 83290839 / +2.0% 0.63 / 0.69 / -7.6%
tpcds_q82/datafusion:vortex-file-compressed 28011277 / 29527786 / -5.1% 67817688 / 46344112 / +46.3% 🔴 0.41 / 0.64 / -35.2%
tpcds_q83/datafusion:vortex-file-compressed 39829740 / 42234106 / -5.7% 69043408 / 65316165 / +5.7% 0.58 / 0.65 / -10.8%
tpcds_q84/datafusion:vortex-file-compressed 11549592 / 12318387 / -6.2% 34631545 / 31461444 / +10.1% 🔴 0.33 / 0.39 / -14.8%
tpcds_q85/datafusion:vortex-file-compressed 52929528 / 60351388 / -12.3% 🟢 85598149 / 89165946 / -4.0% 0.62 / 0.68 / -8.6%
tpcds_q86/datafusion:vortex-file-compressed 17783166 / 18635084 / -4.6% 45118065 / 40794939 / +10.6% 🔴 0.39 / 0.46 / -13.7%
tpcds_q87/datafusion:vortex-file-compressed 63573243 / 77726270 / -18.2% 🟢 94908935 / 106793331 / -11.1% 🟢 0.67 / 0.73 / -8.0%
tpcds_q88/datafusion:vortex-file-compressed 48891478 / 54134854 / -9.7% 90142479 / 91920123 / -1.9% 0.54 / 0.59 / -7.9%
tpcds_q89/datafusion:vortex-file-compressed 25152392 / 27705445 / -9.2% 57616235 / 52989044 / +8.7% 0.44 / 0.52 / -16.5%
tpcds_q90/datafusion:vortex-file-compressed 11439427 / 12876262 / -11.2% 🟢 34966863 / 31193191 / +12.1% 🔴 0.33 / 0.41 / -20.7%
tpcds_q91/datafusion:vortex-file-compressed 16732598 / 19841934 / -15.7% 🟢 45152543 / 40517298 / +11.4% 🔴 0.37 / 0.49 / -24.3%
tpcds_q92/datafusion:vortex-file-compressed 14944179 / 15586140 / -4.1% 38437444 / 35022452 / +9.8% 0.39 / 0.45 / -12.6%
tpcds_q93/datafusion:vortex-file-compressed 55391060 / 54479092 / +1.7% 91238151 / 91110634 / +0.1% 0.61 / 0.60 / +1.5%
tpcds_q94/datafusion:vortex-file-compressed 20607876 / 21721248 / -5.1% 47207821 / 43008447 / +9.8% 0.44 / 0.51 / -13.6%
tpcds_q95/datafusion:vortex-file-compressed 90451132 / 96025348 / -5.8% 127213704 / 125556657 / +1.3% 0.71 / 0.76 / -7.0%
tpcds_q96/datafusion:vortex-file-compressed 10158769 / 11669502 / -12.9% 🟢 34753035 / 29013229 / +19.8% 🔴 0.29 / 0.40 / -27.3%
tpcds_q97/datafusion:vortex-file-compressed 38073124 / 39740562 / -4.2% 65988608 / 64433312 / +2.4% 0.58 / 0.62 / -6.5%
tpcds_q98/datafusion:vortex-file-compressed 19915940 / 20279683 / -1.8% 49703329 / 49580667 / +0.2% 0.40 / 0.41 / -2.0%
tpcds_q99/datafusion:vortex-file-compressed 27826582 / 28990486 / -4.0% 51432569 / 46237709 / +11.2% 🔴 0.54 / 0.63 / -13.7%
datafusion / parquet / ns (0.747x ✅, 84↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 37937724 / 59467470 / -36.2% 🟢 64264828 / 78629990 / -18.3% 🟢 0.59 / 0.76 / -21.9%
tpcds_q02/datafusion:parquet 67228018 / 68841136 / -2.3% 93050334 / 92247774 / +0.9% 0.72 / 0.75 / -3.2%
tpcds_q03/datafusion:parquet 22417980 / 28412717 / -21.1% 🟢 49831729 / 51484914 / -3.2% 0.45 / 0.55 / -18.5%
tpcds_q04/datafusion:parquet 534228991 / 642280600 / -16.8% 🟢 604517124 / 713442164 / -15.3% 🟢 0.88 / 0.90 / -1.8%
tpcds_q05/datafusion:parquet 74717136 / 80587203 / -7.3% 110252100 / 114099796 / -3.4% 0.68 / 0.71 / -4.0%
tpcds_q06/datafusion:parquet 62469644 / 91299202 / -31.6% 🟢 89332759 / 111123421 / -19.6% 🟢 0.70 / 0.82 / -14.9%
tpcds_q07/datafusion:parquet 37565065 / 100516129 / -62.6% 🟢 77576589 / 140439595 / -44.8% 🟢 0.48 / 0.72 / -32.3%
tpcds_q08/datafusion:parquet 39395515 / 47906314 / -17.8% 🟢 64935937 / 77683939 / -16.4% 🟢 0.61 / 0.62 / -1.6%
tpcds_q09/datafusion:parquet 69930211 / 75858005 / -7.8% 103781268 / 103150303 / +0.6% 0.67 / 0.74 / -8.4%
tpcds_q10/datafusion:parquet 39645997 / 59911058 / -33.8% 🟢 61756177 / 85891230 / -28.1% 🟢 0.64 / 0.70 / -8.0%
tpcds_q11/datafusion:parquet 330238152 / 410249982 / -19.5% 🟢 367979588 / 453298906 / -18.8% 🟢 0.90 / 0.91 / -0.8%
tpcds_q12/datafusion:parquet 32752802 / 40180548 / -18.5% 🟢 56623121 / 57554919 / -1.6% 0.58 / 0.70 / -17.1%
tpcds_q13/datafusion:parquet 60597163 / 84877392 / -28.6% 🟢 100420235 / 129583250 / -22.5% 🟢 0.60 / 0.66 / -7.9%
tpcds_q14/datafusion:parquet 226039185 / 390641226 / -42.1% 🟢 263001790 / 422522225 / -37.8% 🟢 0.86 / 0.92 / -7.0%
tpcds_q15/datafusion:parquet 32137257 / 51004075 / -37.0% 🟢 54544291 / 70096169 / -22.2% 🟢 0.59 / 0.73 / -19.0%
tpcds_q16/datafusion:parquet 33225692 / 45319756 / -26.7% 🟢 54868043 / 62344760 / -12.0% 🟢 0.61 / 0.73 / -16.7%
tpcds_q17/datafusion:parquet 92462929 / 140124091 / -34.0% 🟢 125959492 / 173293414 / -27.3% 🟢 0.73 / 0.81 / -9.2%
tpcds_q18/datafusion:parquet 62812704 / 110049167 / -42.9% 🟢 90854546 / 141644863 / -35.9% 🟢 0.69 / 0.78 / -11.0%
tpcds_q19/datafusion:parquet 35629500 / 47382432 / -24.8% 🟢 67341681 / 74454407 / -9.6% 0.53 / 0.64 / -16.9%
tpcds_q20/datafusion:parquet 34126073 / 41140804 / -17.1% 🟢 53100500 / 53422774 / -0.6% 0.64 / 0.77 / -16.5%
tpcds_q21/datafusion:parquet 52413351 / 60585280 / -13.5% 🟢 73819490 / 72359261 / +2.0% 0.71 / 0.84 / -15.2%
tpcds_q22/datafusion:parquet 448867879 / 464956066 / -3.5% 469716513 / 480116418 / -2.2% 0.96 / 0.97 / -1.3%
tpcds_q23/datafusion:parquet 273191534 / 362030230 / -24.5% 🟢 319405489 / 423236940 / -24.5% 🟢 0.86 / 0.86 / -0.0%
tpcds_q24/datafusion:parquet 183491966 / 238522424 / -23.1% 🟢 228320106 / 280988941 / -18.7% 🟢 0.80 / 0.85 / -5.3%
tpcds_q25/datafusion:parquet 101938404 / 145856299 / -30.1% 🟢 148269986 / 180939258 / -18.1% 🟢 0.69 / 0.81 / -14.7%
tpcds_q26/datafusion:parquet 24500899 / 54371764 / -54.9% 🟢 47627495 / 78855738 / -39.6% 🟢 0.51 / 0.69 / -25.4%
tpcds_q27/datafusion:parquet 87659354 / 208670172 / -58.0% 🟢 119499581 / 244008894 / -51.0% 🟢 0.73 / 0.86 / -14.2%
tpcds_q28/datafusion:parquet 85045774 / 88438947 / -3.8% 121995732 / 115489704 / +5.6% 0.70 / 0.77 / -9.0%
tpcds_q29/datafusion:parquet 95206781 / 143202262 / -33.5% 🟢 133748655 / 175795941 / -23.9% 🟢 0.71 / 0.81 / -12.6%
tpcds_q30/datafusion:parquet 69897000 / 99031156 / -29.4% 🟢 95636965 / 119707182 / -20.1% 🟢 0.73 / 0.83 / -11.7%
tpcds_q31/datafusion:parquet 181192253 / 318865238 / -43.2% 🟢 212023657 / 342248409 / -38.0% 🟢 0.85 / 0.93 / -8.3%
tpcds_q32/datafusion:parquet 20731122 / 29268206 / -29.2% 🟢 37402855 / 43049951 / -13.1% 🟢 0.55 / 0.68 / -18.5%
tpcds_q33/datafusion:parquet 41323370 / 54279188 / -23.9% 🟢 72887553 / 73291711 / -0.6% 0.57 / 0.74 / -23.4%
tpcds_q34/datafusion:parquet 43522484 / 62880984 / -30.8% 🟢 70834625 / 85677254 / -17.3% 🟢 0.61 / 0.73 / -16.3%
tpcds_q35/datafusion:parquet 86210229 / 124024507 / -30.5% 🟢 116590261 / 152510309 / -23.6% 🟢 0.74 / 0.81 / -9.1%
tpcds_q36/datafusion:parquet 93136916 / 96065436 / -3.0% 129051455 / 130472892 / -1.1% 0.72 / 0.74 / -2.0%
tpcds_q37/datafusion:parquet 43082530 / 50326967 / -14.4% 🟢 63570533 / 62106792 / +2.4% 0.68 / 0.81 / -16.4%
tpcds_q38/datafusion:parquet 78862170 / 121809162 / -35.3% 🟢 105476200 / 148143097 / -28.8% 🟢 0.75 / 0.82 / -9.1%
tpcds_q39/datafusion:parquet 221520607 / 850365260 / -73.9% 🟢 247365161 / 858244795 / -71.2% 🟢 0.90 / 0.99 / -9.6%
tpcds_q40/datafusion:parquet 31108011 / 34460206 / -9.7% 53236193 / 55082629 / -3.4% 0.58 / 0.63 / -6.6%
tpcds_q41/datafusion:parquet 25595568 / 32074791 / -20.2% 🟢 40308302 / 42604832 / -5.4% 0.63 / 0.75 / -15.7%
tpcds_q42/datafusion:parquet 19132054 / 26668796 / -28.3% 🟢 43168771 / 44471155 / -2.9% 0.44 / 0.60 / -26.1%
tpcds_q43/datafusion:parquet 22780678 / 27798290 / -18.1% 🟢 49095201 / 48667153 / +0.9% 0.46 / 0.57 / -18.8%
tpcds_q44/datafusion:parquet 58427180 / 66005414 / -11.5% 🟢 87592740 / 85489645 / +2.5% 0.67 / 0.77 / -13.6%
tpcds_q45/datafusion:parquet 35358045 / 66367192 / -46.7% 🟢 59880221 / 87700095 / -31.7% 🟢 0.59 / 0.76 / -22.0%
tpcds_q46/datafusion:parquet 73414594 / 108262468 / -32.2% 🟢 123234438 / 147281576 / -16.3% 🟢 0.60 / 0.74 / -19.0%
tpcds_q47/datafusion:parquet 217204149 / 235616338 / -7.8% 259939773 / 274771942 / -5.4% 0.84 / 0.86 / -2.6%
tpcds_q48/datafusion:parquet 52776880 / 79003310 / -33.2% 🟢 86510342 / 104369134 / -17.1% 🟢 0.61 / 0.76 / -19.4%
tpcds_q49/datafusion:parquet 87924490 / 117557337 / -25.2% 🟢 120749448 / 168445239 / -28.3% 🟢 0.73 / 0.70 / +4.3%
tpcds_q50/datafusion:parquet 62559922 / 91455979 / -31.6% 🟢 96887072 / 121449330 / -20.2% 🟢 0.65 / 0.75 / -14.3%
tpcds_q51/datafusion:parquet 252912928 / 257462208 / -1.8% 274646420 / 275612309 / -0.4% 0.92 / 0.93 / -1.4%
tpcds_q52/datafusion:parquet 20017500 / 26582131 / -24.7% 🟢 44106058 / 46713825 / -5.6% 0.45 / 0.57 / -20.2%
tpcds_q53/datafusion:parquet 29147204 / 35857856 / -18.7% 🟢 58547489 / 60285453 / -2.9% 0.50 / 0.59 / -16.3%
tpcds_q54/datafusion:parquet 70170380 / 84979193 / -17.4% 🟢 96659814 / 106622915 / -9.3% 0.73 / 0.80 / -8.9%
tpcds_q55/datafusion:parquet 19410268 / 25716791 / -24.5% 🟢 43612126 / 47255907 / -7.7% 0.45 / 0.54 / -18.2%
tpcds_q56/datafusion:parquet 40075016 / 52634930 / -23.9% 🟢 66519091 / 72550483 / -8.3% 0.60 / 0.73 / -17.0%
tpcds_q57/datafusion:parquet 153836402 / 171481192 / -10.3% 🟢 180253626 / 193556759 / -6.9% 0.85 / 0.89 / -3.7%
tpcds_q58/datafusion:parquet 78075706 / 97417717 / -19.9% 🟢 109107860 / 116545953 / -6.4% 0.72 / 0.84 / -14.4%
tpcds_q59/datafusion:parquet 94772637 / 105187850 / -9.9% 125651115 / 128553486 / -2.3% 0.75 / 0.82 / -7.8%
tpcds_q60/datafusion:parquet 46677234 / 53716710 / -13.1% 🟢 70610322 / 72468178 / -2.6% 0.66 / 0.74 / -10.8%
tpcds_q61/datafusion:parquet 53325105 / 74726424 / -28.6% 🟢 82466489 / 100897235 / -18.3% 🟢 0.65 / 0.74 / -12.7%
tpcds_q62/datafusion:parquet 22424138 / 27394960 / -18.1% 🟢 42540578 / 44704350 / -4.8% 0.53 / 0.61 / -14.0%
tpcds_q63/datafusion:parquet 29353890 / 36109236 / -18.7% 🟢 55586809 / 58190337 / -4.5% 0.53 / 0.62 / -14.9%
tpcds_q64/datafusion:parquet 537248729 / 658028547 / -18.4% 🟢 609395902 / 727112413 / -16.2% 🟢 0.88 / 0.90 / -2.6%
tpcds_q65/datafusion:parquet 103319777 / 100883629 / +2.4% 140041337 / 133391313 / +5.0% 0.74 / 0.76 / -2.4%
tpcds_q66/datafusion:parquet 66442558 / 77524761 / -14.3% 🟢 94172710 / 104064088 / -9.5% 0.71 / 0.74 / -5.3%
tpcds_q67/datafusion:parquet 410472748 / 432898548 / -5.2% 486807368 / 500774321 / -2.8% 0.84 / 0.86 / -2.5%
tpcds_q68/datafusion:parquet 77295372 / 107972369 / -28.4% 🟢 109931006 / 153393827 / -28.3% 🟢 0.70 / 0.70 / -0.1%
tpcds_q69/datafusion:parquet 39340121 / 59031088 / -33.4% 🟢 63053170 / 81368763 / -22.5% 🟢 0.62 / 0.73 / -14.0%
tpcds_q70/datafusion:parquet 191151428 / 211356872 / -9.6% 226641802 / 243628971 / -7.0% 0.84 / 0.87 / -2.8%
tpcds_q71/datafusion:parquet 33176718 / 39988372 / -17.0% 🟢 62082522 / 63580905 / -2.4% 0.53 / 0.63 / -15.0%
tpcds_q72/datafusion:parquet 1084999642 / 1766291258 / -38.6% 🟢 1102796200 / 1717685799 / -35.8% 🟢 0.98 / 1.03 / -4.3%
tpcds_q73/datafusion:parquet 41680639 / 62604856 / -33.4% 🟢 70705429 / 85382876 / -17.2% 🟢 0.59 / 0.73 / -19.6%
tpcds_q74/datafusion:parquet 211549368 / 293543952 / -27.9% 🟢 245806230 / 333014708 / -26.2% 🟢 0.86 / 0.88 / -2.4%
tpcds_q75/datafusion:parquet 162141630 / 195570109 / -17.1% 🟢 210355151 / 227532670 / -7.5% 0.77 / 0.86 / -10.3%
tpcds_q76/datafusion:parquet 43313471 / 50790492 / -14.7% 🟢 79715675 / 80279383 / -0.7% 0.54 / 0.63 / -14.1%
tpcds_q77/datafusion:parquet 53093316 / 71696114 / -25.9% 🟢 87839553 / 102466534 / -14.3% 🟢 0.60 / 0.70 / -13.6%
tpcds_q78/datafusion:parquet 179720232 / 210078458 / -14.5% 🟢 227445013 / 262635746 / -13.4% 🟢 0.79 / 0.80 / -1.2%
tpcds_q79/datafusion:parquet 52558100 / 78772706 / -33.3% 🟢 102286918 / 113848428 / -10.2% 🟢 0.51 / 0.69 / -25.7%
tpcds_q80/datafusion:parquet 133861958 / 143215239 / -6.5% 182260154 / 198385628 / -8.1% 0.73 / 0.72 / +1.7%
tpcds_q81/datafusion:parquet 76996895 / 108666647 / -29.1% 🟢 101434676 / 126675306 / -19.9% 🟢 0.76 / 0.86 / -11.5%
tpcds_q82/datafusion:parquet 47103290 / 54589676 / -13.7% 🟢 70234770 / 72577165 / -3.2% 0.67 / 0.75 / -10.8%
tpcds_q83/datafusion:parquet 46334752 / 66004765 / -29.8% 🟢 71779033 / 80766410 / -11.1% 🟢 0.65 / 0.82 / -21.0%
tpcds_q84/datafusion:parquet 22232246 / 35067368 / -36.6% 🟢 38821129 / 49217980 / -21.1% 🟢 0.57 / 0.71 / -19.6%
tpcds_q85/datafusion:parquet 65515082 / 106118258 / -38.3% 🟢 95089933 / 126965208 / -25.1% 🟢 0.69 / 0.84 / -17.6%
tpcds_q86/datafusion:parquet 17761801 / 21856744 / -18.7% 🟢 38509439 / 38801034 / -0.8% 0.46 / 0.56 / -18.1%
tpcds_q87/datafusion:parquet 77920097 / 121427887 / -35.8% 🟢 104726061 / 146352765 / -28.4% 🟢 0.74 / 0.83 / -10.3%
tpcds_q88/datafusion:parquet 75587314 / 85112720 / -11.2% 🟢 100741964 / 111247316 / -9.4% 0.75 / 0.77 / -1.9%
tpcds_q89/datafusion:parquet 31609795 / 38253917 / -17.4% 🟢 61399550 / 64696968 / -5.1% 0.51 / 0.59 / -12.9%
tpcds_q90/datafusion:parquet 13072802 / 17095194 / -23.5% 🟢 32698948 / 32500458 / +0.6% 0.40 / 0.53 / -24.0%
tpcds_q91/datafusion:parquet 25472177 / 41649029 / -38.8% 🟢 44878481 / 57973405 / -22.6% 🟢 0.57 / 0.72 / -21.0%
tpcds_q92/datafusion:parquet 20305465 / 28701521 / -29.3% 🟢 39683584 / 45914012 / -13.6% 🟢 0.51 / 0.63 / -18.1%
tpcds_q93/datafusion:parquet 57055069 / 61105564 / -6.6% 91237932 / 86368626 / +5.6% 0.63 / 0.71 / -11.6%
tpcds_q94/datafusion:parquet 26597288 / 38133748 / -30.3% 🟢 48683010 / 57944474 / -16.0% 🟢 0.55 / 0.66 / -17.0%
tpcds_q95/datafusion:parquet 88758036 / 129222804 / -31.3% 🟢 114512885 / 153739120 / -25.5% 🟢 0.78 / 0.84 / -7.8%
tpcds_q96/datafusion:parquet 18913442 / 21737938 / -13.0% 🟢 37203073 / 38315607 / -2.9% 0.51 / 0.57 / -10.4%
tpcds_q97/datafusion:parquet 44538602 / 54900939 / -18.9% 🟢 72900570 / 80044710 / -8.9% 0.61 / 0.69 / -10.9%
tpcds_q98/datafusion:parquet 54348738 / 62068014 / -12.4% 🟢 85134429 / 84935164 / +0.2% 0.64 / 0.73 / -12.6%
tpcds_q99/datafusion:parquet 36903523 / 42547334 / -13.3% 🟢 55461272 / 57947364 / -4.3% 0.67 / 0.73 / -9.4%
duckdb / vortex-file-compressed / ns (0.999x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32503584 / 32666622 / -0.5% 44339589 / 44442032 / -0.2% 0.73 / 0.74 / -0.3%
tpcds_q02/duckdb:vortex-file-compressed 31127406 / 31019078 / +0.3% 42193240 / 42210494 / -0.0% 0.74 / 0.73 / +0.4%
tpcds_q03/duckdb:vortex-file-compressed 14504040 / 13791742 / +5.2% 30597001 / 29378226 / +4.1% 0.47 / 0.47 / +1.0%
tpcds_q04/duckdb:vortex-file-compressed 129763796 / 129471634 / +0.2% 158140337 / 151903616 / +4.1% 0.82 / 0.85 / -3.7%
tpcds_q05/duckdb:vortex-file-compressed 55446034 / 54650877 / +1.5% 81570671 / 73147246 / +11.5% 🔴 0.68 / 0.75 / -9.0%
tpcds_q06/duckdb:vortex-file-compressed 59114604 / 58713689 / +0.7% 78403748 / 75959131 / +3.2% 0.75 / 0.77 / -2.5%
tpcds_q07/duckdb:vortex-file-compressed 30505558 / 30579528 / -0.2% 53794581 / 52049505 / +3.4% 0.57 / 0.59 / -3.5%
tpcds_q08/duckdb:vortex-file-compressed 31237894 / 30914874 / +1.0% 42835272 / 40665146 / +5.3% 0.73 / 0.76 / -4.1%
tpcds_q09/duckdb:vortex-file-compressed 55979370 / 56913068 / -1.6% 77910603 / 74998255 / +3.9% 0.72 / 0.76 / -5.3%
tpcds_q10/duckdb:vortex-file-compressed 39134800 / 39635552 / -1.3% 59313572 / 57816076 / +2.6% 0.66 / 0.69 / -3.8%
tpcds_q11/duckdb:vortex-file-compressed 96270066 / 95253860 / +1.1% 112445806 / 113706380 / -1.1% 0.86 / 0.84 / +2.2%
tpcds_q12/duckdb:vortex-file-compressed 17968702 / 17712503 / +1.4% 29985758 / 29984002 / +0.0% 0.60 / 0.59 / +1.4%
tpcds_q13/duckdb:vortex-file-compressed 38279965 / 37991460 / +0.8% 72625836 / 69301429 / +4.8% 0.53 / 0.55 / -3.9%
tpcds_q14/duckdb:vortex-file-compressed 120422590 / 121384720 / -0.8% 135628122 / 134734274 / +0.7% 0.89 / 0.90 / -1.4%
tpcds_q15/duckdb:vortex-file-compressed 59583903 / 61299576 / -2.8% 72795050 / 72388428 / +0.6% 0.82 / 0.85 / -3.3%
tpcds_q16/duckdb:vortex-file-compressed 34670652 / 34690472 / -0.1% 53108300 / 52266117 / +1.6% 0.65 / 0.66 / -1.6%
tpcds_q17/duckdb:vortex-file-compressed 57832822 / 57332318 / +0.9% 78908324 / 79066911 / -0.2% 0.73 / 0.73 / +1.1%
tpcds_q18/duckdb:vortex-file-compressed 82860674 / 82923020 / -0.1% 101967564 / 101023706 / +0.9% 0.81 / 0.82 / -1.0%
tpcds_q19/duckdb:vortex-file-compressed 44965392 / 43597316 / +3.1% 63294302 / 62263780 / +1.7% 0.71 / 0.70 / +1.5%
tpcds_q20/duckdb:vortex-file-compressed 21789515 / 22262395 / -2.1% 37572055 / 35610939 / +5.5% 0.58 / 0.63 / -7.2%
tpcds_q21/duckdb:vortex-file-compressed 35820938 / 34748561 / +3.1% 67472635 / 61670816 / +9.4% 0.53 / 0.56 / -5.8%
tpcds_q22/duckdb:vortex-file-compressed 157150688 / 161348692 / -2.6% 175332583 / 172593381 / +1.6% 0.90 / 0.93 / -4.1%
tpcds_q23/duckdb:vortex-file-compressed 184204106 / 183560942 / +0.4% 200619903 / 197879336 / +1.4% 0.92 / 0.93 / -1.0%
tpcds_q24/duckdb:vortex-file-compressed 51923480 / 52262054 / -0.6% 76012549 / 70571615 / +7.7% 0.68 / 0.74 / -7.8%
tpcds_q25/duckdb:vortex-file-compressed 53360487 / 52927888 / +0.8% 78705809 / 72882457 / +8.0% 0.68 / 0.73 / -6.6%
tpcds_q26/duckdb:vortex-file-compressed 26094291 / 26933009 / -3.1% 42212620 / 40955560 / +3.1% 0.62 / 0.66 / -6.0%
tpcds_q27/duckdb:vortex-file-compressed 31929073 / 32187006 / -0.8% 58855861 / 51949183 / +13.3% 🔴 0.54 / 0.62 / -12.4%
tpcds_q28/duckdb:vortex-file-compressed 43074054 / 42552663 / +1.2% 68195683 / 61657569 / +10.6% 🔴 0.63 / 0.69 / -8.5%
tpcds_q29/duckdb:vortex-file-compressed 51632765 / 52233606 / -1.2% 75013632 / 71810623 / +4.5% 0.69 / 0.73 / -5.4%
tpcds_q30/duckdb:vortex-file-compressed 38259442 / 38885226 / -1.6% 51283018 / 50464856 / +1.6% 0.75 / 0.77 / -3.2%
tpcds_q31/duckdb:vortex-file-compressed 38334484 / 38098196 / +0.6% 54939999 / 53564287 / +2.6% 0.70 / 0.71 / -1.9%
tpcds_q32/duckdb:vortex-file-compressed 14434930 / 13744550 / +5.0% 29585591 / 29352103 / +0.8% 0.49 / 0.47 / +4.2%
tpcds_q33/duckdb:vortex-file-compressed 34462912 / 34677902 / -0.6% 58835560 / 56234127 / +4.6% 0.59 / 0.62 / -5.0%
tpcds_q34/duckdb:vortex-file-compressed 23992966 / 22969670 / +4.5% 40467246 / 38109259 / +6.2% 0.59 / 0.60 / -1.6%
tpcds_q35/duckdb:vortex-file-compressed 67287874 / 67973400 / -1.0% 88198707 / 87774818 / +0.5% 0.76 / 0.77 / -1.5%
tpcds_q36/duckdb:vortex-file-compressed 29204118 / 29798050 / -2.0% 48169782 / 50744981 / -5.1% 0.61 / 0.59 / +3.2%
tpcds_q37/duckdb:vortex-file-compressed 27376848 / 27056984 / +1.2% 76976674 / 63501341 / +21.2% 🔴 0.36 / 0.43 / -16.5%
tpcds_q38/duckdb:vortex-file-compressed 65978457 / 65418466 / +0.9% 74316424 / 79214533 / -6.2% 0.89 / 0.83 / +7.5%
tpcds_q39/duckdb:vortex-file-compressed 57481955 / 59507598 / -3.4% 88614646 / 85059050 / +4.2% 0.65 / 0.70 / -7.3%
tpcds_q40/duckdb:vortex-file-compressed 19210709 / 18871024 / +1.8% 35752617 / 33673544 / +6.2% 0.54 / 0.56 / -4.1%
tpcds_q41/duckdb:vortex-file-compressed 19735000 / 19805286 / -0.4% 26660653 / 29362971 / -9.2% 0.74 / 0.67 / +9.7%
tpcds_q42/duckdb:vortex-file-compressed 14647344 / 13899774 / +5.4% 30434293 / 29210586 / +4.2% 0.48 / 0.48 / +1.1%
tpcds_q43/duckdb:vortex-file-compressed 19346847 / 19246490 / +0.5% 35034314 / 32560191 / +7.6% 0.55 / 0.59 / -6.6%
tpcds_q44/duckdb:vortex-file-compressed 27943632 / 28025286 / -0.3% 49092101 / 48655091 / +0.9% 0.57 / 0.58 / -1.2%
tpcds_q45/duckdb:vortex-file-compressed 47480261 / 47072534 / +0.9% 59890479 / 59554822 / +0.6% 0.79 / 0.79 / +0.3%
tpcds_q46/duckdb:vortex-file-compressed 51064596 / 50438530 / +1.2% 75807352 / 74694605 / +1.5% 0.67 / 0.68 / -0.2%
tpcds_q47/duckdb:vortex-file-compressed 81384326 / 80023928 / +1.7% 96599487 / 94571206 / +2.1% 0.84 / 0.85 / -0.4%
tpcds_q48/duckdb:vortex-file-compressed 54059443 / 54686811 / -1.1% 78359272 / 74230374 / +5.6% 0.69 / 0.74 / -6.4%
tpcds_q49/duckdb:vortex-file-compressed 38393518 / 37594846 / +2.1% 79589443 / 74467492 / +6.9% 0.48 / 0.50 / -4.4%
tpcds_q50/duckdb:vortex-file-compressed 32146603 / 32781100 / -1.9% 57316860 / 53162237 / +7.8% 0.56 / 0.62 / -9.0%
tpcds_q51/duckdb:vortex-file-compressed 204511068 / 203964206 / +0.3% 220762358 / 219753980 / +0.5% 0.93 / 0.93 / -0.2%
tpcds_q52/duckdb:vortex-file-compressed 14948547 / 14677496 / +1.8% 31903199 / 31526862 / +1.2% 0.47 / 0.47 / +0.6%
tpcds_q53/duckdb:vortex-file-compressed 21996383 / 22186665 / -0.9% 41217395 / 37074470 / +11.2% 🔴 0.53 / 0.60 / -10.8%
tpcds_q54/duckdb:vortex-file-compressed 45212923 / 44656646 / +1.2% 65595887 / 64461201 / +1.8% 0.69 / 0.69 / -0.5%
tpcds_q55/duckdb:vortex-file-compressed 14848262 / 14576306 / +1.9% 30901617 / 29207984 / +5.8% 0.48 / 0.50 / -3.7%
tpcds_q56/duckdb:vortex-file-compressed 33639326 / 33782552 / -0.4% 56910521 / 55297615 / +2.9% 0.59 / 0.61 / -3.2%
tpcds_q57/duckdb:vortex-file-compressed 65307108 / 65424170 / -0.2% 78713633 / 78631941 / +0.1% 0.83 / 0.83 / -0.3%
tpcds_q58/duckdb:vortex-file-compressed 38677232 / 38898298 / -0.6% 61609085 / 55844701 / +10.3% 🔴 0.63 / 0.70 / -9.9%
tpcds_q59/duckdb:vortex-file-compressed 54666310 / 53884934 / +1.5% 63674961 / 64106634 / -0.7% 0.86 / 0.84 / +2.1%
tpcds_q60/duckdb:vortex-file-compressed 35970122 / 35946234 / +0.1% 57221623 / 56917888 / +0.5% 0.63 / 0.63 / -0.5%
tpcds_q61/duckdb:vortex-file-compressed 34975578 / 35361596 / -1.1% 55326007 / 54931615 / +0.7% 0.63 / 0.64 / -1.8%
tpcds_q62/duckdb:vortex-file-compressed 16896492 / 15642241 / +8.0% 27447312 / 26437775 / +3.8% 0.62 / 0.59 / +4.0%
tpcds_q63/duckdb:vortex-file-compressed 21179564 / 21535454 / -1.7% 38582545 / 37891582 / +1.8% 0.55 / 0.57 / -3.4%
tpcds_q64/duckdb:vortex-file-compressed 119248314 / 118554184 / +0.6% 154883693 / 155152310 / -0.2% 0.77 / 0.76 / +0.8%
tpcds_q65/duckdb:vortex-file-compressed 52679901 / 51795274 / +1.7% 59910615 / 58381044 / +2.6% 0.88 / 0.89 / -0.9%
tpcds_q66/duckdb:vortex-file-compressed 41134722 / 43175862 / -4.7% 58671389 / 58144026 / +0.9% 0.70 / 0.74 / -5.6%
tpcds_q67/duckdb:vortex-file-compressed 277131502 / 279697525 / -0.9% 283411943 / 286952006 / -1.2% 0.98 / 0.97 / +0.3%
tpcds_q68/duckdb:vortex-file-compressed 45125291 / 43855412 / +2.9% 72890271 / 70889380 / +2.8% 0.62 / 0.62 / +0.1%
tpcds_q69/duckdb:vortex-file-compressed 38619644 / 38928932 / -0.8% 61464010 / 58818393 / +4.5% 0.63 / 0.66 / -5.1%
tpcds_q70/duckdb:vortex-file-compressed 25172170 / 25463294 / -1.1% 41894140 / 40384021 / +3.7% 0.60 / 0.63 / -4.7%
tpcds_q71/duckdb:vortex-file-compressed 27553478 / 28420039 / -3.0% 50996378 / 50106346 / +1.8% 0.54 / 0.57 / -4.7%
tpcds_q72/duckdb:vortex-file-compressed 138936551 / 139979520 / -0.7% 163037806 / 158903169 / +2.6% 0.85 / 0.88 / -3.3%
tpcds_q73/duckdb:vortex-file-compressed 19874715 / 20585262 / -3.5% 35780112 / 34351793 / +4.2% 0.56 / 0.60 / -7.3%
tpcds_q74/duckdb:vortex-file-compressed 82302770 / 82954312 / -0.8% 96244337 / 96750254 / -0.5% 0.86 / 0.86 / -0.3%
tpcds_q75/duckdb:vortex-file-compressed 112067432 / 111812181 / +0.2% 141815674 / 134642468 / +5.3% 0.79 / 0.83 / -4.8%
tpcds_q76/duckdb:vortex-file-compressed 28199570 / 28565848 / -1.3% 58228671 / 50818005 / +14.6% 🔴 0.48 / 0.56 / -13.8%
tpcds_q77/duckdb:vortex-file-compressed 35667072 / 37119674 / -3.9% 60670416 / 58001525 / +4.6% 0.59 / 0.64 / -8.1%
tpcds_q78/duckdb:vortex-file-compressed 135431381 / 134376332 / +0.8% 159972398 / 156253992 / +2.4% 0.85 / 0.86 / -1.6%
tpcds_q79/duckdb:vortex-file-compressed 38335575 / 37226774 / +3.0% 60762036 / 64984627 / -6.5% 0.63 / 0.57 / +10.1%
tpcds_q80/duckdb:vortex-file-compressed 60321704 / 60631832 / -0.5% 93780737 / 87730396 / +6.9% 0.64 / 0.69 / -6.9%
tpcds_q81/duckdb:vortex-file-compressed 56663446 / 56945055 / -0.5% 71104749 / 69412304 / +2.4% 0.80 / 0.82 / -2.9%
tpcds_q82/duckdb:vortex-file-compressed 28849676 / 29310453 / -1.6% 76785331 / 66476381 / +15.5% 🔴 0.38 / 0.44 / -14.8%
tpcds_q83/duckdb:vortex-file-compressed 21660401 / 22220825 / -2.5% 31875721 / 31287098 / +1.9% 0.68 / 0.71 / -4.3%
tpcds_q84/duckdb:vortex-file-compressed 13340936 / 13235808 / +0.8% 24952170 / 23242568 / +7.4% 0.53 / 0.57 / -6.1%
tpcds_q85/duckdb:vortex-file-compressed 37154630 / 36925374 / +0.6% 54161001 / 51546008 / +5.1% 0.69 / 0.72 / -4.2%
tpcds_q86/duckdb:vortex-file-compressed 16845132 / 17513178 / -3.8% 28987942 / 27253205 / +6.4% 0.58 / 0.64 / -9.6%
tpcds_q87/duckdb:vortex-file-compressed 75233599 / 77864842 / -3.4% 86572396 / 89463261 / -3.2% 0.87 / 0.87 / -0.2%
tpcds_q88/duckdb:vortex-file-compressed 38193006 / 38263800 / -0.2% 48162531 / 48154818 / +0.0% 0.79 / 0.79 / -0.2%
tpcds_q89/duckdb:vortex-file-compressed 24885616 / 24642745 / +1.0% 40680931 / 39097340 / +4.1% 0.61 / 0.63 / -2.9%
tpcds_q90/duckdb:vortex-file-compressed 10059876 / 9989277 / +0.7% 23081406 / 19596667 / +17.8% 🔴 0.44 / 0.51 / -14.5%
tpcds_q91/duckdb:vortex-file-compressed 19566843 / 19631830 / -0.3% 30577106 / 28502784 / +7.3% 0.64 / 0.69 / -7.1%
tpcds_q92/duckdb:vortex-file-compressed 13655928 / 13669336 / -0.1% 28025920 / 27546971 / +1.7% 0.49 / 0.50 / -1.8%
tpcds_q93/duckdb:vortex-file-compressed 24975334 / 25614763 / -2.5% 51491218 / 48903940 / +5.3% 0.49 / 0.52 / -7.4%
tpcds_q94/duckdb:vortex-file-compressed 33096412 / 32556908 / +1.7% 47286553 / 46308520 / +2.1% 0.70 / 0.70 / -0.4%
tpcds_q95/duckdb:vortex-file-compressed 92999856 / 94847437 / -1.9% 104645181 / 106019934 / -1.3% 0.89 / 0.89 / -0.7%
tpcds_q96/duckdb:vortex-file-compressed 12219546 / 11913750 / +2.6% 24048249 / 24940175 / -3.6% 0.51 / 0.48 / +6.4%
tpcds_q97/duckdb:vortex-file-compressed 61882104 / 61212860 / +1.1% 80144120 / 78071460 / +2.7% 0.77 / 0.78 / -1.5%
tpcds_q98/duckdb:vortex-file-compressed 27325945 / 27621885 / -1.1% 44518139 / 43376439 / +2.6% 0.61 / 0.64 / -3.6%
tpcds_q99/duckdb:vortex-file-compressed 20317216 / 22726621 / -10.6% 🟢 34848400 / 35480133 / -1.8% 0.58 / 0.64 / -9.0%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 41334117 / 41754509 / -1.0% 50199598 / 49716420 / +1.0% 0.82 / 0.84 / -2.0%
tpcds_q02/duckdb:parquet 37881429 / 39320498 / -3.7% 52410629 / 48014421 / +9.2% 0.72 / 0.82 / -11.7%
tpcds_q03/duckdb:parquet 26264628 / 25927457 / +1.3% 35913512 / 36544174 / -1.7% 0.73 / 0.71 / +3.1%
tpcds_q04/duckdb:parquet 203596308 / 204404258 / -0.4% 220542089 / 225527266 / -2.2% 0.92 / 0.91 / +1.9%
tpcds_q05/duckdb:parquet 69650944 / 69257976 / +0.6% 85789458 / 85239338 / +0.6% 0.81 / 0.81 / -0.1%
tpcds_q06/duckdb:parquet 73838190 / 75009952 / -1.6% 88841721 / 86459760 / +2.8% 0.83 / 0.87 / -4.2%
tpcds_q07/duckdb:parquet 60874623 / 61347346 / -0.8% 80497759 / 78900270 / +2.0% 0.76 / 0.78 / -2.7%
tpcds_q08/duckdb:parquet 40075296 / 39528259 / +1.4% 47834153 / 47045239 / +1.7% 0.84 / 0.84 / -0.3%
tpcds_q09/duckdb:parquet 86001796 / 85242190 / +0.9% 98208336 / 99107059 / -0.9% 0.88 / 0.86 / +1.8%
tpcds_q10/duckdb:parquet 52350725 / 51215596 / +2.2% 61697956 / 60545042 / +1.9% 0.85 / 0.85 / +0.3%
tpcds_q11/duckdb:parquet 156887138 / 157115754 / -0.1% 166248613 / 167096251 / -0.5% 0.94 / 0.94 / +0.4%
tpcds_q12/duckdb:parquet 40614570 / 40352013 / +0.7% 46989377 / 47141692 / -0.3% 0.86 / 0.86 / +1.0%
tpcds_q13/duckdb:parquet 69059838 / 70020372 / -1.4% 93422681 / 85638270 / +9.1% 0.74 / 0.82 / -9.6%
tpcds_q14/duckdb:parquet 184802168 / 184880045 / -0.0% 199819409 / 198443193 / +0.7% 0.92 / 0.93 / -0.7%
tpcds_q15/duckdb:parquet 60784814 / 60771048 / +0.0% 69667657 / 67619690 / +3.0% 0.87 / 0.90 / -2.9%
tpcds_q16/duckdb:parquet 38172770 / 37994630 / +0.5% 46761497 / 45727616 / +2.3% 0.82 / 0.83 / -1.8%
tpcds_q17/duckdb:parquet 81666768 / 83160258 / -1.8% 92766545 / 89114981 / +4.1% 0.88 / 0.93 / -5.7%
tpcds_q18/duckdb:parquet 87967210 / 87879957 / +0.1% 98087751 / 95836133 / +2.3% 0.90 / 0.92 / -2.2%
tpcds_q19/duckdb:parquet 48011758 / 47515380 / +1.0% 60835976 / 61000663 / -0.3% 0.79 / 0.78 / +1.3%
tpcds_q20/duckdb:parquet 40993722 / 43268675 / -5.3% 49521715 / 53319914 / -7.1% 0.83 / 0.81 / +2.0%
tpcds_q21/duckdb:parquet 23829529 / 23792717 / +0.2% 28500527 / 30200345 / -5.6% 0.84 / 0.79 / +6.1%
tpcds_q22/duckdb:parquet 163803010 / 166859429 / -1.8% 162607259 / 164973195 / -1.4% 1.01 / 1.01 / -0.4%
tpcds_q23/duckdb:parquet 187012916 / 185062354 / +1.1% 193349502 / 194317115 / -0.5% 0.97 / 0.95 / +1.6%
tpcds_q24/duckdb:parquet 69594432 / 73795194 / -5.7% 84095224 / 81539892 / +3.1% 0.83 / 0.91 / -8.6%
tpcds_q25/duckdb:parquet 50886232 / 50609986 / +0.5% 60583894 / 59253909 / +2.2% 0.84 / 0.85 / -1.7%
tpcds_q26/duckdb:parquet 42246998 / 42341269 / -0.2% 52258274 / 50367988 / +3.8% 0.81 / 0.84 / -3.8%
tpcds_q27/duckdb:parquet 58364268 / 59273806 / -1.5% 73505763 / 74915572 / -1.9% 0.79 / 0.79 / +0.4%
tpcds_q28/duckdb:parquet 94845799 / 92538077 / +2.5% 106268119 / 108311955 / -1.9% 0.89 / 0.85 / +4.5%
tpcds_q29/duckdb:parquet 84458494 / 85143526 / -0.8% 101224568 / 97322888 / +4.0% 0.83 / 0.87 / -4.6%
tpcds_q30/duckdb:parquet 72193582 / 71883182 / +0.4% 79777497 / 79235601 / +0.7% 0.90 / 0.91 / -0.3%
tpcds_q31/duckdb:parquet 98133573 / 98352300 / -0.2% 110073026 / 110050281 / +0.0% 0.89 / 0.89 / -0.2%
tpcds_q32/duckdb:parquet 18296980 / 18136707 / +0.9% 26794325 / 25667997 / +4.4% 0.68 / 0.71 / -3.4%
tpcds_q33/duckdb:parquet 62502096 / 63106814 / -1.0% 75118603 / 75700594 / -0.8% 0.83 / 0.83 / -0.2%
tpcds_q34/duckdb:parquet 32759576 / 33253224 / -1.5% 47280186 / 39802094 / +18.8% 🔴 0.69 / 0.84 / -17.1%
tpcds_q35/duckdb:parquet 77170884 / 75987730 / +1.6% 88464188 / 90314190 / -2.0% 0.87 / 0.84 / +3.7%
tpcds_q36/duckdb:parquet 99314583 / 96353316 / +3.1% 113709251 / 111385494 / +2.1% 0.87 / 0.87 / +1.0%
tpcds_q37/duckdb:parquet 41437497 / 42209048 / -1.8% 48075341 / 47786871 / +0.6% 0.86 / 0.88 / -2.4%
tpcds_q38/duckdb:parquet 76692302 / 77958424 / -1.6% 82671353 / 85349165 / -3.1% 0.93 / 0.91 / +1.6%
tpcds_q39/duckdb:parquet 61747846 / 61486491 / +0.4% 67280390 / 68395844 / -1.6% 0.92 / 0.90 / +2.1%
tpcds_q40/duckdb:parquet 28148936 / 28074760 / +0.3% 35359545 / 35471051 / -0.3% 0.80 / 0.79 / +0.6%
tpcds_q41/duckdb:parquet 20179153 / 20300412 / -0.6% 27137018 / 27039573 / +0.4% 0.74 / 0.75 / -1.0%
tpcds_q42/duckdb:parquet 25652750 / 25832600 / -0.7% 39305999 / 37396731 / +5.1% 0.65 / 0.69 / -5.5%
tpcds_q43/duckdb:parquet 25682828 / 27833256 / -7.7% 36094871 / 37569548 / -3.9% 0.71 / 0.74 / -4.0%
tpcds_q44/duckdb:parquet 60105944 / 61917711 / -2.9% 74978003 / 76056446 / -1.4% 0.80 / 0.81 / -1.5%
tpcds_q45/duckdb:parquet 62106868 / 60935476 / +1.9% 67153505 / 66445419 / +1.1% 0.92 / 0.92 / +0.8%
tpcds_q46/duckdb:parquet 72384936 / 74233802 / -2.5% 90231299 / 85326401 / +5.7% 0.80 / 0.87 / -7.8%
tpcds_q47/duckdb:parquet 90313880 / 91376278 / -1.2% 99094814 / 100561337 / -1.5% 0.91 / 0.91 / +0.3%
tpcds_q48/duckdb:parquet 67288846 / 65415782 / +2.9% 81356663 / 77089178 / +5.5% 0.83 / 0.85 / -2.5%
tpcds_q49/duckdb:parquet 69203330 / 68736560 / +0.7% 85224520 / 88271949 / -3.5% 0.81 / 0.78 / +4.3%
tpcds_q50/duckdb:parquet 43737696 / 44405659 / -1.5% 55581498 / 50047873 / +11.1% 🔴 0.79 / 0.89 / -11.3%
tpcds_q51/duckdb:parquet 215991865 / 215203352 / +0.4% 228090813 / 225668772 / +1.1% 0.95 / 0.95 / -0.7%
tpcds_q52/duckdb:parquet 26879730 / 26929999 / -0.2% 38485726 / 37851845 / +1.7% 0.70 / 0.71 / -1.8%
tpcds_q53/duckdb:parquet 34236400 / 35085957 / -2.4% 45560402 / 45697835 / -0.3% 0.75 / 0.77 / -2.1%
tpcds_q54/duckdb:parquet 56744448 / 55066050 / +3.0% 65015680 / 62823873 / +3.5% 0.87 / 0.88 / -0.4%
tpcds_q55/duckdb:parquet 27205373 / 27167385 / +0.1% 37926420 / 36846878 / +2.9% 0.72 / 0.74 / -2.7%
tpcds_q56/duckdb:parquet 69504658 / 69810094 / -0.4% 81507460 / 78191395 / +4.2% 0.85 / 0.89 / -4.5%
tpcds_q57/duckdb:parquet 67756172 / 67924052 / -0.2% 75581196 / 75378836 / +0.3% 0.90 / 0.90 / -0.5%
tpcds_q58/duckdb:parquet 56923477 / 55636208 / +2.3% 68223983 / 67771566 / +0.7% 0.83 / 0.82 / +1.6%
tpcds_q59/duckdb:parquet 60331248 / 60888385 / -0.9% 65716362 / 69281606 / -5.1% 0.92 / 0.88 / +4.5%
tpcds_q60/duckdb:parquet 81480652 / 82995592 / -1.8% 92348703 / 93609037 / -1.3% 0.88 / 0.89 / -0.5%
tpcds_q61/duckdb:parquet 81511127 / 79843582 / +2.1% 93721451 / 96209480 / -2.6% 0.87 / 0.83 / +4.8%
tpcds_q62/duckdb:parquet 20812838 / 22427732 / -7.2% 24316153 / 26553261 / -8.4% 0.86 / 0.84 / +1.3%
tpcds_q63/duckdb:parquet 33779990 / 32945599 / +2.5% 44676656 / 44810985 / -0.3% 0.76 / 0.74 / +2.8%
tpcds_q64/duckdb:parquet 135399950 / 137730810 / -1.7% 151543934 / 162467301 / -6.7% 0.89 / 0.85 / +5.4%
tpcds_q65/duckdb:parquet 94570331 / 90841106 / +4.1% 105801668 / 98758923 / +7.1% 0.89 / 0.92 / -2.8%
tpcds_q66/duckdb:parquet 46158424 / 46229679 / -0.2% 51996401 / 52011770 / -0.0% 0.89 / 0.89 / -0.1%
tpcds_q67/duckdb:parquet 297357726 / 296484754 / +0.3% 312445015 / 300794460 / +3.9% 0.95 / 0.99 / -3.4%
tpcds_q68/duckdb:parquet 63616942 / 62271290 / +2.2% 80506106 / 79884988 / +0.8% 0.79 / 0.78 / +1.4%
tpcds_q69/duckdb:parquet 64835304 / 66823133 / -3.0% 76027510 / 75751375 / +0.4% 0.85 / 0.88 / -3.3%
tpcds_q70/duckdb:parquet 43268446 / 43502914 / -0.5% 52329091 / 51876494 / +0.9% 0.83 / 0.84 / -1.4%
tpcds_q71/duckdb:parquet 41535500 / 40235578 / +3.2% 55292346 / 53331431 / +3.7% 0.75 / 0.75 / -0.4%
tpcds_q72/duckdb:parquet 172787322 / 171234634 / +0.9% 184815291 / 185887233 / -0.6% 0.93 / 0.92 / +1.5%
tpcds_q73/duckdb:parquet 28405742 / 28539550 / -0.5% 36118607 / 38525179 / -6.2% 0.79 / 0.74 / +6.2%
tpcds_q74/duckdb:parquet 215941953 / 214701141 / +0.6% 222119167 / 226612264 / -2.0% 0.97 / 0.95 / +2.6%
tpcds_q75/duckdb:parquet 131731536 / 136513298 / -3.5% 151601598 / 144305040 / +5.1% 0.87 / 0.95 / -8.1%
tpcds_q76/duckdb:parquet 50059820 / 52107498 / -3.9% 66911531 / 66393995 / +0.8% 0.75 / 0.78 / -4.7%
tpcds_q77/duckdb:parquet 54405833 / 53680122 / +1.4% 73456506 / 68802211 / +6.8% 0.74 / 0.78 / -5.1%
tpcds_q78/duckdb:parquet 153742665 / 146481247 / +5.0% 167509815 / 173928138 / -3.7% 0.92 / 0.84 / +9.0%
tpcds_q79/duckdb:parquet 53995972 / 52912912 / +2.0% 64356413 / 69766888 / -7.8% 0.84 / 0.76 / +10.6%
tpcds_q80/duckdb:parquet 82611682 / 84091399 / -1.8% 103539093 / 101467325 / +2.0% 0.80 / 0.83 / -3.7%
tpcds_q81/duckdb:parquet 98541610 / 96942804 / +1.6% 106048561 / 105070620 / +0.9% 0.93 / 0.92 / +0.7%
tpcds_q82/duckdb:parquet 46149798 / 46487240 / -0.7% 54119246 / 53044060 / +2.0% 0.85 / 0.88 / -2.7%
tpcds_q83/duckdb:parquet 28533856 / 28126860 / +1.4% 33346995 / 33556853 / -0.6% 0.86 / 0.84 / +2.1%
tpcds_q84/duckdb:parquet 22859751 / 22718850 / +0.6% 29917134 / 28854283 / +3.7% 0.76 / 0.79 / -3.0%
tpcds_q85/duckdb:parquet 51889266 / 51569898 / +0.6% 60184617 / 60972055 / -1.3% 0.86 / 0.85 / +1.9%
tpcds_q86/duckdb:parquet 25523249 / 25653376 / -0.5% 31971243 / 32290498 / -1.0% 0.80 / 0.79 / +0.5%
tpcds_q87/duckdb:parquet 86082933 / 86041585 / +0.0% 93129208 / 96073615 / -3.1% 0.92 / 0.90 / +3.2%
tpcds_q88/duckdb:parquet 104844647 / 104156077 / +0.7% 110935072 / 113708809 / -2.4% 0.95 / 0.92 / +3.2%
tpcds_q89/duckdb:parquet 37229252 / 37221714 / +0.0% 46640178 / 52543843 / -11.2% 🟢 0.80 / 0.71 / +12.7%
tpcds_q90/duckdb:parquet 14936784 / 15320644 / -2.5% 20161330 / 19638004 / +2.7% 0.74 / 0.78 / -5.0%
tpcds_q91/duckdb:parquet 25633546 / 25533825 / +0.4% 33309052 / 32629028 / +2.1% 0.77 / 0.78 / -1.7%
tpcds_q92/duckdb:parquet 22824600 / 22457040 / +1.6% 30695443 / 29600706 / +3.7% 0.74 / 0.76 / -2.0%
tpcds_q93/duckdb:parquet 36197108 / 36522483 / -0.9% 47815842 / 49556338 / -3.5% 0.76 / 0.74 / +2.7%
tpcds_q94/duckdb:parquet 37564850 / 38221661 / -1.7% 45497972 / 47915670 / -5.0% 0.83 / 0.80 / +3.5%
tpcds_q95/duckdb:parquet 80846698 / 80753512 / +0.1% 98742474 / 88826826 / +11.2% 🔴 0.82 / 0.91 / -9.9%
tpcds_q96/duckdb:parquet 17565778 / 17701885 / -0.8% 25440638 / 22852748 / +11.3% 🔴 0.69 / 0.77 / -10.9%
tpcds_q97/duckdb:parquet 73487144 / 72195042 / +1.8% 85996805 / 85867593 / +0.2% 0.85 / 0.84 / +1.6%
tpcds_q98/duckdb:parquet 54140579 / 54526654 / -0.7% 66869480 / 67784295 / -1.3% 0.81 / 0.80 / +0.7%
tpcds_q99/duckdb:parquet 24174582 / 25590772 / -5.5% 32818668 / 32382010 / +1.3% 0.74 / 0.79 / -6.8%

No baseline file sizes found for base commit.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants