Skip to content

feat(array): extend BETWEEN execution across encodings - #10378

Closed
joseph-isaacs wants to merge 1 commit into
developfrom
ji/between-remaining-encodings
Closed

feat(array): extend BETWEEN execution across encodings#10378
joseph-isaacs wants to merge 1 commit into
developfrom
ji/between-remaining-encodings

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 7, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Range predicates on encoded arrays can fall back to materializing the entire input. Add encoding-aware BETWEEN paths so the predicate can run on compressed children, dictionary values, or sequence metadata.

  • Extension: delegate to storage when the input and both bounds have matching extension metadata; preserve nullability and Kleene null-bound semantics.
  • Dictionary and run-end: evaluate constant bounds once per dictionary entry or run value, then expand the boolean result through the existing codes or run ends.
  • Masked: push the predicate into the child and apply the original validity mask to the result.
  • Sequence: derive the matching index interval from monotone sequence metadata using i128 arithmetic, including descending steps and unsigned values above i64::MAX.
  • FoR: translate constant bounds into the encoded domain for a shared reference, splitting an interval when wrapping subtraction crosses the type boundary.
  • Patched, VarBin, DateTimeParts, FSST, and OnPair: reuse the existing comparison kernels through a shared adaptor. Both comparisons must be handled; otherwise the normal canonical fallback remains available.

Extracts the extension implementation, tests, and benchmark from #10339. The existing primitive, decimal, constant, ALP, sparse, bit-packed, and chunked paths remain in place. DecimalByteParts is already covered by merged #10152.

Validation: 154 targeted BETWEEN tests passed across the seven affected crates. All-target/all-feature Clippy with -D warnings, pinned-nightly Rust formatting, and patch whitespace checks passed. Regression cases cover strictness, nulls, row-bound fallback, dictionary codes, run offsets, signed and unsigned sequence limits, FoR wraparound, string bounds, patched values, and non-midnight timestamps.

The extension microbenchmark is included. The additional encoding paths have not yet been benchmarked; cross-platform CI is still running.

Joe Isaacs
feat(array): add BETWEEN paths for remaining comparable encodings
e31e4d0 
Extract extension storage delegation, its regression tests, and benchmark
from the V2 scan driver PR. Add constant-bound dictionary and run-end
kernels, masked-child reduction, monotone sequence range evaluation, and
FoR interval translation that accounts for wrapping subtraction.

Reuse existing comparison kernels for Patched, VarBin, DateTimeParts,
FSST, and OnPair. Decline when either comparison is unsupported so the
canonical fallback can still decode the original input once.

Add regression cases for strictness, nulls, row-bound fallback, run-end
offsets, descending and unsigned sequences, and signed/unsigned FoR wraps.
Validation: 154 targeted BETWEEN tests passed across the seven affected
crates. All-target/all-feature Clippy with warnings denied, pinned-nightly
Rust formatting, and patch whitespace checks passed.

Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs mentioned this pull request Oct 7, 2026
Closed
@codspeed

ghost commented Oct 7, 2026

Copy link
Copy Markdown

Merging this PR will regress 2 benchmarks

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 2 regressed benchmarks
✅ 2119 untouched benchmarks
🆕 24 new benchmarks
⏩ 518 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation chunked_opt_bool_canonical_into[(1000, 10)] 59.5 µs 69.5 µs -14.33%
❌ WallTime bitpack_blocked_compress_avx2 6.7 µs 7.6 µs -11.76%
⚡ Simulation decompress[u32, (1000, 256)] 54.9 µs 32.9 µs +66.82%
⚡ Simulation take[routing/grouped_chunks/primitive/nonnull/chunks=32/indices=1000] 421.6 µs 380.2 µs +10.88%
🆕 WallTime between_avx2[false, 262144] N/A 21.6 µs N/A
🆕 WallTime between_avx2[false, 8192] N/A 1.6 µs N/A
🆕 WallTime between_avx2[true, 262144] N/A 21.7 µs N/A
🆕 WallTime between_avx2[true, 8192] N/A 1.7 µs N/A
🆕 WallTime two_compares_avx2[false, 262144] N/A 84.7 µs N/A
🆕 WallTime two_compares_avx2[false, 8192] N/A 7.7 µs N/A
🆕 WallTime two_compares_avx2[true, 262144] N/A 96.4 µs N/A
🆕 WallTime two_compares_avx2[true, 8192] N/A 8.6 µs N/A
🆕 WallTime between_avx512[false, 262144] N/A 21.6 µs N/A
🆕 WallTime between_avx512[false, 8192] N/A 1.6 µs N/A
🆕 WallTime between_avx512[true, 262144] N/A 21.8 µs N/A
🆕 WallTime between_avx512[true, 8192] N/A 1.7 µs N/A
🆕 WallTime two_compares_avx512[false, 262144] N/A 54.4 µs N/A
🆕 WallTime two_compares_avx512[false, 8192] N/A 6.6 µs N/A
🆕 WallTime two_compares_avx512[true, 262144] N/A 66 µs N/A
🆕 WallTime two_compares_avx512[true, 8192] N/A 7.8 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ji/between-remaining-encodings (e31e4d0) with develop (438600d)

Open in CodSpeed

Footnotes

  1. 518 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Oct 7, 2026
@github-actions

ghost commented Oct 7, 2026 •
edited by github-actions Bot
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done e31e4d0 random-access-bench 1 Explore Profiling Data
🟢 Done e31e4d0 statpopgen 1 Explore Profiling Data
🟢 Done e31e4d0 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e31e4d0 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done e31e4d0 tpch-s3-10 1 Explore Profiling Data
🟢 Done e31e4d0 tpcds-nvme 1 Explore Profiling Data
🟢 Done e31e4d0 clickbench-nvme 1 Explore Profiling Data
🟢 Done e31e4d0 fineweb-s3 1 Explore Profiling Data
🟢 Done e31e4d0 fineweb 1 Explore Profiling Data
🟢 Done e31e4d0 appian-nvme 1 Explore Profiling Data
🟢 Done e31e4d0 polarsignals 1 Explore Profiling Data
🟢 Done e31e4d0 tpch-s3 1 Explore Profiling Data
🟢 Done e31e4d0 tpch-nvme 1 Explore Profiling Data
🟢 Done e31e4d0 compress-bench 1 Explore Profiling Data
🟢 Done e31e4d0 string-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR e31e4d0a vs base 9324b04d
Vortex (geomean): hot 1.006x ➖ · cold 1.104x ❌

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57711532 / 57391412 / +0.6% 105871453 / 96952802 / +9.2% 0.55 / 0.59 / -7.9%
polarsignals_q01/datafusion:vortex-file-compressed 63815916 / 63351636 / +0.7% 128431107 / 125125476 / +2.6% 0.50 / 0.51 / -1.9%
polarsignals_q02/datafusion:vortex-file-compressed 75356425 / 71143387 / +5.9% 115040743 / 106520029 / +8.0% 0.66 / 0.67 / -1.9%
polarsignals_q03/datafusion:vortex-file-compressed 79866800 / 79957580 / -0.1% 143664674 / 136419979 / +5.3% 0.56 / 0.59 / -5.2%
polarsignals_q04/datafusion:vortex-file-compressed 9572192 / 9536383 / +0.4% 55128633 / 44344485 / +24.3% 🔴 0.17 / 0.22 / -19.3%
polarsignals_q05/datafusion:vortex-file-compressed 24601381 / 24612903 / -0.0% 68633189 / 61188170 / +12.2% 🔴 0.36 / 0.40 / -10.9%
polarsignals_q06/datafusion:vortex-file-compressed 21471453 / 21539341 / -0.3% 67068168 / 57928832 / +15.8% 🔴 0.32 / 0.37 / -13.9%
polarsignals_q07/datafusion:vortex-file-compressed 40118894 / 39911727 / +0.5% 83920006 / 75761845 / +10.8% 🔴 0.48 / 0.53 / -9.3%
polarsignals_q08/datafusion:vortex-file-compressed 98555310 / 97600248 / +1.0% 166270698 / 162916632 / +2.1% 0.59 / 0.60 / -1.1%
polarsignals_q09/datafusion:vortex-file-compressed 9901034 / 10096654 / -1.9% 52263155 / 45108177 / +15.9% 🔴 0.19 / 0.22 / -15.4%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR e31e4d0a vs base 9324b04d

vortex / vortex-file-compressed / ms (1.002x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 33.105089 / 33.031068 / +0.2%
read/clickbench/URL/shard-0/onpair-12 21.041368 / 21.285776 / -1.1%
read/tpch/l_comment/fsst 58.107782 / 57.867634 / +0.4%
read/tpch/l_comment/onpair-12 53.837979 / 53.642267 / +0.4%
write/clickbench/URL/shard-0/fsst 590.925541 / 590.452299 / +0.1%
write/clickbench/URL/shard-0/onpair-12 964.763248 / 959.712932 / +0.5%
write/tpch/l_comment/fsst 1912.62584 / 1905.94603 / +0.4%
write/tpch/l_comment/onpair-12 2072.71797 / 2061.13175 / +0.6%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.4055438 / 47.4055438 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.2301956 / 30.2301956 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Engines: DataFusion No clear signal (+1.8%, low confidence) · DuckDB No clear signal (-6.2%, low confidence)
Vortex (geomean): hot 0.969x ➖ · cold 0.996x ➖
Parquet (geomean): hot 0.991x ➖ · cold 1.037x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.980x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6804584 / 6987568 / -2.6% 20454129 / 19985409 / +2.3% 0.33 / 0.35 / -4.9%
fineweb_q01/datafusion:vortex-file-compressed 11703654 / 11423302 / +2.5% 48989787 / 45651890 / +7.3% 0.24 / 0.25 / -4.5%
fineweb_q02/datafusion:vortex-file-compressed 13744774 / 13011452 / +5.6% 52825669 / 50842705 / +3.9% 0.26 / 0.26 / +1.7%
fineweb_q03/datafusion:vortex-file-compressed 20803308 / 21354045 / -2.6% 122177226 / 105702200 / +15.6% 🔴 0.17 / 0.20 / -15.7%
fineweb_q04/datafusion:vortex-file-compressed 80755096 / 82347624 / -1.9% 173123929 / 160201521 / +8.1% 0.47 / 0.51 / -9.3%
fineweb_q05/datafusion:vortex-file-compressed 68346692 / 68125354 / +0.3% 155072150 / 144888784 / +7.0% 0.44 / 0.47 / -6.3%
fineweb_q06/datafusion:vortex-file-compressed 19765298 / 20941982 / -5.6% 125129531 / 105102542 / +19.1% 🔴 0.16 / 0.20 / -20.7%
fineweb_q07/datafusion:vortex-file-compressed 19200876 / 19524014 / -1.7% 113712568 / 100988296 / +12.6% 🔴 0.17 / 0.19 / -12.7%
fineweb_q08/datafusion:vortex-file-compressed 9593533 / 10793452 / -11.1% 🟢 45320308 / 36193083 / +25.2% 🔴 0.21 / 0.30 / -29.0%
datafusion / vortex-compact / ns (1.037x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6988378 / 7123866 / -1.9% 20669413 / 19503481 / +6.0% 0.34 / 0.37 / -7.4%
fineweb_q01/datafusion:vortex-compact 44597932 / 43981971 / +1.4% 83221428 / 77064578 / +8.0% 0.54 / 0.57 / -6.1%
fineweb_q02/datafusion:vortex-compact 61109809 / 43864780 / +39.3% 🔴 115289682 / 78358994 / +47.1% 🔴 0.53 / 0.56 / -5.3%
fineweb_q03/datafusion:vortex-compact 159019689 / 157431186 / +1.0% 230966949 / 226463896 / +2.0% 0.69 / 0.70 / -1.0%
fineweb_q04/datafusion:vortex-compact 192270420 / 176431905 / +9.0% 241491552 / 240943420 / +0.2% 0.80 / 0.73 / +8.7%
fineweb_q05/datafusion:vortex-compact 158640199 / 164678368 / -3.7% 230259431 / 231668675 / -0.6% 0.69 / 0.71 / -3.1%
fineweb_q06/datafusion:vortex-compact 86652663 / 87749222 / -1.2% 167687362 / 161669980 / +3.7% 0.52 / 0.54 / -4.8%
fineweb_q07/datafusion:vortex-compact 88648465 / 88129284 / +0.6% 157055373 / 157362084 / -0.2% 0.56 / 0.56 / +0.8%
fineweb_q08/datafusion:vortex-compact 8751874 / 9204171 / -4.9% 41549066 / 40415356 / +2.8% 0.21 / 0.23 / -7.5%
datafusion / parquet / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9429283 / 9429157 / +0.0% 35379698 / 33303773 / +6.2% 0.27 / 0.28 / -5.9%
fineweb_q01/datafusion:parquet 74602511 / 75740221 / -1.5% 169257080 / 148961361 / +13.6% 🔴 0.44 / 0.51 / -13.3%
fineweb_q02/datafusion:parquet 74640349 / 73853865 / +1.1% 174683737 / 149673571 / +16.7% 🔴 0.43 / 0.49 / -13.4%
fineweb_q03/datafusion:parquet 72968875 / 76227375 / -4.3% 166632417 / 149912771 / +11.2% 🔴 0.44 / 0.51 / -13.9%
fineweb_q04/datafusion:parquet 81475071 / 83271379 / -2.2% 165428799 / 154008945 / +7.4% 0.49 / 0.54 / -8.9%
fineweb_q05/datafusion:parquet 80643374 / 80436338 / +0.3% 168770926 / 153368922 / +10.0% 🔴 0.48 / 0.52 / -8.9%
fineweb_q06/datafusion:parquet 74373286 / 74832914 / -0.6% 158805085 / 159059068 / -0.2% 0.47 / 0.47 / -0.5%
fineweb_q07/datafusion:parquet 73358395 / 74548223 / -1.6% 169107820 / 150923583 / +12.0% 🔴 0.43 / 0.49 / -12.2%
fineweb_q08/datafusion:parquet 74483184 / 74191652 / +0.4% 163898208 / 154333510 / +6.2% 0.45 / 0.48 / -5.5%
duckdb / vortex-file-compressed / ns (0.932x ➖, 5↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2396019 / 2459564 / -2.6% 4834014 / 7434848 / -35.0% 🟢 0.50 / 0.33 / +49.8%
fineweb_q01/duckdb:vortex-file-compressed 20064340 / 22630222 / -11.3% 🟢 50773190 / 53238919 / -4.6% 0.40 / 0.43 / -7.0%
fineweb_q02/duckdb:vortex-file-compressed 18350166 / 21903848 / -16.2% 🟢 63369484 / 57916664 / +9.4% 0.29 / 0.38 / -23.4%
fineweb_q03/duckdb:vortex-file-compressed 29675497 / 25652266 / +15.7% 🔴 121992085 / 110660865 / +10.2% 🔴 0.24 / 0.23 / +4.9%
fineweb_q04/duckdb:vortex-file-compressed 79019103 / 95229680 / -17.0% 🟢 118889015 / 195085226 / -39.1% 🟢 0.66 / 0.49 / +36.2%
fineweb_q05/duckdb:vortex-file-compressed 69695995 / 68175906 / +2.2% 126867570 / 123981043 / +2.3% 0.55 / 0.55 / -0.1%
fineweb_q06/duckdb:vortex-file-compressed 51068696 / 53666874 / -4.8% 140475840 / 149620249 / -6.1% 0.36 / 0.36 / +1.4%
fineweb_q07/duckdb:vortex-file-compressed 25516596 / 28707779 / -11.1% 🟢 106004404 / 99608889 / +6.4% 0.24 / 0.29 / -16.5%
fineweb_q08/duckdb:vortex-file-compressed 5907278 / 6693012 / -11.7% 🟢 13814823 / 16277625 / -15.1% 🟢 0.43 / 0.41 / +4.0%
duckdb / vortex-compact / ns (0.930x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2220149 / 4210886 / -47.3% 🟢 5189915 / 7366026 / -29.5% 🟢 0.43 / 0.57 / -25.2%
fineweb_q01/duckdb:vortex-compact 50864794 / 53839056 / -5.5% 90350182 / 99837096 / -9.5% 0.56 / 0.54 / +4.4%
fineweb_q02/duckdb:vortex-compact 45733956 / 47384966 / -3.5% 64801640 / 88507020 / -26.8% 🟢 0.71 / 0.54 / +31.8%
fineweb_q03/duckdb:vortex-compact 187104866 / 189645310 / -1.3% 241147703 / 265803494 / -9.3% 0.78 / 0.71 / +8.7%
fineweb_q04/duckdb:vortex-compact 190327846 / 189227786 / +0.6% 267237329 / 247487119 / +8.0% 0.71 / 0.76 / -6.9%
fineweb_q05/duckdb:vortex-compact 180344276 / 178676368 / +0.9% 210775430 / 206103451 / +2.3% 0.86 / 0.87 / -1.3%
fineweb_q06/duckdb:vortex-compact 92566826 / 90105023 / +2.7% 144241559 / 142903038 / +0.9% 0.64 / 0.63 / +1.8%
fineweb_q07/duckdb:vortex-compact 107366228 / 100776996 / +6.5% 159543081 / 157169338 / +1.5% 0.67 / 0.64 / +5.0%
fineweb_q08/duckdb:vortex-compact 7258795 / 7342419 / -1.1% 11926141 / 11962820 / -0.3% 0.61 / 0.61 / -0.8%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21331238 / 21711632 / -1.8% 22849008 / 23430920 / -2.5% 0.93 / 0.93 / +0.8%
fineweb_q01/duckdb:parquet 44470022 / 44421042 / +0.1% 55197624 / 55772605 / -1.0% 0.81 / 0.80 / +1.2%
fineweb_q02/duckdb:parquet 44056522 / 44277940 / -0.5% 55725979 / 60216941 / -7.5% 0.79 / 0.74 / +7.5%
fineweb_q03/duckdb:parquet 95078100 / 96700474 / -1.7% 183986677 / 189792644 / -3.1% 0.52 / 0.51 / +1.4%
fineweb_q04/duckdb:parquet 154567136 / 151826552 / +1.8% 199229143 / 189984761 / +4.9% 0.78 / 0.80 / -2.9%
fineweb_q05/duckdb:parquet 142784866 / 144217960 / -1.0% 197941588 / 192984156 / +2.6% 0.72 / 0.75 / -3.5%
fineweb_q06/duckdb:parquet 70964956 / 71131899 / -0.2% 127136503 / 123052855 / +3.3% 0.56 / 0.58 / -3.4%
fineweb_q07/duckdb:parquet 72325611 / 71991096 / +0.5% 158029415 / 155232764 / +1.8% 0.46 / 0.46 / -1.3%
fineweb_q08/duckdb:parquet 23043596 / 24029389 / -4.1% 24062570 / 26828152 / -10.3% 🟢 0.96 / 0.90 / +6.9%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16758887 / 16572961 / +1.1% 49504517 / 45574763 / +8.6% 0.34 / 0.36 / -6.9%
tpch_q02/datafusion:vortex-file-compressed 17633946 / 17485409 / +0.8% 37268332 / 38065305 / -2.1% 0.47 / 0.46 / +3.0%
tpch_q03/datafusion:vortex-file-compressed 19823996 / 19317413 / +2.6% 48870289 / 50766542 / -3.7% 0.41 / 0.38 / +6.6%
tpch_q04/datafusion:vortex-file-compressed 10241166 / 10519273 / -2.6% 35401469 / 35645748 / -0.7% 0.29 / 0.30 / -2.0%
tpch_q05/datafusion:vortex-file-compressed 37053139 / 36815649 / +0.6% 68427037 / 66515783 / +2.9% 0.54 / 0.55 / -2.2%
tpch_q06/datafusion:vortex-file-compressed 6201299 / 6324230 / -1.9% 32682184 / 32686885 / -0.0% 0.19 / 0.19 / -1.9%
tpch_q07/datafusion:vortex-file-compressed 52503856 / 51958464 / +1.0% 83288968 / 81911409 / +1.7% 0.63 / 0.63 / -0.6%
tpch_q08/datafusion:vortex-file-compressed 52003433 / 51843266 / +0.3% 83664511 / 84141305 / -0.6% 0.62 / 0.62 / +0.9%
tpch_q09/datafusion:vortex-file-compressed 49954748 / 49885171 / +0.1% 76628155 / 76995555 / -0.5% 0.65 / 0.65 / +0.6%
tpch_q10/datafusion:vortex-file-compressed 17102875 / 16952899 / +0.9% 49383945 / 51639972 / -4.4% 0.35 / 0.33 / +5.5%
tpch_q11/datafusion:vortex-file-compressed 15014168 / 15259211 / -1.6% 36023431 / 35623323 / +1.1% 0.42 / 0.43 / -2.7%
tpch_q12/datafusion:vortex-file-compressed 22291326 / 22895861 / -2.6% 48238888 / 47779524 / +1.0% 0.46 / 0.48 / -3.6%
tpch_q13/datafusion:vortex-file-compressed 20259853 / 20465568 / -1.0% 41962476 / 42461226 / -1.2% 0.48 / 0.48 / +0.2%
tpch_q14/datafusion:vortex-file-compressed 14907815 / 14890562 / +0.1% 43612552 / 41598898 / +4.8% 0.34 / 0.36 / -4.5%
tpch_q15/datafusion:vortex-file-compressed 18428509 / 18760865 / -1.8% 46533317 / 47094549 / -1.2% 0.40 / 0.40 / -0.6%
tpch_q16/datafusion:vortex-file-compressed 18635718 / 18972994 / -1.8% 38044216 / 39185534 / -2.9% 0.49 / 0.48 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 27916084 / 27983855 / -0.2% 61406503 / 58452923 / +5.1% 0.45 / 0.48 / -5.0%
tpch_q18/datafusion:vortex-file-compressed 36917668 / 37039463 / -0.3% 59136844 / 58609574 / +0.9% 0.62 / 0.63 / -1.2%
tpch_q19/datafusion:vortex-file-compressed 13514951 / 13370751 / +1.1% 38910642 / 41486308 / -6.2% 0.35 / 0.32 / +7.8%
tpch_q20/datafusion:vortex-file-compressed 20569344 / 20965802 / -1.9% 44801868 / 47011492 / -4.7% 0.46 / 0.45 / +2.9%
tpch_q21/datafusion:vortex-file-compressed 40036637 / 39078234 / +2.5% 69714308 / 68435904 / +1.9% 0.57 / 0.57 / +0.6%
tpch_q22/datafusion:vortex-file-compressed 11060624 / 11121959 / -0.6% 30876762 / 31479110 / -1.9% 0.36 / 0.35 / +1.4%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18479240 / 18322600 / +0.9% 45271429 / 47005669 / -3.7% 0.41 / 0.39 / +4.7%
tpch_q02/datafusion:vortex-compact 19696848 / 19573456 / +0.6% 38562679 / 38020159 / +1.4% 0.51 / 0.51 / -0.8%
tpch_q03/datafusion:vortex-compact 20349983 / 19892010 / +2.3% 48259407 / 47998875 / +0.5% 0.42 / 0.41 / +1.8%
tpch_q04/datafusion:vortex-compact 11717548 / 11628774 / +0.8% 32736927 / 34106367 / -4.0% 0.36 / 0.34 / +5.0%
tpch_q05/datafusion:vortex-compact 37680812 / 37957438 / -0.7% 64354653 / 68031900 / -5.4% 0.59 / 0.56 / +4.9%
tpch_q06/datafusion:vortex-compact 6720091 / 6819542 / -1.5% 28784825 / 31306281 / -8.1% 0.23 / 0.22 / +7.2%
tpch_q07/datafusion:vortex-compact 52518371 / 52759796 / -0.5% 82976812 / 84719540 / -2.1% 0.63 / 0.62 / +1.6%
tpch_q08/datafusion:vortex-compact 52609356 / 53095854 / -0.9% 84206057 / 85476784 / -1.5% 0.62 / 0.62 / +0.6%
tpch_q09/datafusion:vortex-compact 50752374 / 50645723 / +0.2% 79433205 / 79182320 / +0.3% 0.64 / 0.64 / -0.1%
tpch_q10/datafusion:vortex-compact 18743250 / 18878215 / -0.7% 50444554 / 50418364 / +0.1% 0.37 / 0.37 / -0.8%
tpch_q11/datafusion:vortex-compact 15907449 / 16238516 / -2.0% 34632885 / 36839917 / -6.0% 0.46 / 0.44 / +4.2%
tpch_q12/datafusion:vortex-compact 24174925 / 24091772 / +0.3% 47884021 / 47694609 / +0.4% 0.50 / 0.51 / -0.1%
tpch_q13/datafusion:vortex-compact 20632714 / 20419777 / +1.0% 41146957 / 40460078 / +1.7% 0.50 / 0.50 / -0.6%
tpch_q14/datafusion:vortex-compact 16180125 / 16161004 / +0.1% 43780659 / 43560898 / +0.5% 0.37 / 0.37 / -0.4%
tpch_q15/datafusion:vortex-compact 19502737 / 19959341 / -2.3% 46835228 / 48308151 / -3.0% 0.42 / 0.41 / +0.8%
tpch_q16/datafusion:vortex-compact 19442428 / 18821383 / +3.3% 38985369 / 38916888 / +0.2% 0.50 / 0.48 / +3.1%
tpch_q17/datafusion:vortex-compact 28875354 / 29152023 / -0.9% 58567232 / 58272558 / +0.5% 0.49 / 0.50 / -1.4%
tpch_q18/datafusion:vortex-compact 38623948 / 37683408 / +2.5% 58827714 / 59573292 / -1.3% 0.66 / 0.63 / +3.8%
tpch_q19/datafusion:vortex-compact 16706652 / 16697486 / +0.1% 43374437 / 42826187 / +1.3% 0.39 / 0.39 / -1.2%
tpch_q20/datafusion:vortex-compact 21703948 / 21817899 / -0.5% 46674660 / 47083994 / -0.9% 0.47 / 0.46 / +0.4%
tpch_q21/datafusion:vortex-compact 41757899 / 41964705 / -0.5% 68491284 / 70659082 / -3.1% 0.61 / 0.59 / +2.7%
tpch_q22/datafusion:vortex-compact 11657903 / 11606173 / +0.4% 31894274 / 32230305 / -1.0% 0.37 / 0.36 / +1.5%
datafusion / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72388496 / 72334556 / +0.1% 92533443 / 91704412 / +0.9% 0.78 / 0.79 / -0.8%
tpch_q02/datafusion:parquet 57542728 / 58442541 / -1.5% 78450000 / 78430783 / +0.0% 0.73 / 0.75 / -1.6%
tpch_q03/datafusion:parquet 84192895 / 83900882 / +0.3% 109968397 / 108179309 / +1.7% 0.77 / 0.78 / -1.3%
tpch_q04/datafusion:parquet 46661837 / 46649300 / +0.0% 66118153 / 68245758 / -3.1% 0.71 / 0.68 / +3.2%
tpch_q05/datafusion:parquet 99648849 / 99432378 / +0.2% 131076383 / 131031268 / +0.0% 0.76 / 0.76 / +0.2%
tpch_q06/datafusion:parquet 31974358 / 32097076 / -0.4% 51826750 / 52651604 / -1.6% 0.62 / 0.61 / +1.2%
tpch_q07/datafusion:parquet 107318349 / 105272831 / +1.9% 136842445 / 139499402 / -1.9% 0.78 / 0.75 / +3.9%
tpch_q08/datafusion:parquet 113524662 / 111836587 / +1.5% 147563462 / 140598158 / +5.0% 0.77 / 0.80 / -3.3%
tpch_q09/datafusion:parquet 131172961 / 131144932 / +0.0% 165277759 / 164760410 / +0.3% 0.79 / 0.80 / -0.3%
tpch_q10/datafusion:parquet 104457840 / 104107279 / +0.3% 135375966 / 136233025 / -0.6% 0.77 / 0.76 / +1.0%
tpch_q11/datafusion:parquet 42709100 / 41785014 / +2.2% 64481652 / 67084620 / -3.9% 0.66 / 0.62 / +6.3%
tpch_q12/datafusion:parquet 70341353 / 69077366 / +1.8% 94011432 / 96212657 / -2.3% 0.75 / 0.72 / +4.2%
tpch_q13/datafusion:parquet 186789226 / 187175408 / -0.2% 210573333 / 209510941 / +0.5% 0.89 / 0.89 / -0.7%
tpch_q14/datafusion:parquet 48199534 / 48126603 / +0.2% 76152248 / 77269210 / -1.4% 0.63 / 0.62 / +1.6%
tpch_q15/datafusion:parquet 55912788 / 54105267 / +3.3% 80842792 / 80576707 / +0.3% 0.69 / 0.67 / +3.0%
tpch_q16/datafusion:parquet 41445385 / 41222916 / +0.5% 62210237 / 60226395 / +3.3% 0.67 / 0.68 / -2.7%
tpch_q17/datafusion:parquet 129633534 / 128380864 / +1.0% 156465994 / 154633409 / +1.2% 0.83 / 0.83 / -0.2%
tpch_q18/datafusion:parquet 130699591 / 130665541 / +0.0% 156092182 / 155085488 / +0.6% 0.84 / 0.84 / -0.6%
tpch_q19/datafusion:parquet 59194287 / 58752843 / +0.8% 89004252 / 89231113 / -0.3% 0.67 / 0.66 / +1.0%
tpch_q20/datafusion:parquet 67642624 / 67235426 / +0.6% 93576478 / 92960241 / +0.7% 0.72 / 0.72 / -0.1%
tpch_q21/datafusion:parquet 107362625 / 109073498 / -1.6% 132308185 / 132301753 / +0.0% 0.81 / 0.82 / -1.6%
tpch_q22/datafusion:parquet 47254890 / 47289985 / -0.1% 67242401 / 68561437 / -1.9% 0.70 / 0.69 / +1.9%
duckdb / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10880096 / 11085592 / -1.9% 25516106 / 18736047 / +36.2% 🔴 0.43 / 0.59 / -27.9%
tpch_q02/duckdb:vortex-file-compressed 17334599 / 17401228 / -0.4% 25668563 / 27863379 / -7.9% 0.68 / 0.62 / +8.1%
tpch_q03/duckdb:vortex-file-compressed 18672465 / 18065094 / +3.4% 35780328 / 36815718 / -2.8% 0.52 / 0.49 / +6.4%
tpch_q04/duckdb:vortex-file-compressed 17077468 / 17437896 / -2.1% 31013828 / 30313235 / +2.3% 0.55 / 0.58 / -4.3%
tpch_q05/duckdb:vortex-file-compressed 21664170 / 22501152 / -3.7% 35998628 / 39228531 / -8.2% 0.60 / 0.57 / +4.9%
tpch_q06/duckdb:vortex-file-compressed 5413367 / 5204098 / +4.0% 14138721 / 14050374 / +0.6% 0.38 / 0.37 / +3.4%
tpch_q07/duckdb:vortex-file-compressed 20789484 / 20785545 / +0.0% 42136687 / 43927232 / -4.1% 0.49 / 0.47 / +4.3%
tpch_q08/duckdb:vortex-file-compressed 23626666 / 23208694 / +1.8% 39507979 / 38872274 / +1.6% 0.60 / 0.60 / +0.2%
tpch_q09/duckdb:vortex-file-compressed 30341301 / 30305341 / +0.1% 45489386 / 55480481 / -18.0% 🟢 0.67 / 0.55 / +22.1%
tpch_q10/duckdb:vortex-file-compressed 27788410 / 27985311 / -0.7% 45111901 / 44226480 / +2.0% 0.62 / 0.63 / -2.7%
tpch_q11/duckdb:vortex-file-compressed 8768566 / 8786774 / -0.2% 14598571 / 14484656 / +0.8% 0.60 / 0.61 / -1.0%
tpch_q12/duckdb:vortex-file-compressed 15383717 / 16089419 / -4.4% 29455956 / 32238591 / -8.6% 0.52 / 0.50 / +4.6%
tpch_q13/duckdb:vortex-file-compressed 22554961 / 22255617 / +1.3% 41184675 / 41991781 / -1.9% 0.55 / 0.53 / +3.3%
tpch_q14/duckdb:vortex-file-compressed 13017618 / 13152882 / -1.0% 25653849 / 26312059 / -2.5% 0.51 / 0.50 / +1.5%
tpch_q15/duckdb:vortex-file-compressed 10498530 / 10373343 / +1.2% 18973918 / 20465910 / -7.3% 0.55 / 0.51 / +9.2%
tpch_q16/duckdb:vortex-file-compressed 18084080 / 18545625 / -2.5% 24820009 / 23729678 / +4.6% 0.73 / 0.78 / -6.8%
tpch_q17/duckdb:vortex-file-compressed 14530780 / 15085458 / -3.7% 31069905 / 31809490 / -2.3% 0.47 / 0.47 / -1.4%
tpch_q18/duckdb:vortex-file-compressed 24320607 / 25120882 / -3.2% 38858864 / 40097210 / -3.1% 0.63 / 0.63 / -0.1%
tpch_q19/duckdb:vortex-file-compressed 22366911 / 23597306 / -5.2% 35350525 / 39419977 / -10.3% 🟢 0.63 / 0.60 / +5.7%
tpch_q20/duckdb:vortex-file-compressed 17110786 / 17506962 / -2.3% 33595529 / 35102959 / -4.3% 0.51 / 0.50 / +2.1%
tpch_q21/duckdb:vortex-file-compressed 65556564 / 66428954 / -1.3% 82797597 / 83571954 / -0.9% 0.79 / 0.79 / -0.4%
tpch_q22/duckdb:vortex-file-compressed 12334979 / 12256346 / +0.6% 20652063 / 21124075 / -2.2% 0.60 / 0.58 / +2.9%
duckdb / vortex-compact / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 12803773 / 12130638 / +5.5% 21161774 / 23338193 / -9.3% 0.61 / 0.52 / +16.4%
tpch_q02/duckdb:vortex-compact 19899885 / 19729266 / +0.9% 30059660 / 31758757 / -5.4% 0.66 / 0.62 / +6.6%
tpch_q03/duckdb:vortex-compact 19054086 / 20083441 / -5.1% 35827162 / 37221499 / -3.7% 0.53 / 0.54 / -1.4%
tpch_q04/duckdb:vortex-compact 17818482 / 18547995 / -3.9% 31312996 / 32499900 / -3.7% 0.57 / 0.57 / -0.3%
tpch_q05/duckdb:vortex-compact 22142857 / 23041270 / -3.9% 36300110 / 36942228 / -1.7% 0.61 / 0.62 / -2.2%
tpch_q06/duckdb:vortex-compact 5843832 / 6094084 / -4.1% 14075097 / 16420875 / -14.3% 🟢 0.42 / 0.37 / +11.9%
tpch_q07/duckdb:vortex-compact 22232156 / 22667542 / -1.9% 39251469 / 40862502 / -3.9% 0.57 / 0.55 / +2.1%
tpch_q08/duckdb:vortex-compact 25297352 / 25782181 / -1.9% 44773048 / 43347065 / +3.3% 0.57 / 0.59 / -5.0%
tpch_q09/duckdb:vortex-compact 30085244 / 30575075 / -1.6% 51050077 / 51799937 / -1.4% 0.59 / 0.59 / -0.2%
tpch_q10/duckdb:vortex-compact 30660228 / 29590516 / +3.6% 46638416 / 46323962 / +0.7% 0.66 / 0.64 / +2.9%
tpch_q11/duckdb:vortex-compact 9840275 / 9901089 / -0.6% 16039776 / 15638218 / +2.6% 0.61 / 0.63 / -3.1%
tpch_q12/duckdb:vortex-compact 18760660 / 18531788 / +1.2% 32920890 / 31306970 / +5.2% 0.57 / 0.59 / -3.7%
tpch_q13/duckdb:vortex-compact 22063081 / 24128790 / -8.6% 39461786 / 41021307 / -3.8% 0.56 / 0.59 / -4.9%
tpch_q14/duckdb:vortex-compact 14635878 / 14204642 / +3.0% 26822761 / 26151924 / +2.6% 0.55 / 0.54 / +0.5%
tpch_q15/duckdb:vortex-compact 10980055 / 10730646 / +2.3% 23588121 / 21043515 / +12.1% 🔴 0.47 / 0.51 / -8.7%
tpch_q16/duckdb:vortex-compact 19942733 / 20406627 / -2.3% 24164882 / 26746293 / -9.7% 0.83 / 0.76 / +8.2%
tpch_q17/duckdb:vortex-compact 16910801 / 15686149 / +7.8% 34645691 / 31343651 / +10.5% 🔴 0.49 / 0.50 / -2.5%
tpch_q18/duckdb:vortex-compact 26164565 / 25925553 / +0.9% 36600477 / 36102360 / +1.4% 0.71 / 0.72 / -0.5%
tpch_q19/duckdb:vortex-compact 23441990 / 23544540 / -0.4% 33608597 / 34320287 / -2.1% 0.70 / 0.69 / +1.7%
tpch_q20/duckdb:vortex-compact 19271712 / 19271020 / +0.0% 36041394 / 39325966 / -8.4% 0.53 / 0.49 / +9.1%
tpch_q21/duckdb:vortex-compact 69393173 / 69497829 / -0.2% 87837258 / 83927824 / +4.7% 0.79 / 0.83 / -4.6%
tpch_q22/duckdb:vortex-compact 13100311 / 13146772 / -0.4% 21297570 / 22014438 / -3.3% 0.62 / 0.60 / +3.0%
duckdb / parquet / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 63142324 / 64296462 / -1.8% 70654897 / 70674867 / -0.0% 0.89 / 0.91 / -1.8%
tpch_q02/duckdb:parquet 37984437 / 37987296 / -0.0% 45927602 / 45405488 / +1.1% 0.83 / 0.84 / -1.1%
tpch_q03/duckdb:parquet 67815297 / 67997539 / -0.3% 79011944 / 78211927 / +1.0% 0.86 / 0.87 / -1.3%
tpch_q04/duckdb:parquet 49373974 / 49366581 / +0.0% 58408652 / 58629570 / -0.4% 0.85 / 0.84 / +0.4%
tpch_q05/duckdb:parquet 66100332 / 66283227 / -0.3% 78026389 / 76620947 / +1.8% 0.85 / 0.87 / -2.1%
tpch_q06/duckdb:parquet 21953996 / 21822235 / +0.6% 27817041 / 27116693 / +2.6% 0.79 / 0.80 / -1.9%
tpch_q07/duckdb:parquet 65605862 / 65401253 / +0.3% 75903880 / 77014457 / -1.4% 0.86 / 0.85 / +1.8%
tpch_q08/duckdb:parquet 80593354 / 80398978 / +0.2% 93552834 / 93335228 / +0.2% 0.86 / 0.86 / +0.0%
tpch_q09/duckdb:parquet 120287987 / 119925162 / +0.3% 133907972 / 132734780 / +0.9% 0.90 / 0.90 / -0.6%
tpch_q10/duckdb:parquet 120284807 / 119462321 / +0.7% 132781940 / 131308554 / +1.1% 0.91 / 0.91 / -0.4%
tpch_q11/duckdb:parquet 21674872 / 21464093 / +1.0% 25391789 / 25323253 / +0.3% 0.85 / 0.85 / +0.7%
tpch_q12/duckdb:parquet 44827526 / 45944450 / -2.4% 51670050 / 54493049 / -5.2% 0.87 / 0.84 / +2.9%
tpch_q13/duckdb:parquet 243064405 / 245057398 / -0.8% 252438921 / 253241708 / -0.3% 0.96 / 0.97 / -0.5%
tpch_q14/duckdb:parquet 47559709 / 47519347 / +0.1% 56295615 / 55732103 / +1.0% 0.84 / 0.85 / -0.9%
tpch_q15/duckdb:parquet 26693665 / 29707654 / -10.1% 🟢 34533983 / 33388528 / +3.4% 0.77 / 0.89 / -13.1%
tpch_q16/duckdb:parquet 51970952 / 51685040 / +0.6% 57917458 / 58614096 / -1.2% 0.90 / 0.88 / +1.8%
tpch_q17/duckdb:parquet 49270316 / 49230614 / +0.1% 59860269 / 59221407 / +1.1% 0.82 / 0.83 / -1.0%
tpch_q18/duckdb:parquet 96587313 / 96547869 / +0.0% 105682856 / 106659916 / -0.9% 0.91 / 0.91 / +1.0%
tpch_q19/duckdb:parquet 65401364 / 65728236 / -0.5% 75151141 / 74648396 / +0.7% 0.87 / 0.88 / -1.2%
tpch_q20/duckdb:parquet 62159999 / 61964648 / +0.3% 76706781 / 74047697 / +3.6% 0.81 / 0.84 / -3.2%
tpch_q21/duckdb:parquet 143965824 / 142520082 / +1.0% 153861730 / 153122853 / +0.5% 0.94 / 0.93 / +0.5%
tpch_q22/duckdb:parquet 51745199 / 51873719 / -0.2% 59099726 / 62135485 / -4.9% 0.88 / 0.83 / +4.9%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-2.4%, environment too noisy confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.052x ➖
Parquet (geomean): hot 1.014x ➖ · cold 1.082x ➖
Shifts: Parquet (control) +1.4% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.019x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 197447138 / 168075058 / +17.5% 🔴 721658071 / 539681441 / +33.7% 🔴 0.27 / 0.31 / -12.1%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10852644 / 10962811 / -1.0% 51455412 / 48541745 / +6.0% 0.21 / 0.23 / -6.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed 12223724 / 11756341 / +4.0% 51732317 / 50191174 / +3.1% 0.24 / 0.23 / +0.9%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23553066 / 23330549 / +1.0% 73950241 / 65721226 / +12.5% 🔴 0.32 / 0.35 / -10.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18521524 / 18608447 / -0.5% 62228418 / 59289970 / +5.0% 0.30 / 0.31 / -5.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17198574 / 17401282 / -1.2% 66983753 / 59746462 / +12.1% 🔴 0.26 / 0.29 / -11.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40041805 / 40606808 / -1.4% 95621455 / 90036584 / +6.2% 0.42 / 0.45 / -7.2%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12240962 / 12140564 / +0.8% 48725691 / 41773169 / +16.6% 🔴 0.25 / 0.29 / -13.6%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12124988 / 11843574 / +2.4% 48101191 / 41734128 / +15.3% 🔴 0.25 / 0.28 / -11.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9788373 / 9947746 / -1.6% 38294628 / 36450327 / +5.1% 0.26 / 0.27 / -6.3%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 190264806 / 201413205 / -5.5% 468405037 / 478746902 / -2.2% 0.41 / 0.42 / -3.4%
clickbench-sorted_q24/datafusion:vortex-compact 22074366 / 22906897 / -3.6% 54383815 / 52910116 / +2.8% 0.41 / 0.43 / -6.2%
clickbench-sorted_q26/datafusion:vortex-compact 24638946 / 22737794 / +8.4% 52758895 / 52376355 / +0.7% 0.47 / 0.43 / +7.6%
clickbench-sorted_q36/datafusion:vortex-compact 27081508 / 26684590 / +1.5% 71804357 / 66861409 / +7.4% 0.38 / 0.40 / -5.5%
clickbench-sorted_q37/datafusion:vortex-compact 22116883 / 22385996 / -1.2% 68797608 / 63655757 / +8.1% 0.32 / 0.35 / -8.6%
clickbench-sorted_q38/datafusion:vortex-compact 21476428 / 21379904 / +0.5% 70289681 / 64575784 / +8.8% 0.31 / 0.33 / -7.7%
clickbench-sorted_q39/datafusion:vortex-compact 43375674 / 43230384 / +0.3% 87745846 / 83020663 / +5.7% 0.49 / 0.52 / -5.1%
clickbench-sorted_q40/datafusion:vortex-compact 14851652 / 14666738 / +1.3% 46456603 / 41394624 / +12.2% 🔴 0.32 / 0.35 / -9.8%
clickbench-sorted_q41/datafusion:vortex-compact 14691996 / 14810738 / -0.8% 47922312 / 45653439 / +5.0% 0.31 / 0.32 / -5.5%
clickbench-sorted_q42/datafusion:vortex-compact 11194866 / 11008651 / +1.7% 37601567 / 36363555 / +3.4% 0.30 / 0.30 / -1.7%
datafusion / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 765315700 / 759505292 / +0.8% 966919741 / 976709136 / -1.0% 0.79 / 0.78 / +1.8%
clickbench-sorted_q24/datafusion:parquet 9044584 / 8591155 / +5.3% 74376274 / 73864322 / +0.7% 0.12 / 0.12 / +4.6%
clickbench-sorted_q26/datafusion:parquet 8982678 / 9264158 / -3.0% 73971888 / 72623619 / +1.9% 0.12 / 0.13 / -4.8%
clickbench-sorted_q36/datafusion:parquet 94215259 / 94059356 / +0.2% 172838169 / 168894311 / +2.3% 0.55 / 0.56 / -2.1%
clickbench-sorted_q37/datafusion:parquet 64769129 / 64368458 / +0.6% 134758135 / 132758544 / +1.5% 0.48 / 0.48 / -0.9%
clickbench-sorted_q38/datafusion:parquet 88124391 / 87243675 / +1.0% 164863529 / 162688392 / +1.3% 0.53 / 0.54 / -0.3%
clickbench-sorted_q39/datafusion:parquet 161083976 / 160191295 / +0.6% 240331468 / 234430950 / +2.5% 0.67 / 0.68 / -1.9%
clickbench-sorted_q40/datafusion:parquet 45024500 / 44614430 / +0.9% 115702094 / 111232974 / +4.0% 0.39 / 0.40 / -3.0%
clickbench-sorted_q41/datafusion:parquet 42592898 / 42089086 / +1.2% 114691008 / 108459690 / +5.7% 0.37 / 0.39 / -4.3%
clickbench-sorted_q42/datafusion:parquet 26202378 / 26117052 / +0.3% 88985075 / 88503867 / +0.5% 0.29 / 0.30 / -0.2%
duckdb / vortex-file-compressed / ns (1.008x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 55170238 / 47706591 / +15.6% 🔴 81165529 / 79339658 / +2.3% 0.68 / 0.60 / +13.0%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18529633 / 19896663 / -6.9% 30444676 / 28996890 / +5.0% 0.61 / 0.69 / -11.3%
clickbench-sorted_q26/duckdb:vortex-file-compressed 15215528 / 14667155 / +3.7% 27920309 / 29963068 / -6.8% 0.54 / 0.49 / +11.3%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29338070 / 28458870 / +3.1% 64960318 / 61261573 / +6.0% 0.45 / 0.46 / -2.8%
clickbench-sorted_q37/duckdb:vortex-file-compressed 25650098 / 26161016 / -2.0% 52677305 / 51046511 / +3.2% 0.49 / 0.51 / -5.0%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26080050 / 26058495 / +0.1% 62840503 / 59981235 / +4.8% 0.42 / 0.43 / -4.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed 48133112 / 48329916 / -0.4% 101961057 / 92532007 / +10.2% 🔴 0.47 / 0.52 / -9.6%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15150418 / 15206214 / -0.4% 40701495 / 39731357 / +2.4% 0.37 / 0.38 / -2.7%
clickbench-sorted_q41/duckdb:vortex-file-compressed 15066294 / 15502798 / -2.8% 46187761 / 38076276 / +21.3% 🔴 0.33 / 0.41 / -19.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13493582 / 13625819 / -1.0% 30602320 / 34768062 / -12.0% 🟢 0.44 / 0.39 / +12.5%
duckdb / vortex-compact / ns (0.986x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 66583252 / 69602767 / -4.3% 97521454 / 85585966 / +13.9% 🔴 0.68 / 0.81 / -16.0%
clickbench-sorted_q24/duckdb:vortex-compact 18948224 / 22979362 / -17.5% 🟢 32851390 / 37769479 / -13.0% 🟢 0.58 / 0.61 / -5.2%
clickbench-sorted_q26/duckdb:vortex-compact 17388662 / 17709955 / -1.8% 32069570 / 30570722 / +4.9% 0.54 / 0.58 / -6.4%
clickbench-sorted_q36/duckdb:vortex-compact 34157346 / 34868776 / -2.0% 71237075 / 70403566 / +1.2% 0.48 / 0.50 / -3.2%
clickbench-sorted_q37/duckdb:vortex-compact 30443179 / 28954968 / +5.1% 65589426 / 64280406 / +2.0% 0.46 / 0.45 / +3.0%
clickbench-sorted_q38/duckdb:vortex-compact 31684790 / 31814330 / -0.4% 63126840 / 64459259 / -2.1% 0.50 / 0.49 / +1.7%
clickbench-sorted_q39/duckdb:vortex-compact 58749674 / 59179019 / -0.7% 105966043 / 100151101 / +5.8% 0.55 / 0.59 / -6.2%
clickbench-sorted_q40/duckdb:vortex-compact 18191592 / 17557755 / +3.6% 45209598 / 39396395 / +14.8% 🔴 0.40 / 0.45 / -9.7%
clickbench-sorted_q41/duckdb:vortex-compact 17696898 / 17136110 / +3.3% 40797015 / 43303492 / -5.8% 0.43 / 0.40 / +9.6%
clickbench-sorted_q42/duckdb:vortex-compact 13127066 / 12814778 / +2.4% 33347142 / 34423592 / -3.1% 0.39 / 0.37 / +5.7%
duckdb / parquet / ns (1.021x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126850976 / 122348332 / +3.7% 153175175 / 142386888 / +7.6% 0.83 / 0.86 / -3.6%
clickbench-sorted_q24/duckdb:parquet 19603182 / 17311464 / +13.2% 🔴 30176766 / 25467004 / +18.5% 🔴 0.65 / 0.68 / -4.4%
clickbench-sorted_q26/duckdb:parquet 14351360 / 12123600 / +18.4% 🔴 29410862 / 24567160 / +19.7% 🔴 0.49 / 0.49 / -1.1%
clickbench-sorted_q36/duckdb:parquet 45733112 / 45970186 / -0.5% 63738009 / 59719781 / +6.7% 0.72 / 0.77 / -6.8%
clickbench-sorted_q37/duckdb:parquet 31171768 / 31063620 / +0.3% 55314638 / 45480019 / +21.6% 🔴 0.56 / 0.68 / -17.5%
clickbench-sorted_q38/duckdb:parquet 40781106 / 39563042 / +3.1% 64711507 / 54911506 / +17.8% 🔴 0.63 / 0.72 / -12.5%
clickbench-sorted_q39/duckdb:parquet 73080083 / 75144800 / -2.7% 88811261 / 84900191 / +4.6% 0.82 / 0.89 / -7.0%
clickbench-sorted_q40/duckdb:parquet 18285190 / 18065648 / +1.2% 43480252 / 36623162 / +18.7% 🔴 0.42 / 0.49 / -14.7%
clickbench-sorted_q41/duckdb:parquet 16402996 / 16797643 / -2.3% 46140822 / 34902927 / +32.2% 🔴 0.36 / 0.48 / -26.1%
clickbench-sorted_q42/duckdb:parquet 11080438 / 12372933 / -10.4% 🟢 23729858 / 22611287 / +4.9% 0.47 / 0.55 / -14.7%
File Size Changes (200 files changed, +0.0% overall, 124↑ 76↓)
File Scale Format Base HEAD Change %
hits_080.vortex 1.0 vortex-compact 94.38 MB 96.19 MB +1.81 MB +1.9%
hits_043.vortex 1.0 vortex-compact 94.08 MB 95.82 MB +1.75 MB +1.9%
hits_004.vortex 1.0 vortex-compact 97.32 MB 98.88 MB +1.56 MB +1.6%
hits_098.vortex 1.0 vortex-compact 102.28 MB 103.73 MB +1.45 MB +1.4%
hits_063.vortex 1.0 vortex-compact 98.15 MB 99.36 MB +1.21 MB +1.2%
hits_093.vortex 1.0 vortex-compact 97.97 MB 99.16 MB +1.20 MB +1.2%
hits_067.vortex 1.0 vortex-compact 98.47 MB 99.63 MB +1.16 MB +1.2%
hits_038.vortex 1.0 vortex-file-compressed 189.55 MB 191.47 MB +1.91 MB +1.0%
hits_012.vortex 1.0 vortex-file-compressed 190.47 MB 192.04 MB +1.57 MB +0.8%
hits_023.vortex 1.0 vortex-file-compressed 194.98 MB 196.52 MB +1.54 MB +0.8%
hits_027.vortex 1.0 vortex-file-compressed 189.62 MB 191.04 MB +1.42 MB +0.8%
hits_092.vortex 1.0 vortex-file-compressed 199.09 MB 200.54 MB +1.45 MB +0.7%
hits_007.vortex 1.0 vortex-file-compressed 199.84 MB 201.24 MB +1.40 MB +0.7%
hits_049.vortex 1.0 vortex-compact 139.29 MB 140.21 MB +939.34 KB +0.7%
hits_041.vortex 1.0 vortex-compact 97.73 MB 98.37 MB +655.99 KB +0.7%
hits_034.vortex 1.0 vortex-compact 132.34 MB 133.15 MB +830.29 KB +0.6%
hits_090.vortex 1.0 vortex-file-compressed 192.30 MB 193.43 MB +1.13 MB +0.6%
hits_018.vortex 1.0 vortex-compact 152.84 MB 153.62 MB +797.76 KB +0.5%
hits_022.vortex 1.0 vortex-file-compressed 199.06 MB 200.03 MB +995.22 KB +0.5%
hits_071.vortex 1.0 vortex-file-compressed 139.35 MB 140.03 MB +692.32 KB +0.5%
hits_039.vortex 1.0 vortex-compact 123.81 MB 124.35 MB +558.14 KB +0.4%
hits_014.vortex 1.0 vortex-file-compressed 172.82 MB 173.41 MB +605.07 KB +0.3%
hits_047.vortex 1.0 vortex-compact 110.47 MB 110.82 MB +353.44 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 130.31 MB 130.69 MB +383.43 KB +0.3%
hits_070.vortex 1.0 vortex-compact 152.94 MB 153.35 MB +421.96 KB +0.3%
hits_040.vortex 1.0 vortex-file-compressed 144.26 MB 144.62 MB +371.09 KB +0.3%
hits_020.vortex 1.0 vortex-file-compressed 159.88 MB 160.28 MB +407.13 KB +0.2%
hits_003.vortex 1.0 vortex-file-compressed 136.49 MB 136.82 MB +335.95 KB +0.2%
hits_010.vortex 1.0 vortex-compact 123.12 MB 123.39 MB +277.17 KB +0.2%
hits_062.vortex 1.0 vortex-compact 132.43 MB 132.71 MB +282.19 KB +0.2%
hits_099.vortex 1.0 vortex-file-compressed 171.79 MB 172.14 MB +363.87 KB +0.2%
hits_077.vortex 1.0 vortex-compact 134.14 MB 134.41 MB +281.31 KB +0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.68 MB 180.02 MB +351.21 KB +0.2%
hits_000.vortex 1.0 vortex-compact 98.06 MB 98.24 MB +186.69 KB +0.2%
hits_030.vortex 1.0 vortex-compact 97.74 MB 97.92 MB +184.91 KB +0.2%
hits_061.vortex 1.0 vortex-compact 123.42 MB 123.64 MB +225.50 KB +0.2%
hits_063.vortex 1.0 vortex-file-compressed 130.76 MB 130.97 MB +217.59 KB +0.2%
hits_067.vortex 1.0 vortex-file-compressed 130.74 MB 130.94 MB +212.35 KB +0.2%
hits_019.vortex 1.0 vortex-file-compressed 139.96 MB 140.16 MB +207.60 KB +0.1%
hits_057.vortex 1.0 vortex-compact 111.43 MB 111.58 MB +156.60 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.94 MB 102.07 MB +141.09 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.63 MB 130.80 MB +176.39 KB +0.1%
hits_014.vortex 1.0 vortex-compact 133.73 MB 133.90 MB +178.16 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.05 MB 202.32 MB +268.64 KB +0.1%
hits_059.vortex 1.0 vortex-file-compressed 200.14 MB 200.40 MB +264.52 KB +0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.60 MB 161.80 MB +206.66 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.68 MB 100.80 MB +128.05 KB +0.1%
hits_099.vortex 1.0 vortex-compact 132.98 MB 133.14 MB +165.78 KB +0.1%
hits_086.vortex 1.0 vortex-compact 139.54 MB 139.70 MB +170.73 KB +0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.68 MB 180.89 MB +213.24 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 200.70 MB 200.92 MB +221.52 KB +0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.43 MB 130.57 MB +143.75 KB +0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.55 MB 172.73 MB +189.58 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.92 MB 173.10 MB +186.84 KB +0.1%
hits_037.vortex 1.0 vortex-compact 132.07 MB 132.20 MB +124.12 KB +0.1%
hits_094.vortex 1.0 vortex-compact 110.66 MB 110.76 MB +102.97 KB +0.1%
hits_023.vortex 1.0 vortex-compact 142.39 MB 142.52 MB +131.82 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.93 MB 154.06 MB +135.60 KB +0.1%
hits_008.vortex 1.0 vortex-compact 105.66 MB 105.75 MB +89.16 KB +0.1%
hits_046.vortex 1.0 vortex-compact 74.95 MB 75.01 MB +61.20 KB +0.1%
hits_006.vortex 1.0 vortex-compact 95.83 MB 95.91 MB +75.05 KB +0.1%
hits_079.vortex 1.0 vortex-compact 127.78 MB 127.87 MB +96.78 KB +0.1%
hits_083.vortex 1.0 vortex-compact 110.01 MB 110.09 MB +79.41 KB +0.1%
hits_061.vortex 1.0 vortex-file-compressed 161.45 MB 161.56 MB +111.12 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.86 MB 172.97 MB +117.52 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.86 MB 161.96 MB +107.70 KB +0.1%
hits_036.vortex 1.0 vortex-compact 133.26 MB 133.34 MB +87.20 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.20 MB 136.29 MB +88.91 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.34 MB 139.43 MB +88.58 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 173.22 MB 173.32 MB +105.00 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.42 MB 190.53 MB +114.35 KB +0.1%
hits_013.vortex 1.0 vortex-compact 125.16 MB 125.23 MB +66.86 KB +0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.14 MB 167.23 MB +88.62 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.23 MB 156.31 MB +82.62 KB +0.1%
hits_034.vortex 1.0 vortex-file-compressed 181.65 MB 181.74 MB +95.94 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.11 MB 101.16 MB +48.53 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.51 MB 189.59 MB +88.92 KB +0.0%
hits_020.vortex 1.0 vortex-compact 111.61 MB 111.66 MB +51.48 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.93 MB 154.00 MB +70.51 KB +0.0%
hits_056.vortex 1.0 vortex-compact 100.76 MB 100.80 MB +45.55 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.22 MB 178.29 MB +79.04 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.49 MB 160.56 MB +70.41 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.95 MB 172.02 MB +73.59 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.57 MB 161.62 MB +57.77 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.00 MB 161.06 MB +56.21 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.36 MB 147.41 MB +50.84 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 201.01 MB 201.08 MB +65.27 KB +0.0%
hits_017.vortex 1.0 vortex-compact 111.70 MB 111.73 MB +32.52 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.65 MB 105.68 MB +29.08 KB +0.0%
hits_068.vortex 1.0 vortex-compact 112.16 MB 112.19 MB +30.55 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.59 MB 110.62 MB +29.36 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.65 MB 126.68 MB +31.91 KB +0.0%
hits_012.vortex 1.0 vortex-compact 138.82 MB 138.85 MB +34.41 KB +0.0%
hits_095.vortex 1.0 vortex-compact 110.61 MB 110.63 MB +26.13 KB +0.0%
hits_053.vortex 1.0 vortex-compact 138.25 MB 138.28 MB +32.12 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.12 MB 111.15 MB +25.67 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.10 MB 135.13 MB +30.99 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.04 MB 189.08 MB +42.48 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.80 MB 142.84 MB +32.02 KB +0.0%
hits_062.vortex 1.0 vortex-file-compressed 171.30 MB 171.34 MB +36.02 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.66 MB 130.68 MB +26.64 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.18 MB 147.20 MB +28.96 KB +0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.25 MB 102.26 MB +19.57 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.67 MB 161.69 MB +27.30 KB +0.0%
hits_087.vortex 1.0 vortex-compact 125.34 MB 125.36 MB +19.45 KB +0.0%
hits_092.vortex 1.0 vortex-compact 153.47 MB 153.50 MB +23.09 KB +0.0%
hits_010.vortex 1.0 vortex-file-compressed 168.96 MB 168.98 MB +24.18 KB +0.0%
hits_015.vortex 1.0 vortex-compact 97.34 MB 97.36 MB +13.12 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.95 MB 75.95 MB +9.41 KB +0.0%
hits_076.vortex 1.0 vortex-compact 124.78 MB 124.80 MB +15.27 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.19 MB 115.21 MB +14.06 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.76 MB 191.78 MB +20.74 KB +0.0%
hits_073.vortex 1.0 vortex-compact 134.15 MB 134.17 MB +12.97 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.86 MB 153.88 MB +14.83 KB +0.0%
hits_009.vortex 1.0 vortex-compact 75.21 MB 75.22 MB +6.80 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.62 MB 192.63 MB +12.58 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 200.93 MB 200.94 MB +11.34 KB +0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.74 MB 200.75 MB +7.89 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.64 MB 110.64 MB +4.06 KB +0.0%
hits_052.vortex 1.0 vortex-compact 97.70 MB 97.71 MB +2.88 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.26 MB 172.26 MB +4.66 KB +0.0%
hits_071.vortex 1.0 vortex-compact 105.57 MB 105.57 MB +2.56 KB +0.0%
hits_060.vortex 1.0 vortex-compact 140.17 MB 140.18 MB +2.45 KB +0.0%
hits_011.vortex 1.0 vortex-compact 152.67 MB 152.67 MB +544 B +0.0%
hits_078.vortex 1.0 vortex-compact 97.15 MB 97.15 MB 3.14 KB -0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.21 MB 152.20 MB 5.73 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.93 MB 159.92 MB 8.68 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.29 MB 147.28 MB 8.23 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.47 MB 154.46 MB 9.44 KB -0.0%
hits_051.vortex 1.0 vortex-compact 133.99 MB 133.98 MB 9.13 KB -0.0%
hits_016.vortex 1.0 vortex-compact 127.30 MB 127.29 MB 10.78 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.06 MB 127.05 MB 11.05 KB -0.0%
hits_058.vortex 1.0 vortex-compact 111.05 MB 111.04 MB 9.91 KB -0.0%
hits_072.vortex 1.0 vortex-compact 75.55 MB 75.54 MB 6.89 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.61 MB 110.60 MB 10.86 KB -0.0%
hits_003.vortex 1.0 vortex-compact 104.52 MB 104.51 MB 13.28 KB -0.0%
hits_050.vortex 1.0 vortex-compact 125.08 MB 125.07 MB 16.04 KB -0.0%
hits_005.vortex 1.0 vortex-compact 115.82 MB 115.81 MB 15.40 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.63 MB 126.61 MB 19.16 KB -0.0%
hits_059.vortex 1.0 vortex-compact 152.92 MB 152.89 MB 23.49 KB -0.0%
hits_002.vortex 1.0 vortex-compact 123.72 MB 123.69 MB 29.83 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.64 MB 161.60 MB 40.25 KB -0.0%
hits_090.vortex 1.0 vortex-compact 141.03 MB 141.00 MB 36.50 KB -0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.08 MB 201.03 MB 52.44 KB -0.0%
hits_054.vortex 1.0 vortex-compact 111.70 MB 111.67 MB 30.01 KB -0.0%
hits_007.vortex 1.0 vortex-compact 153.47 MB 153.43 MB 44.31 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 200.32 MB 200.26 MB 60.88 KB -0.0%
hits_081.vortex 1.0 vortex-compact 153.65 MB 153.60 MB 49.45 KB -0.0%
hits_029.vortex 1.0 vortex-compact 153.51 MB 153.47 MB 49.74 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.26 MB 130.22 MB 42.61 KB -0.0%
hits_045.vortex 1.0 vortex-compact 105.60 MB 105.57 MB 36.87 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.31 MB 130.26 MB 53.73 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.08 MB 106.03 MB 52.67 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.77 MB 153.69 MB 76.62 KB -0.0%
hits_074.vortex 1.0 vortex-compact 152.96 MB 152.88 MB 76.54 KB -0.0%
hits_033.vortex 1.0 vortex-compact 153.53 MB 153.44 MB 82.61 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.17 MB 131.10 MB 74.10 KB -0.1%
hits_055.vortex 1.0 vortex-compact 153.34 MB 153.25 MB 89.34 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.43 MB 158.33 MB 100.84 KB -0.1%
hits_096.vortex 1.0 vortex-file-compressed 200.54 MB 200.41 MB 129.27 KB -0.1%
hits_027.vortex 1.0 vortex-compact 138.03 MB 137.94 MB 89.95 KB -0.1%
hits_031.vortex 1.0 vortex-file-compressed 159.27 MB 159.16 MB 114.04 KB -0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.85 MB 130.76 MB 94.34 KB -0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.45 MB 130.35 MB 109.45 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.85 MB 130.74 MB 112.50 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.63 MB 161.49 MB 142.65 KB -0.1%
hits_089.vortex 1.0 vortex-compact 98.37 MB 98.28 MB 96.34 KB -0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.76 MB 139.62 MB 137.72 KB -0.1%
hits_096.vortex 1.0 vortex-compact 153.27 MB 153.12 MB 152.52 KB -0.1%
hits_060.vortex 1.0 vortex-file-compressed 193.13 MB 192.94 MB 198.62 KB -0.1%
hits_024.vortex 1.0 vortex-compact 123.53 MB 123.41 MB 130.52 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.83 MB 153.66 MB 171.28 KB -0.1%
hits_097.vortex 1.0 vortex-compact 140.23 MB 140.07 MB 164.38 KB -0.1%
hits_088.vortex 1.0 vortex-compact 133.86 MB 133.71 MB 157.05 KB -0.1%
hits_040.vortex 1.0 vortex-compact 110.11 MB 109.98 MB 137.17 KB -0.1%
hits_022.vortex 1.0 vortex-compact 153.06 MB 152.86 MB 208.98 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 163.14 MB 162.92 MB 223.16 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 201.11 MB 200.83 MB 278.12 KB -0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.46 MB 200.18 MB 281.59 KB -0.1%
hits_044.vortex 1.0 vortex-compact 153.59 MB 153.36 MB 233.67 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 138.04 MB 137.82 MB 221.95 KB -0.2%
hits_025.vortex 1.0 vortex-compact 133.57 MB 133.35 MB 225.77 KB -0.2%
hits_026.vortex 1.0 vortex-compact 98.69 MB 98.52 MB 173.17 KB -0.2%
hits_044.vortex 1.0 vortex-file-compressed 201.41 MB 200.99 MB 424.24 KB -0.2%
hits_085.vortex 1.0 vortex-compact 153.60 MB 153.09 MB 524.31 KB -0.3%
hits_066.vortex 1.0 vortex-compact 117.88 MB 117.42 MB 471.80 KB -0.4%
hits_045.vortex 1.0 vortex-file-compressed 139.83 MB 139.26 MB 590.39 KB -0.4%
hits_065.vortex 1.0 vortex-compact 125.64 MB 125.11 MB 542.92 KB -0.4%
hits_069.vortex 1.0 vortex-compact 99.83 MB 99.32 MB 522.85 KB -0.5%
hits_048.vortex 1.0 vortex-compact 153.47 MB 152.66 MB 833.22 KB -0.5%
hits_018.vortex 1.0 vortex-file-compressed 200.63 MB 199.49 MB 1.14 MB -0.6%
hits_064.vortex 1.0 vortex-compact 139.78 MB 138.89 MB 904.15 KB -0.6%
hits_091.vortex 1.0 vortex-compact 112.02 MB 111.20 MB 841.86 KB -0.7%
hits_055.vortex 1.0 vortex-file-compressed 201.14 MB 199.57 MB 1.57 MB -0.8%
hits_038.vortex 1.0 vortex-compact 139.24 MB 138.09 MB 1.15 MB -0.8%
hits_075.vortex 1.0 vortex-compact 138.88 MB 137.69 MB 1.19 MB -0.9%
hits_013.vortex 1.0 vortex-file-compressed 161.87 MB 160.20 MB 1.67 MB -1.0%
hits_001.vortex 1.0 vortex-compact 139.18 MB 137.68 MB 1.50 MB -1.1%
hits_049.vortex 1.0 vortex-file-compressed 193.38 MB 191.09 MB 2.29 MB -1.2%
hits_001.vortex 1.0 vortex-file-compressed 194.40 MB 188.79 MB 5.61 MB -2.9%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.1%)
  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.989x ➖
Parquet (geomean): hot 1.006x ➖ · cold 0.997x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52701516 / 52310897 / +0.7% 72013159 / 74619295 / -3.5% 0.73 / 0.70 / +4.4%
appian_q02/datafusion:vortex-compact 235102263 / 231149019 / +1.7% 268864393 / 263867724 / +1.9% 0.87 / 0.88 / -0.2%
appian_q03/datafusion:vortex-compact 148538526 / 145981349 / +1.8% 183362580 / 187033857 / -2.0% 0.81 / 0.78 / +3.8%
appian_q04/datafusion:vortex-compact 9881777570 / 9913712274 / -0.3% 9796491401 / 9818966182 / -0.2% 1.01 / 1.01 / -0.1%
appian_q05/datafusion:vortex-compact 136190655 / 137060066 / -0.6% 163797491 / 165462372 / -1.0% 0.83 / 0.83 / +0.4%
appian_q06/datafusion:vortex-compact 142857133 / 142549425 / +0.2% 169000391 / 164431413 / +2.8% 0.85 / 0.87 / -2.5%
appian_q07/datafusion:vortex-compact 164879480 / 163255781 / +1.0% 191470161 / 197874938 / -3.2% 0.86 / 0.83 / +4.4%
appian_q08/datafusion:vortex-compact 561967785 / 548859136 / +2.4% 598530795 / 619404015 / -3.4% 0.94 / 0.89 / +6.0%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72909224 / 73640617 / -1.0% 91451106 / 92691541 / -1.3% 0.80 / 0.79 / +0.3%
appian_q02/datafusion:parquet 302151403 / 304368724 / -0.7% 335938432 / 341445685 / -1.6% 0.90 / 0.89 / +0.9%
appian_q03/datafusion:parquet 191124297 / 189071143 / +1.1% 231200621 / 227972137 / +1.4% 0.83 / 0.83 / -0.3%
appian_q04/datafusion:parquet 9943932384 / 9929916904 / +0.1% 9775363274 / 9836043493 / -0.6% 1.02 / 1.01 / +0.8%
appian_q05/datafusion:parquet 198167557 / 198241208 / -0.0% 227291146 / 226072173 / +0.5% 0.87 / 0.88 / -0.6%
appian_q06/datafusion:parquet 171496306 / 168997678 / +1.5% 188264878 / 193652228 / -2.8% 0.91 / 0.87 / +4.4%
appian_q07/datafusion:parquet 211153363 / 210657043 / +0.2% 244958014 / 243190369 / +0.7% 0.86 / 0.87 / -0.5%
appian_q08/datafusion:parquet 671055053 / 670561929 / +0.1% 691470207 / 694819658 / -0.5% 0.97 / 0.97 / +0.6%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91051126 / 90642913 / +0.5% 108871815 / 105493286 / +3.2% 0.84 / 0.86 / -2.7%
appian_q02/duckdb:vortex-compact 212914539 / 213812141 / -0.4% 231474656 / 240772697 / -3.9% 0.92 / 0.89 / +3.6%
appian_q03/duckdb:vortex-compact 123026877 / 122013860 / +0.8% 138360258 / 136414292 / +1.4% 0.89 / 0.89 / -0.6%
appian_q04/duckdb:vortex-compact 568832762 / 576137256 / -1.3% 590403962 / 587206957 / +0.5% 0.96 / 0.98 / -1.8%
appian_q05/duckdb:vortex-compact 125766663 / 131818853 / -4.6% 145996059 / 139054480 / +5.0% 0.86 / 0.95 / -9.1%
appian_q06/duckdb:vortex-compact 402878882 / 398726414 / +1.0% 392684870 / 425939722 / -7.8% 1.03 / 0.94 / +9.6%
appian_q07/duckdb:vortex-compact 136748129 / 136222673 / +0.4% 149464856 / 158849364 / -5.9% 0.91 / 0.86 / +6.7%
appian_q08/duckdb:vortex-compact 435316931 / 434240795 / +0.2% 467872646 / 469503474 / -0.3% 0.93 / 0.92 / +0.6%
duckdb / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 98795302 / 98722902 / +0.1% 113344550 / 110488207 / +2.6% 0.87 / 0.89 / -2.4%
appian_q02/duckdb:parquet 196777157 / 198153410 / -0.7% 202625085 / 198039135 / +2.3% 0.97 / 1.00 / -2.9%
appian_q03/duckdb:parquet 125068447 / 123468467 / +1.3% 132865420 / 145460477 / -8.7% 0.94 / 0.85 / +10.9%
appian_q04/duckdb:parquet 451955875 / 465200646 / -2.8% 482866028 / 437885894 / +10.3% 🔴 0.94 / 1.06 / -11.9%
appian_q05/duckdb:parquet 142906896 / 143219705 / -0.2% 156428971 / 163031664 / -4.0% 0.91 / 0.88 / +4.0%
appian_q06/duckdb:parquet 272391080 / 254344061 / +7.1% 236219182 / 261838869 / -9.8% 1.15 / 0.97 / +18.7%
appian_q07/duckdb:parquet 154031017 / 153600525 / +0.3% 167664236 / 166841175 / +0.5% 0.92 / 0.92 / -0.2%
appian_q08/duckdb:parquet 387149850 / 371483250 / +4.2% 404532696 / 372740477 / +8.5% 0.96 / 1.00 / -4.0%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: Likely regression (environment too noisy confidence)
Attributed Vortex impact: +53.1%
Engines: DataFusion Likely regression (+63.3%, environment too noisy confidence) · DuckDB No clear signal (+43.6%, environment too noisy confidence)
Vortex (geomean): hot 0.882x ➖ · cold 0.909x ➖
Parquet (geomean): hot 0.576x ✅ · cold 0.575x ✅
Shifts: Parquet (control) -42.4% · Median polish -21.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.734x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 39545254 / 77554286 / -49.0% 🟢 137744525 / 167509832 / -17.8% 0.29 / 0.46 / -38.0%
fineweb_q01/datafusion:vortex-file-compressed 818385722 / 805867830 / +1.6% 1172034096 / 1023291318 / +14.5% 0.70 / 0.79 / -11.3%
fineweb_q02/datafusion:vortex-file-compressed 519545634 / 439821650 / +18.1% 725738565 / 683624750 / +6.2% 0.72 / 0.64 / +11.3%
fineweb_q03/datafusion:vortex-file-compressed 558548797 / 1166930718 / -52.1% 🟢 1485811197 / 1566481937 / -5.1% 0.38 / 0.74 / -49.5%
fineweb_q04/datafusion:vortex-file-compressed 629086449 / 721669141 / -12.8% 562072421 / 1251793807 / -55.1% 🟢 1.12 / 0.58 / +94.1%
fineweb_q05/datafusion:vortex-file-compressed 422307670 / 679849790 / -37.9% 🟢 462185753 / 742759874 / -37.8% 🟢 0.91 / 0.92 / -0.2%
fineweb_q06/datafusion:vortex-file-compressed 898122675 / 1100789736 / -18.4% 871307368 / 1199820997 / -27.4% 1.03 / 0.92 / +12.4%
fineweb_q07/datafusion:vortex-file-compressed 633331403 / 740124174 / -14.4% 560421531 / 847783878 / -33.9% 🟢 1.13 / 0.87 / +29.4%
fineweb_q08/datafusion:vortex-file-compressed 306817538 / 552211072 / -44.4% 🟢 385410217 / 219517585 / +75.6% 🔴 0.80 / 2.52 / -68.4%
datafusion / vortex-compact / ns (1.056x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 66870355 / 59994946 / +11.5% 300690227 / 184778847 / +62.7% 🔴 0.22 / 0.32 / -31.5%
fineweb_q01/datafusion:vortex-compact 553405636 / 476073792 / +16.2% 961423311 / 870869412 / +10.4% 0.58 / 0.55 / +5.3%
fineweb_q02/datafusion:vortex-compact 559522382 / 542988131 / +3.0% 572512410 / 685939782 / -16.5% 0.98 / 0.79 / +23.5%
fineweb_q03/datafusion:vortex-compact 624927693 / 573888371 / +8.9% 1179320996 / 1186195126 / -0.6% 0.53 / 0.48 / +9.5%
fineweb_q04/datafusion:vortex-compact 461818243 / 597407786 / -22.7% 500730432 / 555037059 / -9.8% 0.92 / 1.08 / -14.3%
fineweb_q05/datafusion:vortex-compact 486605865 / 545355649 / -10.8% 498277091 / 612404637 / -18.6% 0.98 / 0.89 / +9.7%
fineweb_q06/datafusion:vortex-compact 1377338294 / 717877004 / +91.9% 🔴 1289382917 / 824625258 / +56.4% 🔴 1.07 / 0.87 / +22.7%
fineweb_q07/datafusion:vortex-compact 614757414 / 535423820 / +14.8% 556252395 / 672549308 / -17.3% 1.11 / 0.80 / +38.8%
fineweb_q08/datafusion:vortex-compact 244675136 / 331352196 / -26.2% 377815247 / 297939720 / +26.8% 0.65 / 1.11 / -41.8%
datafusion / parquet / ns (0.539x ✅, 8↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 829611205 / 1049449828 / -20.9% 1264071614 / 1492686952 / -15.3% 0.66 / 0.70 / -6.7%
fineweb_q01/datafusion:parquet 1427025723 / 2610460200 / -45.3% 🟢 1668312459 / 2819052673 / -40.8% 🟢 0.86 / 0.93 / -7.6%
fineweb_q02/datafusion:parquet 1338772616 / 2463926470 / -45.7% 🟢 1334789578 / 2711799774 / -50.8% 🟢 1.00 / 0.91 / +10.4%
fineweb_q03/datafusion:parquet 1286041991 / 3008671134 / -57.3% 🟢 1324226160 / 3058264858 / -56.7% 🟢 0.97 / 0.98 / -1.3%
fineweb_q04/datafusion:parquet 1479713503 / 2784807968 / -46.9% 🟢 1208176439 / 2827516654 / -57.3% 🟢 1.22 / 0.98 / +24.4%
fineweb_q05/datafusion:parquet 1293598713 / 2791144976 / -53.7% 🟢 1262580875 / 3166053148 / -60.1% 🟢 1.02 / 0.88 / +16.2%
fineweb_q06/datafusion:parquet 1569574264 / 2664316285 / -41.1% 🟢 1955457747 / 2901843297 / -32.6% 🟢 0.80 / 0.92 / -12.6%
fineweb_q07/datafusion:parquet 1588354656 / 2905577172 / -45.3% 🟢 1599821833 / 2882194345 / -44.5% 🟢 0.99 / 1.01 / -1.5%
fineweb_q08/datafusion:parquet 1445037621 / 2999118154 / -51.8% 🟢 1454464408 / 3246581061 / -55.2% 🟢 0.99 / 0.92 / +7.5%
duckdb / vortex-file-compressed / ns (0.776x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 55768592 / 59556522 / -6.4% 65210487 / 72916980 / -10.6% 0.86 / 0.82 / +4.7%
fineweb_q01/duckdb:vortex-file-compressed 598195718 / 916535528 / -34.7% 🟢 765234468 / 836377166 / -8.5% 0.78 / 1.10 / -28.7%
fineweb_q02/duckdb:vortex-file-compressed 768868166 / 805032874 / -4.5% 788084895 / 838534533 / -6.0% 0.98 / 0.96 / +1.6%
fineweb_q03/duckdb:vortex-file-compressed 1016774986 / 1293212344 / -21.4% 1400075556 / 1512035254 / -7.4% 0.73 / 0.86 / -15.1%
fineweb_q04/duckdb:vortex-file-compressed 1027760770 / 1269608247 / -19.0% 1061926985 / 1487629098 / -28.6% 0.97 / 0.85 / +13.4%
fineweb_q05/duckdb:vortex-file-compressed 934077620 / 1520606918 / -38.6% 🟢 1014731717 / 1482734616 / -31.6% 🟢 0.92 / 1.03 / -10.2%
fineweb_q06/duckdb:vortex-file-compressed 1351451096 / 1417034084 / -4.6% 1273548291 / 1993390982 / -36.1% 🟢 1.06 / 0.71 / +49.3%
fineweb_q07/duckdb:vortex-file-compressed 1076631498 / 1289260643 / -16.5% 1241032386 / 1307117445 / -5.1% 0.87 / 0.99 / -12.0%
fineweb_q08/duckdb:vortex-file-compressed 495279486 / 879889262 / -43.7% 🟢 467351201 / 930953781 / -49.8% 🟢 1.06 / 0.95 / +12.1%
duckdb / vortex-compact / ns (1.006x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 70497360 / 149046036 / -52.7% 🟢 87070162 / 112322715 / -22.5% 0.81 / 1.33 / -39.0%
fineweb_q01/duckdb:vortex-compact 1124335871 / 560149377 / +100.7% 🔴 663159415 / 830223207 / -20.1% 1.70 / 0.67 / +151.3%
fineweb_q02/duckdb:vortex-compact 558697788 / 635640368 / -12.1% 578750281 / 714962204 / -19.1% 0.97 / 0.89 / +8.6%
fineweb_q03/duckdb:vortex-compact 1262010818 / 1066219122 / +18.4% 1472382156 / 1342575078 / +9.7% 0.86 / 0.79 / +7.9%
fineweb_q04/duckdb:vortex-compact 1088457052 / 1273233854 / -14.5% 1207920029 / 1280008715 / -5.6% 0.90 / 0.99 / -9.4%
fineweb_q05/duckdb:vortex-compact 1259316448 / 962244915 / +30.9% 🔴 1347185624 / 918385060 / +46.7% 🔴 0.93 / 1.05 / -10.8%
fineweb_q06/duckdb:vortex-compact 1177360062 / 1232602910 / -4.5% 1152974940 / 1297567441 / -11.1% 1.02 / 0.95 / +7.5%
fineweb_q07/duckdb:vortex-compact 1008368366 / 1105723576 / -8.8% 1073121480 / 1057872254 / +1.4% 0.94 / 1.05 / -10.1%
fineweb_q08/duckdb:vortex-compact 471069916 / 428567471 / +9.9% 486188563 / 436108420 / +11.5% 0.97 / 0.98 / -1.4%
duckdb / parquet / ns (0.615x ✅, 7↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 641899358 / 868338616 / -26.1% 732178128 / 897216854 / -18.4% 0.88 / 0.97 / -9.4%
fineweb_q01/duckdb:parquet 757210150 / 892517906 / -15.2% 763283272 / 974924293 / -21.7% 0.99 / 0.92 / +8.4%
fineweb_q02/duckdb:parquet 776655090 / 1226248476 / -36.7% 🟢 795895415 / 1058291238 / -24.8% 0.98 / 1.16 / -15.8%
fineweb_q03/duckdb:parquet 1667787108 / 3157467416 / -47.2% 🟢 1598858314 / 3085516931 / -48.2% 🟢 1.04 / 1.02 / +1.9%
fineweb_q04/duckdb:parquet 900744732 / 1433350113 / -37.2% 🟢 1009332211 / 1449289530 / -30.4% 🟢 0.89 / 0.99 / -9.8%
fineweb_q05/duckdb:parquet 1127908630 / 2080917480 / -45.8% 🟢 1173177171 / 2027818879 / -42.1% 🟢 0.96 / 1.03 / -6.3%
fineweb_q06/duckdb:parquet 1935655578 / 3747781911 / -48.4% 🟢 1868279790 / 3765638753 / -50.4% 🟢 1.04 / 1.00 / +4.1%
fineweb_q07/duckdb:parquet 1420410080 / 2702264962 / -47.4% 🟢 1342225598 / 2725986437 / -50.8% 🟢 1.06 / 0.99 / +6.8%
fineweb_q08/duckdb:parquet 578290346 / 886553120 / -34.8% 🟢 582740913 / 928405846 / -37.2% 🟢 0.99 / 0.95 / +3.9%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.984x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.992x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1229168 / 1235438 / -0.5% 19818759 / 21546001 / -8.0% 0.06 / 0.06 / +8.2%
clickbench_q01/datafusion:vortex-file-compressed 6004314 / 5870736 / +2.3% 33410932 / 34292440 / -2.6% 0.18 / 0.17 / +5.0%
clickbench_q02/datafusion:vortex-file-compressed 10022878 / 10274978 / -2.5% 38636769 / 38690423 / -0.1% 0.26 / 0.27 / -2.3%
clickbench_q03/datafusion:vortex-file-compressed 11824384 / 12040700 / -1.8% 52174626 / 51199301 / +1.9% 0.23 / 0.24 / -3.6%
clickbench_q04/datafusion:vortex-file-compressed 57246364 / 56732188 / +0.9% 89636189 / 91920991 / -2.5% 0.64 / 0.62 / +3.5%
clickbench_q05/datafusion:vortex-file-compressed 75048628 / 76924595 / -2.4% 116267907 / 117878405 / -1.4% 0.65 / 0.65 / -1.1%
clickbench_q06/datafusion:vortex-file-compressed 1217030 / 1226680 / -0.8% 19637967 / 21540115 / -8.8% 0.06 / 0.06 / +8.8%
clickbench_q07/datafusion:vortex-file-compressed 9573704 / 9525390 / +0.5% 35333738 / 34195783 / +3.3% 0.27 / 0.28 / -2.7%
clickbench_q08/datafusion:vortex-file-compressed 79323554 / 78032048 / +1.7% 116693606 / 116144947 / +0.5% 0.68 / 0.67 / +1.2%
clickbench_q09/datafusion:vortex-file-compressed 170655532 / 167798129 / +1.7% 202318636 / 205601211 / -1.6% 0.84 / 0.82 / +3.4%
clickbench_q10/datafusion:vortex-file-compressed 24442489 / 23562368 / +3.7% 66591334 / 67900989 / -1.9% 0.37 / 0.35 / +5.8%
clickbench_q11/datafusion:vortex-file-compressed 26750658 / 26701670 / +0.2% 64799048 / 67768415 / -4.4% 0.41 / 0.39 / +4.8%
clickbench_q12/datafusion:vortex-file-compressed 72164115 / 72319811 / -0.2% 113068353 / 112922820 / +0.1% 0.64 / 0.64 / -0.3%
clickbench_q13/datafusion:vortex-file-compressed 117969690 / 121532108 / -2.9% 178090796 / 178952900 / -0.5% 0.66 / 0.68 / -2.5%
clickbench_q14/datafusion:vortex-file-compressed 74602863 / 77071334 / -3.2% 115983211 / 120371811 / -3.6% 0.64 / 0.64 / +0.5%
clickbench_q15/datafusion:vortex-file-compressed 60926014 / 60750062 / +0.3% 95833266 / 96297078 / -0.5% 0.64 / 0.63 / +0.8%
clickbench_q16/datafusion:vortex-file-compressed 149099897 / 153549042 / -2.9% 213572884 / 210044997 / +1.7% 0.70 / 0.73 / -4.5%
clickbench_q17/datafusion:vortex-file-compressed 147636527 / 148829062 / -0.8% 211582279 / 218403311 / -3.1% 0.70 / 0.68 / +2.4%
clickbench_q18/datafusion:vortex-file-compressed 295666890 / 299232312 / -1.2% 365593801 / 367877572 / -0.6% 0.81 / 0.81 / -0.6%
clickbench_q19/datafusion:vortex-file-compressed 7586292 / 8064164 / -5.9% 46036279 / 46171818 / -0.3% 0.16 / 0.17 / -5.6%
clickbench_q20/datafusion:vortex-file-compressed 63752445 / 63196761 / +0.9% 227623871 / 227914524 / -0.1% 0.28 / 0.28 / +1.0%
clickbench_q21/datafusion:vortex-file-compressed 92484957 / 90168984 / +2.6% 267502736 / 270842876 / -1.2% 0.35 / 0.33 / +3.8%
clickbench_q22/datafusion:vortex-file-compressed 103861424 / 105202060 / -1.3% 346451448 / 347669003 / -0.4% 0.30 / 0.30 / -0.9%
clickbench_q23/datafusion:vortex-file-compressed 198221780 / 192744664 / +2.8% 542139773 / 540626690 / +0.3% 0.37 / 0.36 / +2.6%
clickbench_q24/datafusion:vortex-file-compressed 15783999 / 16216002 / -2.7% 63718719 / 64191304 / -0.7% 0.25 / 0.25 / -1.9%
clickbench_q25/datafusion:vortex-file-compressed 18288310 / 18309496 / -0.1% 55705378 / 56921460 / -2.1% 0.33 / 0.32 / +2.1%
clickbench_q26/datafusion:vortex-file-compressed 17137199 / 16754066 / +2.3% 63595808 / 64779712 / -1.8% 0.27 / 0.26 / +4.2%
clickbench_q27/datafusion:vortex-file-compressed 101476745 / 96403326 / +5.3% 242449767 / 247374577 / -2.0% 0.42 / 0.39 / +7.4%
clickbench_q28/datafusion:vortex-file-compressed 566814552 / 567024030 / -0.0% 610170259 / 620769773 / -1.7% 0.93 / 0.91 / +1.7%
clickbench_q29/datafusion:vortex-file-compressed 22987188 / 23182660 / -0.8% 52338614 / 53081466 / -1.4% 0.44 / 0.44 / +0.6%
clickbench_q30/datafusion:vortex-file-compressed 57608832 / 59432258 / -3.1% 111647528 / 108739295 / +2.7% 0.52 / 0.55 / -5.6%
clickbench_q31/datafusion:vortex-file-compressed 70527881 / 71961380 / -2.0% 145976705 / 148842860 / -1.9% 0.48 / 0.48 / -0.1%
clickbench_q32/datafusion:vortex-file-compressed 302665691 / 302148743 / +0.2% 374338123 / 387397271 / -3.4% 0.81 / 0.78 / +3.7%
clickbench_q33/datafusion:vortex-file-compressed 327447206 / 334383895 / -2.1% 423538290 / 432127774 / -2.0% 0.77 / 0.77 / -0.1%
clickbench_q34/datafusion:vortex-file-compressed 331857887 / 328337070 / +1.1% 424808638 / 425193644 / -0.1% 0.78 / 0.77 / +1.2%
clickbench_q35/datafusion:vortex-file-compressed 56768456 / 54924752 / +3.4% 87980181 / 89274330 / -1.4% 0.65 / 0.62 / +4.9%
clickbench_q36/datafusion:vortex-file-compressed 37582194 / 37361604 / +0.6% 64257225 / 66048101 / -2.7% 0.58 / 0.57 / +3.4%
clickbench_q37/datafusion:vortex-file-compressed 21707522 / 21741220 / -0.2% 46644561 / 48353636 / -3.5% 0.47 / 0.45 / +3.5%
clickbench_q38/datafusion:vortex-file-compressed 11709428 / 11761934 / -0.4% 37359297 / 39151611 / -4.6% 0.31 / 0.30 / +4.3%
clickbench_q39/datafusion:vortex-file-compressed 77518155 / 78162492 / -0.8% 108440773 / 110036146 / -1.4% 0.71 / 0.71 / +0.6%
clickbench_q40/datafusion:vortex-file-compressed 11180464 / 11377576 / -1.7% 34951441 / 37452700 / -6.7% 0.32 / 0.30 / +5.3%
clickbench_q41/datafusion:vortex-file-compressed 10680406 / 10680034 / +0.0% 34757268 / 36485504 / -4.7% 0.31 / 0.29 / +5.0%
clickbench_q42/datafusion:vortex-file-compressed 11213286 / 11215044 / -0.0% 34329373 / 36708979 / -6.5% 0.33 / 0.31 / +6.9%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1232358 / 1239518 / -0.6% 19030850 / 21826981 / -12.8% 🟢 0.06 / 0.06 / +14.0%
clickbench_q01/datafusion:vortex-compact 6831508 / 7075218 / -3.4% 34333967 / 34054372 / +0.8% 0.20 / 0.21 / -4.2%
clickbench_q02/datafusion:vortex-compact 20106092 / 20258065 / -0.8% 43218354 / 43647538 / -1.0% 0.47 / 0.46 / +0.2%
clickbench_q03/datafusion:vortex-compact 14627640 / 14062821 / +4.0% 39018778 / 40631698 / -4.0% 0.37 / 0.35 / +8.3%
clickbench_q04/datafusion:vortex-compact 58559113 / 56781492 / +3.1% 92188407 / 88202076 / +4.5% 0.64 / 0.64 / -1.3%
clickbench_q05/datafusion:vortex-compact 82235508 / 87515179 / -6.0% 118905191 / 125955307 / -5.6% 0.69 / 0.69 / -0.5%
clickbench_q06/datafusion:vortex-compact 1221990 / 1222412 / -0.0% 18705943 / 21546130 / -13.2% 🟢 0.07 / 0.06 / +15.1%
clickbench_q07/datafusion:vortex-compact 12199376 / 12089158 / +0.9% 32649640 / 37591047 / -13.1% 🟢 0.37 / 0.32 / +16.2%
clickbench_q08/datafusion:vortex-compact 84974832 / 88489218 / -4.0% 117302088 / 117611278 / -0.3% 0.72 / 0.75 / -3.7%
clickbench_q09/datafusion:vortex-compact 191882436 / 191517894 / +0.2% 217029866 / 219046203 / -0.9% 0.88 / 0.87 / +1.1%
clickbench_q10/datafusion:vortex-compact 43259872 / 44052040 / -1.8% 68700570 / 70957919 / -3.2% 0.63 / 0.62 / +1.4%
clickbench_q11/datafusion:vortex-compact 56100944 / 55065914 / +1.9% 80238144 / 83917867 / -4.4% 0.70 / 0.66 / +6.6%
clickbench_q12/datafusion:vortex-compact 83508146 / 83941128 / -0.5% 119047950 / 122742229 / -3.0% 0.70 / 0.68 / +2.6%
clickbench_q13/datafusion:vortex-compact 135332511 / 134031147 / +1.0% 184464869 / 181081267 / +1.9% 0.73 / 0.74 / -0.9%
clickbench_q14/datafusion:vortex-compact 92048320 / 91684344 / +0.4% 122497460 / 129907816 / -5.7% 0.75 / 0.71 / +6.5%
clickbench_q15/datafusion:vortex-compact 63860039 / 66165250 / -3.5% 92068106 / 92858981 / -0.9% 0.69 / 0.71 / -2.7%
clickbench_q16/datafusion:vortex-compact 166510344 / 162799696 / +2.3% 222050962 / 215005517 / +3.3% 0.75 / 0.76 / -1.0%
clickbench_q17/datafusion:vortex-compact 164236889 / 159350616 / +3.1% 212044769 / 221308343 / -4.2% 0.77 / 0.72 / +7.6%
clickbench_q18/datafusion:vortex-compact 300804347 / 300425398 / +0.1% 368008291 / 371162571 / -0.8% 0.82 / 0.81 / +1.0%
clickbench_q19/datafusion:vortex-compact 10337920 / 11270937 / -8.3% 36344130 / 38312621 / -5.1% 0.28 / 0.29 / -3.3%
clickbench_q20/datafusion:vortex-compact 72331689 / 72001068 / +0.5% 194844099 / 191681447 / +1.6% 0.37 / 0.38 / -1.2%
clickbench_q21/datafusion:vortex-compact 117247708 / 118041324 / -0.7% 226535788 / 224876150 / +0.7% 0.52 / 0.52 / -1.4%
clickbench_q22/datafusion:vortex-compact 184502243 / 184033602 / +0.3% 276029586 / 271794440 / +1.6% 0.67 / 0.68 / -1.3%
clickbench_q23/datafusion:vortex-compact 578321947 / 571706279 / +1.2% 627635445 / 639467479 / -1.9% 0.92 / 0.89 / +3.1%
clickbench_q24/datafusion:vortex-compact 27995912 / 27880086 / +0.4% 58926769 / 58561417 / +0.6% 0.48 / 0.48 / -0.2%
clickbench_q25/datafusion:vortex-compact 35267084 / 35322264 / -0.2% 64550493 / 65913150 / -2.1% 0.55 / 0.54 / +2.0%
clickbench_q26/datafusion:vortex-compact 28361684 / 28751700 / -1.4% 58974420 / 61068068 / -3.4% 0.48 / 0.47 / +2.1%
clickbench_q27/datafusion:vortex-compact 103398339 / 103217884 / +0.2% 208371473 / 210752161 / -1.1% 0.50 / 0.49 / +1.3%
clickbench_q28/datafusion:vortex-compact 602214071 / 589943994 / +2.1% 631153455 / 618156840 / +2.1% 0.95 / 0.95 / -0.0%
clickbench_q29/datafusion:vortex-compact 31207048 / 30762383 / +1.4% 55038766 / 58418326 / -5.8% 0.57 / 0.53 / +7.7%
clickbench_q30/datafusion:vortex-compact 94397619 / 94196385 / +0.2% 126598248 / 130138091 / -2.7% 0.75 / 0.72 / +3.0%
clickbench_q31/datafusion:vortex-compact 101527670 / 101639434 / -0.1% 153621744 / 154162005 / -0.4% 0.66 / 0.66 / +0.2%
clickbench_q32/datafusion:vortex-compact 312235180 / 308603241 / +1.2% 380036528 / 379310146 / +0.2% 0.82 / 0.81 / +1.0%
clickbench_q33/datafusion:vortex-compact 344958915 / 340506575 / +1.3% 418830940 / 426903581 / -1.9% 0.82 / 0.80 / +3.3%
clickbench_q34/datafusion:vortex-compact 345080620 / 336942942 / +2.4% 427025400 / 436698419 / -2.2% 0.81 / 0.77 / +4.7%
clickbench_q35/datafusion:vortex-compact 61661058 / 62230864 / -0.9% 87854543 / 93702437 / -6.2% 0.70 / 0.66 / +5.7%
clickbench_q36/datafusion:vortex-compact 38201888 / 38392840 / -0.5% 64392926 / 67672175 / -4.8% 0.59 / 0.57 / +4.6%
clickbench_q37/datafusion:vortex-compact 22299904 / 22727128 / -1.9% 46731037 / 49468911 / -5.5% 0.48 / 0.46 / +3.9%
clickbench_q38/datafusion:vortex-compact 13193316 / 12624034 / +4.5% 38402109 / 40717193 / -5.7% 0.34 / 0.31 / +10.8%
clickbench_q39/datafusion:vortex-compact 78813446 / 79532359 / -0.9% 110336007 / 110700254 / -0.3% 0.71 / 0.72 / -0.6%
clickbench_q40/datafusion:vortex-compact 12622863 / 12313454 / +2.5% 35408866 / 37267347 / -5.0% 0.36 / 0.33 / +7.9%
clickbench_q41/datafusion:vortex-compact 12827817 / 12899904 / -0.6% 35468822 / 37782226 / -6.1% 0.36 / 0.34 / +5.9%
clickbench_q42/datafusion:vortex-compact 11054166 / 10860676 / +1.8% 33867462 / 36260201 / -6.6% 0.33 / 0.30 / +9.0%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1256552 / 1248026 / +0.7% 48786492 / 49534742 / -1.5% 0.03 / 0.03 / +2.2%
clickbench_q01/datafusion:parquet 15901562 / 16245706 / -2.1% 68598329 / 69260061 / -1.0% 0.23 / 0.23 / -1.2%
clickbench_q02/datafusion:parquet 18922664 / 19442366 / -2.7% 83692567 / 84641274 / -1.1% 0.23 / 0.23 / -1.6%
clickbench_q03/datafusion:parquet 17445115 / 17778956 / -1.9% 79209063 / 80356379 / -1.4% 0.22 / 0.22 / -0.5%
clickbench_q04/datafusion:parquet 62399701 / 62191108 / +0.3% 130573409 / 130801823 / -0.2% 0.48 / 0.48 / +0.5%
clickbench_q05/datafusion:parquet 88268654 / 87421829 / +1.0% 155206551 / 158015053 / -1.8% 0.57 / 0.55 / +2.8%
clickbench_q06/datafusion:parquet 1258233 / 1255220 / +0.2% 48643134 / 50906781 / -4.4% 0.03 / 0.02 / +4.9%
clickbench_q07/datafusion:parquet 16650152 / 16699612 / -0.3% 67064662 / 69200311 / -3.1% 0.25 / 0.24 / +2.9%
clickbench_q08/datafusion:parquet 85450518 / 87867092 / -2.8% 163798121 / 161698380 / +1.3% 0.52 / 0.54 / -4.0%
clickbench_q09/datafusion:parquet 186873244 / 193550404 / -3.4% 269464040 / 275882828 / -2.3% 0.69 / 0.70 / -1.1%
clickbench_q10/datafusion:parquet 36306794 / 36018722 / +0.8% 101796370 / 103541156 / -1.7% 0.36 / 0.35 / +2.5%
clickbench_q11/datafusion:parquet 43268230 / 43606156 / -0.8% 107768547 / 114529734 / -5.9% 0.40 / 0.38 / +5.5%
clickbench_q12/datafusion:parquet 96152686 / 95612140 / +0.6% 162052444 / 162113155 / -0.0% 0.59 / 0.59 / +0.6%
clickbench_q13/datafusion:parquet 148124944 / 148295307 / -0.1% 226971547 / 228698871 / -0.8% 0.65 / 0.65 / +0.6%
clickbench_q14/datafusion:parquet 101219702 / 101517463 / -0.3% 169838049 / 172567030 / -1.6% 0.60 / 0.59 / +1.3%
clickbench_q15/datafusion:parquet 71861246 / 70941828 / +1.3% 135348187 / 131367213 / +3.0% 0.53 / 0.54 / -1.7%
clickbench_q16/datafusion:parquet 156810527 / 156915045 / -0.1% 235025451 / 240387560 / -2.2% 0.67 / 0.65 / +2.2%
clickbench_q17/datafusion:parquet 157174866 / 157223996 / -0.0% 239708414 / 239274524 / +0.2% 0.66 / 0.66 / -0.2%
clickbench_q18/datafusion:parquet 313443913 / 316045338 / -0.8% 416944223 / 418273533 / -0.3% 0.75 / 0.76 / -0.5%
clickbench_q19/datafusion:parquet 19126759 / 18593531 / +2.9% 74115559 / 76377596 / -3.0% 0.26 / 0.24 / +6.0%
clickbench_q20/datafusion:parquet 179598084 / 178479816 / +0.6% 275821352 / 279118630 / -1.2% 0.65 / 0.64 / +1.8%
clickbench_q21/datafusion:parquet 174580030 / 175899723 / -0.8% 291976665 / 291727920 / +0.1% 0.60 / 0.60 / -0.8%
clickbench_q22/datafusion:parquet 261323546 / 262390508 / -0.4% 415300613 / 415532577 / -0.1% 0.63 / 0.63 / -0.4%
clickbench_q23/datafusion:parquet 1135614906 / 1137570718 / -0.2% 1224246142 / 1233369357 / -0.7% 0.93 / 0.92 / +0.6%
clickbench_q24/datafusion:parquet 30105819 / 30371150 / -0.9% 85937105 / 88731948 / -3.1% 0.35 / 0.34 / +2.4%
clickbench_q25/datafusion:parquet 37305450 / 38633726 / -3.4% 99528048 / 101564512 / -2.0% 0.37 / 0.38 / -1.5%
clickbench_q26/datafusion:parquet 30880334 / 30684430 / +0.6% 86872641 / 87799552 / -1.1% 0.36 / 0.35 / +1.7%
clickbench_q27/datafusion:parquet 195311994 / 195009468 / +0.2% 285940042 / 284516429 / +0.5% 0.68 / 0.69 / -0.3%
clickbench_q28/datafusion:parquet 627902246 / 624756759 / +0.5% 706001624 / 701519961 / +0.6% 0.89 / 0.89 / -0.1%
clickbench_q29/datafusion:parquet 28829952 / 29050620 / -0.8% 92640647 / 94105232 / -1.6% 0.31 / 0.31 / +0.8%
clickbench_q30/datafusion:parquet 90418538 / 91273382 / -0.9% 166452356 / 172830294 / -3.7% 0.54 / 0.53 / +2.9%
clickbench_q31/datafusion:parquet 103417795 / 103755396 / -0.3% 190454380 / 192845587 / -1.2% 0.54 / 0.54 / +0.9%
clickbench_q32/datafusion:parquet 330290370 / 321350244 / +2.8% 433362723 / 430441157 / +0.7% 0.76 / 0.75 / +2.1%
clickbench_q33/datafusion:parquet 384956792 / 380685674 / +1.1% 485604673 / 480056386 / +1.2% 0.79 / 0.79 / -0.0%
clickbench_q34/datafusion:parquet 382323474 / 381868252 / +0.1% 477478227 / 474809936 / +0.6% 0.80 / 0.80 / -0.4%
clickbench_q35/datafusion:parquet 63819520 / 65984666 / -3.3% 121568138 / 126534010 / -3.9% 0.52 / 0.52 / +0.7%
clickbench_q36/datafusion:parquet 73245834 / 73251698 / -0.0% 133253866 / 135256467 / -1.5% 0.55 / 0.54 / +1.5%
clickbench_q37/datafusion:parquet 35570074 / 35440044 / +0.4% 90732567 / 91647351 / -1.0% 0.39 / 0.39 / +1.4%
clickbench_q38/datafusion:parquet 47450838 / 47451508 / -0.0% 104927763 / 106448274 / -1.4% 0.45 / 0.45 / +1.4%
clickbench_q39/datafusion:parquet 143007298 / 143759145 / -0.5% 205378587 / 209919329 / -2.2% 0.70 / 0.68 / +1.7%
clickbench_q40/datafusion:parquet 19768082 / 19927760 / -0.8% 75931182 / 76904233 / -1.3% 0.26 / 0.26 / +0.5%
clickbench_q41/datafusion:parquet 18878224 / 18474340 / +2.2% 75905002 / 77274016 / -1.8% 0.25 / 0.24 / +4.0%
clickbench_q42/datafusion:parquet 19188796 / 19398835 / -1.1% 74011668 / 76103524 / -2.7% 0.26 / 0.25 / +1.7%
duckdb / vortex-file-compressed / ns (0.985x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1578344 / 1803532 / -12.5% 🟢 28125982 / 28187870 / -0.2% 0.06 / 0.06 / -12.3%
clickbench_q01/duckdb:vortex-file-compressed 15051761 / 14339347 / +5.0% 28136068 / 31494770 / -10.7% 🟢 0.53 / 0.46 / +17.5%
clickbench_q02/duckdb:vortex-file-compressed 12843414 / 13515103 / -5.0% 32164810 / 33391879 / -3.7% 0.40 / 0.40 / -1.3%
clickbench_q03/duckdb:vortex-file-compressed 19201359 / 18926427 / +1.5% 47085036 / 46525172 / +1.2% 0.41 / 0.41 / +0.2%
clickbench_q04/duckdb:vortex-file-compressed 71788871 / 68499904 / +4.8% 98083417 / 95993631 / +2.2% 0.73 / 0.71 / +2.6%
clickbench_q05/duckdb:vortex-file-compressed 66736621 / 69153190 / -3.5% 95766666 / 93691250 / +2.2% 0.70 / 0.74 / -5.6%
clickbench_q06/duckdb:vortex-file-compressed 1879864 / 1983946 / -5.2% 30263140 / 29084551 / +4.1% 0.06 / 0.07 / -8.9%
clickbench_q07/duckdb:vortex-file-compressed 13764462 / 15455642 / -10.9% 🟢 35965987 / 34259847 / +5.0% 0.38 / 0.45 / -15.2%
clickbench_q08/duckdb:vortex-file-compressed 82014526 / 84554342 / -3.0% 120583585 / 138117231 / -12.7% 🟢 0.68 / 0.61 / +11.1%
clickbench_q09/duckdb:vortex-file-compressed 108308765 / 109523158 / -1.1% 150334583 / 145772780 / +3.1% 0.72 / 0.75 / -4.1%
clickbench_q10/duckdb:vortex-file-compressed 34812000 / 35557442 / -2.1% 65456858 / 67604175 / -3.2% 0.53 / 0.53 / +1.1%
clickbench_q11/duckdb:vortex-file-compressed 35110456 / 36253680 / -3.2% 67130565 / 67306757 / -0.3% 0.52 / 0.54 / -2.9%
clickbench_q12/duckdb:vortex-file-compressed 73788556 / 75379439 / -2.1% 102746411 / 109960691 / -6.6% 0.72 / 0.69 / +4.8%
clickbench_q13/duckdb:vortex-file-compressed 150369071 / 142002201 / +5.9% 176094134 / 174977642 / +0.6% 0.85 / 0.81 / +5.2%
clickbench_q14/duckdb:vortex-file-compressed 78190360 / 78963296 / -1.0% 109913412 / 111219217 / -1.2% 0.71 / 0.71 / +0.2%
clickbench_q15/duckdb:vortex-file-compressed 91374880 / 91123916 / +0.3% 126341283 / 126863864 / -0.4% 0.72 / 0.72 / +0.7%
clickbench_q16/duckdb:vortex-file-compressed 163217412 / 161471586 / +1.1% 207296673 / 236661050 / -12.4% 🟢 0.79 / 0.68 / +15.4%
clickbench_q17/duckdb:vortex-file-compressed 159731512 / 162726584 / -1.8% 205647564 / 202771978 / +1.4% 0.78 / 0.80 / -3.2%
clickbench_q18/duckdb:vortex-file-compressed 321045170 / 326616614 / -1.7% 380624141 / 377804036 / +0.7% 0.84 / 0.86 / -2.4%
clickbench_q19/duckdb:vortex-file-compressed 17295515 / 18730917 / -7.7% 42024863 / 42308453 / -0.7% 0.41 / 0.44 / -7.0%
clickbench_q20/duckdb:vortex-file-compressed 108073176 / 112051108 / -3.6% 188274450 / 190767421 / -1.3% 0.57 / 0.59 / -2.3%
clickbench_q21/duckdb:vortex-file-compressed 158101738 / 156616318 / +0.9% 286747466 / 285455985 / +0.5% 0.55 / 0.55 / +0.5%
clickbench_q22/duckdb:vortex-file-compressed 239763008 / 239055350 / +0.3% 418729420 / 417619342 / +0.3% 0.57 / 0.57 / +0.0%
clickbench_q23/duckdb:vortex-file-compressed 58729698 / 65357532 / -10.1% 🟢 102278009 / 107678363 / -5.0% 0.57 / 0.61 / -5.4%
clickbench_q24/duckdb:vortex-file-compressed 25174572 / 25897818 / -2.8% 43102666 / 43332590 / -0.5% 0.58 / 0.60 / -2.3%
clickbench_q25/duckdb:vortex-file-compressed 32495226 / 31156491 / +4.3% 57895724 / 54115858 / +7.0% 0.56 / 0.58 / -2.5%
clickbench_q26/duckdb:vortex-file-compressed 19680730 / 20380062 / -3.4% 36894441 / 35668387 / +3.4% 0.53 / 0.57 / -6.6%
clickbench_q27/duckdb:vortex-file-compressed 134673333 / 136841142 / -1.6% 237375071 / 234990248 / +1.0% 0.57 / 0.58 / -2.6%
clickbench_q28/duckdb:vortex-file-compressed 610218014 / 579325126 / +5.3% 672033813 / 666584764 / +0.8% 0.91 / 0.87 / +4.5%
clickbench_q29/duckdb:vortex-file-compressed 18584912 / 16974022 / +9.5% 37974097 / 38327395 / -0.9% 0.49 / 0.44 / +10.5%
clickbench_q30/duckdb:vortex-file-compressed 64894418 / 68523016 / -5.3% 105983585 / 106666361 / -0.6% 0.61 / 0.64 / -4.7%
clickbench_q31/duckdb:vortex-file-compressed 125034172 / 128083314 / -2.4% 197630651 / 193029443 / +2.4% 0.63 / 0.66 / -4.7%
clickbench_q32/duckdb:vortex-file-compressed 457812608 / 463739640 / -1.3% 499252992 / 502980387 / -0.7% 0.92 / 0.92 / -0.5%
clickbench_q33/duckdb:vortex-file-compressed 394513354 / 393608460 / +0.2% 491501857 / 497255702 / -1.2% 0.80 / 0.79 / +1.4%
clickbench_q34/duckdb:vortex-file-compressed 409285345 / 413918578 / -1.1% 521371710 / 536012970 / -2.7% 0.79 / 0.77 / +1.7%
clickbench_q35/duckdb:vortex-file-compressed 102386630 / 101686356 / +0.7% 135778485 / 141078147 / -3.8% 0.75 / 0.72 / +4.6%
clickbench_q36/duckdb:vortex-file-compressed 16449740 / 15785949 / +4.2% 32801236 / 32145617 / +2.0% 0.50 / 0.49 / +2.1%
clickbench_q37/duckdb:vortex-file-compressed 10949185 / 11074876 / -1.1% 28126385 / 28197474 / -0.3% 0.39 / 0.39 / -0.9%
clickbench_q38/duckdb:vortex-file-compressed 12824778 / 13429828 / -4.5% 35866434 / 34838680 / +3.0% 0.36 / 0.39 / -7.2%
clickbench_q39/duckdb:vortex-file-compressed 24021983 / 22868501 / +5.0% 39841515 / 39953144 / -0.3% 0.60 / 0.57 / +5.3%
clickbench_q40/duckdb:vortex-file-compressed 10428447 / 12765829 / -18.3% 🟢 27921515 / 26442550 / +5.6% 0.37 / 0.48 / -22.6%
clickbench_q41/duckdb:vortex-file-compressed 13158856 / 12115978 / +8.6% 30127188 / 28656644 / +5.1% 0.44 / 0.42 / +3.3%
clickbench_q42/duckdb:vortex-file-compressed 11295874 / 11026511 / +2.4% 29768282 / 28751805 / +3.5% 0.38 / 0.38 / -1.1%
duckdb / vortex-compact / ns (0.985x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1562754 / 1787804 / -12.6% 🟢 25854018 / 27924276 / -7.4% 0.06 / 0.06 / -5.6%
clickbench_q01/duckdb:vortex-compact 12418762 / 12604838 / -1.5% 30484258 / 29501005 / +3.3% 0.41 / 0.43 / -4.7%
clickbench_q02/duckdb:vortex-compact 21051802 / 21066276 / -0.1% 43279655 / 40758181 / +6.2% 0.49 / 0.52 / -5.9%
clickbench_q03/duckdb:vortex-compact 20174681 / 21567944 / -6.5% 47463899 / 48310427 / -1.8% 0.43 / 0.45 / -4.8%
clickbench_q04/duckdb:vortex-compact 71731072 / 73357449 / -2.2% 100131961 / 98133952 / +2.0% 0.72 / 0.75 / -4.2%
clickbench_q05/duckdb:vortex-compact 77065797 / 77248944 / -0.2% 105353874 / 101956322 / +3.3% 0.73 / 0.76 / -3.5%
clickbench_q06/duckdb:vortex-compact 1895242 / 2113332 / -10.3% 🟢 29007771 / 32139927 / -9.7% 0.07 / 0.07 / -0.6%
clickbench_q07/duckdb:vortex-compact 14849355 / 14834904 / +0.1% 31629203 / 37912665 / -16.6% 🟢 0.47 / 0.39 / +20.0%
clickbench_q08/duckdb:vortex-compact 97702804 / 96486180 / +1.3% 140729470 / 132950745 / +5.9% 0.69 / 0.73 / -4.3%
clickbench_q09/duckdb:vortex-compact 143961759 / 147729998 / -2.6% 192643082 / 179927527 / +7.1% 0.75 / 0.82 / -9.0%
clickbench_q10/duckdb:vortex-compact 53026650 / 53245362 / -0.4% 86608129 / 89376651 / -3.1% 0.61 / 0.60 / +2.8%
clickbench_q11/duckdb:vortex-compact 65306278 / 65712445 / -0.6% 101205833 / 104055809 / -2.7% 0.65 / 0.63 / +2.2%
clickbench_q12/duckdb:vortex-compact 87230698 / 87948619 / -0.8% 119807493 / 123299017 / -2.8% 0.73 / 0.71 / +2.1%
clickbench_q13/duckdb:vortex-compact 164828179 / 161705614 / +1.9% 204524923 / 203791994 / +0.4% 0.81 / 0.79 / +1.6%
clickbench_q14/duckdb:vortex-compact 97817180 / 97522008 / +0.3% 127646057 / 132662650 / -3.8% 0.77 / 0.74 / +4.2%
clickbench_q15/duckdb:vortex-compact 95589313 / 96356964 / -0.8% 131504802 / 132546293 / -0.8% 0.73 / 0.73 / -0.0%
clickbench_q16/duckdb:vortex-compact 182381292 / 181885189 / +0.3% 224483169 / 244055717 / -8.0% 0.81 / 0.75 / +9.0%
clickbench_q17/duckdb:vortex-compact 179368281 / 182852950 / -1.9% 232573895 / 222324367 / +4.6% 0.77 / 0.82 / -6.2%
clickbench_q18/duckdb:vortex-compact 342199424 / 330683680 / +3.5% 385502332 / 381995194 / +0.9% 0.89 / 0.87 / +2.5%
clickbench_q19/duckdb:vortex-compact 18122700 / 16986348 / +6.7% 39967572 / 38554829 / +3.7% 0.45 / 0.44 / +2.9%
clickbench_q20/duckdb:vortex-compact 103798820 / 110080559 / -5.7% 169053072 / 172893564 / -2.2% 0.61 / 0.64 / -3.6%
clickbench_q21/duckdb:vortex-compact 170977066 / 174310348 / -1.9% 289768089 / 289586928 / +0.1% 0.59 / 0.60 / -2.0%
clickbench_q22/duckdb:vortex-compact 350937456 / 347994439 / +0.8% 499285187 / 499647913 / -0.1% 0.70 / 0.70 / +0.9%
clickbench_q23/duckdb:vortex-compact 93569706 / 95597906 / -2.1% 134322474 / 126510462 / +6.2% 0.70 / 0.76 / -7.8%
clickbench_q24/duckdb:vortex-compact 31728718 / 30697800 / +3.4% 47549946 / 52339563 / -9.2% 0.67 / 0.59 / +13.8%
clickbench_q25/duckdb:vortex-compact 48130657 / 47185644 / +2.0% 70645634 / 72669713 / -2.8% 0.68 / 0.65 / +4.9%
clickbench_q26/duckdb:vortex-compact 27133910 / 23766570 / +14.2% 🔴 38113483 / 44879279 / -15.1% 🟢 0.71 / 0.53 / +34.4%
clickbench_q27/duckdb:vortex-compact 187720346 / 188061696 / -0.2% 284281030 / 296801329 / -4.2% 0.66 / 0.63 / +4.2%
clickbench_q28/duckdb:vortex-compact 579115020 / 592752718 / -2.3% 694597306 / 700005394 / -0.8% 0.83 / 0.85 / -1.5%
clickbench_q29/duckdb:vortex-compact 22833788 / 21856061 / +4.5% 43023976 / 45035535 / -4.5% 0.53 / 0.49 / +9.4%
clickbench_q30/duckdb:vortex-compact 111098083 / 110210614 / +0.8% 145903717 / 154046184 / -5.3% 0.76 / 0.72 / +6.4%
clickbench_q31/duckdb:vortex-compact 175642504 / 178583721 / -1.6% 238680951 / 242122664 / -1.4% 0.74 / 0.74 / -0.2%
clickbench_q32/duckdb:vortex-compact 426669774 / 452559150 / -5.7% 575556669 / 499252541 / +15.3% 🔴 0.74 / 0.91 / -18.2%
clickbench_q33/duckdb:vortex-compact 395656636 / 405243418 / -2.4% 490901406 / 487879895 / +0.6% 0.81 / 0.83 / -3.0%
clickbench_q34/duckdb:vortex-compact 406771293 / 420240608 / -3.2% 521439607 / 527414233 / -1.1% 0.78 / 0.80 / -2.1%
clickbench_q35/duckdb:vortex-compact 106408776 / 110784206 / -3.9% 138130366 / 137508553 / +0.5% 0.77 / 0.81 / -4.4%
clickbench_q36/duckdb:vortex-compact 16498997 / 17726215 / -6.9% 35335947 / 34462350 / +2.5% 0.47 / 0.51 / -9.2%
clickbench_q37/duckdb:vortex-compact 13720238 / 13857937 / -1.0% 33385226 / 31683528 / +5.4% 0.41 / 0.44 / -6.0%
clickbench_q38/duckdb:vortex-compact 12905497 / 13311642 / -3.1% 29395100 / 31677313 / -7.2% 0.44 / 0.42 / +4.5%
clickbench_q39/duckdb:vortex-compact 25889502 / 26426051 / -2.0% 46450173 / 41624256 / +11.6% 🔴 0.56 / 0.63 / -12.2%
clickbench_q40/duckdb:vortex-compact 12018280 / 14586467 / -17.6% 🟢 28606475 / 30552271 / -6.4% 0.42 / 0.48 / -12.0%
clickbench_q41/duckdb:vortex-compact 12487256 / 13287164 / -6.0% 29997325 / 31246458 / -4.0% 0.42 / 0.43 / -2.1%
clickbench_q42/duckdb:vortex-compact 12359108 / 11583806 / +6.7% 28468375 / 30559314 / -6.8% 0.43 / 0.38 / +14.5%
duckdb / parquet / ns (0.981x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9686576 / 10153266 / -4.6% 23359071 / 21508150 / +8.6% 0.41 / 0.47 / -12.2%
clickbench_q01/duckdb:parquet 10962016 / 10435572 / +5.0% 19284437 / 21466253 / -10.2% 🟢 0.57 / 0.49 / +16.9%
clickbench_q02/duckdb:parquet 15222085 / 15298374 / -0.5% 31448567 / 32097839 / -2.0% 0.48 / 0.48 / +1.6%
clickbench_q03/duckdb:parquet 15876622 / 15457438 / +2.7% 51857617 / 53257821 / -2.6% 0.31 / 0.29 / +5.5%
clickbench_q04/duckdb:parquet 71183187 / 70179770 / +1.4% 91870663 / 90401373 / +1.6% 0.77 / 0.78 / -0.2%
clickbench_q05/duckdb:parquet 80493664 / 87292932 / -7.8% 135581732 / 119384442 / +13.6% 🔴 0.59 / 0.73 / -18.8%
clickbench_q06/duckdb:parquet 14342756 / 16021347 / -10.5% 🟢 25088432 / 23816278 / +5.3% 0.57 / 0.67 / -15.0%
clickbench_q07/duckdb:parquet 11458134 / 11955332 / -4.2% 21107621 / 22054407 / -4.3% 0.54 / 0.54 / +0.1%
clickbench_q08/duckdb:parquet 84564662 / 83476520 / +1.3% 124281395 / 123646298 / +0.5% 0.68 / 0.68 / +0.8%
clickbench_q09/duckdb:parquet 120442361 / 116116512 / +3.7% 155964004 / 156965878 / -0.6% 0.77 / 0.74 / +4.4%
clickbench_q10/duckdb:parquet 32595504 / 32687367 / -0.3% 68492703 / 70391664 / -2.7% 0.48 / 0.46 / +2.5%
clickbench_q11/duckdb:parquet 36123284 / 36321780 / -0.5% 76496450 / 74927262 / +2.1% 0.47 / 0.48 / -2.6%
clickbench_q12/duckdb:parquet 90205116 / 90970610 / -0.8% 127793600 / 130855660 / -2.3% 0.71 / 0.70 / +1.5%
clickbench_q13/duckdb:parquet 143342098 / 145797742 / -1.7% 207816382 / 209883388 / -1.0% 0.69 / 0.69 / -0.7%
clickbench_q14/duckdb:parquet 98992944 / 96948936 / +2.1% 138104871 / 139864990 / -1.3% 0.72 / 0.69 / +3.4%
clickbench_q15/duckdb:parquet 93304126 / 92660143 / +0.7% 127202663 / 121234623 / +4.9% 0.73 / 0.76 / -4.0%
clickbench_q16/duckdb:parquet 174116461 / 169700217 / +2.6% 224804995 / 227384026 / -1.1% 0.77 / 0.75 / +3.8%
clickbench_q17/duckdb:parquet 177561010 / 185528324 / -4.3% 231856189 / 239986092 / -3.4% 0.77 / 0.77 / -0.9%
clickbench_q18/duckdb:parquet 319247046 / 344070686 / -7.2% 400308157 / 406128208 / -1.4% 0.80 / 0.85 / -5.9%
clickbench_q19/duckdb:parquet 13092632 / 13667494 / -4.2% 44339235 / 42455851 / +4.4% 0.30 / 0.32 / -8.3%
clickbench_q20/duckdb:parquet 133924938 / 134253796 / -0.2% 247266224 / 248827044 / -0.6% 0.54 / 0.54 / +0.4%
clickbench_q21/duckdb:parquet 180004963 / 182292795 / -1.3% 329814481 / 325978699 / +1.2% 0.55 / 0.56 / -2.4%
clickbench_q22/duckdb:parquet 244101570 / 250234822 / -2.5% 405188479 / 409316113 / -1.0% 0.60 / 0.61 / -1.5%
clickbench_q23/duckdb:parquet 143363876 / 147411920 / -2.7% 170256667 / 165953886 / +2.6% 0.84 / 0.89 / -5.2%
clickbench_q24/duckdb:parquet 43179321 / 43995364 / -1.9% 63420045 / 60410705 / +5.0% 0.68 / 0.73 / -6.5%
clickbench_q25/duckdb:parquet 39804959 / 40336980 / -1.3% 89345115 / 93348680 / -4.3% 0.45 / 0.43 / +3.1%
clickbench_q26/duckdb:parquet 30721986 / 31261049 / -1.7% 47613048 / 47375129 / +0.5% 0.65 / 0.66 / -2.2%
clickbench_q27/duckdb:parquet 149935962 / 156172919 / -4.0% 255294633 / 255380271 / -0.0% 0.59 / 0.61 / -4.0%
clickbench_q28/duckdb:parquet 906499878 / 905322066 / +0.1% 1031446665 / 1007946269 / +2.3% 0.88 / 0.90 / -2.2%
clickbench_q29/duckdb:parquet 17610096 / 21192490 / -16.9% 🟢 31458255 / 33498199 / -6.1% 0.56 / 0.63 / -11.5%
clickbench_q30/duckdb:parquet 90965548 / 92236138 / -1.4% 171655807 / 176400012 / -2.7% 0.53 / 0.52 / +1.3%
clickbench_q31/duckdb:parquet 142572484 / 154569216 / -7.8% 293767050 / 291692413 / +0.7% 0.49 / 0.53 / -8.4%
clickbench_q32/duckdb:parquet 461056662 / 457000570 / +0.9% 526973753 / 479541358 / +9.9% 0.87 / 0.95 / -8.2%
clickbench_q33/duckdb:parquet 442632224 / 457006556 / -3.1% 484690058 / 476670164 / +1.7% 0.91 / 0.96 / -4.7%
clickbench_q34/duckdb:parquet 456807238 / 467524580 / -2.3% 496572200 / 485382496 / +2.3% 0.92 / 0.96 / -4.5%
clickbench_q35/duckdb:parquet 104078550 / 101416104 / +2.6% 119817150 / 127335656 / -5.9% 0.87 / 0.80 / +9.1%
clickbench_q36/duckdb:parquet 31375144 / 31026502 / +1.1% 40655801 / 44551975 / -8.7% 0.77 / 0.70 / +10.8%
clickbench_q37/duckdb:parquet 23128512 / 23359946 / -1.0% 32064129 / 32608035 / -1.7% 0.72 / 0.72 / +0.7%
clickbench_q38/duckdb:parquet 23424590 / 23742170 / -1.3% 33660728 / 33872867 / -0.6% 0.70 / 0.70 / -0.7%
clickbench_q39/duckdb:parquet 56572597 / 57316932 / -1.3% 65959147 / 67040677 / -1.6% 0.86 / 0.85 / +0.3%
clickbench_q40/duckdb:parquet 12850598 / 13007454 / -1.2% 22493389 / 21964462 / +2.4% 0.57 / 0.59 / -3.5%
clickbench_q41/duckdb:parquet 13063045 / 13432636 / -2.8% 22202400 / 22752488 / -2.4% 0.59 / 0.59 / -0.3%
clickbench_q42/duckdb:parquet 14427642 / 14483219 / -0.4% 24338697 / 26945075 / -9.7% 0.59 / 0.54 / +10.3%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.7%, environment too noisy confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.991x ➖
Shifts: Parquet (control) -0.4% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24746671 / 24297978 / +1.8% 44003793 / 44316596 / -0.7% 0.56 / 0.55 / +2.6%
tpcds_q02/datafusion:vortex-file-compressed 45205179 / 45866368 / -1.4% 63425864 / 64017664 / -0.9% 0.71 / 0.72 / -0.5%
tpcds_q03/datafusion:vortex-file-compressed 11564208 / 11870736 / -2.6% 29847824 / 30154126 / -1.0% 0.39 / 0.39 / -1.6%
tpcds_q04/datafusion:vortex-file-compressed 113046996 / 113064128 / -0.0% 144537249 / 145993337 / -1.0% 0.78 / 0.77 / +1.0%
tpcds_q05/datafusion:vortex-file-compressed 60114978 / 59707197 / +0.7% 83017128 / 81480429 / +1.9% 0.72 / 0.73 / -1.2%
tpcds_q06/datafusion:vortex-file-compressed 23422934 / 23899397 / -2.0% 45730920 / 46928841 / -2.6% 0.51 / 0.51 / +0.6%
tpcds_q07/datafusion:vortex-file-compressed 32776557 / 33772952 / -3.0% 57901076 / 57004172 / +1.6% 0.57 / 0.59 / -4.5%
tpcds_q08/datafusion:vortex-file-compressed 25444508 / 25549733 / -0.4% 44435894 / 44812459 / -0.8% 0.57 / 0.57 / +0.4%
tpcds_q09/datafusion:vortex-file-compressed 17357656 / 16372142 / +6.0% 35909010 / 36814869 / -2.5% 0.48 / 0.44 / +8.7%
tpcds_q10/datafusion:vortex-file-compressed 29472426 / 28587065 / +3.1% 49913993 / 49969505 / -0.1% 0.59 / 0.57 / +3.2%
tpcds_q11/datafusion:vortex-file-compressed 62437277 / 62787632 / -0.6% 91505879 / 91924882 / -0.5% 0.68 / 0.68 / -0.1%
tpcds_q12/datafusion:vortex-file-compressed 16222108 / 16442494 / -1.3% 32950719 / 34051143 / -3.2% 0.49 / 0.48 / +2.0%
tpcds_q13/datafusion:vortex-file-compressed 33643439 / 33495244 / +0.4% 54318479 / 54008801 / +0.6% 0.62 / 0.62 / -0.1%
tpcds_q14/datafusion:vortex-file-compressed 90736468 / 93006712 / -2.4% 119355549 / 120506983 / -1.0% 0.76 / 0.77 / -1.5%
tpcds_q15/datafusion:vortex-file-compressed 24142686 / 24003069 / +0.6% 44144998 / 45188050 / -2.3% 0.55 / 0.53 / +3.0%
tpcds_q16/datafusion:vortex-file-compressed 20232762 / 20402509 / -0.8% 42183154 / 41981870 / +0.5% 0.48 / 0.49 / -1.3%
tpcds_q17/datafusion:vortex-file-compressed 58131186 / 58198462 / -0.1% 76376861 / 76739827 / -0.5% 0.76 / 0.76 / +0.4%
tpcds_q18/datafusion:vortex-file-compressed 67840332 / 68654068 / -1.2% 94293225 / 96368424 / -2.2% 0.72 / 0.71 / +1.0%
tpcds_q19/datafusion:vortex-file-compressed 18184282 / 18388211 / -1.1% 41227861 / 39444809 / +4.5% 0.44 / 0.47 / -5.4%
tpcds_q20/datafusion:vortex-file-compressed 17478626 / 17779768 / -1.7% 35267110 / 36710720 / -3.9% 0.50 / 0.48 / +2.3%
tpcds_q21/datafusion:vortex-file-compressed 16923012 / 17693290 / -4.4% 42467071 / 38496179 / +10.3% 🔴 0.40 / 0.46 / -13.3%
tpcds_q22/datafusion:vortex-file-compressed 50279560 / 49912518 / +0.7% 73780809 / 72883667 / +1.2% 0.68 / 0.68 / -0.5%
tpcds_q23/datafusion:vortex-file-compressed 73291752 / 72490528 / +1.1% 100783652 / 102909860 / -2.1% 0.73 / 0.70 / +3.2%
tpcds_q24/datafusion:vortex-file-compressed 70734576 / 70996384 / -0.4% 94460360 / 94391749 / +0.1% 0.75 / 0.75 / -0.4%
tpcds_q25/datafusion:vortex-file-compressed 52922659 / 52294430 / +1.2% 83499557 / 82666967 / +1.0% 0.63 / 0.63 / +0.2%
tpcds_q26/datafusion:vortex-file-compressed 30137206 / 30277297 / -0.5% 50678416 / 51653193 / -1.9% 0.59 / 0.59 / +1.5%
tpcds_q27/datafusion:vortex-file-compressed 61595032 / 61605149 / -0.0% 93812587 / 92110787 / +1.8% 0.66 / 0.67 / -1.8%
tpcds_q28/datafusion:vortex-file-compressed 17972947 / 17929754 / +0.2% 38910792 / 36719008 / +6.0% 0.46 / 0.49 / -5.4%
tpcds_q29/datafusion:vortex-file-compressed 62061530 / 60978355 / +1.8% 75925581 / 87241642 / -13.0% 🟢 0.82 / 0.70 / +16.9%
tpcds_q30/datafusion:vortex-file-compressed 27557816 / 27777124 / -0.8% 45157318 / 46538369 / -3.0% 0.61 / 0.60 / +2.2%
tpcds_q31/datafusion:vortex-file-compressed 64468725 / 64666921 / -0.3% 92812095 / 94739701 / -2.0% 0.69 / 0.68 / +1.8%
tpcds_q32/datafusion:vortex-file-compressed 13694534 / 14109578 / -2.9% 31294224 / 32265664 / -3.0% 0.44 / 0.44 / +0.1%
tpcds_q33/datafusion:vortex-file-compressed 26825093 / 26915540 / -0.3% 48664243 / 50014204 / -2.7% 0.55 / 0.54 / +2.4%
tpcds_q34/datafusion:vortex-file-compressed 18441308 / 18152272 / +1.6% 38735860 / 39531745 / -2.0% 0.48 / 0.46 / +3.7%
tpcds_q35/datafusion:vortex-file-compressed 36229516 / 35824948 / +1.1% 59458851 / 57725128 / +3.0% 0.61 / 0.62 / -1.8%
tpcds_q36/datafusion:vortex-file-compressed 48622065 / 48781690 / -0.3% 74248383 / 74383428 / -0.2% 0.65 / 0.66 / -0.1%
tpcds_q37/datafusion:vortex-file-compressed 13906608 / 13666682 / +1.8% 32896787 / 36578755 / -10.1% 🟢 0.42 / 0.37 / +13.1%
tpcds_q38/datafusion:vortex-file-compressed 29508634 / 29432843 / +0.3% 51811455 / 52796631 / -1.9% 0.57 / 0.56 / +2.2%
tpcds_q39/datafusion:vortex-file-compressed 64966443 / 66157542 / -1.8% 93074560 / 92013072 / +1.2% 0.70 / 0.72 / -2.9%
tpcds_q40/datafusion:vortex-file-compressed 25277110 / 25472720 / -0.8% 46245650 / 45183867 / +2.3% 0.55 / 0.56 / -3.0%
tpcds_q41/datafusion:vortex-file-compressed 16798815 / 16439544 / +2.2% 31644386 / 31409223 / +0.7% 0.53 / 0.52 / +1.4%
tpcds_q42/datafusion:vortex-file-compressed 11097968 / 11567712 / -4.1% 29752153 / 28780491 / +3.4% 0.37 / 0.40 / -7.2%
tpcds_q43/datafusion:vortex-file-compressed 13216888 / 13382510 / -1.2% 32574997 / 32556971 / +0.1% 0.41 / 0.41 / -1.3%
tpcds_q44/datafusion:vortex-file-compressed 26053140 / 27398914 / -4.9% 50599719 / 50674367 / -0.1% 0.51 / 0.54 / -4.8%
tpcds_q45/datafusion:vortex-file-compressed 27659958 / 28029034 / -1.3% 49590717 / 48745613 / +1.7% 0.56 / 0.58 / -3.0%
tpcds_q46/datafusion:vortex-file-compressed 24884674 / 24990618 / -0.4% 47566330 / 48737792 / -2.4% 0.52 / 0.51 / +2.0%
tpcds_q47/datafusion:vortex-file-compressed 78461705 / 78583326 / -0.2% 106568249 / 107435409 / -0.8% 0.74 / 0.73 / +0.7%
tpcds_q48/datafusion:vortex-file-compressed 30942402 / 31192167 / -0.8% 52760785 / 53128390 / -0.7% 0.59 / 0.59 / -0.1%
tpcds_q49/datafusion:vortex-file-compressed 60110648 / 60188152 / -0.1% 83506982 / 83445506 / +0.1% 0.72 / 0.72 / -0.2%
tpcds_q50/datafusion:vortex-file-compressed 34194009 / 34067802 / +0.4% 55508461 / 56279171 / -1.4% 0.62 / 0.61 / +1.8%
tpcds_q51/datafusion:vortex-file-compressed 61222632 / 60526483 / +1.2% 83991438 / 86366302 / -2.7% 0.73 / 0.70 / +4.0%
tpcds_q52/datafusion:vortex-file-compressed 11770714 / 11963418 / -1.6% 28100573 / 30033296 / -6.4% 0.42 / 0.40 / +5.2%
tpcds_q53/datafusion:vortex-file-compressed 18294738 / 18508104 / -1.2% 37800388 / 38374399 / -1.5% 0.48 / 0.48 / +0.3%
tpcds_q54/datafusion:vortex-file-compressed 33513512 / 33973992 / -1.4% 58102635 / 58164847 / -0.1% 0.58 / 0.58 / -1.2%
tpcds_q55/datafusion:vortex-file-compressed 11477110 / 11015893 / +4.2% 29613678 / 28582713 / +3.6% 0.39 / 0.39 / +0.6%
tpcds_q56/datafusion:vortex-file-compressed 26734492 / 26514932 / +0.8% 50231779 / 50098688 / +0.3% 0.53 / 0.53 / +0.6%
tpcds_q57/datafusion:vortex-file-compressed 73272046 / 73197772 / +0.1% 98302318 / 97099203 / +1.2% 0.75 / 0.75 / -1.1%
tpcds_q58/datafusion:vortex-file-compressed 41064690 / 41085684 / -0.1% 66663828 / 69568877 / -4.2% 0.62 / 0.59 / +4.3%
tpcds_q59/datafusion:vortex-file-compressed 32658162 / 32217707 / +1.4% 54012479 / 53408943 / +1.1% 0.60 / 0.60 / +0.2%
tpcds_q60/datafusion:vortex-file-compressed 27407002 / 26277776 / +4.3% 48909252 / 49950997 / -2.1% 0.56 / 0.53 / +6.5%
tpcds_q61/datafusion:vortex-file-compressed 23677047 / 24590353 / -3.7% 47441554 / 48390981 / -2.0% 0.50 / 0.51 / -1.8%
tpcds_q62/datafusion:vortex-file-compressed 17095912 / 17264040 / -1.0% 35926837 / 36904384 / -2.6% 0.48 / 0.47 / +1.7%
tpcds_q63/datafusion:vortex-file-compressed 18272637 / 18190556 / +0.5% 38831884 / 39643180 / -2.0% 0.47 / 0.46 / +2.5%
tpcds_q64/datafusion:vortex-file-compressed 325203782 / 324364131 / +0.3% 361900306 / 367136060 / -1.4% 0.90 / 0.88 / +1.7%
tpcds_q65/datafusion:vortex-file-compressed 75343078 / 76572764 / -1.6% 96817722 / 97045658 / -0.2% 0.78 / 0.79 / -1.4%
tpcds_q66/datafusion:vortex-file-compressed 53104044 / 52831390 / +0.5% 75072464 / 76835616 / -2.3% 0.71 / 0.69 / +2.9%
tpcds_q67/datafusion:vortex-file-compressed 55658181 / 55901868 / -0.4% 85929695 / 86936444 / -1.2% 0.65 / 0.64 / +0.7%
tpcds_q68/datafusion:vortex-file-compressed 24057096 / 23718048 / +1.4% 48513027 / 50779114 / -4.5% 0.50 / 0.47 / +6.2%
tpcds_q69/datafusion:vortex-file-compressed 28908911 / 28774492 / +0.5% 49335336 / 49928887 / -1.2% 0.59 / 0.58 / +1.7%
tpcds_q70/datafusion:vortex-file-compressed 71700682 / 72736936 / -1.4% 94366916 / 93807240 / +0.6% 0.76 / 0.78 / -2.0%
tpcds_q71/datafusion:vortex-file-compressed 19365856 / 18254888 / +6.1% 39865117 / 39402327 / +1.2% 0.49 / 0.46 / +4.9%
tpcds_q72/datafusion:vortex-file-compressed 471760674 / 467871461 / +0.8% 538451293 / 483363703 / +11.4% 🔴 0.88 / 0.97 / -9.5%
tpcds_q73/datafusion:vortex-file-compressed 17316498 / 17513638 / -1.1% 38717911 / 38648449 / +0.2% 0.45 / 0.45 / -1.3%
tpcds_q74/datafusion:vortex-file-compressed 45189614 / 45517380 / -0.7% 71162675 / 71321769 / -0.2% 0.64 / 0.64 / -0.5%
tpcds_q75/datafusion:vortex-file-compressed 130961970 / 134276592 / -2.5% 171468517 / 162493274 / +5.5% 0.76 / 0.83 / -7.6%
tpcds_q76/datafusion:vortex-file-compressed 43175760 / 44093778 / -2.1% 62436385 / 65023962 / -4.0% 0.69 / 0.68 / +2.0%
tpcds_q77/datafusion:vortex-file-compressed 35238714 / 34326702 / +2.7% 59304948 / 60404831 / -1.8% 0.59 / 0.57 / +4.6%
tpcds_q78/datafusion:vortex-file-compressed 80617500 / 79880775 / +0.9% 108850917 / 110073644 / -1.1% 0.74 / 0.73 / +2.1%
tpcds_q79/datafusion:vortex-file-compressed 21242462 / 20759037 / +2.3% 43563978 / 42675311 / +2.1% 0.49 / 0.49 / +0.2%
tpcds_q80/datafusion:vortex-file-compressed 77155469 / 76612800 / +0.7% 110219737 / 108920697 / +1.2% 0.70 / 0.70 / -0.5%
tpcds_q81/datafusion:vortex-file-compressed 28009402 / 28279924 / -1.0% 46373950 / 46258833 / +0.2% 0.60 / 0.61 / -1.2%
tpcds_q82/datafusion:vortex-file-compressed 13344066 / 13882304 / -3.9% 35281141 / 35849841 / -1.6% 0.38 / 0.39 / -2.3%
tpcds_q83/datafusion:vortex-file-compressed 36356078 / 35979944 / +1.0% 57250913 / 59120467 / -3.2% 0.64 / 0.61 / +4.3%
tpcds_q84/datafusion:vortex-file-compressed 11900090 / 11866645 / +0.3% 28259966 / 28856293 / -2.1% 0.42 / 0.41 / +2.4%
tpcds_q85/datafusion:vortex-file-compressed 59362318 / 59480292 / -0.2% 83984741 / 84834172 / -1.0% 0.71 / 0.70 / +0.8%
tpcds_q86/datafusion:vortex-file-compressed 16396034 / 16617758 / -1.3% 32666834 / 33745313 / -3.2% 0.50 / 0.49 / +1.9%
tpcds_q87/datafusion:vortex-file-compressed 29403300 / 30112858 / -2.4% 52087098 / 53049740 / -1.8% 0.56 / 0.57 / -0.6%
tpcds_q88/datafusion:vortex-file-compressed 34228018 / 33501022 / +2.2% 63487111 / 63202493 / +0.5% 0.54 / 0.53 / +1.7%
tpcds_q89/datafusion:vortex-file-compressed 20945774 / 21540718 / -2.8% 41818808 / 41440270 / +0.9% 0.50 / 0.52 / -3.6%
tpcds_q90/datafusion:vortex-file-compressed 10607572 / 10530193 / +0.7% 27615913 / 27745041 / -0.5% 0.38 / 0.38 / +1.2%
tpcds_q91/datafusion:vortex-file-compressed 17211388 / 17217388 / -0.0% 35892853 / 37234691 / -3.6% 0.48 / 0.46 / +3.7%
tpcds_q92/datafusion:vortex-file-compressed 13524796 / 13791002 / -1.9% 32855542 / 32642152 / +0.7% 0.41 / 0.42 / -2.6%
tpcds_q93/datafusion:vortex-file-compressed 23904964 / 23725731 / +0.8% 45891472 / 46310002 / -0.9% 0.52 / 0.51 / +1.7%
tpcds_q94/datafusion:vortex-file-compressed 19968946 / 19554668 / +2.1% 40896642 / 39817170 / +2.7% 0.49 / 0.49 / -0.6%
tpcds_q95/datafusion:vortex-file-compressed 45812557 / 46844602 / -2.2% 69897007 / 68305450 / +2.3% 0.66 / 0.69 / -4.4%
tpcds_q96/datafusion:vortex-file-compressed 9543336 / 9399209 / +1.5% 25844671 / 26635050 / -3.0% 0.37 / 0.35 / +4.6%
tpcds_q97/datafusion:vortex-file-compressed 21287008 / 21354494 / -0.3% 42683324 / 44012300 / -3.0% 0.50 / 0.49 / +2.8%
tpcds_q98/datafusion:vortex-file-compressed 16634816 / 16927233 / -1.7% 36521644 / 36920922 / -1.1% 0.46 / 0.46 / -0.7%
tpcds_q99/datafusion:vortex-file-compressed 19355792 / 19579550 / -1.1% 38225334 / 39313024 / -2.8% 0.51 / 0.50 / +1.7%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 25731778 / 25700724 / +0.1% 44334948 / 45036345 / -1.6% 0.58 / 0.57 / +1.7%
tpcds_q02/datafusion:vortex-compact 49037977 / 49196290 / -0.3% 68884726 / 68408289 / +0.7% 0.71 / 0.72 / -1.0%
tpcds_q03/datafusion:vortex-compact 12969672 / 12972704 / -0.0% 34685210 / 34729215 / -0.1% 0.37 / 0.37 / +0.1%
tpcds_q04/datafusion:vortex-compact 125851966 / 123171358 / +2.2% 156103907 / 153100759 / +2.0% 0.81 / 0.80 / +0.2%
tpcds_q05/datafusion:vortex-compact 63234643 / 62055812 / +1.9% 84028547 / 85729540 / -2.0% 0.75 / 0.72 / +4.0%
tpcds_q06/datafusion:vortex-compact 26384394 / 26124663 / +1.0% 45580425 / 48388708 / -5.8% 0.58 / 0.54 / +7.2%
tpcds_q07/datafusion:vortex-compact 35326958 / 36119052 / -2.2% 56691165 / 58138028 / -2.5% 0.62 / 0.62 / +0.3%
tpcds_q08/datafusion:vortex-compact 30697164 / 29818212 / +2.9% 50457691 / 49379754 / +2.2% 0.61 / 0.60 / +0.7%
tpcds_q09/datafusion:vortex-compact 22362230 / 22609408 / -1.1% 39956992 / 40176610 / -0.5% 0.56 / 0.56 / -0.5%
tpcds_q10/datafusion:vortex-compact 38578308 / 38557036 / +0.1% 57369557 / 59015832 / -2.8% 0.67 / 0.65 / +2.9%
tpcds_q11/datafusion:vortex-compact 68873984 / 69215962 / -0.5% 95607299 / 94170497 / +1.5% 0.72 / 0.74 / -2.0%
tpcds_q12/datafusion:vortex-compact 20911754 / 21121328 / -1.0% 40270453 / 39713427 / +1.4% 0.52 / 0.53 / -2.4%
tpcds_q13/datafusion:vortex-compact 54988836 / 55696369 / -1.3% 72865819 / 84724463 / -14.0% 🟢 0.75 / 0.66 / +14.8%
tpcds_q14/datafusion:vortex-compact 97033159 / 97007259 / +0.0% 126238651 / 123774581 / +2.0% 0.77 / 0.78 / -1.9%
tpcds_q15/datafusion:vortex-compact 27917710 / 27038944 / +3.2% 46246704 / 47561256 / -2.8% 0.60 / 0.57 / +6.2%
tpcds_q16/datafusion:vortex-compact 23446461 / 24208708 / -3.1% 44509528 / 44526125 / -0.0% 0.53 / 0.54 / -3.1%
tpcds_q17/datafusion:vortex-compact 59441665 / 60599146 / -1.9% 84915588 / 85306207 / -0.5% 0.70 / 0.71 / -1.5%
tpcds_q18/datafusion:vortex-compact 69161778 / 68873642 / +0.4% 95266188 / 92930266 / +2.5% 0.73 / 0.74 / -2.0%
tpcds_q19/datafusion:vortex-compact 23499669 / 22330550 / +5.2% 43918047 / 42928572 / +2.3% 0.54 / 0.52 / +2.9%
tpcds_q20/datafusion:vortex-compact 22627442 / 22515308 / +0.5% 42858788 / 41794835 / +2.5% 0.53 / 0.54 / -2.0%
tpcds_q21/datafusion:vortex-compact 18320026 / 17843032 / +2.7% 43311400 / 42130195 / +2.8% 0.42 / 0.42 / -0.1%
tpcds_q22/datafusion:vortex-compact 50208970 / 50970033 / -1.5% 72059600 / 78330929 / -8.0% 0.70 / 0.65 / +7.1%
tpcds_q23/datafusion:vortex-compact 76758658 / 77358650 / -0.8% 102591103 / 101825304 / +0.8% 0.75 / 0.76 / -1.5%
tpcds_q24/datafusion:vortex-compact 79960563 / 79530656 / +0.5% 102943956 / 102719316 / +0.2% 0.78 / 0.77 / +0.3%
tpcds_q25/datafusion:vortex-compact 63909726 / 56260074 / +13.6% 🔴 92629244 / 90047310 / +2.9% 0.69 / 0.62 / +10.4%
tpcds_q26/datafusion:vortex-compact 32752472 / 32964909 / -0.6% 50372316 / 53675068 / -6.2% 0.65 / 0.61 / +5.9%
tpcds_q27/datafusion:vortex-compact 61764902 / 65427316 / -5.6% 92649799 / 86793649 / +6.7% 0.67 / 0.75 / -11.6%
tpcds_q28/datafusion:vortex-compact 27847336 / 27094174 / +2.8% 51864425 / 46738616 / +11.0% 🔴 0.54 / 0.58 / -7.4%
tpcds_q29/datafusion:vortex-compact 66368634 / 68152118 / -2.6% 92289110 / 85303986 / +8.2% 0.72 / 0.80 / -10.0%
tpcds_q30/datafusion:vortex-compact 30183744 / 30997666 / -2.6% 48986674 / 49131856 / -0.3% 0.62 / 0.63 / -2.3%
tpcds_q31/datafusion:vortex-compact 77039295 / 76878414 / +0.2% 105329161 / 104185604 / +1.1% 0.73 / 0.74 / -0.9%
tpcds_q32/datafusion:vortex-compact 17106132 / 16171940 / +5.8% 36837360 / 35299211 / +4.4% 0.46 / 0.46 / +1.4%
tpcds_q33/datafusion:vortex-compact 27904071 / 29007993 / -3.8% 53803187 / 51638773 / +4.2% 0.52 / 0.56 / -7.7%
tpcds_q34/datafusion:vortex-compact 20946381 / 20552274 / +1.9% 42197484 / 42372467 / -0.4% 0.50 / 0.49 / +2.3%
tpcds_q35/datafusion:vortex-compact 41979738 / 40886594 / +2.7% 67460558 / 65386087 / +3.2% 0.62 / 0.63 / -0.5%
tpcds_q36/datafusion:vortex-compact 53098736 / 51575956 / +3.0% 75473805 / 79993345 / -5.6% 0.70 / 0.64 / +9.1%
tpcds_q37/datafusion:vortex-compact 15559642 / 15574155 / -0.1% 39596043 / 40960198 / -3.3% 0.39 / 0.38 / +3.3%
tpcds_q38/datafusion:vortex-compact 34256589 / 34364880 / -0.3% 55651426 / 59011285 / -5.7% 0.62 / 0.58 / +5.7%
tpcds_q39/datafusion:vortex-compact 67412268 / 68577658 / -1.7% 92310796 / 91507663 / +0.9% 0.73 / 0.75 / -2.6%
tpcds_q40/datafusion:vortex-compact 28110117 / 28279804 / -0.6% 50543282 / 50377739 / +0.3% 0.56 / 0.56 / -0.9%
tpcds_q41/datafusion:vortex-compact 18641738 / 18630548 / +0.1% 32453711 / 32673115 / -0.7% 0.57 / 0.57 / +0.7%
tpcds_q42/datafusion:vortex-compact 13038376 / 12537734 / +4.0% 33402935 / 32656958 / +2.3% 0.39 / 0.38 / +1.7%
tpcds_q43/datafusion:vortex-compact 16391078 / 16015544 / +2.3% 35723206 / 36261482 / -1.5% 0.46 / 0.44 / +3.9%
tpcds_q44/datafusion:vortex-compact 31243355 / 31607690 / -1.2% 53161400 / 53588129 / -0.8% 0.59 / 0.59 / -0.4%
tpcds_q45/datafusion:vortex-compact 30852464 / 30754244 / +0.3% 52503324 / 50381625 / +4.2% 0.59 / 0.61 / -3.7%
tpcds_q46/datafusion:vortex-compact 30435792 / 27888808 / +9.1% 54547770 / 55671308 / -2.0% 0.56 / 0.50 / +11.4%
tpcds_q47/datafusion:vortex-compact 90012031 / 88403784 / +1.8% 117398430 / 116995511 / +0.3% 0.77 / 0.76 / +1.5%
tpcds_q48/datafusion:vortex-compact 50690063 / 50069706 / +1.2% 69826859 / 69747082 / +0.1% 0.73 / 0.72 / +1.1%
tpcds_q49/datafusion:vortex-compact 66715040 / 64870050 / +2.8% 96455200 / 90009990 / +7.2% 0.69 / 0.72 / -4.0%
tpcds_q50/datafusion:vortex-compact 38164772 / 36610411 / +4.2% 57952998 / 58306667 / -0.6% 0.66 / 0.63 / +4.9%
tpcds_q51/datafusion:vortex-compact 64092287 / 63497051 / +0.9% 84333767 / 85762043 / -1.7% 0.76 / 0.74 / +2.6%
tpcds_q52/datafusion:vortex-compact 13258680 / 13411441 / -1.1% 34134443 / 34390564 / -0.7% 0.39 / 0.39 / -0.4%
tpcds_q53/datafusion:vortex-compact 22184758 / 23397096 / -5.2% 43292185 / 43046361 / +0.6% 0.51 / 0.54 / -5.7%
tpcds_q54/datafusion:vortex-compact 39728071 / 39906226 / -0.4% 67614193 / 65179842 / +3.7% 0.59 / 0.61 / -4.0%
tpcds_q55/datafusion:vortex-compact 12498668 / 13002103 / -3.9% 32550800 / 33577494 / -3.1% 0.38 / 0.39 / -0.8%
tpcds_q56/datafusion:vortex-compact 28622076 / 28632262 / -0.0% 51461544 / 53438507 / -3.7% 0.56 / 0.54 / +3.8%
tpcds_q57/datafusion:vortex-compact 80723990 / 81799544 / -1.3% 108643170 / 112526076 / -3.5% 0.74 / 0.73 / +2.2%
tpcds_q58/datafusion:vortex-compact 48071208 / 47795424 / +0.6% 72048607 / 75119482 / -4.1% 0.67 / 0.64 / +4.9%
tpcds_q59/datafusion:vortex-compact 41977113 / 41041244 / +2.3% 58302049 / 62248788 / -6.3% 0.72 / 0.66 / +9.2%
tpcds_q60/datafusion:vortex-compact 28677372 / 29674550 / -3.4% 55134905 / 50927663 / +8.3% 0.52 / 0.58 / -10.7%
tpcds_q61/datafusion:vortex-compact 28274030 / 28919788 / -2.2% 50131181 / 47971130 / +4.5% 0.56 / 0.60 / -6.4%
tpcds_q62/datafusion:vortex-compact 17790678 / 18071867 / -1.6% 36478944 / 37152523 / -1.8% 0.49 / 0.49 / +0.3%
tpcds_q63/datafusion:vortex-compact 22288388 / 22576618 / -1.3% 43190039 / 44365299 / -2.6% 0.52 / 0.51 / +1.4%
tpcds_q64/datafusion:vortex-compact 445750576 / 446618250 / -0.2% 454047639 / 467144713 / -2.8% 0.98 / 0.96 / +2.7%
tpcds_q65/datafusion:vortex-compact 80553625 / 80785744 / -0.3% 101493513 / 102289633 / -0.8% 0.79 / 0.79 / +0.5%
tpcds_q66/datafusion:vortex-compact 55076137 / 54861035 / +0.4% 78750035 / 78662894 / +0.1% 0.70 / 0.70 / +0.3%
tpcds_q67/datafusion:vortex-compact 60264513 / 59427764 / +1.4% 90411632 / 89466047 / +1.1% 0.67 / 0.66 / +0.3%
tpcds_q68/datafusion:vortex-compact 27695482 / 27730391 / -0.1% 51869665 / 56459855 / -8.1% 0.53 / 0.49 / +8.7%
tpcds_q69/datafusion:vortex-compact 37331525 / 36711388 / +1.7% 58651321 / 60301680 / -2.7% 0.64 / 0.61 / +4.6%
tpcds_q70/datafusion:vortex-compact 75234144 / 75680575 / -0.6% 94906693 / 96439754 / -1.6% 0.79 / 0.78 / +1.0%
tpcds_q71/datafusion:vortex-compact 20332192 / 21164203 / -3.9% 41625673 / 41331692 / +0.7% 0.49 / 0.51 / -4.6%
tpcds_q72/datafusion:vortex-compact 467534476 / 462248708 / +1.1% 498096113 / 509598662 / -2.3% 0.94 / 0.91 / +3.5%
tpcds_q73/datafusion:vortex-compact 23188772 / 22870962 / +1.4% 41621164 / 42750695 / -2.6% 0.56 / 0.53 / +4.1%
tpcds_q74/datafusion:vortex-compact 51643323 / 51287536 / +0.7% 77523984 / 75794886 / +2.3% 0.67 / 0.68 / -1.6%
tpcds_q75/datafusion:vortex-compact 134956537 / 143177924 / -5.7% 161171099 / 172385257 / -6.5% 0.84 / 0.83 / +0.8%
tpcds_q76/datafusion:vortex-compact 42559526 / 42051680 / +1.2% 67860556 / 66354254 / +2.3% 0.63 / 0.63 / -1.0%
tpcds_q77/datafusion:vortex-compact 37568929 / 38370480 / -2.1% 63456620 / 64018082 / -0.9% 0.59 / 0.60 / -1.2%
tpcds_q78/datafusion:vortex-compact 85868952 / 86376054 / -0.6% 114616423 / 114009250 / +0.5% 0.75 / 0.76 / -1.1%
tpcds_q79/datafusion:vortex-compact 25108386 / 27218952 / -7.8% 44439197 / 44517724 / -0.2% 0.57 / 0.61 / -7.6%
tpcds_q80/datafusion:vortex-compact 79625773 / 78620858 / +1.3% 111458333 / 110485880 / +0.9% 0.71 / 0.71 / +0.4%
tpcds_q81/datafusion:vortex-compact 30037010 / 30046922 / -0.0% 48067964 / 47467718 / +1.3% 0.62 / 0.63 / -1.3%
tpcds_q82/datafusion:vortex-compact 15737448 / 15870608 / -0.8% 39614082 / 42207990 / -6.1% 0.40 / 0.38 / +5.7%
tpcds_q83/datafusion:vortex-compact 37058256 / 37690732 / -1.7% 60590323 / 62359055 / -2.8% 0.61 / 0.60 / +1.2%
tpcds_q84/datafusion:vortex-compact 13172250 / 13057004 / +0.9% 29878617 / 30289348 / -1.4% 0.44 / 0.43 / +2.3%
tpcds_q85/datafusion:vortex-compact 103025978 / 103213218 / -0.2% 127957636 / 125987196 / +1.6% 0.81 / 0.82 / -1.7%
tpcds_q86/datafusion:vortex-compact 17282728 / 17236926 / +0.3% 35719861 / 36468911 / -2.1% 0.48 / 0.47 / +2.4%
tpcds_q87/datafusion:vortex-compact 33984652 / 33299592 / +2.1% 56009270 / 56468169 / -0.8% 0.61 / 0.59 / +2.9%
tpcds_q88/datafusion:vortex-compact 40648598 / 41157708 / -1.2% 75426566 / 67179406 / +12.3% 🔴 0.54 / 0.61 / -12.0%
tpcds_q89/datafusion:vortex-compact 25624760 / 25894412 / -1.0% 48459368 / 45142519 / +7.3% 0.53 / 0.57 / -7.8%
tpcds_q90/datafusion:vortex-compact 11244029 / 11597055 / -3.0% 28537880 / 28217386 / +1.1% 0.39 / 0.41 / -4.1%
tpcds_q91/datafusion:vortex-compact 27655446 / 26892844 / +2.8% 46184927 / 46498023 / -0.7% 0.60 / 0.58 / +3.5%
tpcds_q92/datafusion:vortex-compact 15462962 / 15731062 / -1.7% 34070322 / 34121021 / -0.1% 0.45 / 0.46 / -1.6%
tpcds_q93/datafusion:vortex-compact 24829370 / 26218219 / -5.3% 46347395 / 46933061 / -1.2% 0.54 / 0.56 / -4.1%
tpcds_q94/datafusion:vortex-compact 22483115 / 22603532 / -0.5% 41532747 / 42873690 / -3.1% 0.54 / 0.53 / +2.7%
tpcds_q95/datafusion:vortex-compact 50274902 / 49393736 / +1.8% 70913870 / 71059815 / -0.2% 0.71 / 0.70 / +2.0%
tpcds_q96/datafusion:vortex-compact 10454461 / 10196384 / +2.5% 27008686 / 26946399 / +0.2% 0.39 / 0.38 / +2.3%
tpcds_q97/datafusion:vortex-compact 25933988 / 24881811 / +4.2% 44720831 / 47269991 / -5.4% 0.58 / 0.53 / +10.2%
tpcds_q98/datafusion:vortex-compact 21784029 / 22257680 / -2.1% 43783727 / 44206155 / -1.0% 0.50 / 0.50 / -1.2%
tpcds_q99/datafusion:vortex-compact 20942126 / 21050170 / -0.5% 39914355 / 41290176 / -3.3% 0.52 / 0.51 / +2.9%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31212464 / 30411820 / +2.6% 50698013 / 50446059 / +0.5% 0.62 / 0.60 / +2.1%
tpcds_q02/datafusion:parquet 40125153 / 40017206 / +0.3% 58745321 / 57643249 / +1.9% 0.68 / 0.69 / -1.6%
tpcds_q03/datafusion:parquet 16291000 / 16492133 / -1.2% 30892693 / 31613087 / -2.3% 0.53 / 0.52 / +1.1%
tpcds_q04/datafusion:parquet 198820280 / 202023866 / -1.6% 227001896 / 227194960 / -0.1% 0.88 / 0.89 / -1.5%
tpcds_q05/datafusion:parquet 73863262 / 71781222 / +2.9% 96324886 / 95183796 / +1.2% 0.77 / 0.75 / +1.7%
tpcds_q06/datafusion:parquet 28087214 / 28206495 / -0.4% 51827813 / 50516714 / +2.6% 0.54 / 0.56 / -2.9%
tpcds_q07/datafusion:parquet 46851221 / 46581850 / +0.6% 66380019 / 69106460 / -3.9% 0.71 / 0.67 / +4.7%
tpcds_q08/datafusion:parquet 30352122 / 32267530 / -5.9% 49083022 / 51063536 / -3.9% 0.62 / 0.63 / -2.1%
tpcds_q09/datafusion:parquet 30071372 / 31475784 / -4.5% 38888225 / 45863196 / -15.2% 🟢 0.77 / 0.69 / +12.7%
tpcds_q10/datafusion:parquet 43000518 / 42180516 / +1.9% 62344497 / 63986311 / -2.6% 0.69 / 0.66 / +4.6%
tpcds_q11/datafusion:parquet 96312268 / 95493110 / +0.9% 122007892 / 122086422 / -0.1% 0.79 / 0.78 / +0.9%
tpcds_q12/datafusion:parquet 21729632 / 21533476 / +0.9% 36282686 / 37194908 / -2.5% 0.60 / 0.58 / +3.4%
tpcds_q13/datafusion:parquet 43020192 / 42433004 / +1.4% 69756968 / 67658074 / +3.1% 0.62 / 0.63 / -1.7%
tpcds_q14/datafusion:parquet 128110188 / 126604012 / +1.2% 151564891 / 153814134 / -1.5% 0.85 / 0.82 / +2.7%
tpcds_q15/datafusion:parquet 32844464 / 32687405 / +0.5% 51358520 / 51658043 / -0.6% 0.64 / 0.63 / +1.1%
tpcds_q16/datafusion:parquet 37114282 / 37025301 / +0.2% 54200702 / 55217751 / -1.8% 0.68 / 0.67 / +2.1%
tpcds_q17/datafusion:parquet 78535380 / 77139204 / +1.8% 104280104 / 108203760 / -3.6% 0.75 / 0.71 / +5.6%
tpcds_q18/datafusion:parquet 60377012 / 59616578 / +1.3% 78246101 / 81130048 / -3.6% 0.77 / 0.73 / +5.0%
tpcds_q19/datafusion:parquet 25665856 / 26366176 / -2.7% 46519052 / 47847762 / -2.8% 0.55 / 0.55 / +0.1%
tpcds_q20/datafusion:parquet 22403729 / 23069904 / -2.9% 37278205 / 37925976 / -1.7% 0.60 / 0.61 / -1.2%
tpcds_q21/datafusion:parquet 17790912 / 18083603 / -1.6% 33644889 / 34439337 / -2.3% 0.53 / 0.53 / +0.7%
tpcds_q22/datafusion:parquet 75185738 / 76042014 / -1.1% 90354561 / 92117444 / -1.9% 0.83 / 0.83 / +0.8%
tpcds_q23/datafusion:parquet 107382580 / 110164108 / -2.5% 136350696 / 136138048 / +0.2% 0.79 / 0.81 / -2.7%
tpcds_q24/datafusion:parquet 95424754 / 95077847 / +0.4% 124096740 / 125762009 / -1.3% 0.77 / 0.76 / +1.7%
tpcds_q25/datafusion:parquet 79170638 / 78749513 / +0.5% 104644668 / 106963345 / -2.2% 0.76 / 0.74 / +2.8%
tpcds_q26/datafusion:parquet 44502778 / 44505783 / -0.0% 64202534 / 63644906 / +0.9% 0.69 / 0.70 / -0.9%
tpcds_q27/datafusion:parquet 77889613 / 76068407 / +2.4% 102402401 / 100698958 / +1.7% 0.76 / 0.76 / +0.7%
tpcds_q28/datafusion:parquet 27258940 / 27575544 / -1.1% 44828867 / 47940816 / -6.5% 0.61 / 0.58 / +5.7%
tpcds_q29/datafusion:parquet 79233564 / 78926933 / +0.4% 106396509 / 105372875 / +1.0% 0.74 / 0.75 / -0.6%
tpcds_q30/datafusion:parquet 43794998 / 44643684 / -1.9% 65225305 / 64054913 / +1.8% 0.67 / 0.70 / -3.7%
tpcds_q31/datafusion:parquet 80352208 / 80448829 / -0.1% 104974682 / 104798026 / +0.2% 0.77 / 0.77 / -0.3%
tpcds_q32/datafusion:parquet 23735096 / 23675618 / +0.3% 40676465 / 41853277 / -2.8% 0.58 / 0.57 / +3.2%
tpcds_q33/datafusion:parquet 33094020 / 33125785 / -0.1% 50975226 / 52601858 / -3.1% 0.65 / 0.63 / +3.1%
tpcds_q34/datafusion:parquet 22799258 / 22579914 / +1.0% 38919588 / 38985334 / -0.2% 0.59 / 0.58 / +1.1%
tpcds_q35/datafusion:parquet 49576944 / 50313182 / -1.5% 71595617 / 69823963 / +2.5% 0.69 / 0.72 / -3.9%
tpcds_q36/datafusion:parquet 54095598 / 54256161 / -0.3% 75779022 / 74509762 / +1.7% 0.71 / 0.73 / -2.0%
tpcds_q37/datafusion:parquet 23318275 / 23126042 / +0.8% 37818284 / 39007147 / -3.0% 0.62 / 0.59 / +4.0%
tpcds_q38/datafusion:parquet 43971494 / 42854324 / +2.6% 64926365 / 64724443 / +0.3% 0.68 / 0.66 / +2.3%
tpcds_q39/datafusion:parquet 72057631 / 72585592 / -0.7% 89722818 / 91430472 / -1.9% 0.80 / 0.79 / +1.2%
tpcds_q40/datafusion:parquet 31208158 / 30822754 / +1.3% 50296722 / 49735871 / +1.1% 0.62 / 0.62 / +0.1%
tpcds_q41/datafusion:parquet 17526660 / 17470697 / +0.3% 29362591 / 29821194 / -1.5% 0.60 / 0.59 / +1.9%
tpcds_q42/datafusion:parquet 15349267 / 15721524 / -2.4% 29735442 / 30931349 / -3.9% 0.52 / 0.51 / +1.6%
tpcds_q43/datafusion:parquet 17592406 / 17688488 / -0.5% 32266266 / 33139490 / -2.6% 0.55 / 0.53 / +2.1%
tpcds_q44/datafusion:parquet 33424524 / 33382096 / +0.1% 51611085 / 53018988 / -2.7% 0.65 / 0.63 / +2.9%
tpcds_q45/datafusion:parquet 38020394 / 37592622 / +1.1% 55433287 / 55131246 / +0.5% 0.69 / 0.68 / +0.6%
tpcds_q46/datafusion:parquet 28725772 / 29502615 / -2.6% 49623679 / 50009770 / -0.8% 0.58 / 0.59 / -1.9%
tpcds_q47/datafusion:parquet 96554714 / 96073740 / +0.5% 123481016 / 124389021 / -0.7% 0.78 / 0.77 / +1.2%
tpcds_q48/datafusion:parquet 38926362 / 37951806 / +2.6% 59748869 / 59510979 / +0.4% 0.65 / 0.64 / +2.2%
tpcds_q49/datafusion:parquet 74907496 / 74701519 / +0.3% 101040740 / 101981243 / -0.9% 0.74 / 0.73 / +1.2%
tpcds_q50/datafusion:parquet 49432378 / 49945086 / -1.0% 72404513 / 71325347 / +1.5% 0.68 / 0.70 / -2.5%
tpcds_q51/datafusion:parquet 67049906 / 66861446 / +0.3% 90989875 / 91206109 / -0.2% 0.74 / 0.73 / +0.5%
tpcds_q52/datafusion:parquet 15887869 / 16119364 / -1.4% 30216662 / 30757196 / -1.8% 0.53 / 0.52 / +0.3%
tpcds_q53/datafusion:parquet 21535032 / 21680485 / -0.7% 40155662 / 40859873 / -1.7% 0.54 / 0.53 / +1.1%
tpcds_q54/datafusion:parquet 45251902 / 45718240 / -1.0% 68041419 / 66416971 / +2.4% 0.67 / 0.69 / -3.4%
tpcds_q55/datafusion:parquet 15540273 / 15384911 / +1.0% 29884718 / 31342427 / -4.7% 0.52 / 0.49 / +5.9%
tpcds_q56/datafusion:parquet 31846726 / 32056310 / -0.7% 53451772 / 55306958 / -3.4% 0.60 / 0.58 / +2.8%
tpcds_q57/datafusion:parquet 99386626 / 99222256 / +0.2% 120702187 / 122156070 / -1.2% 0.82 / 0.81 / +1.4%
tpcds_q58/datafusion:parquet 64410000 / 64446867 / -0.1% 86071973 / 87338754 / -1.5% 0.75 / 0.74 / +1.4%
tpcds_q59/datafusion:parquet 42855138 / 42634266 / +0.5% 63685997 / 63834257 / -0.2% 0.67 / 0.67 / +0.8%
tpcds_q60/datafusion:parquet 31198732 / 31072030 / +0.4% 53713696 / 54750179 / -1.9% 0.58 / 0.57 / +2.3%
tpcds_q61/datafusion:parquet 34035926 / 35041421 / -2.9% 57829491 / 57669703 / +0.3% 0.59 / 0.61 / -3.1%
tpcds_q62/datafusion:parquet 23833465 / 24138834 / -1.3% 38119065 / 38470214 / -0.9% 0.63 / 0.63 / -0.4%
tpcds_q63/datafusion:parquet 21996890 / 21694608 / +1.4% 39147137 / 39725884 / -1.5% 0.56 / 0.55 / +2.9%
tpcds_q64/datafusion:parquet 206575618 / 203453817 / +1.5% 232582920 / 240716448 / -3.4% 0.89 / 0.85 / +5.1%
tpcds_q65/datafusion:parquet 38873188 / 38492261 / +1.0% 60301695 / 59704922 / +1.0% 0.64 / 0.64 / -0.0%
tpcds_q66/datafusion:parquet 61797863 / 62294853 / -0.8% 79779496 / 80958236 / -1.5% 0.77 / 0.77 / +0.7%
tpcds_q67/datafusion:parquet 70324180 / 70460080 / -0.2% 96396951 / 96990661 / -0.6% 0.73 / 0.73 / +0.4%
tpcds_q68/datafusion:parquet 29462658 / 29357690 / +0.4% 50955981 / 50928264 / +0.1% 0.58 / 0.58 / +0.3%
tpcds_q69/datafusion:parquet 41063540 / 41328728 / -0.6% 61164743 / 58715118 / +4.2% 0.67 / 0.70 / -4.6%
tpcds_q70/datafusion:parquet 32866922 / 32869032 / -0.0% 56163298 / 54571712 / +2.9% 0.59 / 0.60 / -2.8%
tpcds_q71/datafusion:parquet 23317402 / 23998372 / -2.8% 39544294 / 40181339 / -1.6% 0.59 / 0.60 / -1.3%
tpcds_q72/datafusion:parquet 557942342 / 549011801 / +1.6% 589933100 / 578484836 / +2.0% 0.95 / 0.95 / -0.3%
tpcds_q73/datafusion:parquet 21853424 / 21476567 / +1.8% 38815814 / 38374946 / +1.1% 0.56 / 0.56 / +0.6%
tpcds_q74/datafusion:parquet 66637518 / 66031742 / +0.9% 86275058 / 87943372 / -1.9% 0.77 / 0.75 / +2.9%
tpcds_q75/datafusion:parquet 147484253 / 148463000 / -0.7% 180614408 / 181976717 / -0.7% 0.82 / 0.82 / +0.1%
tpcds_q76/datafusion:parquet 47612004 / 48226986 / -1.3% 65666910 / 68494456 / -4.1% 0.73 / 0.70 / +3.0%
tpcds_q77/datafusion:parquet 54100460 / 52584069 / +2.9% 75519999 / 74989313 / +0.7% 0.72 / 0.70 / +2.2%
tpcds_q78/datafusion:parquet 92809352 / 91348130 / +1.6% 128403648 / 124076938 / +3.5% 0.72 / 0.74 / -1.8%
tpcds_q79/datafusion:parquet 26239076 / 25505106 / +2.9% 45336635 / 45898906 / -1.2% 0.58 / 0.56 / +4.2%
tpcds_q80/datafusion:parquet 81787433 / 80796106 / +1.2% 112396522 / 111991974 / +0.4% 0.73 / 0.72 / +0.9%
tpcds_q81/datafusion:parquet 38820078 / 39526314 / -1.8% 58865460 / 62872076 / -6.4% 0.66 / 0.63 / +4.9%
tpcds_q82/datafusion:parquet 25160664 / 25458799 / -1.2% 42764365 / 40996340 / +4.3% 0.59 / 0.62 / -5.3%
tpcds_q83/datafusion:parquet 47610734 / 48192734 / -1.2% 68477823 / 67356411 / +1.7% 0.70 / 0.72 / -2.8%
tpcds_q84/datafusion:parquet 29008638 / 28970602 / +0.1% 48038347 / 47487161 / +1.2% 0.60 / 0.61 / -1.0%
tpcds_q85/datafusion:parquet 85800703 / 86501496 / -0.8% 111232202 / 111261730 / -0.0% 0.77 / 0.78 / -0.8%
tpcds_q86/datafusion:parquet 20669478 / 21160592 / -2.3% 33846746 / 34209030 / -1.1% 0.61 / 0.62 / -1.3%
tpcds_q87/datafusion:parquet 42703366 / 43009757 / -0.7% 62600882 / 61324741 / +2.1% 0.68 / 0.70 / -2.7%
tpcds_q88/datafusion:parquet 38507202 / 38680026 / -0.4% 62887903 / 62742384 / +0.2% 0.61 / 0.62 / -0.7%
tpcds_q89/datafusion:parquet 25199412 / 25211641 / -0.0% 43404334 / 43264201 / +0.3% 0.58 / 0.58 / -0.4%
tpcds_q90/datafusion:parquet 15656838 / 15872850 / -1.4% 30725300 / 31679250 / -3.0% 0.51 / 0.50 / +1.7%
tpcds_q91/datafusion:parquet 31955585 / 33033266 / -3.3% 50015425 / 51928669 / -3.7% 0.64 / 0.64 / +0.4%
tpcds_q92/datafusion:parquet 23319417 / 23634640 / -1.3% 41697849 / 42315343 / -1.5% 0.56 / 0.56 / +0.1%
tpcds_q93/datafusion:parquet 27898560 / 27499285 / +1.5% 46488201 / 48487718 / -4.1% 0.60 / 0.57 / +5.8%
tpcds_q94/datafusion:parquet 32244813 / 32137712 / +0.3% 48234015 / 50075642 / -3.7% 0.67 / 0.64 / +4.2%
tpcds_q95/datafusion:parquet 65789132 / 65350480 / +0.7% 79403429 / 81509012 / -2.6% 0.83 / 0.80 / +3.3%
tpcds_q96/datafusion:parquet 12871478 / 12927964 / -0.4% 28027912 / 28881212 / -3.0% 0.46 / 0.45 / +2.6%
tpcds_q97/datafusion:parquet 32146400 / 32352864 / -0.6% 52021813 / 51630752 / +0.8% 0.62 / 0.63 / -1.4%
tpcds_q98/datafusion:parquet 22778287 / 22663130 / +0.5% 38535364 / 39853067 / -3.3% 0.59 / 0.57 / +3.9%
tpcds_q99/datafusion:parquet 28224072 / 28647794 / -1.5% 43771436 / 41815502 / +4.7% 0.64 / 0.69 / -5.9%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15024402 / 14994968 / +0.2% 22805191 / 22067589 / +3.3% 0.66 / 0.68 / -3.0%
tpcds_q02/duckdb:vortex-file-compressed 15009774 / 14834742 / +1.2% 19142692 / 20514990 / -6.7% 0.78 / 0.72 / +8.4%
tpcds_q03/duckdb:vortex-file-compressed 11595510 / 11022106 / +5.2% 18850325 / 19855852 / -5.1% 0.62 / 0.56 / +10.8%
tpcds_q04/duckdb:vortex-file-compressed 50201470 / 49822464 / +0.8% 61193547 / 59147300 / +3.5% 0.82 / 0.84 / -2.6%
tpcds_q05/duckdb:vortex-file-compressed 19205461 / 18725924 / +2.6% 28068953 / 29400745 / -4.5% 0.68 / 0.64 / +7.4%
tpcds_q06/duckdb:vortex-file-compressed 26589432 / 26570526 / +0.1% 39251616 / 39437623 / -0.5% 0.68 / 0.67 / +0.5%
tpcds_q07/duckdb:vortex-file-compressed 15957143 / 15693188 / +1.7% 27874276 / 30534332 / -8.7% 0.57 / 0.51 / +11.4%
tpcds_q08/duckdb:vortex-file-compressed 18655784 / 18663126 / -0.0% 27669459 / 27460340 / +0.8% 0.67 / 0.68 / -0.8%
tpcds_q09/duckdb:vortex-file-compressed 14116835 / 14777214 / -4.5% 21151324 / 23012035 / -8.1% 0.67 / 0.64 / +3.9%
tpcds_q10/duckdb:vortex-file-compressed 27448522 / 27007039 / +1.6% 41766260 / 43336482 / -3.6% 0.66 / 0.62 / +5.5%
tpcds_q11/duckdb:vortex-file-compressed 39898714 / 40138613 / -0.6% 48744610 / 50470660 / -3.4% 0.82 / 0.80 / +2.9%
tpcds_q12/duckdb:vortex-file-compressed 10406768 / 11160127 / -6.8% 15773520 / 15746317 / +0.2% 0.66 / 0.71 / -6.9%
tpcds_q13/duckdb:vortex-file-compressed 20556948 / 20116660 / +2.2% 31907804 / 39351137 / -18.9% 🟢 0.64 / 0.51 / +26.0%
tpcds_q14/duckdb:vortex-file-compressed 57498124 / 57982654 / -0.8% 71552815 / 70351970 / +1.7% 0.80 / 0.82 / -2.5%
tpcds_q15/duckdb:vortex-file-compressed 20401668 / 20701622 / -1.4% 26634513 / 26579814 / +0.2% 0.77 / 0.78 / -1.7%
tpcds_q16/duckdb:vortex-file-compressed 18632846 / 17356498 / +7.4% 29687999 / 30704708 / -3.3% 0.63 / 0.57 / +11.0%
tpcds_q17/duckdb:vortex-file-compressed 29629936 / 29962303 / -1.1% 45755999 / 44375560 / +3.1% 0.65 / 0.68 / -4.1%
tpcds_q18/duckdb:vortex-file-compressed 28509794 / 28495024 / +0.1% 36677874 / 39150095 / -6.3% 0.78 / 0.73 / +6.8%
tpcds_q19/duckdb:vortex-file-compressed 24652976 / 23367532 / +5.5% 33532491 / 37559887 / -10.7% 🟢 0.74 / 0.62 / +18.2%
tpcds_q20/duckdb:vortex-file-compressed 10816470 / 10345434 / +4.6% 15560460 / 15011429 / +3.7% 0.70 / 0.69 / +0.9%
tpcds_q21/duckdb:vortex-file-compressed 11201109 / 11151324 / +0.4% 18814216 / 19198823 / -2.0% 0.60 / 0.58 / +2.5%
tpcds_q22/duckdb:vortex-file-compressed 29217034 / 28785698 / +1.5% 39624879 / 41274036 / -4.0% 0.74 / 0.70 / +5.7%
tpcds_q23/duckdb:vortex-file-compressed 36893202 / 37724274 / -2.2% 46924655 / 59017272 / -20.5% 🟢 0.79 / 0.64 / +23.0%
tpcds_q24/duckdb:vortex-file-compressed 27697338 / 27985084 / -1.0% 44285384 / 40469952 / +9.4% 0.63 / 0.69 / -9.6%
tpcds_q25/duckdb:vortex-file-compressed 25379012 / 25183532 / +0.8% 39838788 / 42100247 / -5.4% 0.64 / 0.60 / +6.5%
tpcds_q26/duckdb:vortex-file-compressed 13348033 / 13278497 / +0.5% 20056507 / 21891856 / -8.4% 0.67 / 0.61 / +9.7%
tpcds_q27/duckdb:vortex-file-compressed 17270490 / 17449591 / -1.0% 30279105 / 31805591 / -4.8% 0.57 / 0.55 / +4.0%
tpcds_q28/duckdb:vortex-file-compressed 12698690 / 12424690 / +2.2% 21500656 / 22297638 / -3.6% 0.59 / 0.56 / +6.0%
tpcds_q29/duckdb:vortex-file-compressed 28695888 / 28036034 / +2.4% 42306481 / 42634156 / -0.8% 0.68 / 0.66 / +3.1%
tpcds_q30/duckdb:vortex-file-compressed 19189924 / 18957455 / +1.2% 26851323 / 27795630 / -3.4% 0.71 / 0.68 / +4.8%
tpcds_q31/duckdb:vortex-file-compressed 19009230 / 19007728 / +0.0% 25176065 / 31014589 / -18.8% 🟢 0.76 / 0.61 / +23.2%
tpcds_q32/duckdb:vortex-file-compressed 9784258 / 9877374 / -0.9% 16622601 / 15584885 / +6.7% 0.59 / 0.63 / -7.1%
tpcds_q33/duckdb:vortex-file-compressed 16919308 / 16597778 / +1.9% 28144019 / 27875934 / +1.0% 0.60 / 0.60 / +1.0%
tpcds_q34/duckdb:vortex-file-compressed 15434344 / 15124756 / +2.0% 20614251 / 21583303 / -4.5% 0.75 / 0.70 / +6.8%
tpcds_q35/duckdb:vortex-file-compressed 45765138 / 45616314 / +0.3% 59245717 / 59629367 / -0.6% 0.77 / 0.76 / +1.0%
tpcds_q36/duckdb:vortex-file-compressed 15054759 / 14433429 / +4.3% 26109882 / 30044078 / -13.1% 🟢 0.58 / 0.48 / +20.0%
tpcds_q37/duckdb:vortex-file-compressed 13865182 / 13965168 / -0.7% 25588283 / 22708252 / +12.7% 🔴 0.54 / 0.61 / -11.9%
tpcds_q38/duckdb:vortex-file-compressed 21927518 / 22072791 / -0.7% 27733317 / 28148452 / -1.5% 0.79 / 0.78 / +0.8%
tpcds_q39/duckdb:vortex-file-compressed 18421068 / 18086912 / +1.8% 26639601 / 26216481 / +1.6% 0.69 / 0.69 / +0.2%
tpcds_q40/duckdb:vortex-file-compressed 13187075 / 13057726 / +1.0% 21511880 / 20726620 / +3.8% 0.61 / 0.63 / -2.7%
tpcds_q41/duckdb:vortex-file-compressed 6355110 / 6332431 / +0.4% 8990274 / 8975245 / +0.2% 0.71 / 0.71 / +0.2%
tpcds_q42/duckdb:vortex-file-compressed 10619015 / 8141196 / +30.4% 🔴 16394430 / 17431684 / -6.0% 0.65 / 0.47 / +38.7%
tpcds_q43/duckdb:vortex-file-compressed 10722609 / 9947421 / +7.8% 18496751 / 18918408 / -2.2% 0.58 / 0.53 / +10.3%
tpcds_q44/duckdb:vortex-file-compressed 15311646 / 15383430 / -0.5% 26878164 / 27839348 / -3.5% 0.57 / 0.55 / +3.1%
tpcds_q45/duckdb:vortex-file-compressed 21872534 / 22311028 / -2.0% 30923920 / 28551075 / +8.3% 0.71 / 0.78 / -9.5%
tpcds_q46/duckdb:vortex-file-compressed 18549124 / 18065277 / +2.7% 28418842 / 29711118 / -4.3% 0.65 / 0.61 / +7.3%
tpcds_q47/duckdb:vortex-file-compressed 30779521 / 30220310 / +1.9% 41115860 / 42594368 / -3.5% 0.75 / 0.71 / +5.5%
tpcds_q48/duckdb:vortex-file-compressed 19894530 / 19340481 / +2.9% 34155423 / 31039767 / +10.0% 🔴 0.58 / 0.62 / -6.5%
tpcds_q49/duckdb:vortex-file-compressed 16473387 / 16454308 / +0.1% 28033479 / 30203567 / -7.2% 0.59 / 0.54 / +7.9%
tpcds_q50/duckdb:vortex-file-compressed 16531058 / 16495366 / +0.2% 25410929 / 28153357 / -9.7% 0.65 / 0.59 / +11.0%
tpcds_q51/duckdb:vortex-file-compressed 76612910 / 76588225 / +0.0% 59081901 / 59702074 / -1.0% 1.30 / 1.28 / +1.1%
tpcds_q52/duckdb:vortex-file-compressed 8178494 / 8360134 / -2.2% 16898423 / 17529033 / -3.6% 0.48 / 0.48 / +1.5%
tpcds_q53/duckdb:vortex-file-compressed 14338876 / 13645116 / +5.1% 23694393 / 24620310 / -3.8% 0.61 / 0.55 / +9.2%
tpcds_q54/duckdb:vortex-file-compressed 20185832 / 20222926 / -0.2% 29081366 / 32253025 / -9.8% 0.69 / 0.63 / +10.7%
tpcds_q55/duckdb:vortex-file-compressed 8777673 / 8673874 / +1.2% 17639873 / 18101966 / -2.6% 0.50 / 0.48 / +3.8%
tpcds_q56/duckdb:vortex-file-compressed 16895611 / 16949548 / -0.3% 27849177 / 29653043 / -6.1% 0.61 / 0.57 / +6.1%
tpcds_q57/duckdb:vortex-file-compressed 23709848 / 23861679 / -0.6% 32183315 / 33067703 / -2.7% 0.74 / 0.72 / +2.1%
tpcds_q58/duckdb:vortex-file-compressed 17527814 / 17779214 / -1.4% 26430064 / 29252463 / -9.6% 0.66 / 0.61 / +9.1%
tpcds_q59/duckdb:vortex-file-compressed 18782408 / 18377841 / +2.2% 23645399 / 24321459 / -2.8% 0.79 / 0.76 / +5.1%
tpcds_q60/duckdb:vortex-file-compressed 17924454 / 17933171 / -0.0% 32439063 / 30763349 / +5.4% 0.55 / 0.58 / -5.2%
tpcds_q61/duckdb:vortex-file-compressed 19637469 / 18630510 / +5.4% 31134500 / 31128182 / +0.0% 0.63 / 0.60 / +5.4%
tpcds_q62/duckdb:vortex-file-compressed 10036268 / 10110565 / -0.7% 15987305 / 17138869 / -6.7% 0.63 / 0.59 / +6.4%
tpcds_q63/duckdb:vortex-file-compressed 13306434 / 14582078 / -8.7% 21956071 / 23396810 / -6.2% 0.61 / 0.62 / -2.8%
tpcds_q64/duckdb:vortex-file-compressed 61919630 / 62417984 / -0.8% 78426490 / 80895255 / -3.1% 0.79 / 0.77 / +2.3%
tpcds_q65/duckdb:vortex-file-compressed 15313844 / 15069068 / +1.6% 29671802 / 26855062 / +10.5% 🔴 0.52 / 0.56 / -8.0%
tpcds_q66/duckdb:vortex-file-compressed 20608460 / 20666600 / -0.3% 35351172 / 31506217 / +12.2% 🔴 0.58 / 0.66 / -11.1%
tpcds_q67/duckdb:vortex-file-compressed 64222061 / 64938215 / -1.1% 81016663 / 94322843 / -14.1% 🟢 0.79 / 0.69 / +15.1%
tpcds_q68/duckdb:vortex-file-compressed 18203340 / 18032180 / +0.9% 28997125 / 31046317 / -6.6% 0.63 / 0.58 / +8.1%
tpcds_q69/duckdb:vortex-file-compressed 28110660 / 29610930 / -5.1% 44774760 / 41609499 / +7.6% 0.63 / 0.71 / -11.8%
tpcds_q70/duckdb:vortex-file-compressed 18049490 / 19388344 / -6.9% 28897971 / 30501903 / -5.3% 0.62 / 0.64 / -1.7%
tpcds_q71/duckdb:vortex-file-compressed 12673702 / 12520948 / +1.2% 21803618 / 27760193 / -21.5% 🟢 0.58 / 0.45 / +28.9%
tpcds_q72/duckdb:vortex-file-compressed 61823678 / 62397930 / -0.9% 75466040 / 76346708 / -1.2% 0.82 / 0.82 / +0.2%
tpcds_q73/duckdb:vortex-file-compressed 14670983 / 14866158 / -1.3% 23518987 / 22061111 / +6.6% 0.62 / 0.67 / -7.4%
tpcds_q74/duckdb:vortex-file-compressed 27203185 / 27331010 / -0.5% 37789808 / 37765117 / +0.1% 0.72 / 0.72 / -0.5%
tpcds_q75/duckdb:vortex-file-compressed 27961666 / 28462636 / -1.8% 41158206 / 44634252 / -7.8% 0.68 / 0.64 / +6.5%
tpcds_q76/duckdb:vortex-file-compressed 12348174 / 12313774 / +0.3% 22549975 / 26907772 / -16.2% 🟢 0.55 / 0.46 / +19.7%
tpcds_q77/duckdb:vortex-file-compressed 15977325 / 16023753 / -0.3% 23948749 / 25801217 / -7.2% 0.67 / 0.62 / +7.4%
tpcds_q78/duckdb:vortex-file-compressed 37433060 / 36910706 / +1.4% 45560114 / 46226252 / -1.4% 0.82 / 0.80 / +2.9%
tpcds_q79/duckdb:vortex-file-compressed 14196086 / 14827284 / -4.3% 24829472 / 29970424 / -17.2% 🟢 0.57 / 0.49 / +15.6%
tpcds_q80/duckdb:vortex-file-compressed 27483212 / 27838510 / -1.3% 44522054 / 43691417 / +1.9% 0.62 / 0.64 / -3.1%
tpcds_q81/duckdb:vortex-file-compressed 22386615 / 22034214 / +1.6% 30122216 / 31751500 / -5.1% 0.74 / 0.69 / +7.1%
tpcds_q82/duckdb:vortex-file-compressed 31924958 / 31766192 / +0.5% 43388345 / 39792927 / +9.0% 0.74 / 0.80 / -7.8%
tpcds_q83/duckdb:vortex-file-compressed 19677068 / 19125816 / +2.9% 25757730 / 25139010 / +2.5% 0.76 / 0.76 / +0.4%
tpcds_q84/duckdb:vortex-file-compressed 12708147 / 12803546 / -0.7% 18345541 / 19604280 / -6.4% 0.69 / 0.65 / +6.1%
tpcds_q85/duckdb:vortex-file-compressed 30713416 / 31016668 / -1.0% 39314977 / 39507262 / -0.5% 0.78 / 0.79 / -0.5%
tpcds_q86/duckdb:vortex-file-compressed 10647429 / 10820662 / -1.6% 17068967 / 17168108 / -0.6% 0.62 / 0.63 / -1.0%
tpcds_q87/duckdb:vortex-file-compressed 23786010 / 24031931 / -1.0% 30504941 / 30916709 / -1.3% 0.78 / 0.78 / +0.3%
tpcds_q88/duckdb:vortex-file-compressed 31933748 / 31492128 / +1.4% 47119705 / 43705468 / +7.8% 0.68 / 0.72 / -5.9%
tpcds_q89/duckdb:vortex-file-compressed 13614686 / 14301330 / -4.8% 23305151 / 24791802 / -6.0% 0.58 / 0.58 / +1.3%
tpcds_q90/duckdb:vortex-file-compressed 8256951 / 8116902 / +1.7% 12416069 / 12204978 / +1.7% 0.67 / 0.67 / -0.0%
tpcds_q91/duckdb:vortex-file-compressed 15068714 / 15449568 / -2.5% 22128647 / 22264332 / -0.6% 0.68 / 0.69 / -1.9%
tpcds_q92/duckdb:vortex-file-compressed 14366590 / 12876964 / +11.6% 🔴 19965787 / 20184777 / -1.1% 0.72 / 0.64 / +12.8%
tpcds_q93/duckdb:vortex-file-compressed 17337306 / 17314540 / +0.1% 24923406 / 25967180 / -4.0% 0.70 / 0.67 / +4.3%
tpcds_q94/duckdb:vortex-file-compressed 16044442 / 15926156 / +0.7% 25664292 / 25825685 / -0.6% 0.63 / 0.62 / +1.4%
tpcds_q95/duckdb:vortex-file-compressed 43733821 / 44545190 / -1.8% 54104764 / 53443176 / +1.2% 0.81 / 0.83 / -3.0%
tpcds_q96/duckdb:vortex-file-compressed 7021696 / 7116159 / -1.3% 17162895 / 14951770 / +14.8% 🔴 0.41 / 0.48 / -14.0%
tpcds_q97/duckdb:vortex-file-compressed 22308341 / 22014986 / +1.3% 28022282 / 34868147 / -19.6% 🟢 0.80 / 0.63 / +26.1%
tpcds_q98/duckdb:vortex-file-compressed 13632620 / 14306396 / -4.7% 23397675 / 21944858 / +6.6% 0.58 / 0.65 / -10.6%
tpcds_q99/duckdb:vortex-file-compressed 13231252 / 13162209 / +0.5% 19356499 / 19003822 / +1.9% 0.68 / 0.69 / -1.3%
duckdb / vortex-compact / ns (0.998x ➖, 4↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16400886 / 16285480 / +0.7% 23528810 / 23408788 / +0.5% 0.70 / 0.70 / +0.2%
tpcds_q02/duckdb:vortex-compact 15970107 / 16254405 / -1.7% 21436295 / 21439188 / -0.0% 0.75 / 0.76 / -1.7%
tpcds_q03/duckdb:vortex-compact 21941450 / 21764545 / +0.8% 29185899 / 29947658 / -2.5% 0.75 / 0.73 / +3.4%
tpcds_q04/duckdb:vortex-compact 54638998 / 54424490 / +0.4% 64308042 / 66653538 / -3.5% 0.85 / 0.82 / +4.1%
tpcds_q05/duckdb:vortex-compact 22901236 / 24050021 / -4.8% 33192822 / 33637635 / -1.3% 0.69 / 0.71 / -3.5%
tpcds_q06/duckdb:vortex-compact 33328368 / 33193298 / +0.4% 43381442 / 44659893 / -2.9% 0.77 / 0.74 / +3.4%
tpcds_q07/duckdb:vortex-compact 24942137 / 28689749 / -13.1% 🟢 33728261 / 36275083 / -7.0% 0.74 / 0.79 / -6.5%
tpcds_q08/duckdb:vortex-compact 48704620 / 48829342 / -0.3% 56626655 / 59384772 / -4.6% 0.86 / 0.82 / +4.6%
tpcds_q09/duckdb:vortex-compact 18935032 / 18993684 / -0.3% 28110784 / 26213859 / +7.2% 0.67 / 0.72 / -7.0%
tpcds_q10/duckdb:vortex-compact 45251270 / 45377600 / -0.3% 56820064 / 63774932 / -10.9% 🟢 0.80 / 0.71 / +11.9%
tpcds_q11/duckdb:vortex-compact 46066964 / 44825362 / +2.8% 54935945 / 55887339 / -1.7% 0.84 / 0.80 / +4.5%
tpcds_q12/duckdb:vortex-compact 13485106 / 13271550 / +1.6% 19275900 / 19168669 / +0.6% 0.70 / 0.69 / +1.0%
tpcds_q13/duckdb:vortex-compact 35983784 / 37462038 / -3.9% 48327856 / 54398204 / -11.2% 🟢 0.74 / 0.69 / +8.1%
tpcds_q14/duckdb:vortex-compact 67846872 / 66501706 / +2.0% 78193323 / 80587585 / -3.0% 0.87 / 0.83 / +5.1%
tpcds_q15/duckdb:vortex-compact 26207928 / 26209264 / -0.0% 30908481 / 31621250 / -2.3% 0.85 / 0.83 / +2.3%
tpcds_q16/duckdb:vortex-compact 24746122 / 26048954 / -5.0% 35783862 / 35312437 / +1.3% 0.69 / 0.74 / -6.3%
tpcds_q17/duckdb:vortex-compact 45256852 / 44582492 / +1.5% 57794459 / 57273026 / +0.9% 0.78 / 0.78 / +0.6%
tpcds_q18/duckdb:vortex-compact 35355166 / 36076534 / -2.0% 43119807 / 44860829 / -3.9% 0.82 / 0.80 / +2.0%
tpcds_q19/duckdb:vortex-compact 36346400 / 35504450 / +2.4% 43576920 / 47571990 / -8.4% 0.83 / 0.75 / +11.8%
tpcds_q20/duckdb:vortex-compact 14074204 / 13800312 / +2.0% 19848720 / 19393988 / +2.3% 0.71 / 0.71 / -0.4%
tpcds_q21/duckdb:vortex-compact 12175216 / 10768016 / +13.1% 🔴 18505654 / 18283065 / +1.2% 0.66 / 0.59 / +11.7%
tpcds_q22/duckdb:vortex-compact 30197614 / 30527968 / -1.1% 40457649 / 41189414 / -1.8% 0.75 / 0.74 / +0.7%
tpcds_q23/duckdb:vortex-compact 43573286 / 41969412 / +3.8% 55635064 / 60579274 / -8.2% 0.78 / 0.69 / +13.0%
tpcds_q24/duckdb:vortex-compact 39538984 / 39321294 / +0.6% 47545933 / 48267999 / -1.5% 0.83 / 0.81 / +2.1%
tpcds_q25/duckdb:vortex-compact 42673643 / 43260757 / -1.4% 55883009 / 54257797 / +3.0% 0.76 / 0.80 / -4.2%
tpcds_q26/duckdb:vortex-compact 22158285 / 22114820 / +0.2% 27785762 / 28157987 / -1.3% 0.80 / 0.79 / +1.5%
tpcds_q27/duckdb:vortex-compact 29351120 / 30157950 / -2.7% 36636755 / 37625682 / -2.6% 0.80 / 0.80 / -0.0%
tpcds_q28/duckdb:vortex-compact 21657278 / 22257658 / -2.7% 32814024 / 30542396 / +7.4% 0.66 / 0.73 / -9.4%
tpcds_q29/duckdb:vortex-compact 44314864 / 43887918 / +1.0% 56609192 / 56952528 / -0.6% 0.78 / 0.77 / +1.6%
tpcds_q30/duckdb:vortex-compact 22373570 / 22257256 / +0.5% 31753421 / 30733450 / +3.3% 0.70 / 0.72 / -2.7%
tpcds_q31/duckdb:vortex-compact 23497222 / 23520580 / -0.1% 30750302 / 31033326 / -0.9% 0.76 / 0.76 / +0.8%
tpcds_q32/duckdb:vortex-compact 14039530 / 14201930 / -1.1% 20289924 / 20372396 / -0.4% 0.69 / 0.70 / -0.7%
tpcds_q33/duckdb:vortex-compact 23528792 / 22915512 / +2.7% 33503924 / 36534641 / -8.3% 0.70 / 0.63 / +12.0%
tpcds_q34/duckdb:vortex-compact 22024236 / 21830715 / +0.9% 29288069 / 29001606 / +1.0% 0.75 / 0.75 / -0.1%
tpcds_q35/duckdb:vortex-compact 62009866 / 61936183 / +0.1% 74336581 / 75775798 / -1.9% 0.83 / 0.82 / +2.1%
tpcds_q36/duckdb:vortex-compact 22125992 / 21995644 / +0.6% 30842404 / 32221361 / -4.3% 0.72 / 0.68 / +5.1%
tpcds_q37/duckdb:vortex-compact 15445614 / 15041078 / +2.7% 24614200 / 26540848 / -7.3% 0.63 / 0.57 / +10.7%
tpcds_q38/duckdb:vortex-compact 26163951 / 26045323 / +0.5% 32920761 / 33589083 / -2.0% 0.79 / 0.78 / +2.5%
tpcds_q39/duckdb:vortex-compact 19745915 / 19622572 / +0.6% 29203282 / 27763410 / +5.2% 0.68 / 0.71 / -4.3%
tpcds_q40/duckdb:vortex-compact 16072288 / 15816448 / +1.6% 24137019 / 23464342 / +2.9% 0.67 / 0.67 / -1.2%
tpcds_q41/duckdb:vortex-compact 7469722 / 7555102 / -1.1% 10562257 / 10378245 / +1.8% 0.71 / 0.73 / -2.9%
tpcds_q42/duckdb:vortex-compact 11954520 / 14204918 / -15.8% 🟢 19826541 / 22712569 / -12.7% 🟢 0.60 / 0.63 / -3.6%
tpcds_q43/duckdb:vortex-compact 16303357 / 16167824 / +0.8% 24355492 / 23399074 / +4.1% 0.67 / 0.69 / -3.1%
tpcds_q44/duckdb:vortex-compact 21861574 / 22905984 / -4.6% 32694667 / 36349758 / -10.1% 🟢 0.67 / 0.63 / +6.1%
tpcds_q45/duckdb:vortex-compact 27159482 / 27173497 / -0.1% 33093578 / 32874549 / +0.7% 0.82 / 0.83 / -0.7%
tpcds_q46/duckdb:vortex-compact 29261760 / 29048694 / +0.7% 38468475 / 38078554 / +1.0% 0.76 / 0.76 / -0.3%
tpcds_q47/duckdb:vortex-compact 36020314 / 36755684 / -2.0% 44208592 / 47651852 / -7.2% 0.81 / 0.77 / +5.6%
tpcds_q48/duckdb:vortex-compact 33963986 / 33107429 / +2.6% 41638529 / 43124606 / -3.4% 0.82 / 0.77 / +6.2%
tpcds_q49/duckdb:vortex-compact 23982960 / 23387649 / +2.5% 39265399 / 41080285 / -4.4% 0.61 / 0.57 / +7.3%
tpcds_q50/duckdb:vortex-compact 26985794 / 26866368 / +0.4% 35295961 / 36125399 / -2.3% 0.76 / 0.74 / +2.8%
tpcds_q51/duckdb:vortex-compact 53361761 / 53265650 / +0.2% 66593553 / 61015909 / +9.1% 0.80 / 0.87 / -8.2%
tpcds_q52/duckdb:vortex-compact 12094198 / 12097058 / -0.0% 22835443 / 20628087 / +10.7% 🔴 0.53 / 0.59 / -9.7%
tpcds_q53/duckdb:vortex-compact 21414318 / 22054100 / -2.9% 28549642 / 29807867 / -4.2% 0.75 / 0.74 / +1.4%
tpcds_q54/duckdb:vortex-compact 26853228 / 27825176 / -3.5% 34672863 / 36499147 / -5.0% 0.77 / 0.76 / +1.6%
tpcds_q55/duckdb:vortex-compact 12807120 / 14665773 / -12.7% 🟢 23834178 / 23548628 / +1.2% 0.54 / 0.62 / -13.7%
tpcds_q56/duckdb:vortex-compact 23941510 / 23720593 / +0.9% 35351722 / 34913135 / +1.3% 0.68 / 0.68 / -0.3%
tpcds_q57/duckdb:vortex-compact 27473904 / 27657556 / -0.7% 36234402 / 35202676 / +2.9% 0.76 / 0.79 / -3.5%
tpcds_q58/duckdb:vortex-compact 24355664 / 23650450 / +3.0% 36006285 / 33364749 / +7.9% 0.68 / 0.71 / -4.6%
tpcds_q59/duckdb:vortex-compact 22968040 / 23283402 / -1.4% 29079150 / 32519304 / -10.6% 🟢 0.79 / 0.72 / +10.3%
tpcds_q60/duckdb:vortex-compact 24047460 / 24844090 / -3.2% 35390173 / 36147574 / -2.1% 0.68 / 0.69 / -1.1%
tpcds_q61/duckdb:vortex-compact 31862256 / 31173882 / +2.2% 46921160 / 42998668 / +9.1% 0.68 / 0.72 / -6.3%
tpcds_q62/duckdb:vortex-compact 11718344 / 11696926 / +0.2% 19529179 / 18034147 / +8.3% 0.60 / 0.65 / -7.5%
tpcds_q63/duckdb:vortex-compact 22859382 / 20952061 / +9.1% 34563078 / 27972770 / +23.6% 🔴 0.66 / 0.75 / -11.7%
tpcds_q64/duckdb:vortex-compact 84042715 / 85548384 / -1.8% 98378978 / 97835569 / +0.6% 0.85 / 0.87 / -2.3%
tpcds_q65/duckdb:vortex-compact 19977299 / 19831204 / +0.7% 32255100 / 35152931 / -8.2% 0.62 / 0.56 / +9.8%
tpcds_q66/duckdb:vortex-compact 25366994 / 25270167 / +0.4% 36278220 / 33664164 / +7.8% 0.70 / 0.75 / -6.9%
tpcds_q67/duckdb:vortex-compact 71625326 / 71955025 / -0.5% 83128623 / 85653219 / -2.9% 0.86 / 0.84 / +2.6%
tpcds_q68/duckdb:vortex-compact 28853720 / 28960873 / -0.4% 38385278 / 46388121 / -17.3% 🟢 0.75 / 0.62 / +20.4%
tpcds_q69/duckdb:vortex-compact 46011886 / 46223803 / -0.5% 59091787 / 60205394 / -1.8% 0.78 / 0.77 / +1.4%
tpcds_q70/duckdb:vortex-compact 31424644 / 30777054 / +2.1% 38997594 / 39492425 / -1.3% 0.81 / 0.78 / +3.4%
tpcds_q71/duckdb:vortex-compact 20789388 / 19454142 / +6.9% 27242913 / 32463712 / -16.1% 🟢 0.76 / 0.60 / +27.3%
tpcds_q72/duckdb:vortex-compact 69280080 / 68846746 / +0.6% 81255233 / 83284698 / -2.4% 0.85 / 0.83 / +3.1%
tpcds_q73/duckdb:vortex-compact 21405140 / 21299162 / +0.5% 31792280 / 29032508 / +9.5% 0.67 / 0.73 / -8.2%
tpcds_q74/duckdb:vortex-compact 32272306 / 31896163 / +1.2% 39399186 / 43324044 / -9.1% 0.82 / 0.74 / +11.3%
tpcds_q75/duckdb:vortex-compact 33551808 / 32718030 / +2.5% 43816964 / 46408002 / -5.6% 0.77 / 0.71 / +8.6%
tpcds_q76/duckdb:vortex-compact 16554952 / 18428670 / -10.2% 🟢 25911404 / 29201639 / -11.3% 🟢 0.64 / 0.63 / +1.2%
tpcds_q77/duckdb:vortex-compact 22891884 / 22395466 / +2.2% 30757737 / 32047894 / -4.0% 0.74 / 0.70 / +6.5%
tpcds_q78/duckdb:vortex-compact 41649293 / 41494202 / +0.4% 51385635 / 49326994 / +4.2% 0.81 / 0.84 / -3.6%
tpcds_q79/duckdb:vortex-compact 37571350 / 37539298 / +0.1% 49544961 / 52197999 / -5.1% 0.76 / 0.72 / +5.4%
tpcds_q80/duckdb:vortex-compact 36449223 / 36490738 / -0.1% 47945874 / 52411563 / -8.5% 0.76 / 0.70 / +9.2%
tpcds_q81/duckdb:vortex-compact 24965050 / 24313798 / +2.7% 35204420 / 34649560 / +1.6% 0.71 / 0.70 / +1.1%
tpcds_q82/duckdb:vortex-compact 36166490 / 35317957 / +2.4% 51133513 / 42662791 / +19.9% 🔴 0.71 / 0.83 / -14.6%
tpcds_q83/duckdb:vortex-compact 29244071 / 28985766 / +0.9% 32962197 / 33550026 / -1.8% 0.89 / 0.86 / +2.7%
tpcds_q84/duckdb:vortex-compact 14415921 / 14626210 / -1.4% 23720893 / 20623297 / +15.0% 🔴 0.61 / 0.71 / -14.3%
tpcds_q85/duckdb:vortex-compact 41253100 / 41418700 / -0.4% 49689911 / 51014008 / -2.6% 0.83 / 0.81 / +2.3%
tpcds_q86/duckdb:vortex-compact 12141394 / 12312296 / -1.4% 19673180 / 19886974 / -1.1% 0.62 / 0.62 / -0.3%
tpcds_q87/duckdb:vortex-compact 27568243 / 27922684 / -1.3% 34723382 / 34324330 / +1.2% 0.79 / 0.81 / -2.4%
tpcds_q88/duckdb:vortex-compact 67139894 / 68046374 / -1.3% 76240058 / 80986550 / -5.9% 0.88 / 0.84 / +4.8%
tpcds_q89/duckdb:vortex-compact 21733518 / 20603683 / +5.5% 31008480 / 31522071 / -1.6% 0.70 / 0.65 / +7.2%
tpcds_q90/duckdb:vortex-compact 12812129 / 12355470 / +3.7% 19236314 / 18220761 / +5.6% 0.67 / 0.68 / -1.8%
tpcds_q91/duckdb:vortex-compact 29926484 / 30223403 / -1.0% 37107233 / 49207499 / -24.6% 🟢 0.81 / 0.61 / +31.3%
tpcds_q92/duckdb:vortex-compact 20233978 / 20380072 / -0.7% 28209456 / 31149462 / -9.4% 0.72 / 0.65 / +9.6%
tpcds_q93/duckdb:vortex-compact 19190960 / 19986181 / -4.0% 25686935 / 25602196 / +0.3% 0.75 / 0.78 / -4.3%
tpcds_q94/duckdb:vortex-compact 21764694 / 21885304 / -0.6% 30720172 / 31026295 / -1.0% 0.71 / 0.71 / +0.4%
tpcds_q95/duckdb:vortex-compact 46828944 / 45460909 / +3.0% 54044601 / 55449289 / -2.5% 0.87 / 0.82 / +5.7%
tpcds_q96/duckdb:vortex-compact 16970708 / 16879994 / +0.5% 23674994 / 27772570 / -14.8% 🟢 0.72 / 0.61 / +17.9%
tpcds_q97/duckdb:vortex-compact 25127326 / 25292228 / -0.7% 36964613 / 33792013 / +9.4% 0.68 / 0.75 / -9.2%
tpcds_q98/duckdb:vortex-compact 18346904 / 18244211 / +0.6% 29056993 / 28222816 / +3.0% 0.63 / 0.65 / -2.3%
tpcds_q99/duckdb:vortex-compact 16863260 / 16891288 / -0.2% 22382859 / 21703824 / +3.1% 0.75 / 0.78 / -3.2%
duckdb / parquet / ns (0.994x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24901906 / 27784220 / -10.4% 🟢 32594724 / 34324630 / -5.0% 0.76 / 0.81 / -5.6%
tpcds_q02/duckdb:parquet 15501411 / 15620530 / -0.8% 20045052 / 22184868 / -9.6% 0.77 / 0.70 / +9.8%
tpcds_q03/duckdb:parquet 9081996 / 9188179 / -1.2% 15805868 / 16925693 / -6.6% 0.57 / 0.54 / +5.8%
tpcds_q04/duckdb:parquet 129608688 / 129199480 / +0.3% 134411463 / 135928307 / -1.1% 0.96 / 0.95 / +1.4%
tpcds_q05/duckdb:parquet 22017002 / 22978357 / -4.2% 29077619 / 26050926 / +11.6% 🔴 0.76 / 0.88 / -14.2%
tpcds_q06/duckdb:parquet 27110087 / 27628545 / -1.9% 37000284 / 37644559 / -1.7% 0.73 / 0.73 / -0.2%
tpcds_q07/duckdb:parquet 15526992 / 15484302 / +0.3% 23090957 / 22715328 / +1.7% 0.67 / 0.68 / -1.4%
tpcds_q08/duckdb:parquet 26080378 / 25989556 / +0.3% 33050457 / 33276776 / -0.7% 0.79 / 0.78 / +1.0%
tpcds_q09/duckdb:parquet 19141096 / 19157912 / -0.1% 23963003 / 23232059 / +3.1% 0.80 / 0.82 / -3.1%
tpcds_q10/duckdb:parquet 28088528 / 28151478 / -0.2% 38097116 / 38888981 / -2.0% 0.74 / 0.72 / +1.9%
tpcds_q11/duckdb:parquet 73013306 / 72469791 / +0.7% 76963666 / 78345325 / -1.8% 0.95 / 0.93 / +2.6%
tpcds_q12/duckdb:parquet 12841777 / 12996230 / -1.2% 21102220 / 18505750 / +14.0% 🔴 0.61 / 0.70 / -13.3%
tpcds_q13/duckdb:parquet 24306377 / 24230226 / +0.3% 31301479 / 30728714 / +1.9% 0.78 / 0.79 / -1.5%
tpcds_q14/duckdb:parquet 62955997 / 61312990 / +2.7% 68455414 / 67625882 / +1.2% 0.92 / 0.91 / +1.4%
tpcds_q15/duckdb:parquet 25133066 / 25258512 / -0.5% 30993084 / 30357433 / +2.1% 0.81 / 0.83 / -2.5%
tpcds_q16/duckdb:parquet 20829616 / 22345028 / -6.8% 29202965 / 28897233 / +1.1% 0.71 / 0.77 / -7.8%
tpcds_q17/duckdb:parquet 32620378 / 32729759 / -0.3% 40187070 / 40005736 / +0.5% 0.81 / 0.82 / -0.8%
tpcds_q18/duckdb:parquet 40263234 / 41426606 / -2.8% 50102824 / 49851116 / +0.5% 0.80 / 0.83 / -3.3%
tpcds_q19/duckdb:parquet 24931974 / 24977012 / -0.2% 32219663 / 32901729 / -2.1% 0.77 / 0.76 / +1.9%
tpcds_q20/duckdb:parquet 13851182 / 13804140 / +0.3% 18993586 / 18149303 / +4.7% 0.73 / 0.76 / -4.1%
tpcds_q21/duckdb:parquet 9536551 / 9464651 / +0.8% 15192884 / 13361839 / +13.7% 🔴 0.63 / 0.71 / -11.4%
tpcds_q22/duckdb:parquet 35552360 / 34798960 / +2.2% 39701704 / 41651075 / -4.7% 0.90 / 0.84 / +7.2%
tpcds_q23/duckdb:parquet 41428860 / 41287606 / +0.3% 48269343 / 50869087 / -5.1% 0.86 / 0.81 / +5.7%
tpcds_q24/duckdb:parquet 34059973 / 33604968 / +1.4% 41949928 / 42202337 / -0.6% 0.81 / 0.80 / +2.0%
tpcds_q25/duckdb:parquet 31320696 / 31358790 / -0.1% 40088774 / 39827712 / +0.7% 0.78 / 0.79 / -0.8%
tpcds_q26/duckdb:parquet 31855143 / 31826098 / +0.1% 39354039 / 37683134 / +4.4% 0.81 / 0.84 / -4.2%
tpcds_q27/duckdb:parquet 32057383 / 31979928 / +0.2% 39512172 / 39790299 / -0.7% 0.81 / 0.80 / +0.9%
tpcds_q28/duckdb:parquet 17530898 / 17387038 / +0.8% 22080575 / 28640878 / -22.9% 🟢 0.79 / 0.61 / +30.8%
tpcds_q29/duckdb:parquet 31028894 / 31044678 / -0.1% 38511432 / 38502566 / +0.0% 0.81 / 0.81 / -0.1%
tpcds_q30/duckdb:parquet 33597232 / 35602041 / -5.6% 43247630 / 41772003 / +3.5% 0.78 / 0.85 / -8.9%
tpcds_q31/duckdb:parquet 20778865 / 20358594 / +2.1% 25056495 / 28674612 / -12.6% 🟢 0.83 / 0.71 / +16.8%
tpcds_q32/duckdb:parquet 12167262 / 11979996 / +1.6% 18541968 / 18146198 / +2.2% 0.66 / 0.66 / -0.6%
tpcds_q33/duckdb:parquet 16341422 / 16241924 / +0.6% 23204397 / 23688042 / -2.0% 0.70 / 0.69 / +2.7%
tpcds_q34/duckdb:parquet 16495310 / 16384168 / +0.7% 22246617 / 22278942 / -0.1% 0.74 / 0.74 / +0.8%
tpcds_q35/duckdb:parquet 46840928 / 47041981 / -0.4% 56421580 / 56078969 / +0.6% 0.83 / 0.84 / -1.0%
tpcds_q36/duckdb:parquet 15990232 / 15952286 / +0.2% 23400257 / 23520523 / -0.5% 0.68 / 0.68 / +0.8%
tpcds_q37/duckdb:parquet 12138498 / 11398870 / +6.5% 17801647 / 17460722 / +2.0% 0.68 / 0.65 / +4.4%
tpcds_q38/duckdb:parquet 26747752 / 26477830 / +1.0% 33850108 / 30471065 / +11.1% 🔴 0.79 / 0.87 / -9.1%
tpcds_q39/duckdb:parquet 25034707 / 24320028 / +2.9% 31026792 / 28320459 / +9.6% 0.81 / 0.86 / -6.0%
tpcds_q40/duckdb:parquet 16583114 / 16559168 / +0.1% 20751138 / 21369534 / -2.9% 0.80 / 0.77 / +3.1%
tpcds_q41/duckdb:parquet 7823172 / 10722982 / -27.0% 🟢 13307572 / 12652488 / +5.2% 0.59 / 0.85 / -30.6%
tpcds_q42/duckdb:parquet 8588018 / 11475587 / -25.2% 🟢 15487252 / 17751833 / -12.8% 🟢 0.55 / 0.65 / -14.2%
tpcds_q43/duckdb:parquet 10616858 / 10675838 / -0.6% 14848124 / 17824350 / -16.7% 🟢 0.72 / 0.60 / +19.4%
tpcds_q44/duckdb:parquet 16033906 / 16966232 / -5.5% 21447868 / 21400514 / +0.2% 0.75 / 0.79 / -5.7%
tpcds_q45/duckdb:parquet 23429200 / 23393668 / +0.2% 28422740 / 29641928 / -4.1% 0.82 / 0.79 / +4.4%
tpcds_q46/duckdb:parquet 37122536 / 37008258 / +0.3% 44891711 / 45748117 / -1.9% 0.83 / 0.81 / +2.2%
tpcds_q47/duckdb:parquet 34066090 / 31580452 / +7.9% 39438336 / 40213932 / -1.9% 0.86 / 0.79 / +10.0%
tpcds_q48/duckdb:parquet 21237080 / 21284131 / -0.2% 27295403 / 27622163 / -1.2% 0.78 / 0.77 / +1.0%
tpcds_q49/duckdb:parquet 20153680 / 19911308 / +1.2% 28227647 / 29003418 / -2.7% 0.71 / 0.69 / +4.0%
tpcds_q50/duckdb:parquet 17893822 / 17764536 / +0.7% 23536247 / 23466231 / +0.3% 0.76 / 0.76 / +0.4%
tpcds_q51/duckdb:parquet 53925987 / 53740559 / +0.3% 68789811 / 60857809 / +13.0% 🔴 0.78 / 0.88 / -11.2%
tpcds_q52/duckdb:parquet 8818640 / 8889767 / -0.8% 15771689 / 15565149 / +1.3% 0.56 / 0.57 / -2.1%
tpcds_q53/duckdb:parquet 11678102 / 11702626 / -0.2% 16044224 / 16651235 / -3.6% 0.73 / 0.70 / +3.6%
tpcds_q54/duckdb:parquet 20684462 / 20693480 / -0.0% 33287634 / 30345391 / +9.7% 0.62 / 0.68 / -8.9%
tpcds_q55/duckdb:parquet 8850805 / 8802825 / +0.5% 15623724 / 15900767 / -1.7% 0.57 / 0.55 / +2.3%
tpcds_q56/duckdb:parquet 16900248 / 17435132 / -3.1% 23955370 / 24490041 / -2.2% 0.71 / 0.71 / -0.9%
tpcds_q57/duckdb:parquet 29174487 / 29001168 / +0.6% 34253213 / 34502266 / -0.7% 0.85 / 0.84 / +1.3%
tpcds_q58/duckdb:parquet 18699860 / 18914723 / -1.1% 25691306 / 27058283 / -5.1% 0.73 / 0.70 / +4.1%
tpcds_q59/duckdb:parquet 20088960 / 19966080 / +0.6% 24867439 / 25072578 / -0.8% 0.81 / 0.80 / +1.4%
tpcds_q60/duckdb:parquet 17577176 / 17264170 / +1.8% 26521002 / 26173366 / +1.3% 0.66 / 0.66 / +0.5%
tpcds_q61/duckdb:parquet 22215952 / 22287297 / -0.3% 28490129 / 28935585 / -1.5% 0.78 / 0.77 / +1.2%
tpcds_q62/duckdb:parquet 10898398 / 10758838 / +1.3% 14930731 / 14947044 / -0.1% 0.73 / 0.72 / +1.4%
tpcds_q63/duckdb:parquet 11188171 / 11054956 / +1.2% 15816498 / 16022842 / -1.3% 0.71 / 0.69 / +2.5%
tpcds_q64/duckdb:parquet 52592632 / 52621998 / -0.1% 62762926 / 64392417 / -2.5% 0.84 / 0.82 / +2.5%
tpcds_q65/duckdb:parquet 14608852 / 14803666 / -1.3% 20285451 / 23747119 / -14.6% 🟢 0.72 / 0.62 / +15.5%
tpcds_q66/duckdb:parquet 24701256 / 24922518 / -0.9% 30222854 / 31451041 / -3.9% 0.82 / 0.79 / +3.1%
tpcds_q67/duckdb:parquet 76863856 / 77582934 / -0.9% 81875782 / 85365008 / -4.1% 0.94 / 0.91 / +3.3%
tpcds_q68/duckdb:parquet 32296280 / 29756548 / +8.5% 38864598 / 46359685 / -16.2% 🟢 0.83 / 0.64 / +29.5%
tpcds_q69/duckdb:parquet 28869657 / 28833260 / +0.1% 40223365 / 39208366 / +2.6% 0.72 / 0.74 / -2.4%
tpcds_q70/duckdb:parquet 18234287 / 17880086 / +2.0% 27845883 / 25588939 / +8.8% 0.65 / 0.70 / -6.3%
tpcds_q71/duckdb:parquet 15084244 / 15040978 / +0.3% 20830678 / 21977548 / -5.2% 0.72 / 0.68 / +5.8%
tpcds_q72/duckdb:parquet 81425947 / 81545458 / -0.1% 86098211 / 90182475 / -4.5% 0.95 / 0.90 / +4.6%
tpcds_q73/duckdb:parquet 13820806 / 13669442 / +1.1% 19211323 / 18952504 / +1.4% 0.72 / 0.72 / -0.3%
tpcds_q74/duckdb:parquet 100140976 / 100052714 / +0.1% 107944904 / 114117398 / -5.4% 0.93 / 0.88 / +5.8%
tpcds_q75/duckdb:parquet 40483232 / 40645628 / -0.4% 50169036 / 49819046 / +0.7% 0.81 / 0.82 / -1.1%
tpcds_q76/duckdb:parquet 14074119 / 13682278 / +2.9% 20625670 / 23401580 / -11.9% 🟢 0.68 / 0.58 / +16.7%
tpcds_q77/duckdb:parquet 17514113 / 17260352 / +1.5% 24228462 / 25610354 / -5.4% 0.72 / 0.67 / +7.3%
tpcds_q78/duckdb:parquet 48370994 / 48256536 / +0.2% 53039836 / 54265292 / -2.3% 0.91 / 0.89 / +2.6%
tpcds_q79/duckdb:parquet 21106159 / 21093544 / +0.1% 28819278 / 28708231 / +0.4% 0.73 / 0.73 / -0.3%
tpcds_q80/duckdb:parquet 32976602 / 32940522 / +0.1% 39546912 / 40453746 / -2.2% 0.83 / 0.81 / +2.4%
tpcds_q81/duckdb:parquet 31405112 / 31305471 / +0.3% 42648913 / 39737586 / +7.3% 0.74 / 0.79 / -6.5%
tpcds_q82/duckdb:parquet 12448806 / 12461291 / -0.1% 18313954 / 20211791 / -9.4% 0.68 / 0.62 / +10.3%
tpcds_q83/duckdb:parquet 16900578 / 16388242 / +3.1% 21422264 / 24345687 / -12.0% 🟢 0.79 / 0.67 / +17.2%
tpcds_q84/duckdb:parquet 18734544 / 18568252 / +0.9% 24319726 / 23989093 / +1.4% 0.77 / 0.77 / -0.5%
tpcds_q85/duckdb:parquet 35580693 / 35119714 / +1.3% 44658728 / 44776068 / -0.3% 0.80 / 0.78 / +1.6%
tpcds_q86/duckdb:parquet 11314878 / 12350616 / -8.4% 18225238 / 16838117 / +8.2% 0.62 / 0.73 / -15.4%
tpcds_q87/duckdb:parquet 28640830 / 28338586 / +1.1% 33303784 / 32002720 / +4.1% 0.86 / 0.89 / -2.9%
tpcds_q88/duckdb:parquet 28047201 / 26956082 / +4.0% 34560337 / 30864936 / +12.0% 🔴 0.81 / 0.87 / -7.1%
tpcds_q89/duckdb:parquet 12884814 / 12847831 / +0.3% 20588299 / 18834233 / +9.3% 0.63 / 0.68 / -8.3%
tpcds_q90/duckdb:parquet 6874470 / 7010923 / -1.9% 11151249 / 11159380 / -0.1% 0.62 / 0.63 / -1.9%
tpcds_q91/duckdb:parquet 21776302 / 24611427 / -11.5% 🟢 29101243 / 30832777 / -5.6% 0.75 / 0.80 / -6.3%
tpcds_q92/duckdb:parquet 13418997 / 12410358 / +8.1% 22395848 / 20096904 / +11.4% 🔴 0.60 / 0.62 / -3.0%
tpcds_q93/duckdb:parquet 21529262 / 21662123 / -0.6% 26396165 / 27057155 / -2.4% 0.82 / 0.80 / +1.9%
tpcds_q94/duckdb:parquet 17125398 / 16725680 / +2.4% 27862589 / 26333087 / +5.8% 0.61 / 0.64 / -3.2%
tpcds_q95/duckdb:parquet 90945573 / 90017809 / +1.0% 97259689 / 98485853 / -1.2% 0.94 / 0.91 / +2.3%
tpcds_q96/duckdb:parquet 7013294 / 6900840 / +1.6% 10448931 / 10767993 / -3.0% 0.67 / 0.64 / +4.7%
tpcds_q97/duckdb:parquet 25818983 / 25863368 / -0.2% 31653073 / 32808299 / -3.5% 0.82 / 0.79 / +3.5%
tpcds_q98/duckdb:parquet 15051672 / 15121078 / -0.5% 22317507 / 22373888 / -0.3% 0.67 / 0.68 / -0.2%
tpcds_q99/duckdb:parquet 17353714 / 17341554 / +0.1% 21520335 / 21430990 / +0.4% 0.81 / 0.81 / -0.3%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 1.025x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.015x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 96465735 / 96260488 / +0.2% 169355299 / 175237760 / -3.4% 0.57 / 0.55 / +3.7%
tpch_q02/datafusion:vortex-file-compressed 65135780 / 64771915 / +0.6% 98710083 / 96073056 / +2.7% 0.66 / 0.67 / -2.1%
tpch_q03/datafusion:vortex-file-compressed 64359663 / 65137084 / -1.2% 117837230 / 117238729 / +0.5% 0.55 / 0.56 / -1.7%
tpch_q04/datafusion:vortex-file-compressed 34965199 / 35625658 / -1.9% 81543270 / 78437135 / +4.0% 0.43 / 0.45 / -5.6%
tpch_q05/datafusion:vortex-file-compressed 117997378 / 116652751 / +1.2% 183697407 / 183851573 / -0.1% 0.64 / 0.63 / +1.2%
tpch_q06/datafusion:vortex-file-compressed 13856867 / 14676421 / -5.6% 74596276 / 70182473 / +6.3% 0.19 / 0.21 / -11.2%
tpch_q07/datafusion:vortex-file-compressed 136838920 / 140072006 / -2.3% 202807714 / 197064384 / +2.9% 0.67 / 0.71 / -5.1%
tpch_q08/datafusion:vortex-file-compressed 143880825 / 147055335 / -2.2% 208322043 / 212744834 / -2.1% 0.69 / 0.69 / -0.1%
tpch_q09/datafusion:vortex-file-compressed 184904609 / 183424206 / +0.8% 263022226 / 260070027 / +1.1% 0.70 / 0.71 / -0.3%
tpch_q10/datafusion:vortex-file-compressed 73582326 / 73704844 / -0.2% 141636492 / 139569367 / +1.5% 0.52 / 0.53 / -1.6%
tpch_q11/datafusion:vortex-file-compressed 43340514 / 42970795 / +0.9% 66856822 / 68913777 / -3.0% 0.65 / 0.62 / +4.0%
tpch_q12/datafusion:vortex-file-compressed 44662650 / 44861938 / -0.4% 94724275 / 90827772 / +4.3% 0.47 / 0.49 / -4.5%
tpch_q13/datafusion:vortex-file-compressed 46502406 / 46833881 / -0.7% 84222665 / 82106224 / +2.6% 0.55 / 0.57 / -3.2%
tpch_q14/datafusion:vortex-file-compressed 24980515 / 25184711 / -0.8% 97648809 / 100189331 / -2.5% 0.26 / 0.25 / +1.8%
tpch_q15/datafusion:vortex-file-compressed 35669456 / 36868143 / -3.3% 101499153 / 101104911 / +0.4% 0.35 / 0.36 / -3.6%
tpch_q16/datafusion:vortex-file-compressed 37543472 / 37265454 / +0.7% 65863721 / 67047341 / -1.8% 0.57 / 0.56 / +2.6%
tpch_q17/datafusion:vortex-file-compressed 172948660 / 174488914 / -0.9% 220581838 / 231519385 / -4.7% 0.78 / 0.75 / +4.0%
tpch_q18/datafusion:vortex-file-compressed 201400530 / 199886154 / +0.8% 262373060 / 264494797 / -0.8% 0.77 / 0.76 / +1.6%
tpch_q19/datafusion:vortex-file-compressed 34364723 / 34214073 / +0.4% 91820753 / 95555040 / -3.9% 0.37 / 0.36 / +4.5%
tpch_q20/datafusion:vortex-file-compressed 62866221 / 63386119 / -0.8% 127864429 / 125322267 / +2.0% 0.49 / 0.51 / -2.8%
tpch_q21/datafusion:vortex-file-compressed 184131611 / 182953640 / +0.6% 242683429 / 242566411 / +0.0% 0.76 / 0.75 / +0.6%
tpch_q22/datafusion:vortex-file-compressed 25938309 / 25341731 / +2.4% 55085785 / 54401499 / +1.3% 0.47 / 0.47 / +1.1%
datafusion / vortex-compact / ns (0.984x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 99971528 / 98987635 / +1.0% 153736111 / 157446162 / -2.4% 0.65 / 0.63 / +3.4%
tpch_q02/datafusion:vortex-compact 66153206 / 64955545 / +1.8% 95772229 / 94481968 / +1.4% 0.69 / 0.69 / +0.5%
tpch_q03/datafusion:vortex-compact 66768089 / 67035832 / -0.4% 110939701 / 117724506 / -5.8% 0.60 / 0.57 / +5.7%
tpch_q04/datafusion:vortex-compact 41158047 / 41271872 / -0.3% 81826680 / 80694036 / +1.4% 0.50 / 0.51 / -1.7%
tpch_q05/datafusion:vortex-compact 119840929 / 117988639 / +1.6% 166660908 / 169284868 / -1.6% 0.72 / 0.70 / +3.2%
tpch_q06/datafusion:vortex-compact 16340203 / 18185828 / -10.1% 🟢 58792912 / 65271734 / -9.9% 0.28 / 0.28 / -0.2%
tpch_q07/datafusion:vortex-compact 142980572 / 145308135 / -1.6% 193318949 / 190636052 / +1.4% 0.74 / 0.76 / -3.0%
tpch_q08/datafusion:vortex-compact 144548507 / 147570573 / -2.0% 209466595 / 205512367 / +1.9% 0.69 / 0.72 / -3.9%
tpch_q09/datafusion:vortex-compact 184299827 / 182603623 / +0.9% 245268889 / 247673619 / -1.0% 0.75 / 0.74 / +1.9%
tpch_q10/datafusion:vortex-compact 78175233 / 79655991 / -1.9% 129764393 / 129002776 / +0.6% 0.60 / 0.62 / -2.4%
tpch_q11/datafusion:vortex-compact 43520711 / 44385597 / -1.9% 67077388 / 66906442 / +0.3% 0.65 / 0.66 / -2.2%
tpch_q12/datafusion:vortex-compact 54825143 / 58000480 / -5.5% 92496939 / 99016992 / -6.6% 0.59 / 0.59 / +1.2%
tpch_q13/datafusion:vortex-compact 53896960 / 54194056 / -0.5% 81894128 / 83222845 / -1.6% 0.66 / 0.65 / +1.1%
tpch_q14/datafusion:vortex-compact 26722932 / 28472924 / -6.1% 94310582 / 93590169 / +0.8% 0.28 / 0.30 / -6.9%
tpch_q15/datafusion:vortex-compact 42280988 / 45090012 / -6.2% 100169307 / 102113351 / -1.9% 0.42 / 0.44 / -4.4%
tpch_q16/datafusion:vortex-compact 40700866 / 39524557 / +3.0% 69041264 / 68001223 / +1.5% 0.59 / 0.58 / +1.4%
tpch_q17/datafusion:vortex-compact 175416266 / 173971555 / +0.8% 215875512 / 225892411 / -4.4% 0.81 / 0.77 / +5.5%
tpch_q18/datafusion:vortex-compact 203532529 / 202927780 / +0.3% 255508701 / 261342006 / -2.2% 0.80 / 0.78 / +2.6%
tpch_q19/datafusion:vortex-compact 40353855 / 42077787 / -4.1% 87654668 / 97145074 / -9.8% 0.46 / 0.43 / +6.3%
tpch_q20/datafusion:vortex-compact 65011211 / 65859389 / -1.3% 123684432 / 127668062 / -3.1% 0.53 / 0.52 / +1.9%
tpch_q21/datafusion:vortex-compact 192977462 / 191178642 / +0.9% 245315364 / 239730546 / +2.3% 0.79 / 0.80 / -1.4%
tpch_q22/datafusion:vortex-compact 26309477 / 26760276 / -1.7% 55319874 / 56392880 / -1.9% 0.48 / 0.47 / +0.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87107048 / 86916290 / +0.2% 131817883 / 136419396 / -3.4% 0.66 / 0.64 / +3.7%
tpch_q02/datafusion:parquet 157890913 / 159446809 / -1.0% 184605210 / 183055828 / +0.8% 0.86 / 0.87 / -1.8%
tpch_q03/datafusion:parquet 143089296 / 143113166 / -0.0% 198264555 / 193453602 / +2.5% 0.72 / 0.74 / -2.4%
tpch_q04/datafusion:parquet 59277194 / 59779099 / -0.8% 98506400 / 98477795 / +0.0% 0.60 / 0.61 / -0.9%
tpch_q05/datafusion:parquet 182028760 / 181703447 / +0.2% 243350582 / 238575320 / +2.0% 0.75 / 0.76 / -1.8%
tpch_q06/datafusion:parquet 35189481 / 35082735 / +0.3% 78333364 / 82789864 / -5.4% 0.45 / 0.42 / +6.0%
tpch_q07/datafusion:parquet 229800527 / 229184869 / +0.3% 289371743 / 291982335 / -0.9% 0.79 / 0.78 / +1.2%
tpch_q08/datafusion:parquet 234673546 / 234272992 / +0.2% 304280533 / 301509927 / +0.9% 0.77 / 0.78 / -0.7%
tpch_q09/datafusion:parquet 314177449 / 311848145 / +0.7% 388327050 / 386728406 / +0.4% 0.81 / 0.81 / +0.3%
tpch_q10/datafusion:parquet 408090063 / 406354111 / +0.4% 467008749 / 458673457 / +1.8% 0.87 / 0.89 / -1.4%
tpch_q11/datafusion:parquet 104848198 / 105917233 / -1.0% 129089193 / 128866052 / +0.2% 0.81 / 0.82 / -1.2%
tpch_q12/datafusion:parquet 84934888 / 84488849 / +0.5% 129390888 / 124782921 / +3.7% 0.66 / 0.68 / -3.1%
tpch_q13/datafusion:parquet 228296650 / 229835292 / -0.7% 257206247 / 256205730 / +0.4% 0.89 / 0.90 / -1.1%
tpch_q14/datafusion:parquet 87263483 / 87039239 / +0.3% 199261297 / 201230086 / -1.0% 0.44 / 0.43 / +1.2%
tpch_q15/datafusion:parquet 91088282 / 89773774 / +1.5% 142681568 / 140706472 / +1.4% 0.64 / 0.64 / +0.1%
tpch_q16/datafusion:parquet 95454597 / 95254580 / +0.2% 121305923 / 119660294 / +1.4% 0.79 / 0.80 / -1.1%
tpch_q17/datafusion:parquet 218149980 / 217815030 / +0.2% 269465188 / 267969750 / +0.6% 0.81 / 0.81 / -0.4%
tpch_q18/datafusion:parquet 289649958 / 300875125 / -3.7% 336373483 / 327701288 / +2.6% 0.86 / 0.92 / -6.2%
tpch_q19/datafusion:parquet 109265224 / 109622245 / -0.3% 173588236 / 178019679 / -2.5% 0.63 / 0.62 / +2.2%
tpch_q20/datafusion:parquet 184553336 / 182952768 / +0.9% 248181570 / 240228284 / +3.3% 0.74 / 0.76 / -2.4%
tpch_q21/datafusion:parquet 245532244 / 246651126 / -0.5% 317401271 / 314639748 / +0.9% 0.77 / 0.78 / -1.3%
tpch_q22/datafusion:parquet 198933021 / 199273694 / -0.2% 223412658 / 220312098 / +1.4% 0.89 / 0.90 / -1.6%
duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54799265 / 51834535 / +5.7% 103776505 / 96189745 / +7.9% 0.53 / 0.54 / -2.0%
tpch_q02/duckdb:vortex-file-compressed 32108105 / 32483264 / -1.2% 52671654 / 45959587 / +14.6% 🔴 0.61 / 0.71 / -13.8%
tpch_q03/duckdb:vortex-file-compressed 57241784 / 56625690 / +1.1% 114708533 / 104575696 / +9.7% 0.50 / 0.54 / -7.8%
tpch_q04/duckdb:vortex-file-compressed 80981157 / 80853979 / +0.2% 125387524 / 115261140 / +8.8% 0.65 / 0.70 / -7.9%
tpch_q05/duckdb:vortex-file-compressed 63832140 / 65047221 / -1.9% 120503927 / 120601328 / -0.1% 0.53 / 0.54 / -1.8%
tpch_q06/duckdb:vortex-file-compressed 21879516 / 20258001 / +8.0% 66428081 / 61206357 / +8.5% 0.33 / 0.33 / -0.5%
tpch_q07/duckdb:vortex-file-compressed 59360027 / 60641299 / -2.1% 133675460 / 120245735 / +11.2% 🔴 0.44 / 0.50 / -11.9%
tpch_q08/duckdb:vortex-file-compressed 85427802 / 87127192 / -2.0% 155326499 / 141038694 / +10.1% 🔴 0.55 / 0.62 / -11.0%
tpch_q09/duckdb:vortex-file-compressed 166473653 / 164402993 / +1.3% 238500794 / 237707238 / +0.3% 0.70 / 0.69 / +0.9%
tpch_q10/duckdb:vortex-file-compressed 106946081 / 111264321 / -3.9% 169511870 / 181124715 / -6.4% 0.63 / 0.61 / +2.7%
tpch_q11/duckdb:vortex-file-compressed 18150383 / 17992482 / +0.9% 29473548 / 30527133 / -3.5% 0.62 / 0.59 / +4.5%
tpch_q12/duckdb:vortex-file-compressed 55093114 / 54651723 / +0.8% 108896797 / 107733739 / +1.1% 0.51 / 0.51 / -0.3%
tpch_q13/duckdb:vortex-file-compressed 90510375 / 91784894 / -1.4% 147417656 / 139128271 / +6.0% 0.61 / 0.66 / -6.9%
tpch_q14/duckdb:vortex-file-compressed 28941649 / 31088528 / -6.9% 78362339 / 73712860 / +6.3% 0.37 / 0.42 / -12.4%
tpch_q15/duckdb:vortex-file-compressed 39818110 / 39615765 / +0.5% 92728756 / 85456307 / +8.5% 0.43 / 0.46 / -7.4%
tpch_q16/duckdb:vortex-file-compressed 42441610 / 41987937 / +1.1% 54139695 / 54618486 / -0.9% 0.78 / 0.77 / +2.0%
tpch_q17/duckdb:vortex-file-compressed 56985863 / 63138129 / -9.7% 114444328 / 125409282 / -8.7% 0.50 / 0.50 / -1.1%
tpch_q18/duckdb:vortex-file-compressed 133460179 / 135121221 / -1.2% 170667149 / 156491835 / +9.1% 0.78 / 0.86 / -9.4%
tpch_q19/duckdb:vortex-file-compressed 44270411 / 42161908 / +5.0% 100263313 / 90713440 / +10.5% 🔴 0.44 / 0.46 / -5.0%
tpch_q20/duckdb:vortex-file-compressed 61401830 / 60940500 / +0.8% 127995775 / 112797993 / +13.5% 🔴 0.48 / 0.54 / -11.2%
tpch_q21/duckdb:vortex-file-compressed 242173802 / 239916934 / +0.9% 289854715 / 275991850 / +5.0% 0.84 / 0.87 / -3.9%
tpch_q22/duckdb:vortex-file-compressed 42101921 / 41621232 / +1.2% 66679978 / 60046960 / +11.0% 🔴 0.63 / 0.69 / -8.9%
duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 67647567 / 69414531 / -2.5% 112265020 / 106038015 / +5.9% 0.60 / 0.65 / -8.0%
tpch_q02/duckdb:vortex-compact 34700474 / 34643534 / +0.2% 51384826 / 48930797 / +5.0% 0.68 / 0.71 / -4.6%
tpch_q03/duckdb:vortex-compact 61402947 / 62224261 / -1.3% 104884435 / 97812476 / +7.2% 0.59 / 0.64 / -8.0%
tpch_q04/duckdb:vortex-compact 89660299 / 89814606 / -0.2% 119712508 / 115016743 / +4.1% 0.75 / 0.78 / -4.1%
tpch_q05/duckdb:vortex-compact 69381248 / 68140023 / +1.8% 122051418 / 113259777 / +7.8% 0.57 / 0.60 / -5.5%
tpch_q06/duckdb:vortex-compact 23574338 / 24687596 / -4.5% 65435669 / 56117458 / +16.6% 🔴 0.36 / 0.44 / -18.1%
tpch_q07/duckdb:vortex-compact 68838755 / 73302127 / -6.1% 137219865 / 131854179 / +4.1% 0.50 / 0.56 / -9.8%
tpch_q08/duckdb:vortex-compact 89934383 / 91795600 / -2.0% 147348380 / 141856535 / +3.9% 0.61 / 0.65 / -5.7%
tpch_q09/duckdb:vortex-compact 169281057 / 172533679 / -1.9% 237484047 / 234716764 / +1.2% 0.71 / 0.74 / -3.0%
tpch_q10/duckdb:vortex-compact 118228279 / 117702707 / +0.4% 166819253 / 159489218 / +4.6% 0.71 / 0.74 / -4.0%
tpch_q11/duckdb:vortex-compact 19204699 / 18966966 / +1.3% 36386321 / 34931885 / +4.2% 0.53 / 0.54 / -2.8%
tpch_q12/duckdb:vortex-compact 69768513 / 69278671 / +0.7% 118999149 / 104188777 / +14.2% 🔴 0.59 / 0.66 / -11.8%
tpch_q13/duckdb:vortex-compact 94819883 / 93934154 / +0.9% 147779739 / 141224936 / +4.6% 0.64 / 0.67 / -3.5%
tpch_q14/duckdb:vortex-compact 32092795 / 34546693 / -7.1% 77237160 / 70406228 / +9.7% 0.42 / 0.49 / -15.3%
tpch_q15/duckdb:vortex-compact 45667977 / 44766311 / +2.0% 103108883 / 93588759 / +10.2% 🔴 0.44 / 0.48 / -7.4%
tpch_q16/duckdb:vortex-compact 43995065 / 43358686 / +1.5% 59545863 / 55793304 / +6.7% 0.74 / 0.78 / -4.9%
tpch_q17/duckdb:vortex-compact 58157157 / 59839658 / -2.8% 112269592 / 110620943 / +1.5% 0.52 / 0.54 / -4.2%
tpch_q18/duckdb:vortex-compact 145514749 / 141064980 / +3.2% 161380006 / 161255472 / +0.1% 0.90 / 0.87 / +3.1%
tpch_q19/duckdb:vortex-compact 43639226 / 44551293 / -2.0% 88548655 / 81384486 / +8.8% 0.49 / 0.55 / -10.0%
tpch_q20/duckdb:vortex-compact 68142675 / 66693792 / +2.2% 135470670 / 119391197 / +13.5% 🔴 0.50 / 0.56 / -10.0%
tpch_q21/duckdb:vortex-compact 251205639 / 259242853 / -3.1% 285099395 / 276647428 / +3.1% 0.88 / 0.94 / -6.0%
tpch_q22/duckdb:vortex-compact 44995652 / 44209850 / +1.8% 71816310 / 67694298 / +6.1% 0.63 / 0.65 / -4.1%
duckdb / parquet / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72294843 / 72014658 / +0.4% 89765389 / 84816042 / +5.8% 0.81 / 0.85 / -5.1%
tpch_q02/duckdb:parquet 81015279 / 80677303 / +0.4% 95995496 / 94247764 / +1.9% 0.84 / 0.86 / -1.4%
tpch_q03/duckdb:parquet 120983373 / 121813007 / -0.7% 154099233 / 149963052 / +2.8% 0.79 / 0.81 / -3.3%
tpch_q04/duckdb:parquet 76327424 / 76226520 / +0.1% 101829477 / 92685566 / +9.9% 0.75 / 0.82 / -8.9%
tpch_q05/duckdb:parquet 129651466 / 131076925 / -1.1% 163832063 / 178819726 / -8.4% 0.79 / 0.73 / +8.0%
tpch_q06/duckdb:parquet 34969238 / 34279039 / +2.0% 53462659 / 47311826 / +13.0% 🔴 0.65 / 0.72 / -9.7%
tpch_q07/duckdb:parquet 94221397 / 92945001 / +1.4% 134804069 / 128058370 / +5.3% 0.70 / 0.73 / -3.7%
tpch_q08/duckdb:parquet 151577890 / 150320450 / +0.8% 213177708 / 209128096 / +1.9% 0.71 / 0.72 / -1.1%
tpch_q09/duckdb:parquet 228116170 / 228374712 / -0.1% 267234483 / 286673515 / -6.8% 0.85 / 0.80 / +7.2%
tpch_q10/duckdb:parquet 513273041 / 511939609 / +0.3% 546011338 / 544174760 / +0.3% 0.94 / 0.94 / -0.1%
tpch_q11/duckdb:parquet 33815235 / 33528555 / +0.9% 39142580 / 39278299 / -0.3% 0.86 / 0.85 / +1.2%
tpch_q12/duckdb:parquet 77274100 / 77935290 / -0.8% 93936901 / 87842680 / +6.9% 0.82 / 0.89 / -7.3%
tpch_q13/duckdb:parquet 324035076 / 325266177 / -0.4% 336915615 / 334044091 / +0.9% 0.96 / 0.97 / -1.2%
tpch_q14/duckdb:parquet 109785325 / 111519900 / -1.6% 156499802 / 136679960 / +14.5% 🔴 0.70 / 0.82 / -14.0%
tpch_q15/duckdb:parquet 43979046 / 43388503 / +1.4% 87423995 / 68707260 / +27.2% 🔴 0.50 / 0.63 / -20.3%
tpch_q16/duckdb:parquet 120003187 / 118881840 / +0.9% 128435097 / 129012493 / -0.4% 0.93 / 0.92 / +1.4%
tpch_q17/duckdb:parquet 80595111 / 80430621 / +0.2% 108529196 / 116690564 / -7.0% 0.74 / 0.69 / +7.7%
tpch_q18/duckdb:parquet 212404652 / 209032411 / +1.6% 171824876 / 183460720 / -6.3% 1.24 / 1.14 / +8.5%
tpch_q19/duckdb:parquet 173385944 / 167859405 / +3.3% 196348540 / 210081442 / -6.5% 0.88 / 0.80 / +10.5%
tpch_q20/duckdb:parquet 137833323 / 137920755 / -0.1% 176697090 / 167233493 / +5.7% 0.78 / 0.82 / -5.4%
tpch_q21/duckdb:parquet 274767765 / 271305481 / +1.3% 290784861 / 286022708 / +1.7% 0.94 / 0.95 / -0.4%
tpch_q22/duckdb:parquet 268119329 / 268521783 / -0.1% 280353911 / 277517259 / +1.0% 0.96 / 0.97 / -1.2%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1825544 / 1805730 / +1.1% 6168004 / 6928341 / -11.0% 🟢 0.30 / 0.26 / +13.6%
statpopgen_q01/datafusion:vortex-file-compressed 23945116 / 25189169 / -4.9% 34252646 / 35742231 / -4.2% 0.70 / 0.70 / -0.8%
statpopgen_q02/datafusion:vortex-file-compressed 111470266 / 111594129 / -0.1% 141359100 / 144571389 / -2.2% 0.79 / 0.77 / +2.2%
statpopgen_q03/datafusion:vortex-file-compressed 353742018 / 352995778 / +0.2% 394395391 / 389880929 / +1.2% 0.90 / 0.91 / -0.9%
statpopgen_q04/datafusion:vortex-file-compressed 354533026 / 346522414 / +2.3% 400466421 / 404111683 / -0.9% 0.89 / 0.86 / +3.2%
statpopgen_q05/datafusion:vortex-file-compressed 211241142 / 213668386 / -1.1% 264677037 / 262676513 / +0.8% 0.80 / 0.81 / -1.9%
statpopgen_q06/datafusion:vortex-file-compressed 763262268 / 767104532 / -0.5% 803761155 / 857598841 / -6.3% 0.95 / 0.89 / +6.2%
statpopgen_q07/datafusion:vortex-file-compressed 412794703 / 410903688 / +0.5% 425947769 / 425763270 / +0.0% 0.97 / 0.97 / +0.4%
statpopgen_q08/datafusion:vortex-file-compressed 411741939 / 415146846 / -0.8% 427187999 / 421227842 / +1.4% 0.96 / 0.99 / -2.2%
statpopgen_q09/datafusion:vortex-file-compressed 250243925 / 249424591 / +0.3% 285987184 / 296472923 / -3.5% 0.88 / 0.84 / +4.0%
statpopgen_q10/datafusion:vortex-file-compressed 744513328 / 754664004 / -1.3% 792040587 / 781293346 / +1.4% 0.94 / 0.97 / -2.7%
datafusion / vortex-compact / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1813907 / 1787429 / +1.5% 6124771 / 6113375 / +0.2% 0.30 / 0.29 / +1.3%
statpopgen_q01/datafusion:vortex-compact 28523695 / 26654285 / +7.0% 26447781 / 28281041 / -6.5% 1.08 / 0.94 / +14.4%
statpopgen_q02/datafusion:vortex-compact 210284078 / 212726813 / -1.1% 230545834 / 225835436 / +2.1% 0.91 / 0.94 / -3.2%
statpopgen_q03/datafusion:vortex-compact 465878403 / 469520456 / -0.8% 695051135 / 483415209 / +43.8% 🔴 0.67 / 0.97 / -31.0%
statpopgen_q04/datafusion:vortex-compact 468303151 / 457868054 / +2.3% 479888593 / 486518511 / -1.4% 0.98 / 0.94 / +3.7%
statpopgen_q05/datafusion:vortex-compact 315674628 / 313649859 / +0.6% 336146792 / 340183757 / -1.2% 0.94 / 0.92 / +1.9%
statpopgen_q06/datafusion:vortex-compact 889499174 / 889519130 / -0.0% 906119411 / 909078126 / -0.3% 0.98 / 0.98 / +0.3%
statpopgen_q07/datafusion:vortex-compact 973541996 / 970622745 / +0.3% 985252963 / 975395032 / +1.0% 0.99 / 1.00 / -0.7%
statpopgen_q08/datafusion:vortex-compact 967186022 / 979203626 / -1.2% 990449193 / 994649184 / -0.4% 0.98 / 0.98 / -0.8%
statpopgen_q09/datafusion:vortex-compact 367012094 / 363602979 / +0.9% 387471241 / 388426056 / -0.2% 0.95 / 0.94 / +1.2%
statpopgen_q10/datafusion:vortex-compact 972723500 / 972116668 / +0.1% 988629283 / 971414379 / +1.8% 0.98 / 1.00 / -1.7%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1999428 / 1987198 / +0.6% 90418949 / 90610084 / -0.2% 0.02 / 0.02 / +0.8%
statpopgen_q01/datafusion:parquet 161346585 / 160978967 / +0.2% 172966887 / 173783711 / -0.5% 0.93 / 0.93 / +0.7%
statpopgen_q02/datafusion:parquet 296419858 / 294131283 / +0.8% 407916352 / 426485888 / -4.4% 0.73 / 0.69 / +5.4%
statpopgen_q03/datafusion:parquet 398051702 / 404563693 / -1.6% 538585797 / 516290579 / +4.3% 0.74 / 0.78 / -5.7%
statpopgen_q04/datafusion:parquet 395632252 / 390376520 / +1.3% 531812516 / 537096504 / -1.0% 0.74 / 0.73 / +2.4%
statpopgen_q05/datafusion:parquet 314195724 / 327381894 / -4.0% 422991388 / 424941062 / -0.5% 0.74 / 0.77 / -3.6%
statpopgen_q06/datafusion:parquet 507356954 / 497620121 / +2.0% 659932175 / 644939459 / +2.3% 0.77 / 0.77 / -0.4%
statpopgen_q07/datafusion:parquet 443201477 / 433602474 / +2.2% 546337236 / 548684688 / -0.4% 0.81 / 0.79 / +2.7%
statpopgen_q08/datafusion:parquet 435543608 / 432919336 / +0.6% 566527393 / 567396195 / -0.2% 0.77 / 0.76 / +0.8%
statpopgen_q09/datafusion:parquet 365084158 / 372415163 / -2.0% 473351842 / 475882882 / -0.5% 0.77 / 0.78 / -1.4%
statpopgen_q10/datafusion:parquet 572422964 / 561054104 / +2.0% 690700151 / 680276678 / +1.5% 0.83 / 0.82 / +0.5%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9006458 / 9026140 / -0.2% 9564696 / 9427053 / +1.5% 0.94 / 0.96 / -1.7%
statpopgen_q01/duckdb:vortex-file-compressed 10359688 / 10411672 / -0.5% 14659250 / 13997036 / +4.7% 0.71 / 0.74 / -5.0%
statpopgen_q02/duckdb:vortex-file-compressed 306829154 / 305405411 / +0.5% 357374466 / 348965455 / +2.4% 0.86 / 0.88 / -1.9%
statpopgen_q03/duckdb:vortex-file-compressed 825486064 / 819118477 / +0.8% 823113720 / 832088887 / -1.1% 1.00 / 0.98 / +1.9%
statpopgen_q04/duckdb:vortex-file-compressed 817672582 / 818554822 / -0.1% 824671543 / 812095807 / +1.5% 0.99 / 1.01 / -1.6%
statpopgen_q05/duckdb:vortex-file-compressed 320085834 / 322363817 / -0.7% 343310575 / 343029565 / +0.1% 0.93 / 0.94 / -0.8%
statpopgen_q06/duckdb:vortex-file-compressed 1141640935 / 1140616745 / +0.1% 1149246001 / 1149205412 / +0.0% 0.99 / 0.99 / +0.1%
statpopgen_q07/duckdb:vortex-file-compressed 380862804 / 374668820 / +1.7% 426694123 / 419161371 / +1.8% 0.89 / 0.89 / -0.1%
statpopgen_q08/duckdb:vortex-file-compressed 380214957 / 378806199 / +0.4% 425428434 / 439525389 / -3.2% 0.89 / 0.86 / +3.7%
statpopgen_q09/duckdb:vortex-file-compressed 614517932 / 614903380 / -0.1% 621951678 / 624840153 / -0.5% 0.99 / 0.98 / +0.4%
statpopgen_q10/duckdb:vortex-file-compressed 1939170429 / 1910259276 / +1.5% 1907232282 / 1920826844 / -0.7% 1.02 / 0.99 / +2.2%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8986118 / 8953094 / +0.4% 9467717 / 9406248 / +0.7% 0.95 / 0.95 / -0.3%
statpopgen_q01/duckdb:vortex-compact 10289730 / 10327472 / -0.4% 13186610 / 13565603 / -2.8% 0.78 / 0.76 / +2.5%
statpopgen_q02/duckdb:vortex-compact 380738782 / 379404649 / +0.4% 398074012 / 393631323 / +1.1% 0.96 / 0.96 / -0.8%
statpopgen_q03/duckdb:vortex-compact 902739352 / 895316762 / +0.8% 899166436 / 895287618 / +0.4% 1.00 / 1.00 / +0.4%
statpopgen_q04/duckdb:vortex-compact 893607669 / 900144927 / -0.7% 901982019 / 901770028 / +0.0% 0.99 / 1.00 / -0.7%
statpopgen_q05/duckdb:vortex-compact 425193758 / 427850808 / -0.6% 436902258 / 440161493 / -0.7% 0.97 / 0.97 / +0.1%
statpopgen_q06/duckdb:vortex-compact 1168238828 / 1179609322 / -1.0% 1168320078 / 1172548003 / -0.4% 1.00 / 1.01 / -0.6%
statpopgen_q07/duckdb:vortex-compact 943596872 / 939476870 / +0.4% 937525666 / 939278848 / -0.2% 1.01 / 1.00 / +0.6%
statpopgen_q08/duckdb:vortex-compact 955144462 / 948814660 / +0.7% 955888775 / 963491791 / -0.8% 1.00 / 0.98 / +1.5%
statpopgen_q09/duckdb:vortex-compact 713381982 / 707552982 / +0.8% 714424493 / 718180285 / -0.5% 1.00 / 0.99 / +1.4%
statpopgen_q10/duckdb:vortex-compact 2019476758 / 2018138166 / +0.1% 1972617809 / 1970381169 / +0.1% 1.02 / 1.02 / -0.0%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245523692 / 244422836 / +0.5% 245045728 / 244245639 / +0.3% 1.00 / 1.00 / +0.1%
statpopgen_q01/duckdb:parquet 303645270 / 300612184 / +1.0% 307195553 / 301291484 / +2.0% 0.99 / 1.00 / -0.9%
statpopgen_q02/duckdb:parquet 529243310 / 536218046 / -1.3% 552230754 / 555409785 / -0.6% 0.96 / 0.97 / -0.7%
statpopgen_q03/duckdb:parquet 867908014 / 862582341 / +0.6% 873661069 / 865955425 / +0.9% 0.99 / 1.00 / -0.3%
statpopgen_q04/duckdb:parquet 814126554 / 895427278 / -9.1% 848710048 / 883140863 / -3.9% 0.96 / 1.01 / -5.4%
statpopgen_q05/duckdb:parquet 567146613 / 579924127 / -2.2% 568075841 / 613457325 / -7.4% 1.00 / 0.95 / +5.6%
statpopgen_q06/duckdb:parquet 740235236 / 697390558 / +6.1% 717995494 / 769158738 / -6.7% 1.03 / 0.91 / +13.7%
statpopgen_q07/duckdb:parquet 609129387 / 612208789 / -0.5% 715745119 / 679653792 / +5.3% 0.85 / 0.90 / -5.5%
statpopgen_q08/duckdb:parquet 627425428 / 613223877 / +2.3% 712064365 / 692371923 / +2.8% 0.88 / 0.89 / -0.5%
statpopgen_q09/duckdb:parquet 783645428 / 776463037 / +0.9% 791996951 / 822533706 / -3.7% 0.99 / 0.94 / +4.8%
statpopgen_q10/duckdb:parquet 1473175154 / 1480022516 / -0.5% 1341959896 / 1407785821 / -4.7% 1.10 / 1.05 / +4.4%

No file size changes detected.

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR e31e4d0a vs base 9324b04d

vortex / vortex-file-compressed / ns (0.977x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 764619535 / 769700483 / -0.7%
compress time/Bimbo 3702149587 / 3743459651 / -1.1%
compress time/CMSprovider 2511335432 / 2656050690 / -5.4%
compress time/Euro2016 266085180 / 271020920 / -1.8%
compress time/Food 278022703 / 282547111 / -1.6%
compress time/HashTags 477129775 / 488566768 / -2.3%
compress time/TPC-H l_comment canonical 630553135 / 630617075 / -0.0%
compress time/TPC-H l_comment chunked 629514357 / 630016289 / -0.1%
compress time/taxi 399424264 / 409518974 / -2.5%
compress time/wide table cols=100 chunks=1 rows=1000 6945034 / 7519257 / -7.6%
compress time/wide table cols=100 chunks=50 rows=1000 7021908 / 7181558 / -2.2%
compress time/wide table cols=1000 chunks=1 rows=1000 69837132 / 72187195 / -3.3%
compress time/wide table cols=1000 chunks=50 rows=1000 69426183 / 72491937 / -4.2%
compress time/wide table cols=10000 chunks=1 rows=1000 739669748 / 769068284 / -3.8%
compress time/wide table cols=10000 chunks=50 rows=1000 755917920 / 784198260 / -3.6%
decompress time/Arade 9088882 / 9354963 / -2.8%
decompress time/Bimbo 36935842 / 38100499 / -3.1%
decompress time/CMSprovider 28980879 / 29122551 / -0.5%
decompress time/Euro2016 6951770 / 7083026 / -1.9%
decompress time/Food 2773297 / 2578814 / +7.5%
decompress time/HashTags 47790172 / 48307217 / -1.1%
decompress time/TPC-H l_comment canonical 20925464 / 22297469 / -6.2%
decompress time/TPC-H l_comment chunked 20867506 / 21457848 / -2.8%
decompress time/taxi 5366728 / 5728436 / -6.3%
decompress time/wide table cols=100 chunks=1 rows=1000 1962951 / 2025675 / -3.1%
decompress time/wide table cols=100 chunks=50 rows=1000 1961417 / 2011508 / -2.5%
decompress time/wide table cols=1000 chunks=1 rows=1000 19154214 / 19267405 / -0.6%
decompress time/wide table cols=1000 chunks=50 rows=1000 18886885 / 19479566 / -3.0%
decompress time/wide table cols=10000 chunks=1 rows=1000 219617942 / 224431844 / -2.1%
decompress time/wide table cols=10000 chunks=50 rows=1000 227326656 / 223208205 / +1.8%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142212028 / 142212028 / +0.0%
vortex-file-compressed size/Bimbo 458553996 / 458553996 / +0.0%
vortex-file-compressed size/CMSprovider 420778804 / 420778804 / +0.0%
vortex-file-compressed size/Euro2016 164046188 / 164046188 / +0.0%
vortex-file-compressed size/Food 38949464 / 38949464 / +0.0%
vortex-file-compressed size/HashTags 190338852 / 190338852 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845112 / 179845112 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845112 / 179845112 / +0.0%
vortex-file-compressed size/taxi 49994396 / 49994396 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.986x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.339291255 / 0.342171127 / -0.8%
vortex:parquet-zstd ratio compress time/Bimbo 0.31334388 / 0.317593173 / -1.3%
vortex:parquet-zstd ratio compress time/CMSprovider 0.393952411 / 0.415219343 / -5.1%
vortex:parquet-zstd ratio compress time/Euro2016 0.246831986 / 0.251073392 / -1.7%
vortex:parquet-zstd ratio compress time/Food 0.376739607 / 0.380591206 / -1.0%
vortex:parquet-zstd ratio compress time/HashTags 0.26063152 / 0.266494675 / -2.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.239208806 / 0.239646785 / -0.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.239360489 / 0.239046233 / +0.1%
vortex:parquet-zstd ratio compress time/taxi 0.366084022 / 0.374844055 / -2.3%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.75065987 / 1.89196111 / -7.5%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.77096721 / 1.76410876 / +0.4%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.56526372 / 1.61872482 / -3.3%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.55678741 / 1.59854597 / -2.6%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.58104705 / 1.69786678 / -6.9%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.64982833 / 1.72618556 / -4.4%
vortex:parquet-zstd ratio decompress time/Arade 0.016334644 / 0.0167043626 / -2.2%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0229756595 / 0.0235267783 / -2.3%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0212555453 / 0.0212467958 / +0.0%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0208937993 / 0.0211866456 / -1.4%
vortex:parquet-zstd ratio decompress time/Food 0.0162956757 / 0.0150456221 / +8.3%
vortex:parquet-zstd ratio decompress time/HashTags 0.0927352134 / 0.0933765125 / -0.7%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0418992515 / 0.0447463793 / -6.4%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0418642028 / 0.0430923917 / -2.9%
vortex:parquet-zstd ratio decompress time/taxi 0.0246518317 / 0.026211212 / -5.9%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.941641702 / 0.978699956 / -3.8%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.945029388 / 0.926386742 / +2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.816728601 / 0.811656887 / +0.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.808279629 / 0.801262749 / +0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.86705088 / 0.915807033 / -5.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.905956812 / 0.918294477 / -1.3%
vortex:parquet-zstd size/Arade 0.551178899 / 0.551178899 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19254454 / 1.19254454 / +0.0%
vortex:parquet-zstd size/CMSprovider 1.11645609 / 1.11645609 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33393606 / 1.33393606 / +0.0%
vortex:parquet-zstd size/Food 1.09103668 / 1.09103668 / +0.0%
vortex:parquet-zstd size/HashTags 1.42578493 / 1.42578493 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568523 / 1.13568523 / -0.0%
vortex:parquet-zstd size/taxi 0.904325412 / 0.904325412 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (0.998x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2253578667 / 2249460643 / +0.2%
parquet_rs-zstd compress time/Bimbo 11814973344 / 11786965107 / +0.2%
parquet_rs-zstd compress time/CMSprovider 6374717764 / 6396741223 / -0.3%
parquet_rs-zstd compress time/Euro2016 1078001211 / 1079448992 / -0.1%
parquet_rs-zstd compress time/Food 737970465 / 742390014 / -0.6%
parquet_rs-zstd compress time/HashTags 1830667965 / 1833307808 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2635994662 / 2631443921 / +0.2%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2629984420 / 2635541591 / -0.2%
parquet_rs-zstd compress time/taxi 1091072651 / 1092504920 / -0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3967095 / 3974319 / -0.2%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3965013 / 4070927 / -2.6%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44616847 / 44595100 / +0.0%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44595802 / 45348672 / -1.7%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 467835380 / 452961501 / +3.3%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 458179744 / 454295459 / +0.9%
parquet_rs-zstd decompress time/Arade 556417514 / 560031127 / -0.6%
parquet_rs-zstd decompress time/Bimbo 1607607477 / 1619452461 / -0.7%
parquet_rs-zstd decompress time/CMSprovider 1363450268 / 1370679666 / -0.5%
parquet_rs-zstd decompress time/Euro2016 332719286 / 334315593 / -0.5%
parquet_rs-zstd decompress time/Food 170186070 / 171399626 / -0.7%
parquet_rs-zstd decompress time/HashTags 515340077 / 517337987 / -0.4%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 499423337 / 498307782 / +0.2%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 498457026 / 497949804 / +0.1%
parquet_rs-zstd decompress time/taxi 217700983 / 218549070 / -0.4%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2084605 / 2069761 / +0.7%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2075509 / 2171348 / -4.4%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23452361 / 23738362 / -1.2%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23366771 / 24311084 / -3.9%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 253293027 / 245064556 / +3.4%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 250924385 / 243068221 / +3.2%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.988x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 98181713 / 100303252 / -2.1%
arrow-ipc compress time/Bimbo 616453020 / 636672202 / -3.2%
arrow-ipc compress time/CMSprovider 388696012 / 388513582 / +0.0%
arrow-ipc compress time/Euro2016 38361738 / 38712051 / -0.9%
arrow-ipc compress time/Food 33723762 / 34126043 / -1.2%
arrow-ipc compress time/HashTags 78589140 / 79051317 / -0.6%
arrow-ipc compress time/TPC-H l_comment canonical 498242600 / 499547608 / -0.3%
arrow-ipc compress time/TPC-H l_comment chunked 500369022 / 501201684 / -0.2%
arrow-ipc compress time/taxi 74178647 / 75803958 / -2.1%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 207413 / 205110 / +1.1%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 202080 / 206924 / -2.3%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2245334 / 2270275 / -1.1%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2223931 / 2268996 / -2.0%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25513917 / 25617298 / -0.4%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25715086 / 25853640 / -0.5%
arrow-ipc decompress time/Arade 180635820 / 182430970 / -1.0%
arrow-ipc decompress time/Bimbo 407557277 / 429865140 / -5.2%
arrow-ipc decompress time/CMSprovider 580335719 / 581266850 / -0.2%
arrow-ipc decompress time/Euro2016 74667103 / 74970450 / -0.4%
arrow-ipc decompress time/Food 58256786 / 58364108 / -0.2%
arrow-ipc decompress time/HashTags 143457549 / 144586348 / -0.8%
arrow-ipc decompress time/TPC-H l_comment canonical 532321070 / 533873573 / -0.3%
arrow-ipc decompress time/TPC-H l_comment chunked 530679776 / 530723340 / -0.0%
arrow-ipc decompress time/taxi 48153801 / 48869769 / -1.5%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 322162 / 323080 / -0.3%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 318710 / 351365 / -9.3%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3644557 / 3634886 / +0.3%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3624437 / 3637674 / -0.4%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36110795 / 36736967 / -1.7%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36943868 / 36720167 / +0.6%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.0%
Engines: DataFusion No clear signal (+9.2%, environment too noisy confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 0.930x ➖ · cold 0.951x ➖
Parquet (geomean): hot 0.894x ➖ · cold 0.914x ➖
Shifts: Parquet (control) -10.6% · Median polish -10.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.066x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 217228470 / 234431565 / -7.3% 876340312 / 978422603 / -10.4% 0.25 / 0.24 / +3.5%
tpch_q02/datafusion:vortex-file-compressed 859489085 / 376488875 / +128.3% 🔴 1381023987 / 758136878 / +82.2% 🔴 0.62 / 0.50 / +25.3%
tpch_q03/datafusion:vortex-file-compressed 467038765 / 418755090 / +11.5% 1109978800 / 1406574191 / -21.1% 0.42 / 0.30 / +41.3%
tpch_q04/datafusion:vortex-file-compressed 243786001 / 218615924 / +11.5% 564202734 / 451021104 / +25.1% 0.43 / 0.48 / -10.9%
tpch_q05/datafusion:vortex-file-compressed 539371278 / 450631569 / +19.7% 917001764 / 777491564 / +17.9% 0.59 / 0.58 / +1.5%
tpch_q06/datafusion:vortex-file-compressed 299894007 / 338529854 / -11.4% 563897798 / 504359741 / +11.8% 0.53 / 0.67 / -20.8%
tpch_q07/datafusion:vortex-file-compressed 430548782 / 448209044 / -3.9% 588763522 / 617848040 / -4.7% 0.73 / 0.73 / +0.8%
tpch_q08/datafusion:vortex-file-compressed 826569952 / 568077026 / +45.5% 🔴 777837844 / 977298891 / -20.4% 1.06 / 0.58 / +82.8%
tpch_q09/datafusion:vortex-file-compressed 535406535 / 452735745 / +18.3% 670249500 / 602989097 / +11.2% 0.80 / 0.75 / +6.4%
tpch_q10/datafusion:vortex-file-compressed 530441168 / 488479553 / +8.6% 768350199 / 687823895 / +11.7% 0.69 / 0.71 / -2.8%
tpch_q11/datafusion:vortex-file-compressed 363387415 / 327351464 / +11.0% 443369766 / 447438327 / -0.9% 0.82 / 0.73 / +12.0%
tpch_q12/datafusion:vortex-file-compressed 523458929 / 761037883 / -31.2% 🟢 1037098007 / 943576884 / +9.9% 0.50 / 0.81 / -37.4%
tpch_q13/datafusion:vortex-file-compressed 208240552 / 167334417 / +24.4% 400824378 / 449025272 / -10.7% 0.52 / 0.37 / +39.4%
tpch_q14/datafusion:vortex-file-compressed 205549453 / 221733716 / -7.3% 338465802 / 317700649 / +6.5% 0.61 / 0.70 / -13.0%
tpch_q15/datafusion:vortex-file-compressed 355840963 / 357365120 / -0.4% 671917948 / 823391754 / -18.4% 0.53 / 0.43 / +22.0%
tpch_q16/datafusion:vortex-file-compressed 257757178 / 172353326 / +49.6% 🔴 426436274 / 476907082 / -10.6% 0.60 / 0.36 / +67.3%
tpch_q17/datafusion:vortex-file-compressed 413616106 / 544929448 / -24.1% 502479326 / 1016403618 / -50.6% 🟢 0.82 / 0.54 / +53.5%
tpch_q18/datafusion:vortex-file-compressed 436329700 / 398287969 / +9.6% 583438938 / 745391378 / -21.7% 0.75 / 0.53 / +40.0%
tpch_q19/datafusion:vortex-file-compressed 389651984 / 410546399 / -5.1% 737392900 / 526708126 / +40.0% 🔴 0.53 / 0.78 / -32.2%
tpch_q20/datafusion:vortex-file-compressed 394527382 / 389787031 / +1.2% 675460477 / 833455144 / -19.0% 0.58 / 0.47 / +24.9%
tpch_q21/datafusion:vortex-file-compressed 601997554 / 570713222 / +5.5% 654386516 / 820422127 / -20.2% 0.92 / 0.70 / +32.2%
tpch_q22/datafusion:vortex-file-compressed 209690011 / 284134232 / -26.2% 494735603 / 429630873 / +15.2% 0.42 / 0.66 / -35.9%
datafusion / vortex-compact / ns (0.872x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 223667106 / 237641348 / -5.9% 778380830 / 789636379 / -1.4% 0.29 / 0.30 / -4.5%
tpch_q02/datafusion:vortex-compact 366392203 / 390572289 / -6.2% 724799924 / 777059920 / -6.7% 0.51 / 0.50 / +0.6%
tpch_q03/datafusion:vortex-compact 376985434 / 407267088 / -7.4% 1167035829 / 993409612 / +17.5% 0.32 / 0.41 / -21.2%
tpch_q04/datafusion:vortex-compact 215526026 / 274277051 / -21.4% 544451913 / 439182609 / +24.0% 0.40 / 0.62 / -36.6%
tpch_q05/datafusion:vortex-compact 706862332 / 488657321 / +44.7% 🔴 628780470 / 782428843 / -19.6% 1.12 / 0.62 / +80.0%
tpch_q06/datafusion:vortex-compact 302210015 / 309680349 / -2.4% 533766910 / 397853135 / +34.2% 🔴 0.57 / 0.78 / -27.3%
tpch_q07/datafusion:vortex-compact 438390932 / 537338516 / -18.4% 528754162 / 735134494 / -28.1% 0.83 / 0.73 / +13.4%
tpch_q08/datafusion:vortex-compact 503084872 / 719213493 / -30.1% 🟢 623459910 / 914719800 / -31.8% 🟢 0.81 / 0.79 / +2.6%
tpch_q09/datafusion:vortex-compact 380534211 / 571059109 / -33.4% 🟢 453725568 / 653217096 / -30.5% 🟢 0.84 / 0.87 / -4.1%
tpch_q10/datafusion:vortex-compact 368058381 / 450780093 / -18.4% 531940698 / 1218008194 / -56.3% 🟢 0.69 / 0.37 / +87.0%
tpch_q11/datafusion:vortex-compact 394660195 / 444678923 / -11.2% 563260318 / 528221741 / +6.6% 0.70 / 0.84 / -16.8%
tpch_q12/datafusion:vortex-compact 305360462 / 376569807 / -18.9% 590520156 / 590557233 / -0.0% 0.52 / 0.64 / -18.9%
tpch_q13/datafusion:vortex-compact 130047828 / 142432836 / -8.7% 457908334 / 475410289 / -3.7% 0.28 / 0.30 / -5.2%
tpch_q14/datafusion:vortex-compact 188341349 / 209828055 / -10.2% 311227019 / 473149182 / -34.2% 🟢 0.61 / 0.44 / +36.5%
tpch_q15/datafusion:vortex-compact 288837196 / 339199669 / -14.8% 527275793 / 609204717 / -13.4% 0.55 / 0.56 / -1.6%
tpch_q16/datafusion:vortex-compact 177425177 / 183643176 / -3.4% 327818490 / 333401450 / -1.7% 0.54 / 0.55 / -1.7%
tpch_q17/datafusion:vortex-compact 310679196 / 368146547 / -15.6% 523492258 / 472462190 / +10.8% 0.59 / 0.78 / -23.8%
tpch_q18/datafusion:vortex-compact 378347967 / 312692704 / +21.0% 560450014 / 477934449 / +17.3% 0.68 / 0.65 / +3.2%
tpch_q19/datafusion:vortex-compact 521415176 / 1241780341 / -58.0% 🟢 570643805 / 561180446 / +1.7% 0.91 / 2.21 / -58.7%
tpch_q20/datafusion:vortex-compact 336609404 / 329685856 / +2.1% 886667683 / 487328570 / +81.9% 🔴 0.38 / 0.68 / -43.9%
tpch_q21/datafusion:vortex-compact 484605830 / 444676021 / +9.0% 712470288 / 625545981 / +13.9% 0.68 / 0.71 / -4.3%
tpch_q22/datafusion:vortex-compact 176793003 / 233927846 / -24.4% 395063054 / 443364133 / -10.9% 0.45 / 0.53 / -15.2%
datafusion / parquet / ns (0.883x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 181703723 / 173556310 / +4.7% 478718863 / 591047348 / -19.0% 0.38 / 0.29 / +29.3%
tpch_q02/datafusion:parquet 316348528 / 296364523 / +6.7% 601055805 / 541903348 / +10.9% 0.53 / 0.55 / -3.8%
tpch_q03/datafusion:parquet 250296630 / 313006716 / -20.0% 772950949 / 825633899 / -6.4% 0.32 / 0.38 / -14.6%
tpch_q04/datafusion:parquet 165766911 / 220588937 / -24.9% 440036746 / 418464411 / +5.2% 0.38 / 0.53 / -28.5%
tpch_q05/datafusion:parquet 392213824 / 454860126 / -13.8% 463536921 / 704506451 / -34.2% 🟢 0.85 / 0.65 / +31.1%
tpch_q06/datafusion:parquet 136228018 / 140804733 / -3.3% 304535318 / 282252146 / +7.9% 0.45 / 0.50 / -10.3%
tpch_q07/datafusion:parquet 474738885 / 450468002 / +5.4% 528762527 / 466202993 / +13.4% 0.90 / 0.97 / -7.1%
tpch_q08/datafusion:parquet 497104750 / 512089890 / -2.9% 691730852 / 711457862 / -2.8% 0.72 / 0.72 / -0.2%
tpch_q09/datafusion:parquet 436802337 / 429695437 / +1.7% 621861880 / 618238862 / +0.6% 0.70 / 0.70 / +1.1%
tpch_q10/datafusion:parquet 402270895 / 453805355 / -11.4% 648417616 / 629994024 / +2.9% 0.62 / 0.72 / -13.9%
tpch_q11/datafusion:parquet 268154319 / 306638175 / -12.6% 435004149 / 521202867 / -16.5% 0.62 / 0.59 / +4.8%
tpch_q12/datafusion:parquet 202140348 / 221185708 / -8.6% 481940843 / 495375489 / -2.7% 0.42 / 0.45 / -6.1%
tpch_q13/datafusion:parquet 364201013 / 397090341 / -8.3% 509380027 / 639788394 / -20.4% 0.71 / 0.62 / +15.2%
tpch_q14/datafusion:parquet 162614713 / 263625543 / -38.3% 🟢 293985115 / 412141497 / -28.7% 0.55 / 0.64 / -13.5%
tpch_q15/datafusion:parquet 381870525 / 370452684 / +3.1% 470773492 / 629109438 / -25.2% 0.81 / 0.59 / +37.8%
tpch_q16/datafusion:parquet 130669243 / 117994622 / +10.7% 428175359 / 332818825 / +28.7% 0.31 / 0.35 / -13.9%
tpch_q17/datafusion:parquet 322796737 / 408367950 / -21.0% 449470054 / 471181257 / -4.6% 0.72 / 0.87 / -17.1%
tpch_q18/datafusion:parquet 365509173 / 435326900 / -16.0% 523768529 / 694724442 / -24.6% 0.70 / 0.63 / +11.4%
tpch_q19/datafusion:parquet 187050325 / 228354930 / -18.1% 324964726 / 457652831 / -29.0% 0.58 / 0.50 / +15.4%
tpch_q20/datafusion:parquet 303826650 / 382851691 / -20.6% 702731468 / 564583465 / +24.5% 0.43 / 0.68 / -36.2%
tpch_q21/datafusion:parquet 416331791 / 583768101 / -28.7% 517963996 / 583790666 / -11.3% 0.80 / 1.00 / -19.6%
tpch_q22/datafusion:parquet 206464284 / 259320478 / -20.4% 406315134 / 447041951 / -9.1% 0.51 / 0.58 / -12.4%
duckdb / vortex-file-compressed / ns (0.912x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 200403864 / 212207487 / -5.6% 419369776 / 524098911 / -20.0% 0.48 / 0.40 / +18.0%
tpch_q02/duckdb:vortex-file-compressed 541130083 / 479748949 / +12.8% 573374638 / 449616693 / +27.5% 0.94 / 1.07 / -11.6%
tpch_q03/duckdb:vortex-file-compressed 672499911 / 630117112 / +6.7% 1060446360 / 805262921 / +31.7% 🔴 0.63 / 0.78 / -19.0%
tpch_q04/duckdb:vortex-file-compressed 437520703 / 339054682 / +29.0% 348473159 / 525477849 / -33.7% 🟢 1.26 / 0.65 / +94.6%
tpch_q05/duckdb:vortex-file-compressed 508594929 / 784571828 / -35.2% 🟢 600219277 / 1378643875 / -56.5% 🟢 0.85 / 0.57 / +48.9%
tpch_q06/duckdb:vortex-file-compressed 305425832 / 341942496 / -10.7% 340572111 / 326843223 / +4.2% 0.90 / 1.05 / -14.3%
tpch_q07/duckdb:vortex-file-compressed 569724481 / 556540767 / +2.4% 628423528 / 757169488 / -17.0% 0.91 / 0.74 / +23.3%
tpch_q08/duckdb:vortex-file-compressed 733206236 / 789330844 / -7.1% 684219036 / 907973127 / -24.6% 1.07 / 0.87 / +23.3%
tpch_q09/duckdb:vortex-file-compressed 515505093 / 571571042 / -9.8% 542868753 / 454175980 / +19.5% 0.95 / 1.26 / -24.5%
tpch_q10/duckdb:vortex-file-compressed 574901285 / 791272513 / -27.3% 517421259 / 526698236 / -1.8% 1.11 / 1.50 / -26.0%
tpch_q11/duckdb:vortex-file-compressed 193789003 / 246777514 / -21.5% 242349492 / 286253582 / -15.3% 0.80 / 0.86 / -7.2%
tpch_q12/duckdb:vortex-file-compressed 486990526 / 607757233 / -19.9% 505105328 / 547742335 / -7.8% 0.96 / 1.11 / -13.1%
tpch_q13/duckdb:vortex-file-compressed 374410295 / 703000936 / -46.7% 🟢 614382846 / 640810775 / -4.1% 0.61 / 1.10 / -44.5%
tpch_q14/duckdb:vortex-file-compressed 267198056 / 410171874 / -34.9% 🟢 336268365 / 418857513 / -19.7% 0.79 / 0.98 / -18.9%
tpch_q15/duckdb:vortex-file-compressed 176857271 / 203091215 / -12.9% 217957220 / 186822442 / +16.7% 0.81 / 1.09 / -25.4%
tpch_q16/duckdb:vortex-file-compressed 217987028 / 215262689 / +1.3% 340412911 / 198606613 / +71.4% 🔴 0.64 / 1.08 / -40.9%
tpch_q17/duckdb:vortex-file-compressed 440784506 / 457294995 / -3.6% 473985599 / 497263693 / -4.7% 0.93 / 0.92 / +1.1%
tpch_q18/duckdb:vortex-file-compressed 389033211 / 459091242 / -15.3% 515638918 / 396445893 / +30.1% 🔴 0.75 / 1.16 / -34.8%
tpch_q19/duckdb:vortex-file-compressed 435995952 / 319675288 / +36.4% 🔴 857481276 / 378231818 / +126.7% 🔴 0.51 / 0.85 / -39.8%
tpch_q20/duckdb:vortex-file-compressed 414813611 / 442538880 / -6.3% 429966712 / 545861097 / -21.2% 0.96 / 0.81 / +19.0%
tpch_q21/duckdb:vortex-file-compressed 660180211 / 618982697 / +6.7% 822820015 / 696338341 / +18.2% 0.80 / 0.89 / -9.7%
tpch_q22/duckdb:vortex-file-compressed 281847469 / 240068778 / +17.4% 205851234 / 270561172 / -23.9% 1.37 / 0.89 / +54.3%
duckdb / vortex-compact / ns (0.880x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 219034919 / 214242142 / +2.2% 374143486 / 535912619 / -30.2% 🟢 0.59 / 0.40 / +46.4%
tpch_q02/duckdb:vortex-compact 418256057 / 436779519 / -4.2% 427041619 / 494370795 / -13.6% 0.98 / 0.88 / +10.9%
tpch_q03/duckdb:vortex-compact 420825150 / 499620767 / -15.8% 537833615 / 704920727 / -23.7% 0.78 / 0.71 / +10.4%
tpch_q04/duckdb:vortex-compact 303086025 / 256214682 / +18.3% 421279476 / 344147708 / +22.4% 0.72 / 0.74 / -3.4%
tpch_q05/duckdb:vortex-compact 387823256 / 392357220 / -1.2% 635618226 / 425754316 / +49.3% 🔴 0.61 / 0.92 / -33.8%
tpch_q06/duckdb:vortex-compact 290190145 / 382954986 / -24.2% 277912038 / 364442327 / -23.7% 1.04 / 1.05 / -0.6%
tpch_q07/duckdb:vortex-compact 480325162 / 689663684 / -30.4% 🟢 537812801 / 839740878 / -36.0% 🟢 0.89 / 0.82 / +8.7%
tpch_q08/duckdb:vortex-compact 651975165 / 630108802 / +3.5% 638763312 / 726368508 / -12.1% 1.02 / 0.87 / +17.7%
tpch_q09/duckdb:vortex-compact 472019467 / 574957429 / -17.9% 510790869 / 479748570 / +6.5% 0.92 / 1.20 / -22.9%
tpch_q10/duckdb:vortex-compact 463032005 / 649446261 / -28.7% 523396139 / 620223612 / -15.6% 0.88 / 1.05 / -15.5%
tpch_q11/duckdb:vortex-compact 191185888 / 256945106 / -25.6% 218581848 / 310209651 / -29.5% 0.87 / 0.83 / +5.6%
tpch_q12/duckdb:vortex-compact 411967554 / 555267474 / -25.8% 470521552 / 561274634 / -16.2% 0.88 / 0.99 / -11.5%
tpch_q13/duckdb:vortex-compact 243101748 / 482352341 / -49.6% 🟢 291901963 / 494499981 / -41.0% 🟢 0.83 / 0.98 / -14.6%
tpch_q14/duckdb:vortex-compact 362682943 / 225618298 / +60.8% 🔴 585528421 / 254086402 / +130.4% 🔴 0.62 / 0.89 / -30.2%
tpch_q15/duckdb:vortex-compact 162890092 / 162389363 / +0.3% 279982955 / 218167518 / +28.3% 0.58 / 0.74 / -21.8%
tpch_q16/duckdb:vortex-compact 181199778 / 216924766 / -16.5% 199923455 / 258324188 / -22.6% 0.91 / 0.84 / +7.9%
tpch_q17/duckdb:vortex-compact 387726610 / 435713320 / -11.0% 402161632 / 486465027 / -17.3% 0.96 / 0.90 / +7.6%
tpch_q18/duckdb:vortex-compact 345472048 / 391115342 / -11.7% 369617214 / 369422892 / +0.1% 0.93 / 1.06 / -11.7%
tpch_q19/duckdb:vortex-compact 365349535 / 368398851 / -0.8% 458190768 / 494141450 / -7.3% 0.80 / 0.75 / +7.0%
tpch_q20/duckdb:vortex-compact 401650527 / 403500946 / -0.5% 396946214 / 449133385 / -11.6% 1.01 / 0.90 / +12.6%
tpch_q21/duckdb:vortex-compact 616075066 / 845239722 / -27.1% 741438540 / 981883382 / -24.5% 0.83 / 0.86 / -3.5%
tpch_q22/duckdb:vortex-compact 171719461 / 185389159 / -7.4% 182814924 / 264382120 / -30.9% 🟢 0.94 / 0.70 / +34.0%
duckdb / parquet / ns (0.904x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 297166347 / 379251000 / -21.6% 311493335 / 429565243 / -27.5% 0.95 / 0.88 / +8.1%
tpch_q02/duckdb:parquet 743123239 / 660103612 / +12.6% 892404262 / 1007594482 / -11.4% 0.83 / 0.66 / +27.1%
tpch_q03/duckdb:parquet 773682922 / 855311698 / -9.5% 826829783 / 951296321 / -13.1% 0.94 / 0.90 / +4.1%
tpch_q04/duckdb:parquet 549328748 / 541646241 / +1.4% 560173153 / 670869067 / -16.5% 0.98 / 0.81 / +21.5%
tpch_q05/duckdb:parquet 994603385 / 1009241051 / -1.5% 991808783 / 1274242386 / -22.2% 1.00 / 0.79 / +26.6%
tpch_q06/duckdb:parquet 320273362 / 498652806 / -35.8% 🟢 298277361 / 464031525 / -35.7% 🟢 1.07 / 1.07 / -0.1%
tpch_q07/duckdb:parquet 884210288 / 1097478863 / -19.4% 839639152 / 893010783 / -6.0% 1.05 / 1.23 / -14.3%
tpch_q08/duckdb:parquet 1134819789 / 1222916237 / -7.2% 1253004306 / 1219080526 / +2.8% 0.91 / 1.00 / -9.7%
tpch_q09/duckdb:parquet 1028355988 / 1118569986 / -8.1% 1058293593 / 1290037680 / -18.0% 0.97 / 0.87 / +12.1%
tpch_q10/duckdb:parquet 1020575899 / 1150811461 / -11.3% 930949916 / 1152383235 / -19.2% 1.10 / 1.00 / +9.8%
tpch_q11/duckdb:parquet 502527266 / 470277823 / +6.9% 464975449 / 470001506 / -1.1% 1.08 / 1.00 / +8.0%
tpch_q12/duckdb:parquet 629498869 / 660974741 / -4.8% 963662591 / 705380543 / +36.6% 🔴 0.65 / 0.94 / -30.3%
tpch_q13/duckdb:parquet 728867030 / 734009342 / -0.7% 1370833454 / 923125175 / +48.5% 🔴 0.53 / 0.80 / -33.1%
tpch_q14/duckdb:parquet 549291315 / 592346426 / -7.3% 565870757 / 662511096 / -14.6% 0.97 / 0.89 / +8.6%
tpch_q15/duckdb:parquet 404628748 / 395917098 / +2.2% 374478220 / 441232371 / -15.1% 1.08 / 0.90 / +20.4%
tpch_q16/duckdb:parquet 498259237 / 528057993 / -5.6% 636586323 / 485198967 / +31.2% 🔴 0.78 / 1.09 / -28.1%
tpch_q17/duckdb:parquet 445933474 / 639124039 / -30.2% 🟢 521186207 / 510208757 / +2.2% 0.86 / 1.25 / -31.7%
tpch_q18/duckdb:parquet 627002608 / 807211360 / -22.3% 576169055 / 749372479 / -23.1% 1.09 / 1.08 / +1.0%
tpch_q19/duckdb:parquet 593474977 / 664915573 / -10.7% 678587819 / 1164118983 / -41.7% 🟢 0.87 / 0.57 / +53.1%
tpch_q20/duckdb:parquet 887951380 / 984214475 / -9.8% 776217625 / 873836143 / -11.2% 1.14 / 1.13 / +1.6%
tpch_q21/duckdb:parquet 695009899 / 814070357 / -14.6% 697199337 / 750776063 / -7.1% 1.00 / 1.08 / -8.1%
tpch_q22/duckdb:parquet 437457781 / 423809428 / +3.2% 441910400 / 400285111 / +10.4% 0.99 / 1.06 / -6.5%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.9%
Engines: DataFusion No clear signal (+16.7%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, environment too noisy confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.911x ➖
Parquet (geomean): hot 0.927x ➖ · cold 0.881x ➖
Shifts: Parquet (control) -7.3% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (1.011x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 509025264 / 421562417 / +20.7% 1125843196 / 1595819443 / -29.5% 0.45 / 0.26 / +71.2%
tpch_q02/datafusion:vortex-compact 600415623 / 710137069 / -15.5% 1132880490 / 1286010116 / -11.9% 0.53 / 0.55 / -4.0%
tpch_q03/datafusion:vortex-compact 701368043 / 725353190 / -3.3% 1561821544 / 1889921584 / -17.4% 0.45 / 0.38 / +17.0%
tpch_q04/datafusion:vortex-compact 409338938 / 353839740 / +15.7% 730948722 / 698569270 / +4.6% 0.56 / 0.51 / +10.6%
tpch_q05/datafusion:vortex-compact 752840234 / 814140447 / -7.5% 972283519 / 1201879665 / -19.1% 0.77 / 0.68 / +14.3%
tpch_q06/datafusion:vortex-compact 428545926 / 375984019 / +14.0% 532095963 / 734689497 / -27.6% 0.81 / 0.51 / +57.4%
tpch_q07/datafusion:vortex-compact 679474987 / 666106269 / +2.0% 804043254 / 803030333 / +0.1% 0.85 / 0.83 / +1.9%
tpch_q08/datafusion:vortex-compact 1156459229 / 1445766030 / -20.0% 1210583225 / 1769771824 / -31.6% 🟢 0.96 / 0.82 / +16.9%
tpch_q09/datafusion:vortex-compact 726791596 / 729344138 / -0.3% 1128442560 / 1087808844 / +3.7% 0.64 / 0.67 / -3.9%
tpch_q10/datafusion:vortex-compact 1040048705 / 743058557 / +40.0% 🔴 1460523685 / 1143011967 / +27.8% 0.71 / 0.65 / +9.5%
tpch_q11/datafusion:vortex-compact 374144089 / 585966796 / -36.1% 🟢 747306907 / 846699656 / -11.7% 0.50 / 0.69 / -27.7%
tpch_q12/datafusion:vortex-compact 762426172 / 849147942 / -10.2% 884021737 / 1217978121 / -27.4% 0.86 / 0.70 / +23.7%
tpch_q13/datafusion:vortex-compact 610630116 / 336775565 / +81.3% 🔴 668425119 / 709938361 / -5.8% 0.91 / 0.47 / +92.6%
tpch_q14/datafusion:vortex-compact 431104782 / 514049633 / -16.1% 598095128 / 986910892 / -39.4% 🟢 0.72 / 0.52 / +38.4%
tpch_q15/datafusion:vortex-compact 934377442 / 728803871 / +28.2% 1018655811 / 849160490 / +20.0% 0.92 / 0.86 / +6.9%
tpch_q16/datafusion:vortex-compact 421649214 / 369697556 / +14.1% 534560863 / 708194785 / -24.5% 0.79 / 0.52 / +51.1%
tpch_q17/datafusion:vortex-compact 773417471 / 1084670786 / -28.7% 991782438 / 1127126527 / -12.0% 0.78 / 0.96 / -19.0%
tpch_q18/datafusion:vortex-compact 809290148 / 627455754 / +29.0% 839778632 / 747968160 / +12.3% 0.96 / 0.84 / +14.9%
tpch_q19/datafusion:vortex-compact 577703133 / 669808302 / -13.8% 856389768 / 823549404 / +4.0% 0.67 / 0.81 / -17.1%
tpch_q20/datafusion:vortex-compact 858576715 / 741487483 / +15.8% 1434378667 / 946825680 / +51.5% 🔴 0.60 / 0.78 / -23.6%
tpch_q21/datafusion:vortex-compact 750942329 / 808693950 / -7.1% 1065969436 / 1012250110 / +5.3% 0.70 / 0.80 / -11.8%
tpch_q22/datafusion:vortex-compact 397274318 / 466986287 / -14.9% 943373862 / 825032150 / +14.3% 0.42 / 0.57 / -25.6%
datafusion / parquet / ns (0.866x ➖, 5↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 247287244 / 388223902 / -36.3% 🟢 812688457 / 887262930 / -8.4% 0.30 / 0.44 / -30.5%
tpch_q02/datafusion:parquet 771406973 / 548494410 / +40.6% 🔴 1464426572 / 1297095858 / +12.9% 0.53 / 0.42 / +24.6%
tpch_q03/datafusion:parquet 592007019 / 780051947 / -24.1% 1213543136 / 1432948708 / -15.3% 0.49 / 0.54 / -10.4%
tpch_q04/datafusion:parquet 409822367 / 422534819 / -3.0% 848840687 / 575111743 / +47.6% 🔴 0.48 / 0.73 / -34.3%
tpch_q05/datafusion:parquet 775572492 / 711977050 / +8.9% 945700788 / 1093435064 / -13.5% 0.82 / 0.65 / +25.9%
tpch_q06/datafusion:parquet 194110752 / 299242662 / -35.1% 🟢 351970984 / 499124205 / -29.5% 0.55 / 0.60 / -8.0%
tpch_q07/datafusion:parquet 703231143 / 669888476 / +5.0% 900380542 / 969354807 / -7.1% 0.78 / 0.69 / +13.0%
tpch_q08/datafusion:parquet 1013706220 / 1148217920 / -11.7% 1549981679 / 1279444863 / +21.1% 0.65 / 0.90 / -27.1%
tpch_q09/datafusion:parquet 1244658713 / 1189558211 / +4.6% 1562298022 / 1492642302 / +4.7% 0.80 / 0.80 / -0.0%
tpch_q10/datafusion:parquet 2006441223 / 1411801773 / +42.1% 🔴 3297088610 / 2418270223 / +36.3% 🔴 0.61 / 0.58 / +4.2%
tpch_q11/datafusion:parquet 505644245 / 535352336 / -5.5% 684777328 / 827017416 / -17.2% 0.74 / 0.65 / +14.1%
tpch_q12/datafusion:parquet 416951924 / 625993098 / -33.4% 🟢 646889069 / 916842985 / -29.4% 0.64 / 0.68 / -5.6%
tpch_q13/datafusion:parquet 503771535 / 592157375 / -14.9% 966780773 / 1016028414 / -4.8% 0.52 / 0.58 / -10.6%
tpch_q14/datafusion:parquet 428463303 / 449999144 / -4.8% 672002246 / 837703473 / -19.8% 0.64 / 0.54 / +18.7%
tpch_q15/datafusion:parquet 745713225 / 1088079207 / -31.5% 🟢 954305489 / 1197752679 / -20.3% 0.78 / 0.91 / -14.0%
tpch_q16/datafusion:parquet 285420904 / 369935956 / -22.8% 626326990 / 684524058 / -8.5% 0.46 / 0.54 / -15.7%
tpch_q17/datafusion:parquet 746698360 / 933956796 / -20.1% 933742711 / 1241885518 / -24.8% 0.80 / 0.75 / +6.3%
tpch_q18/datafusion:parquet 873387863 / 1644219378 / -46.9% 🟢 982578983 / 1987417035 / -50.6% 🟢 0.89 / 0.83 / +7.4%
tpch_q19/datafusion:parquet 473863329 / 622308353 / -23.9% 565507653 / 850069707 / -33.5% 🟢 0.84 / 0.73 / +14.5%
tpch_q20/datafusion:parquet 831828813 / 1057723470 / -21.4% 1163907950 / 1254975549 / -7.3% 0.71 / 0.84 / -15.2%
tpch_q21/datafusion:parquet 1205770952 / 1350221703 / -10.7% 1577686380 / 1261557941 / +25.1% 0.76 / 1.07 / -28.6%
tpch_q22/datafusion:parquet 607651559 / 562509513 / +8.0% 947584329 / 1081971099 / -12.4% 0.64 / 0.52 / +23.3%
duckdb / vortex-compact / ns (0.973x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1222479115 / 1038566963 / +17.7% 1817306691 / 3023962589 / -39.9% 🟢 0.67 / 0.34 / +95.9%
tpch_q02/duckdb:vortex-compact 562744077 / 623679889 / -9.8% 980413346 / 997845178 / -1.7% 0.57 / 0.63 / -8.2%
tpch_q03/duckdb:vortex-compact 1271157366 / 1520231257 / -16.4% 1788112713 / 2568186594 / -30.4% 🟢 0.71 / 0.59 / +20.1%
tpch_q04/duckdb:vortex-compact 982753217 / 1086652115 / -9.6% 1322476710 / 1493828953 / -11.5% 0.74 / 0.73 / +2.2%
tpch_q05/duckdb:vortex-compact 1253811572 / 1366591824 / -8.3% 1747062462 / 2412458269 / -27.6% 0.72 / 0.57 / +26.7%
tpch_q06/duckdb:vortex-compact 1211923346 / 1210161260 / +0.1% 1237485789 / 1177297739 / +5.1% 0.98 / 1.03 / -4.7%
tpch_q07/duckdb:vortex-compact 1619555243 / 1807614425 / -10.4% 1522387188 / 1943415004 / -21.7% 1.06 / 0.93 / +14.4%
tpch_q08/duckdb:vortex-compact 1657377000 / 1700887050 / -2.6% 1836198321 / 2075403600 / -11.5% 0.90 / 0.82 / +10.1%
tpch_q09/duckdb:vortex-compact 1963706222 / 2070594376 / -5.2% 2324535780 / 2736586989 / -15.1% 0.84 / 0.76 / +11.6%
tpch_q10/duckdb:vortex-compact 1575472653 / 1579821260 / -0.3% 1985186092 / 2359095016 / -15.8% 0.79 / 0.67 / +18.5%
tpch_q11/duckdb:vortex-compact 558291265 / 499362646 / +11.8% 752934143 / 803663249 / -6.3% 0.74 / 0.62 / +19.3%
tpch_q12/duckdb:vortex-compact 2336172101 / 2238680571 / +4.4% 2210468248 / 2736413437 / -19.2% 1.06 / 0.82 / +29.2%
tpch_q13/duckdb:vortex-compact 1528969862 / 1281360359 / +19.3% 1821868289 / 1722802527 / +5.8% 0.84 / 0.74 / +12.8%
tpch_q14/duckdb:vortex-compact 1005979840 / 1328213784 / -24.3% 1051300742 / 1299624347 / -19.1% 0.96 / 1.02 / -6.4%
tpch_q15/duckdb:vortex-compact 1232711534 / 1032353526 / +19.4% 1228619693 / 1030649388 / +19.2% 1.00 / 1.00 / +0.2%
tpch_q16/duckdb:vortex-compact 251247828 / 301118550 / -16.6% 336816007 / 264766290 / +27.2% 0.75 / 1.14 / -34.4%
tpch_q17/duckdb:vortex-compact 1643405586 / 1745761695 / -5.9% 1720144940 / 1593854528 / +7.9% 0.96 / 1.10 / -12.8%
tpch_q18/duckdb:vortex-compact 1499403742 / 1313668724 / +14.1% 1869075324 / 1475731466 / +26.7% 0.80 / 0.89 / -9.9%
tpch_q19/duckdb:vortex-compact 1668931206 / 1316188562 / +26.8% 1570730167 / 1695013179 / -7.3% 1.06 / 0.78 / +36.8%
tpch_q20/duckdb:vortex-compact 1727778629 / 1848036880 / -6.5% 2093722313 / 2028397383 / +3.2% 0.83 / 0.91 / -9.4%
tpch_q21/duckdb:vortex-compact 2674219928 / 2711031507 / -1.4% 2536751164 / 3014477184 / -15.8% 1.05 / 0.90 / +17.2%
tpch_q22/duckdb:vortex-compact 479621535 / 707100423 / -32.2% 🟢 626143832 / 991697891 / -36.9% 🟢 0.77 / 0.71 / +7.4%
duckdb / parquet / ns (0.993x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 432577758 / 458641124 / -5.7% 446033188 / 861417500 / -48.2% 🟢 0.97 / 0.53 / +82.2%
tpch_q02/duckdb:parquet 838317674 / 1093131051 / -23.3% 1367128307 / 1711419592 / -20.1% 0.61 / 0.64 / -4.0%
tpch_q03/duckdb:parquet 1310180062 / 1167556337 / +12.2% 1355904608 / 2137888171 / -36.6% 🟢 0.97 / 0.55 / +76.9%
tpch_q04/duckdb:parquet 709636345 / 718020603 / -1.2% 780158023 / 1317260070 / -40.8% 🟢 0.91 / 0.55 / +66.9%
tpch_q05/duckdb:parquet 1270112685 / 1490505903 / -14.8% 1527285792 / 1772001279 / -13.8% 0.83 / 0.84 / -1.1%
tpch_q06/duckdb:parquet 429264101 / 614255766 / -30.1% 🟢 490702695 / 534538001 / -8.2% 0.87 / 1.15 / -23.9%
tpch_q07/duckdb:parquet 1438621960 / 1133633315 / +26.9% 1139935379 / 1182194747 / -3.6% 1.26 / 0.96 / +31.6%
tpch_q08/duckdb:parquet 1786999036 / 1476455263 / +21.0% 1393637683 / 1412308037 / -1.3% 1.28 / 1.05 / +22.7%
tpch_q09/duckdb:parquet 1563849384 / 1433399643 / +9.1% 1608057321 / 1635374739 / -1.7% 0.97 / 0.88 / +11.0%
tpch_q10/duckdb:parquet 2072101992 / 2174708836 / -4.7% 2492733051 / 2800003498 / -11.0% 0.83 / 0.78 / +7.0%
tpch_q11/duckdb:parquet 627025313 / 604625260 / +3.7% 922710416 / 560765400 / +64.5% 🔴 0.68 / 1.08 / -37.0%
tpch_q12/duckdb:parquet 842063929 / 838575312 / +0.4% 972092062 / 978722031 / -0.7% 0.87 / 0.86 / +1.1%
tpch_q13/duckdb:parquet 973452422 / 912774986 / +6.6% 1155177857 / 1283795157 / -10.0% 0.84 / 0.71 / +18.5%
tpch_q14/duckdb:parquet 654161477 / 838459005 / -22.0% 795157786 / 981442579 / -19.0% 0.82 / 0.85 / -3.7%
tpch_q15/duckdb:parquet 534895306 / 530585253 / +0.8% 407669432 / 771027869 / -47.1% 🟢 1.31 / 0.69 / +90.7%
tpch_q16/duckdb:parquet 691887657 / 669872549 / +3.3% 768036717 / 646176008 / +18.9% 0.90 / 1.04 / -13.1%
tpch_q17/duckdb:parquet 666642346 / 625515879 / +6.6% 1078869204 / 1070469338 / +0.8% 0.62 / 0.58 / +5.7%
tpch_q18/duckdb:parquet 1175660586 / 861137051 / +36.5% 🔴 1044655980 / 914636202 / +14.2% 1.13 / 0.94 / +19.5%
tpch_q19/duckdb:parquet 846333045 / 1174248247 / -27.9% 848205135 / 1620971428 / -47.7% 🟢 1.00 / 0.72 / +37.7%
tpch_q20/duckdb:parquet 1331483998 / 1215046593 / +9.6% 1480475679 / 1473891706 / +0.4% 0.90 / 0.82 / +9.1%
tpch_q21/duckdb:parquet 1090334293 / 1009572041 / +8.0% 981379341 / 1262708255 / -22.3% 1.11 / 0.80 / +39.0%
tpch_q22/duckdb:parquet 796931211 / 800744911 / -0.5% 928330672 / 922618070 / +0.6% 0.86 / 0.87 / -1.1%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: random-access No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 1.006x ➖
Parquet (geomean): hot 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
vortex / arrow-ipc / ns (0.997x ➖, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 72864 / 73068 / -0.3%
random-access/arrow-tokio-local-disk-footer 167545 / 162830 / +2.9%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 2427466 / 2283730 / +6.3%
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2028140 / 2056071 / -1.4%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 31665612 / 32048921 / -1.2%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 47874846 / 55484687 / -13.7% 🟢
random-access/nested-lists/correlated/arrow-tokio-local-disk 56823 / 59572 / -4.6%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 102598 / 101379 / +1.2%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1111605 / 1115214 / -0.3%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1188780 / 1157111 / +2.7%
random-access/nested-structs/correlated/arrow-tokio-local-disk 52283 / 54506 / -4.1%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 91239 / 89927 / +1.5%
random-access/nested-structs/uniform/arrow-tokio-local-disk 865994 / 871352 / -0.6%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 918050 / 910547 / +0.8%
random-access/taxi/correlated/arrow-tokio-local-disk 123694 / 123428 / +0.2%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 221466 / 216541 / +2.3%
random-access/taxi/uniform/arrow-tokio-local-disk 2883400 / 2828014 / +2.0%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 3065621 / 2988889 / +2.6%
random-access / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 243940 / 245584 / -0.7%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1232790 / 1242039 / -0.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1423601 / 1448935 / -1.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2737111 / 2611954 / +4.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk 240524 / 204017 / +17.9% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 371793 / 396304 / -6.2%
random-access/nested-lists/uniform/vortex-tokio-local-disk 731486 / 710984 / +2.9%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 929761 / 964605 / -3.6%
random-access/nested-structs/correlated/vortex-tokio-local-disk 289311 / 275079 / +5.2%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 527415 / 505267 / +4.4%
random-access/nested-structs/uniform/vortex-tokio-local-disk 627196 / 585980 / +7.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 914575 / 967571 / -5.5%
random-access/taxi/correlated/vortex-tokio-local-disk 635359 / 677088 / -6.2%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1443714 / 1415228 / +2.0%
random-access/taxi/uniform/vortex-tokio-local-disk 2664474 / 2682277 / -0.7%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3849180 / 3848248 / +0.0%
random-access/vortex-tokio-local-disk 432118 / 459190 / -5.9%
random-access/vortex-tokio-local-disk-footer 1065719 / 1066084 / -0.0%
random-access / parquet / ns (1.004x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 107858248887 / 107563617143 / +0.3%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 108013122364 / 107764874597 / +0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 107726978470 / 106170406773 / +1.5%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 107415258983 / 114092131884 / -5.9%
random-access/nested-lists/correlated/parquet-tokio-local-disk 147488938 / 144443015 / +2.1%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 148106787 / 147427061 / +0.5%
random-access/nested-lists/uniform/parquet-tokio-local-disk 147591161 / 147391425 / +0.1%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 148004071 / 147634974 / +0.3%
random-access/nested-structs/correlated/parquet-tokio-local-disk 44931697 / 44165709 / +1.7%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 45130342 / 44194752 / +2.1%
random-access/nested-structs/uniform/parquet-tokio-local-disk 44022387 / 44011727 / +0.0%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 44249014 / 44168758 / +0.2%
random-access/parquet-tokio-local-disk 120002395 / 118760048 / +1.0%
random-access/parquet-tokio-local-disk-footer 118534334 / 118975418 / -0.4%
random-access/taxi/correlated/parquet-tokio-local-disk 180106144 / 178271600 / +1.0%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 178544018 / 178540226 / +0.0%
random-access/taxi/uniform/parquet-tokio-local-disk 189914074 / 187977381 / +1.0%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 190694457 / 188152641 / +1.4%
random-access / lance / ns (1.005x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 296219 / 297085 / -0.3%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1269088 / 1243422 / +2.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1035590 / 1016428 / +1.9%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1985819 / 1967905 / +0.9%
random-access/lance-tokio-local-disk 529055 / 524464 / +0.9%
random-access/lance-tokio-local-disk-footer 1501739 / 1490822 / +0.7%
random-access/nested-lists/correlated/lance-tokio-local-disk 161273 / 163718 / -1.5%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 734297 / 733218 / +0.1%
random-access/nested-lists/uniform/lance-tokio-local-disk 846574 / 830152 / +2.0%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1429179 / 1439475 / -0.7%
random-access/nested-structs/correlated/lance-tokio-local-disk 274535 / 269204 / +2.0%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 637806 / 637136 / +0.1%
random-access/nested-structs/uniform/lance-tokio-local-disk 2248472 / 2295635 / -2.1%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2593606 / 2622817 / -1.1%
random-access/taxi/correlated/lance-tokio-local-disk 759626 / 777264 / -2.3%
random-access/taxi/correlated/lance-tokio-local-disk-footer 2039144 / 2017095 / +1.1%
random-access/taxi/uniform/lance-tokio-local-disk 8221837 / 7956727 / +3.3%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8984476 / 8878243 / +1.2%

@github-actions

ghost commented Oct 7, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR e31e4d0a vs base 9324b04d
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.7%
Engines: random-access No clear signal (-4.7%, low confidence)
Vortex (geomean): hot 0.966x ➖
Parquet (geomean): hot 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
random-access / vortex-file-compressed / ns (0.966x ➖, 3↑ 2↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-s3 47637774 / 53750836 / -11.4%
random-access/feature-vectors/correlated/vortex-tokio-s3-footer 121059141 / 119495293 / +1.3%
random-access/feature-vectors/uniform/vortex-tokio-s3 93343773 / 166544488 / -44.0% 🟢
random-access/feature-vectors/uniform/vortex-tokio-s3-footer 265531680 / 281234929 / -5.6%
random-access/nested-lists/correlated/vortex-tokio-s3 78440582 / 43355237 / +80.9% 🔴
random-access/nested-lists/correlated/vortex-tokio-s3-footer 159770119 / 95258581 / +67.7% 🔴
random-access/nested-lists/uniform/vortex-tokio-s3 160359781 / 160521710 / -0.1%
random-access/nested-lists/uniform/vortex-tokio-s3-footer 234464712 / 207650621 / +12.9%
random-access/nested-structs/correlated/vortex-tokio-s3 53344441 / 49555009 / +7.6%
random-access/nested-structs/correlated/vortex-tokio-s3-footer 105790551 / 93594376 / +13.0%
random-access/nested-structs/uniform/vortex-tokio-s3 182305560 / 168388120 / +8.3%
random-access/nested-structs/uniform/vortex-tokio-s3-footer 213015010 / 209925100 / +1.5%
random-access/taxi/correlated/vortex-tokio-s3 100462069 / 130155036 / -22.8%
random-access/taxi/correlated/vortex-tokio-s3-footer 142136005 / 223855899 / -36.5% 🟢
random-access/taxi/uniform/vortex-tokio-s3 253648833 / 232221849 / +9.2%
random-access/taxi/uniform/vortex-tokio-s3-footer 231309415 / 235496286 / -1.8%
random-access/vortex-tokio-s3 74948330 / 165622424 / -54.7% 🟢
random-access/vortex-tokio-s3-footer 121477676 / 116182961 / +4.6%
random-access / parquet / ns (1.014x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-s3 201490488645 / 190207639810 / +5.9%
random-access/feature-vectors/correlated/parquet-tokio-s3-footer 179679297007 / 185947922181 / -3.4%
random-access/feature-vectors/uniform/parquet-tokio-s3 181454719741 / 179584545725 / +1.0%
random-access/feature-vectors/uniform/parquet-tokio-s3-footer 179642707289 / 178919527825 / +0.4%
random-access/nested-lists/correlated/parquet-tokio-s3 1025460341 / 1035667569 / -1.0%
random-access/nested-lists/correlated/parquet-tokio-s3-footer 1093455518 / 1110844274 / -1.6%
random-access/nested-lists/uniform/parquet-tokio-s3 1024985938 / 1030455779 / -0.5%
random-access/nested-lists/uniform/parquet-tokio-s3-footer 1109804979 / 1111891639 / -0.2%
random-access/nested-structs/correlated/parquet-tokio-s3 452043403 / 453322168 / -0.3%
random-access/nested-structs/correlated/parquet-tokio-s3-footer 534894555 / 540613435 / -1.1%
random-access/nested-structs/uniform/parquet-tokio-s3 452043024 / 456078078 / -0.9%
random-access/nested-structs/uniform/parquet-tokio-s3-footer 636936761 / 538031155 / +18.4%
random-access/parquet-tokio-s3 493857018 / 488479077 / +1.1%
random-access/parquet-tokio-s3-footer 561693991 / 550422450 / +2.0%
random-access/taxi/correlated/parquet-tokio-s3 735677004 / 742293975 / -0.9%
random-access/taxi/correlated/parquet-tokio-s3-footer 818047069 / 792169473 / +3.3%
random-access/taxi/uniform/parquet-tokio-s3 781967174 / 780421346 / +0.2%
random-access/taxi/uniform/parquet-tokio-s3-footer 857976273 / 825987682 / +3.9%
random-access / lance / ns (0.968x ➖, 0↑ 1↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-s3 40153599 / 51848339 / -22.6%
random-access/feature-vectors/correlated/lance-tokio-s3-footer 208536386 / 205247810 / +1.6%
random-access/feature-vectors/uniform/lance-tokio-s3 89045361 / 103203844 / -13.7%
random-access/feature-vectors/uniform/lance-tokio-s3-footer 232935698 / 269291276 / -13.5%
random-access/lance-tokio-s3 63027371 / 71457200 / -11.8%
random-access/lance-tokio-s3-footer 268153988 / 312977906 / -14.3%
random-access/nested-lists/correlated/lance-tokio-s3 39841148 / 35599085 / +11.9%
random-access/nested-lists/correlated/lance-tokio-s3-footer 265556017 / 221626366 / +19.8%
random-access/nested-lists/uniform/lance-tokio-s3 84573470 / 77488811 / +9.1%
random-access/nested-lists/uniform/lance-tokio-s3-footer 365909678 / 271151443 / +34.9% 🔴
random-access/nested-structs/correlated/lance-tokio-s3 43465739 / 45559964 / -4.6%
random-access/nested-structs/correlated/lance-tokio-s3-footer 258315097 / 239478165 / +7.9%
random-access/nested-structs/uniform/lance-tokio-s3 119622063 / 121876693 / -1.8%
random-access/nested-structs/uniform/lance-tokio-s3-footer 304797211 / 299430085 / +1.8%
random-access/taxi/correlated/lance-tokio-s3 96542018 / 80006157 / +20.7%
random-access/taxi/correlated/lance-tokio-s3-footer 279950687 / 350266151 / -20.1%
random-access/taxi/uniform/lance-tokio-s3 210469124 / 289978688 / -27.4%
random-access/taxi/uniform/lance-tokio-s3-footer 524192436 / 593332705 / -11.7%

@joseph-isaacs joseph-isaacs mentioned this pull request Oct 13, 2026
Closed
@github-actions

ghost commented Oct 24, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label Oct 24, 2026
@github-actions

ghost commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

This PR was closed because it has been inactive for 7 days since being marked as stale.

@github-actions github-actions Bot closed this Nov 5, 2026
@robert3005
robert3005 deleted the ji/between-remaining-encodings branch November 10, 2026 11:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/feature A new feature stale This PR is stale and will be auto-closed soon

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@joseph-isaacs