Skip to content

fix(datafusion): infer singleton distinct counts from exact bounds - #10448

Merged
joseph-isaacs merged 6 commits into
developfrom
ji/constant-stats-min-max
Oct 15, 2026
Merged

fix(datafusion): infer singleton distinct counts from exact bounds#10448
joseph-isaacs merged 6 commits into
developfrom
ji/constant-stats-min-max

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Summary

Vortex can omit IsConstant from file statistics even when the existing exact min/max bounds prove that a column contains one non-null value. For example, a column with min = max = 'TN' and null_count = 0 currently reports an unknown distinct count to DataFusion. Infer distinct_count = Exact(1) from those statistics so DataFusion can use the singleton cardinality when planning.

Changes

  • Share inference between in-memory array statistics and persistent file statistics.
  • Support bool, integer, decimal, UTF-8, binary, and temporal columns with equal exact bounds and an exact zero null count. Float columns additionally require an exact zero NaNCount, because Vortex extrema skip NaNs.
  • Preserve explicit IsConstant information and leave the distinct count unknown when the required statistics are missing or inexact.
  • Check the original bounds before schema casts can collapse distinct values, and preserve the distinction between positive and negative zero.
  • Add a TODO to replace the fallback with IsConstant once file statistics aggregate and persist it.
  • Move conversion tests into a separate module and add regression cases for supported dtypes, nulls, NaNs across float widths, uncertain statistics, signed zero, and lossy timestamp casts.

The change applies to both V1 and V2 DataFusion scans.

Validation

The added regression cases have not been run. Tests, lint, formatting, builds, and benchmarks have not been run on this branch; no new latency or throughput improvement is claimed.

@joseph-isaacs
fix(datafusion): infer constant columns from exact typed bounds
600612e 
Report an exact singleton distinct count for bool, integer, decimal,
string, binary, and temporal columns with equal exact min/max and an
exact zero null count. Float columns also require an exact zero NaN
count because Vortex statistics skip NaNs in extrema.

Use the shared inference in both in-memory and persistent file
statistics. Preserve explicit IsConstant information, reject unknown
statistics, and compare original bounds before schema casts can
collapse distinct values. Keep signed zero distinct.

Move conversion tests into a tests module and add dtype, null, NaN,
missing/inexact-statistic, signed-zero, and lossy timestamp-cast cases.
This integration change applies to both V1 and V2 scans. No new
latency or throughput claim is made for this branch.

Tests, lint, formatting, builds, and benchmarks were not run.

Signed-off-by: Joseph Isaacs <[email protected]>
@joseph-isaacs
docs(datafusion): note using IsConstant for future file statistics
b4804b5 
Signed-off-by: Joseph Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 12, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 12, 2026
@codspeed

codspeed Bot commented Oct 12, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will degrade performance by 18.02%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ 2 benchmarks measured no execution time

Nothing ran under measurement, usually because the compiler removed the code under test. These results are not comparable, so they count as unchanged.

Preventing compiler optimizations

⚠️ 21 benchmarks spent significant time in system calls

System calls cannot be consistently instrumented, so they are not included in the measure, which understates the real cost. Please switch to the Walltime instrument to accurately measure system calls.

Measurement and system calls

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 9 regressed benchmarks
✅ 2248 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ WallTime filter_neon[8] 988 ns 2,140 ns -53.83%
❌ Simulation density_sweep_dense_runs[0.001] 28.5 µs 45.9 µs -37.81%
❌ WallTime filter_neon[64] 3.2 µs 4.5 µs -29.47%
❌ WallTime threshold_neon[80] 5.2 µs 6.4 µs -17.9%
❌ WallTime threshold_neon[8] 3.6 µs 4.2 µs -14.83%
❌ WallTime starts_with_avx512[8, VarBin] 40.7 µs 46.3 µs -12.1%
❌ WallTime bitpack_blocked_compress_avx2 6.8 µs 7.6 µs -11.36%
❌ WallTime filter_neon[80] 3.3 µs 3.7 µs -11.3%
❌ WallTime threshold_neon[64] 5.2 µs 5.8 µs -10.57%
⚡ WallTime take_u16_nullable_from_65536_avx512[1048576] 450.8 µs 395.2 µs +14.07%
⚡ ⚠️ Simulation test_scan_filter[int] 3.5 ms 3.1 ms +12.52%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ji/constant-stats-min-max (519b361) with develop (c128e99)

Open in CodSpeed

@github-actions

github-actions Bot commented Oct 12, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done b4804b5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done b4804b5 clickbench-nvme 1 Explore Profiling Data
🟢 Done b4804b5 tpcds-nvme 1 Explore Profiling Data
🟢 Done b4804b5 polarsignals 1 Explore Profiling Data
🟢 Done b4804b5 tpch-s3 1 Explore Profiling Data
🟢 Done b4804b5 fineweb 1 Explore Profiling Data
🟢 Done b4804b5 tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR b4804b5a vs base d9ad4cfe
Vortex (geomean): hot 1.003x ➖ · cold 0.976x ➖

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 57607084 / 57884548 / -0.5% 104655656 / 107447364 / -2.6% 0.55 / 0.54 / +2.2%
polarsignals_q01/datafusion:vortex-file-compressed 63669740 / 63469288 / +0.3% 126575601 / 127928155 / -1.1% 0.50 / 0.50 / +1.4%
polarsignals_q02/datafusion:vortex-file-compressed 71273400 / 70837804 / +0.6% 112824488 / 114963907 / -1.9% 0.63 / 0.62 / +2.5%
polarsignals_q03/datafusion:vortex-file-compressed 79447738 / 78875980 / +0.7% 138595852 / 143835960 / -3.6% 0.57 / 0.55 / +4.5%
polarsignals_q04/datafusion:vortex-file-compressed 9489622 / 9455042 / +0.4% 49136340 / 50202696 / -2.1% 0.19 / 0.19 / +2.5%
polarsignals_q05/datafusion:vortex-file-compressed 24228612 / 23696036 / +2.2% 65120526 / 69108067 / -5.8% 0.37 / 0.34 / +8.5%
polarsignals_q06/datafusion:vortex-file-compressed 21788688 / 21756600 / +0.1% 61458948 / 63615092 / -3.4% 0.35 / 0.34 / +3.7%
polarsignals_q07/datafusion:vortex-file-compressed 39423340 / 39407106 / +0.0% 78585631 / 79229618 / -0.8% 0.50 / 0.50 / +0.9%
polarsignals_q08/datafusion:vortex-file-compressed 98917440 / 97809798 / +1.1% 162134845 / 167605616 / -3.3% 0.61 / 0.58 / +4.5%
polarsignals_q09/datafusion:vortex-file-compressed 10077858 / 10316665 / -2.3% 48858788 / 48607284 / +0.5% 0.21 / 0.21 / -2.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+1.7%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 1.078x ➖
Parquet (geomean): hot 0.986x ➖ · cold 1.089x ➖
Shifts: Parquet (control) -1.4% · Median polish -1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6967517 / 6973802 / -0.1% 19335356 / 20177614 / -4.2% 0.36 / 0.35 / +4.3%
fineweb_q01/datafusion:vortex-file-compressed 11517365 / 12113664 / -4.9% 48389429 / 48867334 / -1.0% 0.24 / 0.25 / -4.0%
fineweb_q02/datafusion:vortex-file-compressed 12817372 / 13155932 / -2.6% 54524790 / 50529540 / +7.9% 0.24 / 0.26 / -9.7%
fineweb_q03/datafusion:vortex-file-compressed 20932150 / 22519406 / -7.0% 114808325 / 102400076 / +12.1% 🔴 0.18 / 0.22 / -17.1%
fineweb_q04/datafusion:vortex-file-compressed 81591348 / 80585260 / +1.2% 168907030 / 156291277 / +8.1% 0.48 / 0.52 / -6.3%
fineweb_q05/datafusion:vortex-file-compressed 67643309 / 67658216 / -0.0% 149319012 / 142667810 / +4.7% 0.45 / 0.47 / -4.5%
fineweb_q06/datafusion:vortex-file-compressed 20109196 / 19122436 / +5.2% 115329933 / 103944933 / +11.0% 🔴 0.17 / 0.18 / -5.2%
fineweb_q07/datafusion:vortex-file-compressed 19414758 / 19618440 / -1.0% 111017574 / 95915525 / +15.7% 🔴 0.17 / 0.20 / -14.5%
fineweb_q08/datafusion:vortex-file-compressed 10199672 / 10139034 / +0.6% 48990607 / 47373843 / +3.4% 0.21 / 0.21 / -2.7%
datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9438868 / 9533632 / -1.0% 36087967 / 33077357 / +9.1% 0.26 / 0.29 / -9.3%
fineweb_q01/datafusion:parquet 73962586 / 76060150 / -2.8% 165216374 / 153925357 / +7.3% 0.45 / 0.49 / -9.4%
fineweb_q02/datafusion:parquet 73548234 / 75208365 / -2.2% 168545992 / 145837366 / +15.6% 🔴 0.44 / 0.52 / -15.4%
fineweb_q03/datafusion:parquet 73335583 / 73864829 / -0.7% 156783846 / 146140055 / +7.3% 0.47 / 0.51 / -7.5%
fineweb_q04/datafusion:parquet 84018540 / 82075926 / +2.4% 166954585 / 147102315 / +13.5% 🔴 0.50 / 0.56 / -9.8%
fineweb_q05/datafusion:parquet 80378121 / 82716823 / -2.8% 162654751 / 141950670 / +14.6% 🔴 0.49 / 0.58 / -15.2%
fineweb_q06/datafusion:parquet 75654970 / 74813113 / +1.1% 165360384 / 146345841 / +13.0% 🔴 0.46 / 0.51 / -10.5%
fineweb_q07/datafusion:parquet 72908389 / 75932410 / -4.0% 169595160 / 139447835 / +21.6% 🔴 0.43 / 0.54 / -21.1%
fineweb_q08/datafusion:parquet 74440276 / 73435004 / +1.4% 170567700 / 144635333 / +17.9% 🔴 0.44 / 0.51 / -14.0%
duckdb / vortex-file-compressed / ns (0.998x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2063742 / 1944082 / +6.2% 8028104 / 4841787 / +65.8% 🔴 0.26 / 0.40 / -36.0%
fineweb_q01/duckdb:vortex-file-compressed 23796718 / 21255428 / +12.0% 🔴 66316297 / 59333770 / +11.8% 🔴 0.36 / 0.36 / +0.2%
fineweb_q02/duckdb:vortex-file-compressed 14499909 / 21711662 / -33.2% 🟢 38206337 / 59506370 / -35.8% 🟢 0.38 / 0.36 / +4.0%
fineweb_q03/duckdb:vortex-file-compressed 28191264 / 26970728 / +4.5% 129816115 / 117035308 / +10.9% 🔴 0.22 / 0.23 / -5.8%
fineweb_q04/duckdb:vortex-file-compressed 79438098 / 80109788 / -0.8% 121060217 / 118423570 / +2.2% 0.66 / 0.68 / -3.0%
fineweb_q05/duckdb:vortex-file-compressed 71048498 / 70650961 / +0.6% 121965492 / 115276716 / +5.8% 0.58 / 0.61 / -5.0%
fineweb_q06/duckdb:vortex-file-compressed 44296237 / 36813024 / +20.3% 🔴 145703120 / 114045285 / +27.8% 🔴 0.30 / 0.32 / -5.8%
fineweb_q07/duckdb:vortex-file-compressed 28890865 / 28334320 / +2.0% 102546099 / 91617941 / +11.9% 🔴 0.28 / 0.31 / -8.9%
fineweb_q08/duckdb:vortex-file-compressed 7127084 / 7332958 / -2.8% 16693288 / 15205250 / +9.8% 0.43 / 0.48 / -11.5%
duckdb / parquet / ns (0.982x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 21360273 / 22059558 / -3.2% 26101842 / 22951708 / +13.7% 🔴 0.82 / 0.96 / -14.9%
fineweb_q01/duckdb:parquet 44173734 / 44660190 / -1.1% 54424489 / 55816839 / -2.5% 0.81 / 0.80 / +1.4%
fineweb_q02/duckdb:parquet 43675696 / 44186856 / -1.2% 57294450 / 52519465 / +9.1% 0.76 / 0.84 / -9.4%
fineweb_q03/duckdb:parquet 94804237 / 94151980 / +0.7% 193294928 / 178767192 / +8.1% 0.49 / 0.53 / -6.9%
fineweb_q04/duckdb:parquet 153275120 / 153299281 / -0.0% 200005726 / 199135637 / +0.4% 0.77 / 0.77 / -0.5%
fineweb_q05/duckdb:parquet 142373583 / 145258269 / -2.0% 203756741 / 195516580 / +4.2% 0.70 / 0.74 / -5.9%
fineweb_q06/duckdb:parquet 70554238 / 71019882 / -0.7% 132207611 / 115577380 / +14.4% 🔴 0.53 / 0.61 / -13.2%
fineweb_q07/duckdb:parquet 71236520 / 72600426 / -1.9% 155282563 / 154894530 / +0.3% 0.46 / 0.47 / -2.1%
fineweb_q08/duckdb:parquet 23599926 / 25401830 / -7.1% 23735046 / 24537497 / -3.3% 0.99 / 1.04 / -4.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): hot 0.982x ➖ · cold 0.974x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.984x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16865264 / 16786209 / +0.5% 46510394 / 46970787 / -1.0% 0.36 / 0.36 / +1.5%
tpch_q02/datafusion:vortex-file-compressed 17472090 / 17555390 / -0.5% 36585408 / 35914356 / +1.9% 0.48 / 0.49 / -2.3%
tpch_q03/datafusion:vortex-file-compressed 19349868 / 19150194 / +1.0% 47150413 / 49831613 / -5.4% 0.41 / 0.38 / +6.8%
tpch_q04/datafusion:vortex-file-compressed 10248224 / 10307884 / -0.6% 33757008 / 32485638 / +3.9% 0.30 / 0.32 / -4.3%
tpch_q05/datafusion:vortex-file-compressed 37210865 / 37658407 / -1.2% 64401117 / 66215814 / -2.7% 0.58 / 0.57 / +1.6%
tpch_q06/datafusion:vortex-file-compressed 6119790 / 6428811 / -4.8% 30153127 / 31332445 / -3.8% 0.20 / 0.21 / -1.1%
tpch_q07/datafusion:vortex-file-compressed 52018482 / 52305883 / -0.5% 83748671 / 82909319 / +1.0% 0.62 / 0.63 / -1.5%
tpch_q08/datafusion:vortex-file-compressed 51770054 / 51868180 / -0.2% 82157516 / 82242422 / -0.1% 0.63 / 0.63 / -0.1%
tpch_q09/datafusion:vortex-file-compressed 50170178 / 50492040 / -0.6% 78323362 / 77819972 / +0.6% 0.64 / 0.65 / -1.3%
tpch_q10/datafusion:vortex-file-compressed 16995763 / 17087692 / -0.5% 49365889 / 53251364 / -7.3% 0.34 / 0.32 / +7.3%
tpch_q11/datafusion:vortex-file-compressed 15320553 / 15133396 / +1.2% 34556879 / 35120719 / -1.6% 0.44 / 0.43 / +2.9%
tpch_q12/datafusion:vortex-file-compressed 22358291 / 22633401 / -1.2% 44319787 / 46153521 / -4.0% 0.50 / 0.49 / +2.9%
tpch_q13/datafusion:vortex-file-compressed 19826567 / 20147437 / -1.6% 41672752 / 41984437 / -0.7% 0.48 / 0.48 / -0.9%
tpch_q14/datafusion:vortex-file-compressed 14912612 / 15016684 / -0.7% 40103392 / 42637792 / -5.9% 0.37 / 0.35 / +5.6%
tpch_q15/datafusion:vortex-file-compressed 18586123 / 18712345 / -0.7% 47127035 / 46568130 / +1.2% 0.39 / 0.40 / -1.9%
tpch_q16/datafusion:vortex-file-compressed 19061056 / 18762765 / +1.6% 38444296 / 38562453 / -0.3% 0.50 / 0.49 / +1.9%
tpch_q17/datafusion:vortex-file-compressed 28453028 / 29005090 / -1.9% 59764892 / 59214636 / +0.9% 0.48 / 0.49 / -2.8%
tpch_q18/datafusion:vortex-file-compressed 36913686 / 36845547 / +0.2% 55407144 / 58459727 / -5.2% 0.67 / 0.63 / +5.7%
tpch_q19/datafusion:vortex-file-compressed 13379071 / 13505574 / -0.9% 37968373 / 40032063 / -5.2% 0.35 / 0.34 / +4.4%
tpch_q20/datafusion:vortex-file-compressed 20947204 / 20701149 / +1.2% 44577480 / 45787597 / -2.6% 0.47 / 0.45 / +3.9%
tpch_q21/datafusion:vortex-file-compressed 38567948 / 39979147 / -3.5% 68757878 / 68618887 / +0.2% 0.56 / 0.58 / -3.7%
tpch_q22/datafusion:vortex-file-compressed 11396054 / 11043605 / +3.2% 32529106 / 32894801 / -1.1% 0.35 / 0.34 / +4.4%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72579538 / 72306618 / +0.4% 92128811 / 90863636 / +1.4% 0.79 / 0.80 / -1.0%
tpch_q02/datafusion:parquet 56766447 / 57459087 / -1.2% 77724807 / 79385593 / -2.1% 0.73 / 0.72 / +0.9%
tpch_q03/datafusion:parquet 84366347 / 84238750 / +0.2% 107982819 / 114797717 / -5.9% 0.78 / 0.73 / +6.5%
tpch_q04/datafusion:parquet 46760528 / 46803735 / -0.1% 66725823 / 67659248 / -1.4% 0.70 / 0.69 / +1.3%
tpch_q05/datafusion:parquet 99151142 / 99455325 / -0.3% 128148615 / 132899461 / -3.6% 0.77 / 0.75 / +3.4%
tpch_q06/datafusion:parquet 32006593 / 31880535 / +0.4% 51243772 / 56894830 / -9.9% 0.62 / 0.56 / +11.5%
tpch_q07/datafusion:parquet 105965249 / 109233850 / -3.0% 132227769 / 139693201 / -5.3% 0.80 / 0.78 / +2.5%
tpch_q08/datafusion:parquet 113177578 / 113366980 / -0.2% 142387928 / 142950319 / -0.4% 0.79 / 0.79 / +0.2%
tpch_q09/datafusion:parquet 131099007 / 130529817 / +0.4% 164591743 / 165935189 / -0.8% 0.80 / 0.79 / +1.3%
tpch_q10/datafusion:parquet 104021865 / 104270832 / -0.2% 133237113 / 136035220 / -2.1% 0.78 / 0.77 / +1.9%
tpch_q11/datafusion:parquet 42071523 / 41738498 / +0.8% 66432532 / 65620868 / +1.2% 0.63 / 0.64 / -0.4%
tpch_q12/datafusion:parquet 68420265 / 69278058 / -1.2% 91846566 / 96447456 / -4.8% 0.74 / 0.72 / +3.7%
tpch_q13/datafusion:parquet 186943758 / 187633114 / -0.4% 210164713 / 212703788 / -1.2% 0.89 / 0.88 / +0.8%
tpch_q14/datafusion:parquet 48099182 / 48117668 / -0.0% 74492970 / 76804634 / -3.0% 0.65 / 0.63 / +3.1%
tpch_q15/datafusion:parquet 53841407 / 54348515 / -0.9% 76108517 / 80504712 / -5.5% 0.71 / 0.68 / +4.8%
tpch_q16/datafusion:parquet 40676717 / 41151795 / -1.2% 59381176 / 59443030 / -0.1% 0.69 / 0.69 / -1.1%
tpch_q17/datafusion:parquet 128035893 / 128992845 / -0.7% 155243112 / 159955356 / -2.9% 0.82 / 0.81 / +2.3%
tpch_q18/datafusion:parquet 130473285 / 130302162 / +0.1% 151457866 / 153641962 / -1.4% 0.86 / 0.85 / +1.6%
tpch_q19/datafusion:parquet 59299830 / 59114529 / +0.3% 87520079 / 89760356 / -2.5% 0.68 / 0.66 / +2.9%
tpch_q20/datafusion:parquet 67444385 / 67008588 / +0.7% 90222445 / 93151761 / -3.1% 0.75 / 0.72 / +3.9%
tpch_q21/datafusion:parquet 108647264 / 108398330 / +0.2% 132516621 / 132252078 / +0.2% 0.82 / 0.82 / +0.0%
tpch_q22/datafusion:parquet 47360787 / 47759147 / -0.8% 66774252 / 66953671 / -0.3% 0.71 / 0.71 / -0.6%
duckdb / vortex-file-compressed / ns (0.969x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9431130 / 11453455 / -17.7% 🟢 22648989 / 23622510 / -4.1% 0.42 / 0.48 / -14.1%
tpch_q02/duckdb:vortex-file-compressed 17194335 / 17356430 / -0.9% 26539754 / 26756715 / -0.8% 0.65 / 0.65 / -0.1%
tpch_q03/duckdb:vortex-file-compressed 17749468 / 18647489 / -4.8% 34098549 / 37918799 / -10.1% 🟢 0.52 / 0.49 / +5.8%
tpch_q04/duckdb:vortex-file-compressed 16918720 / 17454353 / -3.1% 30627781 / 31196715 / -1.8% 0.55 / 0.56 / -1.3%
tpch_q05/duckdb:vortex-file-compressed 21642457 / 22263786 / -2.8% 37714787 / 38216740 / -1.3% 0.57 / 0.58 / -1.5%
tpch_q06/duckdb:vortex-file-compressed 5265033 / 8129338 / -35.2% 🟢 15316102 / 15785271 / -3.0% 0.34 / 0.51 / -33.3%
tpch_q07/duckdb:vortex-file-compressed 20209394 / 20100303 / +0.5% 41643911 / 39172578 / +6.3% 0.49 / 0.51 / -5.4%
tpch_q08/duckdb:vortex-file-compressed 23465340 / 22693128 / +3.4% 39893576 / 40993637 / -2.7% 0.59 / 0.55 / +6.3%
tpch_q09/duckdb:vortex-file-compressed 29880402 / 29537195 / +1.2% 47656729 / 53292047 / -10.6% 🟢 0.63 / 0.55 / +13.1%
tpch_q10/duckdb:vortex-file-compressed 28780202 / 28120045 / +2.3% 43509662 / 43891823 / -0.9% 0.66 / 0.64 / +3.2%
tpch_q11/duckdb:vortex-file-compressed 8750947 / 8623280 / +1.5% 15862834 / 14894043 / +6.5% 0.55 / 0.58 / -4.7%
tpch_q12/duckdb:vortex-file-compressed 15678527 / 16340639 / -4.1% 34029258 / 32670328 / +4.2% 0.46 / 0.50 / -7.9%
tpch_q13/duckdb:vortex-file-compressed 22044095 / 22009382 / +0.2% 41651724 / 45753590 / -9.0% 0.53 / 0.48 / +10.0%
tpch_q14/duckdb:vortex-file-compressed 12901026 / 12766550 / +1.1% 24465877 / 24604071 / -0.6% 0.53 / 0.52 / +1.6%
tpch_q15/duckdb:vortex-file-compressed 9176067 / 9626245 / -4.7% 18075237 / 22464184 / -19.5% 🟢 0.51 / 0.43 / +18.5%
tpch_q16/duckdb:vortex-file-compressed 18269076 / 18552740 / -1.5% 24192579 / 25838671 / -6.4% 0.76 / 0.72 / +5.2%
tpch_q17/duckdb:vortex-file-compressed 15499951 / 14306877 / +8.3% 30335151 / 32107747 / -5.5% 0.51 / 0.45 / +14.7%
tpch_q18/duckdb:vortex-file-compressed 24444791 / 24592268 / -0.6% 36125658 / 35155305 / +2.8% 0.68 / 0.70 / -3.3%
tpch_q19/duckdb:vortex-file-compressed 22878323 / 23174109 / -1.3% 37157589 / 38404431 / -3.2% 0.62 / 0.60 / +2.0%
tpch_q20/duckdb:vortex-file-compressed 16761737 / 16658658 / +0.6% 32375190 / 33704267 / -3.9% 0.52 / 0.49 / +4.7%
tpch_q21/duckdb:vortex-file-compressed 66140980 / 66577979 / -0.7% 77777466 / 82836238 / -6.1% 0.85 / 0.80 / +5.8%
tpch_q22/duckdb:vortex-file-compressed 12154377 / 12274075 / -1.0% 20530254 / 21240079 / -3.3% 0.59 / 0.58 / +2.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 62913546 / 63181332 / -0.4% 69959229 / 69359226 / +0.9% 0.90 / 0.91 / -1.3%
tpch_q02/duckdb:parquet 37498673 / 37722987 / -0.6% 46283512 / 46570950 / -0.6% 0.81 / 0.81 / +0.0%
tpch_q03/duckdb:parquet 67738035 / 67854175 / -0.2% 78547114 / 78277229 / +0.3% 0.86 / 0.87 / -0.5%
tpch_q04/duckdb:parquet 46345317 / 47222547 / -1.9% 56260430 / 55312592 / +1.7% 0.82 / 0.85 / -3.5%
tpch_q05/duckdb:parquet 65538971 / 66098290 / -0.8% 76828412 / 77409249 / -0.8% 0.85 / 0.85 / -0.1%
tpch_q06/duckdb:parquet 22055109 / 21869432 / +0.8% 26409697 / 26848659 / -1.6% 0.84 / 0.81 / +2.5%
tpch_q07/duckdb:parquet 65114282 / 65383613 / -0.4% 74875163 / 76368037 / -2.0% 0.87 / 0.86 / +1.6%
tpch_q08/duckdb:parquet 79772740 / 80008726 / -0.3% 91410572 / 92394690 / -1.1% 0.87 / 0.87 / +0.8%
tpch_q09/duckdb:parquet 119905121 / 120128237 / -0.2% 132664594 / 132764426 / -0.1% 0.90 / 0.90 / -0.1%
tpch_q10/duckdb:parquet 119579026 / 119179729 / +0.3% 130505521 / 132322893 / -1.4% 0.92 / 0.90 / +1.7%
tpch_q11/duckdb:parquet 21465481 / 21234626 / +1.1% 25558930 / 24895019 / +2.7% 0.84 / 0.85 / -1.5%
tpch_q12/duckdb:parquet 44462954 / 44293114 / +0.4% 51762517 / 53088585 / -2.5% 0.86 / 0.83 / +3.0%
tpch_q13/duckdb:parquet 242211835 / 242545636 / -0.1% 250584311 / 252575915 / -0.8% 0.97 / 0.96 / +0.7%
tpch_q14/duckdb:parquet 47191424 / 47128808 / +0.1% 54591759 / 56288222 / -3.0% 0.86 / 0.84 / +3.2%
tpch_q15/duckdb:parquet 26736540 / 26518312 / +0.8% 32541277 / 32882791 / -1.0% 0.82 / 0.81 / +1.9%
tpch_q16/duckdb:parquet 51331144 / 51574137 / -0.5% 58959707 / 58488990 / +0.8% 0.87 / 0.88 / -1.3%
tpch_q17/duckdb:parquet 48964248 / 49214277 / -0.5% 58781344 / 59075546 / -0.5% 0.83 / 0.83 / -0.0%
tpch_q18/duckdb:parquet 98573579 / 98848396 / -0.3% 106417417 / 108076762 / -1.5% 0.93 / 0.91 / +1.3%
tpch_q19/duckdb:parquet 65038725 / 64790492 / +0.4% 74672419 / 74511369 / +0.2% 0.87 / 0.87 / +0.2%
tpch_q20/duckdb:parquet 61460747 / 62030894 / -0.9% 72992837 / 73277549 / -0.4% 0.84 / 0.85 / -0.5%
tpch_q21/duckdb:parquet 142250400 / 141748522 / +0.4% 152555499 / 152482944 / +0.0% 0.93 / 0.93 / +0.3%
tpch_q22/duckdb:parquet 51440068 / 53378678 / -3.6% 58577765 / 62133563 / -5.7% 0.88 / 0.86 / +2.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-1.3%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.979x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.2% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.987x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24274485 / 24370056 / -0.4% 43548686 / 43866791 / -0.7% 0.56 / 0.56 / +0.3%
tpcds_q02/datafusion:vortex-file-compressed 45289596 / 45482400 / -0.4% 62602401 / 63201471 / -0.9% 0.72 / 0.72 / +0.5%
tpcds_q03/datafusion:vortex-file-compressed 11721673 / 11607982 / +1.0% 31178265 / 28793464 / +8.3% 0.38 / 0.40 / -6.7%
tpcds_q04/datafusion:vortex-file-compressed 112577313 / 113424602 / -0.7% 148007774 / 145417590 / +1.8% 0.76 / 0.78 / -2.5%
tpcds_q05/datafusion:vortex-file-compressed 60494394 / 60359508 / +0.2% 81642717 / 82507385 / -1.0% 0.74 / 0.73 / +1.3%
tpcds_q06/datafusion:vortex-file-compressed 23581294 / 23715483 / -0.6% 44894854 / 47759270 / -6.0% 0.53 / 0.50 / +5.8%
tpcds_q07/datafusion:vortex-file-compressed 32600168 / 33080687 / -1.5% 56614125 / 57647981 / -1.8% 0.58 / 0.57 / +0.3%
tpcds_q08/datafusion:vortex-file-compressed 25231392 / 25141266 / +0.4% 45218070 / 45186225 / +0.1% 0.56 / 0.56 / +0.3%
tpcds_q09/datafusion:vortex-file-compressed 16774990 / 17252220 / -2.8% 35679977 / 35360253 / +0.9% 0.47 / 0.49 / -3.6%
tpcds_q10/datafusion:vortex-file-compressed 29373606 / 29010354 / +1.3% 50983652 / 50714023 / +0.5% 0.58 / 0.57 / +0.7%
tpcds_q11/datafusion:vortex-file-compressed 62518744 / 62374314 / +0.2% 90238057 / 90759080 / -0.6% 0.69 / 0.69 / +0.8%
tpcds_q12/datafusion:vortex-file-compressed 16230424 / 16310859 / -0.5% 32653179 / 33459916 / -2.4% 0.50 / 0.49 / +2.0%
tpcds_q13/datafusion:vortex-file-compressed 33440170 / 34250032 / -2.4% 50780131 / 53996319 / -6.0% 0.66 / 0.63 / +3.8%
tpcds_q14/datafusion:vortex-file-compressed 93141504 / 91648192 / +1.6% 120045725 / 118424136 / +1.4% 0.78 / 0.77 / +0.3%
tpcds_q15/datafusion:vortex-file-compressed 23929522 / 23911892 / +0.1% 43303386 / 43810147 / -1.2% 0.55 / 0.55 / +1.2%
tpcds_q16/datafusion:vortex-file-compressed 20066376 / 20368192 / -1.5% 42379242 / 42986694 / -1.4% 0.47 / 0.47 / -0.1%
tpcds_q17/datafusion:vortex-file-compressed 58799975 / 57886908 / +1.6% 84638630 / 85210235 / -0.7% 0.69 / 0.68 / +2.3%
tpcds_q18/datafusion:vortex-file-compressed 68405140 / 68272142 / +0.2% 93805498 / 92917194 / +1.0% 0.73 / 0.73 / -0.8%
tpcds_q19/datafusion:vortex-file-compressed 18201754 / 18110012 / +0.5% 38282021 / 39691298 / -3.6% 0.48 / 0.46 / +4.2%
tpcds_q20/datafusion:vortex-file-compressed 18191798 / 17587871 / +3.4% 35276552 / 36090195 / -2.3% 0.52 / 0.49 / +5.8%
tpcds_q21/datafusion:vortex-file-compressed 17064284 / 18076216 / -5.6% 41357232 / 39418817 / +4.9% 0.41 / 0.46 / -10.0%
tpcds_q22/datafusion:vortex-file-compressed 49618880 / 49907707 / -0.6% 70814603 / 73818051 / -4.1% 0.70 / 0.68 / +3.6%
tpcds_q23/datafusion:vortex-file-compressed 71464186 / 74072027 / -3.5% 99919525 / 101021831 / -1.1% 0.72 / 0.73 / -2.5%
tpcds_q24/datafusion:vortex-file-compressed 70363449 / 70476426 / -0.2% 92700448 / 97372222 / -4.8% 0.76 / 0.72 / +4.9%
tpcds_q25/datafusion:vortex-file-compressed 52917716 / 52607842 / +0.6% 80938130 / 74429650 / +8.7% 0.65 / 0.71 / -7.5%
tpcds_q26/datafusion:vortex-file-compressed 30356103 / 30320482 / +0.1% 50857296 / 51183991 / -0.6% 0.60 / 0.59 / +0.8%
tpcds_q27/datafusion:vortex-file-compressed 63944136 / 64826365 / -1.4% 87836908 / 87726551 / +0.1% 0.73 / 0.74 / -1.5%
tpcds_q28/datafusion:vortex-file-compressed 18356646 / 18614540 / -1.4% 37448230 / 39229071 / -4.5% 0.49 / 0.47 / +3.3%
tpcds_q29/datafusion:vortex-file-compressed 57457580 / 56853758 / +1.1% 79091945 / 78983664 / +0.1% 0.73 / 0.72 / +0.9%
tpcds_q30/datafusion:vortex-file-compressed 27515852 / 26727400 / +2.9% 45489342 / 46171709 / -1.5% 0.60 / 0.58 / +4.5%
tpcds_q31/datafusion:vortex-file-compressed 64142694 / 64780407 / -1.0% 93433086 / 92906287 / +0.6% 0.69 / 0.70 / -1.5%
tpcds_q32/datafusion:vortex-file-compressed 13434776 / 13411432 / +0.2% 32029818 / 31202844 / +2.7% 0.42 / 0.43 / -2.4%
tpcds_q33/datafusion:vortex-file-compressed 26974202 / 26830974 / +0.5% 48717838 / 49503595 / -1.6% 0.55 / 0.54 / +2.2%
tpcds_q34/datafusion:vortex-file-compressed 18131119 / 18525211 / -2.1% 39774389 / 39723681 / +0.1% 0.46 / 0.47 / -2.3%
tpcds_q35/datafusion:vortex-file-compressed 35960336 / 35206411 / +2.1% 57069649 / 57733486 / -1.1% 0.63 / 0.61 / +3.3%
tpcds_q36/datafusion:vortex-file-compressed 49581390 / 48031080 / +3.2% 70442021 / 77257089 / -8.8% 0.70 / 0.62 / +13.2%
tpcds_q37/datafusion:vortex-file-compressed 13685596 / 14357263 / -4.7% 34050956 / 36755633 / -7.4% 0.40 / 0.39 / +2.9%
tpcds_q38/datafusion:vortex-file-compressed 30079408 / 29635581 / +1.5% 52645473 / 53734279 / -2.0% 0.57 / 0.55 / +3.6%
tpcds_q39/datafusion:vortex-file-compressed 65809426 / 66263896 / -0.7% 93062829 / 91735540 / +1.4% 0.71 / 0.72 / -2.1%
tpcds_q40/datafusion:vortex-file-compressed 25050798 / 24870532 / +0.7% 46274084 / 47629089 / -2.8% 0.54 / 0.52 / +3.7%
tpcds_q41/datafusion:vortex-file-compressed 16590170 / 16724158 / -0.8% 32063244 / 31611215 / +1.4% 0.52 / 0.53 / -2.2%
tpcds_q42/datafusion:vortex-file-compressed 11418964 / 11525804 / -0.9% 26733900 / 28865272 / -7.4% 0.43 / 0.40 / +7.0%
tpcds_q43/datafusion:vortex-file-compressed 14083358 / 13813666 / +2.0% 32472808 / 32703353 / -0.7% 0.43 / 0.42 / +2.7%
tpcds_q44/datafusion:vortex-file-compressed 26200191 / 26574157 / -1.4% 50700885 / 52651800 / -3.7% 0.52 / 0.50 / +2.4%
tpcds_q45/datafusion:vortex-file-compressed 27566209 / 27800710 / -0.8% 48598436 / 49833891 / -2.5% 0.57 / 0.56 / +1.7%
tpcds_q46/datafusion:vortex-file-compressed 24772196 / 24311182 / +1.9% 47762634 / 48463029 / -1.4% 0.52 / 0.50 / +3.4%
tpcds_q47/datafusion:vortex-file-compressed 78319604 / 77897458 / +0.5% 106482928 / 105822613 / +0.6% 0.74 / 0.74 / -0.1%
tpcds_q48/datafusion:vortex-file-compressed 31882935 / 31221870 / +2.1% 51275908 / 52566698 / -2.5% 0.62 / 0.59 / +4.7%
tpcds_q49/datafusion:vortex-file-compressed 61365922 / 59714426 / +2.8% 84568212 / 83464414 / +1.3% 0.73 / 0.72 / +1.4%
tpcds_q50/datafusion:vortex-file-compressed 34668668 / 34054390 / +1.8% 54979394 / 56164956 / -2.1% 0.63 / 0.61 / +4.0%
tpcds_q51/datafusion:vortex-file-compressed 61130040 / 60738502 / +0.6% 82860370 / 86514641 / -4.2% 0.74 / 0.70 / +5.1%
tpcds_q52/datafusion:vortex-file-compressed 11701759 / 11658846 / +0.4% 28028117 / 29640021 / -5.4% 0.42 / 0.39 / +6.1%
tpcds_q53/datafusion:vortex-file-compressed 18518560 / 18517222 / +0.0% 37610916 / 38633961 / -2.6% 0.49 / 0.48 / +2.7%
tpcds_q54/datafusion:vortex-file-compressed 33493588 / 34169060 / -2.0% 60734463 / 61707979 / -1.6% 0.55 / 0.55 / -0.4%
tpcds_q55/datafusion:vortex-file-compressed 11239706 / 11392675 / -1.3% 27440472 / 28583823 / -4.0% 0.41 / 0.40 / +2.8%
tpcds_q56/datafusion:vortex-file-compressed 26586900 / 26700613 / -0.4% 48799945 / 49589795 / -1.6% 0.54 / 0.54 / +1.2%
tpcds_q57/datafusion:vortex-file-compressed 72686231 / 73577620 / -1.2% 97370351 / 98283376 / -0.9% 0.75 / 0.75 / -0.3%
tpcds_q58/datafusion:vortex-file-compressed 40782246 / 40920978 / -0.3% 67365207 / 69160013 / -2.6% 0.61 / 0.59 / +2.3%
tpcds_q59/datafusion:vortex-file-compressed 31906966 / 32157713 / -0.8% 52133687 / 53945134 / -3.4% 0.61 / 0.60 / +2.7%
tpcds_q60/datafusion:vortex-file-compressed 26423056 / 26663649 / -0.9% 46753616 / 49231056 / -5.0% 0.57 / 0.54 / +4.3%
tpcds_q61/datafusion:vortex-file-compressed 24481984 / 24494220 / -0.0% 46773809 / 47539715 / -1.6% 0.52 / 0.52 / +1.6%
tpcds_q62/datafusion:vortex-file-compressed 17100131 / 17152038 / -0.3% 36248275 / 36462289 / -0.6% 0.47 / 0.47 / +0.3%
tpcds_q63/datafusion:vortex-file-compressed 18503354 / 18397890 / +0.6% 38746785 / 38296192 / +1.2% 0.48 / 0.48 / -0.6%
tpcds_q64/datafusion:vortex-file-compressed 322239437 / 322328310 / -0.0% 360547464 / 359663560 / +0.2% 0.89 / 0.90 / -0.3%
tpcds_q65/datafusion:vortex-file-compressed 75228622 / 75297970 / -0.1% 95477382 / 95243480 / +0.2% 0.79 / 0.79 / -0.3%
tpcds_q66/datafusion:vortex-file-compressed 52801612 / 52489268 / +0.6% 75333145 / 77405143 / -2.7% 0.70 / 0.68 / +3.4%
tpcds_q67/datafusion:vortex-file-compressed 55210346 / 54898005 / +0.6% 87329805 / 86829937 / +0.6% 0.63 / 0.63 / -0.0%
tpcds_q68/datafusion:vortex-file-compressed 24073264 / 24113958 / -0.2% 47929106 / 48378483 / -0.9% 0.50 / 0.50 / +0.8%
tpcds_q69/datafusion:vortex-file-compressed 28451996 / 28889444 / -1.5% 47717059 / 51180556 / -6.8% 0.60 / 0.56 / +5.6%
tpcds_q70/datafusion:vortex-file-compressed 24928468 / 71074872 / -64.9% 🟢 45951871 / 93488266 / -50.8% 🟢 0.54 / 0.76 / -28.6%
tpcds_q71/datafusion:vortex-file-compressed 19668750 / 19598634 / +0.4% 38441742 / 38253232 / +0.5% 0.51 / 0.51 / -0.1%
tpcds_q72/datafusion:vortex-file-compressed 465192716 / 455413278 / +2.1% 477703776 / 493691008 / -3.2% 0.97 / 0.92 / +5.6%
tpcds_q73/datafusion:vortex-file-compressed 17580662 / 17862357 / -1.6% 38321276 / 39682715 / -3.4% 0.46 / 0.45 / +1.9%
tpcds_q74/datafusion:vortex-file-compressed 44947418 / 45312633 / -0.8% 70445301 / 71916319 / -2.0% 0.64 / 0.63 / +1.3%
tpcds_q75/datafusion:vortex-file-compressed 130973021 / 131597652 / -0.5% 168380510 / 164197238 / +2.5% 0.78 / 0.80 / -2.9%
tpcds_q76/datafusion:vortex-file-compressed 43497226 / 42407778 / +2.6% 63776795 / 65472091 / -2.6% 0.68 / 0.65 / +5.3%
tpcds_q77/datafusion:vortex-file-compressed 34988132 / 36027625 / -2.9% 59897611 / 60852921 / -1.6% 0.58 / 0.59 / -1.3%
tpcds_q78/datafusion:vortex-file-compressed 79564661 / 80656268 / -1.4% 108014606 / 109895858 / -1.7% 0.74 / 0.73 / +0.4%
tpcds_q79/datafusion:vortex-file-compressed 20885502 / 21034603 / -0.7% 42651173 / 44375682 / -3.9% 0.49 / 0.47 / +3.3%
tpcds_q80/datafusion:vortex-file-compressed 76269822 / 77106579 / -1.1% 108875387 / 109940574 / -1.0% 0.70 / 0.70 / -0.1%
tpcds_q81/datafusion:vortex-file-compressed 27950883 / 28353334 / -1.4% 47099287 / 45734549 / +3.0% 0.59 / 0.62 / -4.3%
tpcds_q82/datafusion:vortex-file-compressed 12890286 / 13712100 / -6.0% 32979037 / 34947660 / -5.6% 0.39 / 0.39 / -0.4%
tpcds_q83/datafusion:vortex-file-compressed 36400866 / 36399916 / +0.0% 58295304 / 58683930 / -0.7% 0.62 / 0.62 / +0.7%
tpcds_q84/datafusion:vortex-file-compressed 11847516 / 12302190 / -3.7% 29709985 / 29203110 / +1.7% 0.40 / 0.42 / -5.3%
tpcds_q85/datafusion:vortex-file-compressed 59790896 / 60167044 / -0.6% 85396455 / 84800851 / +0.7% 0.70 / 0.71 / -1.3%
tpcds_q86/datafusion:vortex-file-compressed 16347614 / 16502192 / -0.9% 33830295 / 33424369 / +1.2% 0.48 / 0.49 / -2.1%
tpcds_q87/datafusion:vortex-file-compressed 29712588 / 29927739 / -0.7% 52296321 / 52765464 / -0.9% 0.57 / 0.57 / +0.2%
tpcds_q88/datafusion:vortex-file-compressed 34828756 / 34015474 / +2.4% 64580053 / 62657950 / +3.1% 0.54 / 0.54 / -0.7%
tpcds_q89/datafusion:vortex-file-compressed 21155191 / 20864774 / +1.4% 41459699 / 41162687 / +0.7% 0.51 / 0.51 / +0.7%
tpcds_q90/datafusion:vortex-file-compressed 10295736 / 10384375 / -0.9% 27209806 / 27522739 / -1.1% 0.38 / 0.38 / +0.3%
tpcds_q91/datafusion:vortex-file-compressed 16770708 / 16623124 / +0.9% 37128278 / 37299920 / -0.5% 0.45 / 0.45 / +1.4%
tpcds_q92/datafusion:vortex-file-compressed 13669944 / 13650788 / +0.1% 33308095 / 31701211 / +5.1% 0.41 / 0.43 / -4.7%
tpcds_q93/datafusion:vortex-file-compressed 23772595 / 23814178 / -0.2% 43250664 / 46113751 / -6.2% 0.55 / 0.52 / +6.4%
tpcds_q94/datafusion:vortex-file-compressed 19774368 / 19904596 / -0.7% 38198571 / 40118034 / -4.8% 0.52 / 0.50 / +4.3%
tpcds_q95/datafusion:vortex-file-compressed 45746509 / 46057812 / -0.7% 68670323 / 70001100 / -1.9% 0.67 / 0.66 / +1.2%
tpcds_q96/datafusion:vortex-file-compressed 9638658 / 9527158 / +1.2% 25251238 / 26708855 / -5.5% 0.38 / 0.36 / +7.0%
tpcds_q97/datafusion:vortex-file-compressed 21396534 / 21408666 / -0.1% 42755370 / 44285666 / -3.5% 0.50 / 0.48 / +3.5%
tpcds_q98/datafusion:vortex-file-compressed 17047290 / 16911256 / +0.8% 37965771 / 37038910 / +2.5% 0.45 / 0.46 / -1.7%
tpcds_q99/datafusion:vortex-file-compressed 19596740 / 19455217 / +0.7% 38103498 / 39456488 / -3.4% 0.51 / 0.49 / +4.3%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 32364827 / 31689446 / +2.1% 48965302 / 48940634 / +0.1% 0.66 / 0.65 / +2.1%
tpcds_q02/datafusion:parquet 40612667 / 39243724 / +3.5% 58277645 / 57833116 / +0.8% 0.70 / 0.68 / +2.7%
tpcds_q03/datafusion:parquet 16176956 / 16305556 / -0.8% 30404577 / 30078333 / +1.1% 0.53 / 0.54 / -1.9%
tpcds_q04/datafusion:parquet 200944711 / 201126461 / -0.1% 225987035 / 234905191 / -3.8% 0.89 / 0.86 / +3.9%
tpcds_q05/datafusion:parquet 72488420 / 72884554 / -0.5% 98281320 / 94546134 / +4.0% 0.74 / 0.77 / -4.3%
tpcds_q06/datafusion:parquet 27991408 / 28148086 / -0.6% 49135563 / 47986567 / +2.4% 0.57 / 0.59 / -2.9%
tpcds_q07/datafusion:parquet 46941247 / 46889112 / +0.1% 68876012 / 67722804 / +1.7% 0.68 / 0.69 / -1.6%
tpcds_q08/datafusion:parquet 30476673 / 30493630 / -0.1% 52700050 / 49808460 / +5.8% 0.58 / 0.61 / -5.5%
tpcds_q09/datafusion:parquet 32812260 / 33270132 / -1.4% 45499331 / 44474175 / +2.3% 0.72 / 0.75 / -3.6%
tpcds_q10/datafusion:parquet 41669699 / 41884336 / -0.5% 63853813 / 61147554 / +4.4% 0.65 / 0.68 / -4.7%
tpcds_q11/datafusion:parquet 95516662 / 94799714 / +0.8% 116802436 / 116478382 / +0.3% 0.82 / 0.81 / +0.5%
tpcds_q12/datafusion:parquet 21533654 / 21548336 / -0.1% 36708436 / 35722245 / +2.8% 0.59 / 0.60 / -2.8%
tpcds_q13/datafusion:parquet 42372392 / 42427980 / -0.1% 66580218 / 68365799 / -2.6% 0.64 / 0.62 / +2.5%
tpcds_q14/datafusion:parquet 128289180 / 128810596 / -0.4% 149850115 / 149194791 / +0.4% 0.86 / 0.86 / -0.8%
tpcds_q15/datafusion:parquet 33002218 / 32634686 / +1.1% 49407569 / 49351871 / +0.1% 0.67 / 0.66 / +1.0%
tpcds_q16/datafusion:parquet 37123667 / 36830023 / +0.8% 55374895 / 54443078 / +1.7% 0.67 / 0.68 / -0.9%
tpcds_q17/datafusion:parquet 79079006 / 77290237 / +2.3% 102992252 / 106618502 / -3.4% 0.77 / 0.72 / +5.9%
tpcds_q18/datafusion:parquet 60697878 / 61390332 / -1.1% 83234924 / 83229521 / +0.0% 0.73 / 0.74 / -1.1%
tpcds_q19/datafusion:parquet 26223385 / 26424878 / -0.8% 46277785 / 45971522 / +0.7% 0.57 / 0.57 / -1.4%
tpcds_q20/datafusion:parquet 23528260 / 22624740 / +4.0% 37684954 / 37032455 / +1.8% 0.62 / 0.61 / +2.2%
tpcds_q21/datafusion:parquet 17965028 / 18136538 / -0.9% 32439917 / 31462968 / +3.1% 0.55 / 0.58 / -3.9%
tpcds_q22/datafusion:parquet 75449075 / 75980040 / -0.7% 90456252 / 90831171 / -0.4% 0.83 / 0.84 / -0.3%
tpcds_q23/datafusion:parquet 110449046 / 107524926 / +2.7% 137892044 / 138746226 / -0.6% 0.80 / 0.77 / +3.4%
tpcds_q24/datafusion:parquet 95531206 / 95782483 / -0.3% 123653232 / 125176952 / -1.2% 0.77 / 0.77 / +1.0%
tpcds_q25/datafusion:parquet 79979703 / 80770934 / -1.0% 104324222 / 105334139 / -1.0% 0.77 / 0.77 / -0.0%
tpcds_q26/datafusion:parquet 43777626 / 44049332 / -0.6% 61940834 / 63483808 / -2.4% 0.71 / 0.69 / +1.9%
tpcds_q27/datafusion:parquet 74966165 / 76269969 / -1.7% 101282884 / 104378551 / -3.0% 0.74 / 0.73 / +1.3%
tpcds_q28/datafusion:parquet 27461960 / 27602128 / -0.5% 46646821 / 44136846 / +5.7% 0.59 / 0.63 / -5.9%
tpcds_q29/datafusion:parquet 79469554 / 79216598 / +0.3% 103165543 / 108262250 / -4.7% 0.77 / 0.73 / +5.3%
tpcds_q30/datafusion:parquet 44115243 / 44751958 / -1.4% 66565884 / 66547618 / +0.0% 0.66 / 0.67 / -1.4%
tpcds_q31/datafusion:parquet 80690042 / 81022904 / -0.4% 103777197 / 104040909 / -0.3% 0.78 / 0.78 / -0.2%
tpcds_q32/datafusion:parquet 23072924 / 23365975 / -1.3% 40307147 / 38681457 / +4.2% 0.57 / 0.60 / -5.2%
tpcds_q33/datafusion:parquet 32723300 / 33775084 / -3.1% 49599918 / 56202649 / -11.7% 🟢 0.66 / 0.60 / +9.8%
tpcds_q34/datafusion:parquet 22078564 / 23485524 / -6.0% 38826411 / 38104524 / +1.9% 0.57 / 0.62 / -7.7%
tpcds_q35/datafusion:parquet 49500645 / 50008900 / -1.0% 68327440 / 69758705 / -2.1% 0.72 / 0.72 / +1.1%
tpcds_q36/datafusion:parquet 54436740 / 52720996 / +3.3% 74586676 / 76600782 / -2.6% 0.73 / 0.69 / +6.0%
tpcds_q37/datafusion:parquet 22833982 / 23307228 / -2.0% 37893634 / 38750479 / -2.2% 0.60 / 0.60 / +0.2%
tpcds_q38/datafusion:parquet 44193294 / 43878778 / +0.7% 64370462 / 63630767 / +1.2% 0.69 / 0.69 / -0.4%
tpcds_q39/datafusion:parquet 71973918 / 72220992 / -0.3% 90591311 / 88301355 / +2.6% 0.79 / 0.82 / -2.9%
tpcds_q40/datafusion:parquet 30885182 / 30733742 / +0.5% 50879169 / 49290370 / +3.2% 0.61 / 0.62 / -2.6%
tpcds_q41/datafusion:parquet 17338557 / 17387104 / -0.3% 29119976 / 28876075 / +0.8% 0.60 / 0.60 / -1.1%
tpcds_q42/datafusion:parquet 15409372 / 15144980 / +1.7% 30716676 / 29301094 / +4.8% 0.50 / 0.52 / -2.9%
tpcds_q43/datafusion:parquet 17303690 / 17293364 / +0.1% 32580848 / 32584812 / -0.0% 0.53 / 0.53 / +0.1%
tpcds_q44/datafusion:parquet 33189052 / 33414292 / -0.7% 50968038 / 52510092 / -2.9% 0.65 / 0.64 / +2.3%
tpcds_q45/datafusion:parquet 37730795 / 37618678 / +0.3% 54933262 / 54619279 / +0.6% 0.69 / 0.69 / -0.3%
tpcds_q46/datafusion:parquet 29237912 / 28292406 / +3.3% 49325313 / 49745039 / -0.8% 0.59 / 0.57 / +4.2%
tpcds_q47/datafusion:parquet 96987622 / 96460878 / +0.5% 123538588 / 125369608 / -1.5% 0.79 / 0.77 / +2.0%
tpcds_q48/datafusion:parquet 39228684 / 38427476 / +2.1% 58244565 / 61664231 / -5.5% 0.67 / 0.62 / +8.1%
tpcds_q49/datafusion:parquet 75613813 / 76301002 / -0.9% 104603417 / 99733659 / +4.9% 0.72 / 0.77 / -5.5%
tpcds_q50/datafusion:parquet 49935548 / 49481038 / +0.9% 71513011 / 72432984 / -1.3% 0.70 / 0.68 / +2.2%
tpcds_q51/datafusion:parquet 67609915 / 67455680 / +0.2% 90928056 / 91098854 / -0.2% 0.74 / 0.74 / +0.4%
tpcds_q52/datafusion:parquet 16077388 / 15759012 / +2.0% 30676327 / 30328803 / +1.1% 0.52 / 0.52 / +0.9%
tpcds_q53/datafusion:parquet 22114802 / 21916893 / +0.9% 39080425 / 39505642 / -1.1% 0.57 / 0.55 / +2.0%
tpcds_q54/datafusion:parquet 45364902 / 44921517 / +1.0% 66988249 / 64828113 / +3.3% 0.68 / 0.69 / -2.3%
tpcds_q55/datafusion:parquet 15425382 / 15544318 / -0.8% 29856355 / 28283034 / +5.6% 0.52 / 0.55 / -6.0%
tpcds_q56/datafusion:parquet 31820726 / 32211628 / -1.2% 53112445 / 53520288 / -0.8% 0.60 / 0.60 / -0.5%
tpcds_q57/datafusion:parquet 98565675 / 99055567 / -0.5% 122154016 / 121677000 / +0.4% 0.81 / 0.81 / -0.9%
tpcds_q58/datafusion:parquet 65586989 / 65537580 / +0.1% 87162989 / 88713673 / -1.7% 0.75 / 0.74 / +1.9%
tpcds_q59/datafusion:parquet 42791164 / 43164070 / -0.9% 63077421 / 62827694 / +0.4% 0.68 / 0.69 / -1.3%
tpcds_q60/datafusion:parquet 31651846 / 31334504 / +1.0% 53553151 / 53275769 / +0.5% 0.59 / 0.59 / +0.5%
tpcds_q61/datafusion:parquet 32708994 / 34094428 / -4.1% 56175777 / 57809948 / -2.8% 0.58 / 0.59 / -1.3%
tpcds_q62/datafusion:parquet 24025184 / 24079482 / -0.2% 38594995 / 39063501 / -1.2% 0.62 / 0.62 / +1.0%
tpcds_q63/datafusion:parquet 21635286 / 21745336 / -0.5% 38675992 / 38849408 / -0.4% 0.56 / 0.56 / -0.1%
tpcds_q64/datafusion:parquet 206956663 / 211231208 / -2.0% 231054247 / 244555155 / -5.5% 0.90 / 0.86 / +3.7%
tpcds_q65/datafusion:parquet 39274096 / 38759506 / +1.3% 59188696 / 58881593 / +0.5% 0.66 / 0.66 / +0.8%
tpcds_q66/datafusion:parquet 61848096 / 61884130 / -0.1% 81586166 / 77447592 / +5.3% 0.76 / 0.80 / -5.1%
tpcds_q67/datafusion:parquet 70958866 / 70506650 / +0.6% 96268625 / 96280069 / -0.0% 0.74 / 0.73 / +0.7%
tpcds_q68/datafusion:parquet 29142806 / 29493166 / -1.2% 50838955 / 52922807 / -3.9% 0.57 / 0.56 / +2.9%
tpcds_q69/datafusion:parquet 41667368 / 41628012 / +0.1% 61009213 / 58551648 / +4.2% 0.68 / 0.71 / -3.9%
tpcds_q70/datafusion:parquet 32447888 / 32652316 / -0.6% 54827712 / 55598338 / -1.4% 0.59 / 0.59 / +0.8%
tpcds_q71/datafusion:parquet 25257596 / 23127864 / +9.2% 40532721 / 37427098 / +8.3% 0.62 / 0.62 / +0.8%
tpcds_q72/datafusion:parquet 547574606 / 560704936 / -2.3% 589276660 / 570441947 / +3.3% 0.93 / 0.98 / -5.5%
tpcds_q73/datafusion:parquet 22045024 / 21658818 / +1.8% 38695559 / 37999407 / +1.8% 0.57 / 0.57 / -0.0%
tpcds_q74/datafusion:parquet 67014288 / 66429270 / +0.9% 84609073 / 86003056 / -1.6% 0.79 / 0.77 / +2.5%
tpcds_q75/datafusion:parquet 148752509 / 147558838 / +0.8% 174928797 / 175197657 / -0.2% 0.85 / 0.84 / +1.0%
tpcds_q76/datafusion:parquet 46722907 / 47252197 / -1.1% 66315580 / 65193426 / +1.7% 0.70 / 0.72 / -2.8%
tpcds_q77/datafusion:parquet 53790026 / 53811370 / -0.0% 74513911 / 74280045 / +0.3% 0.72 / 0.72 / -0.4%
tpcds_q78/datafusion:parquet 93598280 / 94427777 / -0.9% 124472918 / 122905413 / +1.3% 0.75 / 0.77 / -2.1%
tpcds_q79/datafusion:parquet 26094139 / 25864760 / +0.9% 45357498 / 46877310 / -3.2% 0.58 / 0.55 / +4.3%
tpcds_q80/datafusion:parquet 82684646 / 82406244 / +0.3% 116133264 / 111204168 / +4.4% 0.71 / 0.74 / -3.9%
tpcds_q81/datafusion:parquet 38633762 / 38092504 / +1.4% 60441407 / 59037420 / +2.4% 0.64 / 0.65 / -0.9%
tpcds_q82/datafusion:parquet 25123160 / 25667565 / -2.1% 39489425 / 40067467 / -1.4% 0.64 / 0.64 / -0.7%
tpcds_q83/datafusion:parquet 47456838 / 47445680 / +0.0% 68057320 / 66183962 / +2.8% 0.70 / 0.72 / -2.7%
tpcds_q84/datafusion:parquet 29276466 / 28466693 / +2.8% 46290037 / 45381924 / +2.0% 0.63 / 0.63 / +0.8%
tpcds_q85/datafusion:parquet 86620389 / 86386537 / +0.3% 109095759 / 110132239 / -0.9% 0.79 / 0.78 / +1.2%
tpcds_q86/datafusion:parquet 20488486 / 21247652 / -3.6% 33919711 / 34718502 / -2.3% 0.60 / 0.61 / -1.3%
tpcds_q87/datafusion:parquet 43463551 / 43218468 / +0.6% 61772554 / 60735056 / +1.7% 0.70 / 0.71 / -1.1%
tpcds_q88/datafusion:parquet 39117188 / 37754943 / +3.6% 63469029 / 57068727 / +11.2% 🔴 0.62 / 0.66 / -6.8%
tpcds_q89/datafusion:parquet 25279835 / 25113356 / +0.7% 42489777 / 42746731 / -0.6% 0.59 / 0.59 / +1.3%
tpcds_q90/datafusion:parquet 15245118 / 16033854 / -4.9% 30846440 / 30449177 / +1.3% 0.49 / 0.53 / -6.1%
tpcds_q91/datafusion:parquet 32197620 / 31919697 / +0.9% 49702536 / 50240040 / -1.1% 0.65 / 0.64 / +2.0%
tpcds_q92/datafusion:parquet 23434619 / 24038366 / -2.5% 40345366 / 41824226 / -3.5% 0.58 / 0.57 / +1.1%
tpcds_q93/datafusion:parquet 27395704 / 28094284 / -2.5% 48363764 / 49632789 / -2.6% 0.57 / 0.57 / +0.1%
tpcds_q94/datafusion:parquet 32018208 / 32484600 / -1.4% 49455908 / 49226634 / +0.5% 0.65 / 0.66 / -1.9%
tpcds_q95/datafusion:parquet 66315879 / 66624666 / -0.5% 83844532 / 80016934 / +4.8% 0.79 / 0.83 / -5.0%
tpcds_q96/datafusion:parquet 12818937 / 12827804 / -0.1% 27912550 / 29085248 / -4.0% 0.46 / 0.44 / +4.1%
tpcds_q97/datafusion:parquet 31976725 / 31448980 / +1.7% 51535236 / 52049299 / -1.0% 0.62 / 0.60 / +2.7%
tpcds_q98/datafusion:parquet 22678142 / 22280866 / +1.8% 38142604 / 39056890 / -2.3% 0.59 / 0.57 / +4.2%
tpcds_q99/datafusion:parquet 28933081 / 28479341 / +1.6% 42971006 / 43077534 / -0.2% 0.67 / 0.66 / +1.8%
duckdb / vortex-file-compressed / ns (0.995x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15117924 / 15191246 / -0.5% 22368463 / 22765068 / -1.7% 0.68 / 0.67 / +1.3%
tpcds_q02/duckdb:vortex-file-compressed 14947919 / 15093541 / -1.0% 19583666 / 20400940 / -4.0% 0.76 / 0.74 / +3.2%
tpcds_q03/duckdb:vortex-file-compressed 12719315 / 11344102 / +12.1% 🔴 18913752 / 22801157 / -17.0% 🟢 0.67 / 0.50 / +35.2%
tpcds_q04/duckdb:vortex-file-compressed 51093816 / 50812014 / +0.6% 60271916 / 62822098 / -4.1% 0.85 / 0.81 / +4.8%
tpcds_q05/duckdb:vortex-file-compressed 18897560 / 18616494 / +1.5% 28079189 / 28946669 / -3.0% 0.67 / 0.64 / +4.6%
tpcds_q06/duckdb:vortex-file-compressed 27035167 / 26612674 / +1.6% 39495162 / 42713991 / -7.5% 0.68 / 0.62 / +9.9%
tpcds_q07/duckdb:vortex-file-compressed 15850287 / 15706712 / +0.9% 28806159 / 29392251 / -2.0% 0.55 / 0.53 / +3.0%
tpcds_q08/duckdb:vortex-file-compressed 18744122 / 18831412 / -0.5% 27808225 / 27751732 / +0.2% 0.67 / 0.68 / -0.7%
tpcds_q09/duckdb:vortex-file-compressed 13577310 / 13530440 / +0.3% 22782938 / 22230866 / +2.5% 0.60 / 0.61 / -2.1%
tpcds_q10/duckdb:vortex-file-compressed 27209226 / 27599296 / -1.4% 42591537 / 41155979 / +3.5% 0.64 / 0.67 / -4.7%
tpcds_q11/duckdb:vortex-file-compressed 40445687 / 40167200 / +0.7% 48798476 / 50582431 / -3.5% 0.83 / 0.79 / +4.4%
tpcds_q12/duckdb:vortex-file-compressed 10140964 / 10210990 / -0.7% 16475931 / 16290247 / +1.1% 0.62 / 0.63 / -1.8%
tpcds_q13/duckdb:vortex-file-compressed 21386420 / 21952141 / -2.6% 34806937 / 35365468 / -1.6% 0.61 / 0.62 / -1.0%
tpcds_q14/duckdb:vortex-file-compressed 58295552 / 58096550 / +0.3% 69684106 / 72022887 / -3.2% 0.84 / 0.81 / +3.7%
tpcds_q15/duckdb:vortex-file-compressed 20553694 / 21105872 / -2.6% 24719957 / 27575529 / -10.4% 🟢 0.83 / 0.77 / +8.6%
tpcds_q16/duckdb:vortex-file-compressed 17144906 / 17942466 / -4.4% 28215335 / 30144003 / -6.4% 0.61 / 0.60 / +2.1%
tpcds_q17/duckdb:vortex-file-compressed 29930398 / 29897908 / +0.1% 46400523 / 46272318 / +0.3% 0.65 / 0.65 / -0.2%
tpcds_q18/duckdb:vortex-file-compressed 28075486 / 27945720 / +0.5% 38566085 / 38315501 / +0.7% 0.73 / 0.73 / -0.2%
tpcds_q19/duckdb:vortex-file-compressed 23412005 / 23338370 / +0.3% 33354380 / 38314831 / -12.9% 🟢 0.70 / 0.61 / +15.2%
tpcds_q20/duckdb:vortex-file-compressed 10975545 / 10578782 / +3.8% 15422365 / 15537935 / -0.7% 0.71 / 0.68 / +4.5%
tpcds_q21/duckdb:vortex-file-compressed 9700670 / 9469784 / +2.4% 22034262 / 18138490 / +21.5% 🔴 0.44 / 0.52 / -15.7%
tpcds_q22/duckdb:vortex-file-compressed 29764630 / 28995234 / +2.7% 40020794 / 39423823 / +1.5% 0.74 / 0.74 / +1.1%
tpcds_q23/duckdb:vortex-file-compressed 37327957 / 37912852 / -1.5% 47485057 / 47576593 / -0.2% 0.79 / 0.80 / -1.4%
tpcds_q24/duckdb:vortex-file-compressed 28370538 / 28118156 / +0.9% 38966409 / 41680945 / -6.5% 0.73 / 0.67 / +7.9%
tpcds_q25/duckdb:vortex-file-compressed 26146826 / 25225223 / +3.7% 42640984 / 40022256 / +6.5% 0.61 / 0.63 / -2.7%
tpcds_q26/duckdb:vortex-file-compressed 13144606 / 13167872 / -0.2% 19801750 / 23439579 / -15.5% 🟢 0.66 / 0.56 / +18.2%
tpcds_q27/duckdb:vortex-file-compressed 17320586 / 18267198 / -5.2% 32989551 / 31307059 / +5.4% 0.53 / 0.58 / -10.0%
tpcds_q28/duckdb:vortex-file-compressed 12627834 / 11617543 / +8.7% 21869402 / 21617468 / +1.2% 0.58 / 0.54 / +7.4%
tpcds_q29/duckdb:vortex-file-compressed 28507720 / 28432313 / +0.3% 42589730 / 45456469 / -6.3% 0.67 / 0.63 / +7.0%
tpcds_q30/duckdb:vortex-file-compressed 19139013 / 18948338 / +1.0% 27692119 / 31573463 / -12.3% 🟢 0.69 / 0.60 / +15.2%
tpcds_q31/duckdb:vortex-file-compressed 19068158 / 19177274 / -0.6% 25573809 / 25197003 / +1.5% 0.75 / 0.76 / -2.0%
tpcds_q32/duckdb:vortex-file-compressed 9779707 / 9848063 / -0.7% 16379003 / 17703589 / -7.5% 0.60 / 0.56 / +7.3%
tpcds_q33/duckdb:vortex-file-compressed 17117878 / 16659709 / +2.8% 28019743 / 29011245 / -3.4% 0.61 / 0.57 / +6.4%
tpcds_q34/duckdb:vortex-file-compressed 15441567 / 15402476 / +0.3% 20527807 / 22020475 / -6.8% 0.75 / 0.70 / +7.5%
tpcds_q35/duckdb:vortex-file-compressed 46449626 / 45675845 / +1.7% 59606465 / 60586307 / -1.6% 0.78 / 0.75 / +3.4%
tpcds_q36/duckdb:vortex-file-compressed 15967624 / 14800350 / +7.9% 27193396 / 30405582 / -10.6% 🟢 0.59 / 0.49 / +20.6%
tpcds_q37/duckdb:vortex-file-compressed 13785388 / 13673251 / +0.8% 23529396 / 23466498 / +0.3% 0.59 / 0.58 / +0.6%
tpcds_q38/duckdb:vortex-file-compressed 22050918 / 22299924 / -1.1% 28757710 / 27772322 / +3.5% 0.77 / 0.80 / -4.5%
tpcds_q39/duckdb:vortex-file-compressed 18258578 / 18224387 / +0.2% 28608602 / 30003014 / -4.6% 0.64 / 0.61 / +5.1%
tpcds_q40/duckdb:vortex-file-compressed 12994783 / 13951642 / -6.9% 21626915 / 21355020 / +1.3% 0.60 / 0.65 / -8.0%
tpcds_q41/duckdb:vortex-file-compressed 6396954 / 6417144 / -0.3% 9217342 / 9555812 / -3.5% 0.69 / 0.67 / +3.3%
tpcds_q42/duckdb:vortex-file-compressed 8088313 / 9726660 / -16.8% 🟢 16336640 / 17696729 / -7.7% 0.50 / 0.55 / -9.9%
tpcds_q43/duckdb:vortex-file-compressed 10063812 / 9934380 / +1.3% 19747413 / 18089125 / +9.2% 0.51 / 0.55 / -7.2%
tpcds_q44/duckdb:vortex-file-compressed 15734923 / 15554488 / +1.2% 24938554 / 24767869 / +0.7% 0.63 / 0.63 / +0.5%
tpcds_q45/duckdb:vortex-file-compressed 22226362 / 22413678 / -0.8% 28495499 / 29891653 / -4.7% 0.78 / 0.75 / +4.0%
tpcds_q46/duckdb:vortex-file-compressed 18757130 / 18476777 / +1.5% 31323794 / 28064971 / +11.6% 🔴 0.60 / 0.66 / -9.0%
tpcds_q47/duckdb:vortex-file-compressed 30755422 / 31017923 / -0.8% 40919069 / 42793329 / -4.4% 0.75 / 0.72 / +3.7%
tpcds_q48/duckdb:vortex-file-compressed 19279020 / 19087160 / +1.0% 30093396 / 29228820 / +3.0% 0.64 / 0.65 / -1.9%
tpcds_q49/duckdb:vortex-file-compressed 16751242 / 16418607 / +2.0% 29523310 / 31997210 / -7.7% 0.57 / 0.51 / +10.6%
tpcds_q50/duckdb:vortex-file-compressed 16615562 / 16129210 / +3.0% 26934606 / 27871997 / -3.4% 0.62 / 0.58 / +6.6%
tpcds_q51/duckdb:vortex-file-compressed 76857152 / 76338352 / +0.7% 60114427 / 61648828 / -2.5% 1.28 / 1.24 / +3.2%
tpcds_q52/duckdb:vortex-file-compressed 8033006 / 8567908 / -6.2% 18424620 / 17374283 / +6.0% 0.44 / 0.49 / -11.6%
tpcds_q53/duckdb:vortex-file-compressed 14139010 / 14424195 / -2.0% 24137453 / 25259287 / -4.4% 0.59 / 0.57 / +2.6%
tpcds_q54/duckdb:vortex-file-compressed 20489423 / 20718978 / -1.1% 30068658 / 29047448 / +3.5% 0.68 / 0.71 / -4.5%
tpcds_q55/duckdb:vortex-file-compressed 8456018 / 9673070 / -12.6% 🟢 17058075 / 20710025 / -17.6% 🟢 0.50 / 0.47 / +6.1%
tpcds_q56/duckdb:vortex-file-compressed 17128654 / 16820220 / +1.8% 28602214 / 29303645 / -2.4% 0.60 / 0.57 / +4.3%
tpcds_q57/duckdb:vortex-file-compressed 23775618 / 24107191 / -1.4% 31190099 / 31561331 / -1.2% 0.76 / 0.76 / -0.2%
tpcds_q58/duckdb:vortex-file-compressed 17564942 / 17568267 / -0.0% 27688727 / 27478740 / +0.8% 0.63 / 0.64 / -0.8%
tpcds_q59/duckdb:vortex-file-compressed 18686910 / 18515932 / +0.9% 24828440 / 25180614 / -1.4% 0.75 / 0.74 / +2.4%
tpcds_q60/duckdb:vortex-file-compressed 17741262 / 17938672 / -1.1% 28216906 / 30929581 / -8.8% 0.63 / 0.58 / +8.4%
tpcds_q61/duckdb:vortex-file-compressed 18708722 / 19462950 / -3.9% 30149246 / 30706209 / -1.8% 0.62 / 0.63 / -2.1%
tpcds_q62/duckdb:vortex-file-compressed 10210210 / 10078681 / +1.3% 15445720 / 15995771 / -3.4% 0.66 / 0.63 / +4.9%
tpcds_q63/duckdb:vortex-file-compressed 13256392 / 13121004 / +1.0% 22234601 / 24637223 / -9.8% 0.60 / 0.53 / +11.9%
tpcds_q64/duckdb:vortex-file-compressed 62826121 / 63223194 / -0.6% 77542231 / 80805315 / -4.0% 0.81 / 0.78 / +3.6%
tpcds_q65/duckdb:vortex-file-compressed 16063602 / 14967545 / +7.3% 25832802 / 25492369 / +1.3% 0.62 / 0.59 / +5.9%
tpcds_q66/duckdb:vortex-file-compressed 21546116 / 21918237 / -1.7% 28939992 / 29354018 / -1.4% 0.74 / 0.75 / -0.3%
tpcds_q67/duckdb:vortex-file-compressed 65856798 / 65838304 / +0.0% 81253941 / 84154590 / -3.4% 0.81 / 0.78 / +3.6%
tpcds_q68/duckdb:vortex-file-compressed 17786511 / 18280692 / -2.7% 30104600 / 31327510 / -3.9% 0.59 / 0.58 / +1.2%
tpcds_q69/duckdb:vortex-file-compressed 28673937 / 28772474 / -0.3% 44965607 / 41434695 / +8.5% 0.64 / 0.69 / -8.2%
tpcds_q70/duckdb:vortex-file-compressed 18505746 / 19159328 / -3.4% 28639962 / 28966293 / -1.1% 0.65 / 0.66 / -2.3%
tpcds_q71/duckdb:vortex-file-compressed 12558338 / 13461201 / -6.7% 22732101 / 23260911 / -2.3% 0.55 / 0.58 / -4.5%
tpcds_q72/duckdb:vortex-file-compressed 60902382 / 61880224 / -1.6% 75482824 / 76535160 / -1.4% 0.81 / 0.81 / -0.2%
tpcds_q73/duckdb:vortex-file-compressed 14608967 / 14835878 / -1.5% 21547542 / 20831472 / +3.4% 0.68 / 0.71 / -4.8%
tpcds_q74/duckdb:vortex-file-compressed 27226670 / 27293696 / -0.2% 37597120 / 37056510 / +1.5% 0.72 / 0.74 / -1.7%
tpcds_q75/duckdb:vortex-file-compressed 28063424 / 28356637 / -1.0% 40370775 / 39374901 / +2.5% 0.70 / 0.72 / -3.5%
tpcds_q76/duckdb:vortex-file-compressed 12142588 / 12369502 / -1.8% 22365464 / 29126117 / -23.2% 🟢 0.54 / 0.42 / +27.8%
tpcds_q77/duckdb:vortex-file-compressed 15808306 / 15534626 / +1.8% 23264739 / 24967416 / -6.8% 0.68 / 0.62 / +9.2%
tpcds_q78/duckdb:vortex-file-compressed 37134256 / 36861522 / +0.7% 45930927 / 46913507 / -2.1% 0.81 / 0.79 / +2.9%
tpcds_q79/duckdb:vortex-file-compressed 14528780 / 14570512 / -0.3% 23385822 / 25777755 / -9.3% 0.62 / 0.57 / +9.9%
tpcds_q80/duckdb:vortex-file-compressed 26870825 / 28221420 / -4.8% 43956607 / 44152791 / -0.4% 0.61 / 0.64 / -4.4%
tpcds_q81/duckdb:vortex-file-compressed 22229994 / 22218030 / +0.1% 30833242 / 30471880 / +1.2% 0.72 / 0.73 / -1.1%
tpcds_q82/duckdb:vortex-file-compressed 31999956 / 33184862 / -3.6% 44446517 / 40922563 / +8.6% 0.72 / 0.81 / -11.2%
tpcds_q83/duckdb:vortex-file-compressed 19620780 / 19708465 / -0.4% 24695584 / 24557644 / +0.6% 0.79 / 0.80 / -1.0%
tpcds_q84/duckdb:vortex-file-compressed 12620982 / 12598128 / +0.2% 18842239 / 18842298 / -0.0% 0.67 / 0.67 / +0.2%
tpcds_q85/duckdb:vortex-file-compressed 30853512 / 31311941 / -1.5% 39201886 / 39927077 / -1.8% 0.79 / 0.78 / +0.4%
tpcds_q86/duckdb:vortex-file-compressed 10784095 / 12949412 / -16.7% 🟢 17675563 / 18125527 / -2.5% 0.61 / 0.71 / -14.6%
tpcds_q87/duckdb:vortex-file-compressed 23894930 / 24039915 / -0.6% 36949298 / 29407505 / +25.6% 🔴 0.65 / 0.82 / -20.9%
tpcds_q88/duckdb:vortex-file-compressed 32427852 / 32515688 / -0.3% 44299031 / 47518401 / -6.8% 0.73 / 0.68 / +7.0%
tpcds_q89/duckdb:vortex-file-compressed 14110130 / 14064400 / +0.3% 22336648 / 24468377 / -8.7% 0.63 / 0.57 / +9.9%
tpcds_q90/duckdb:vortex-file-compressed 8090854 / 8217440 / -1.5% 12321641 / 15198764 / -18.9% 🟢 0.66 / 0.54 / +21.5%
tpcds_q91/duckdb:vortex-file-compressed 15143489 / 15335796 / -1.3% 21076638 / 22759468 / -7.4% 0.72 / 0.67 / +6.6%
tpcds_q92/duckdb:vortex-file-compressed 12843886 / 12918572 / -0.6% 21880181 / 21526207 / +1.6% 0.59 / 0.60 / -2.2%
tpcds_q93/duckdb:vortex-file-compressed 18829108 / 16936162 / +11.2% 🔴 27114229 / 27127730 / -0.0% 0.69 / 0.62 / +11.2%
tpcds_q94/duckdb:vortex-file-compressed 16184353 / 16167606 / +0.1% 28778022 / 27658028 / +4.0% 0.56 / 0.58 / -3.8%
tpcds_q95/duckdb:vortex-file-compressed 45218000 / 44860818 / +0.8% 52744781 / 54147259 / -2.6% 0.86 / 0.83 / +3.5%
tpcds_q96/duckdb:vortex-file-compressed 7064910 / 7235350 / -2.4% 17071671 / 15030574 / +13.6% 🔴 0.41 / 0.48 / -14.0%
tpcds_q97/duckdb:vortex-file-compressed 22037416 / 22334440 / -1.3% 30143663 / 29137091 / +3.5% 0.73 / 0.77 / -4.6%
tpcds_q98/duckdb:vortex-file-compressed 13040941 / 13190310 / -1.1% 24528954 / 22818467 / +7.5% 0.53 / 0.58 / -8.0%
tpcds_q99/duckdb:vortex-file-compressed 13262733 / 13117288 / +1.1% 18472225 / 19035616 / -3.0% 0.72 / 0.69 / +4.2%
duckdb / parquet / ns (1.004x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 27786301 / 24511734 / +13.4% 🔴 31845018 / 32117553 / -0.8% 0.87 / 0.76 / +14.3%
tpcds_q02/duckdb:parquet 17182364 / 17470282 / -1.6% 22658449 / 25052870 / -9.6% 0.76 / 0.70 / +8.7%
tpcds_q03/duckdb:parquet 9149100 / 9241032 / -1.0% 16269894 / 16300623 / -0.2% 0.56 / 0.57 / -0.8%
tpcds_q04/duckdb:parquet 129998822 / 130145070 / -0.1% 135523365 / 136338801 / -0.6% 0.96 / 0.95 / +0.5%
tpcds_q05/duckdb:parquet 22111746 / 21992711 / +0.5% 26540330 / 26090372 / +1.7% 0.83 / 0.84 / -1.2%
tpcds_q06/duckdb:parquet 27233694 / 27381069 / -0.5% 35880229 / 37009615 / -3.1% 0.76 / 0.74 / +2.6%
tpcds_q07/duckdb:parquet 15639210 / 15323339 / +2.1% 23277580 / 22903810 / +1.6% 0.67 / 0.67 / +0.4%
tpcds_q08/duckdb:parquet 26262961 / 29341738 / -10.5% 🟢 33641912 / 33140656 / +1.5% 0.78 / 0.89 / -11.8%
tpcds_q09/duckdb:parquet 19219346 / 19496714 / -1.4% 23320191 / 22939512 / +1.7% 0.82 / 0.85 / -3.0%
tpcds_q10/duckdb:parquet 28099741 / 28195842 / -0.3% 37940899 / 37890467 / +0.1% 0.74 / 0.74 / -0.5%
tpcds_q11/duckdb:parquet 72953962 / 72970974 / -0.0% 77225497 / 78397858 / -1.5% 0.94 / 0.93 / +1.5%
tpcds_q12/duckdb:parquet 12650836 / 12825278 / -1.4% 18013034 / 17985283 / +0.2% 0.70 / 0.71 / -1.5%
tpcds_q13/duckdb:parquet 24233144 / 24267566 / -0.1% 30783984 / 31533095 / -2.4% 0.79 / 0.77 / +2.3%
tpcds_q14/duckdb:parquet 64321008 / 63616481 / +1.1% 68239943 / 67540118 / +1.0% 0.94 / 0.94 / +0.1%
tpcds_q15/duckdb:parquet 25092874 / 25438766 / -1.4% 31035476 / 29985829 / +3.5% 0.81 / 0.85 / -4.7%
tpcds_q16/duckdb:parquet 20949759 / 21027117 / -0.4% 31325396 / 28904728 / +8.4% 0.67 / 0.73 / -8.1%
tpcds_q17/duckdb:parquet 32915004 / 32702648 / +0.6% 40424720 / 40054770 / +0.9% 0.81 / 0.82 / -0.3%
tpcds_q18/duckdb:parquet 40021964 / 39912090 / +0.3% 49731440 / 49770142 / -0.1% 0.80 / 0.80 / +0.4%
tpcds_q19/duckdb:parquet 25043160 / 25122658 / -0.3% 32841496 / 31564836 / +4.0% 0.76 / 0.80 / -4.2%
tpcds_q20/duckdb:parquet 13961172 / 14153179 / -1.4% 19230484 / 18463234 / +4.2% 0.73 / 0.77 / -5.3%
tpcds_q21/duckdb:parquet 9511904 / 9632970 / -1.3% 13809725 / 12235537 / +12.9% 🔴 0.69 / 0.79 / -12.5%
tpcds_q22/duckdb:parquet 34804150 / 35425360 / -1.8% 42960377 / 63637180 / -32.5% 🟢 0.81 / 0.56 / +45.5%
tpcds_q23/duckdb:parquet 40787884 / 42784298 / -4.7% 47899977 / 48398970 / -1.0% 0.85 / 0.88 / -3.7%
tpcds_q24/duckdb:parquet 33943656 / 33811089 / +0.4% 43088416 / 42009619 / +2.6% 0.79 / 0.80 / -2.1%
tpcds_q25/duckdb:parquet 34705986 / 31455838 / +10.3% 🔴 41049541 / 40075901 / +2.4% 0.85 / 0.78 / +7.7%
tpcds_q26/duckdb:parquet 31828241 / 31801292 / +0.1% 38606928 / 39054575 / -1.1% 0.82 / 0.81 / +1.2%
tpcds_q27/duckdb:parquet 32193077 / 31906574 / +0.9% 39430671 / 39794497 / -0.9% 0.82 / 0.80 / +1.8%
tpcds_q28/duckdb:parquet 17770858 / 17902810 / -0.7% 37416184 / 30151348 / +24.1% 🔴 0.47 / 0.59 / -20.0%
tpcds_q29/duckdb:parquet 31156818 / 31311738 / -0.5% 38777737 / 39248609 / -1.2% 0.80 / 0.80 / +0.7%
tpcds_q30/duckdb:parquet 34314264 / 34427628 / -0.3% 43295092 / 43130173 / +0.4% 0.79 / 0.80 / -0.7%
tpcds_q31/duckdb:parquet 21085758 / 20712850 / +1.8% 26644199 / 25714770 / +3.6% 0.79 / 0.81 / -1.8%
tpcds_q32/duckdb:parquet 13698720 / 12141965 / +12.8% 🔴 18188798 / 18204310 / -0.1% 0.75 / 0.67 / +12.9%
tpcds_q33/duckdb:parquet 17646902 / 16559407 / +6.6% 23367171 / 26003763 / -10.1% 🟢 0.76 / 0.64 / +18.6%
tpcds_q34/duckdb:parquet 16633774 / 16414881 / +1.3% 22511633 / 22273828 / +1.1% 0.74 / 0.74 / +0.3%
tpcds_q35/duckdb:parquet 46513096 / 47125860 / -1.3% 59330598 / 56643506 / +4.7% 0.78 / 0.83 / -5.8%
tpcds_q36/duckdb:parquet 16000006 / 16025124 / -0.2% 23248296 / 23343460 / -0.4% 0.69 / 0.69 / +0.3%
tpcds_q37/duckdb:parquet 11558079 / 12434944 / -7.1% 17058766 / 19904529 / -14.3% 🟢 0.68 / 0.62 / +8.5%
tpcds_q38/duckdb:parquet 26847846 / 26680710 / +0.6% 32008299 / 30689741 / +4.3% 0.84 / 0.87 / -3.5%
tpcds_q39/duckdb:parquet 24623480 / 25777110 / -4.5% 30981242 / 28347529 / +9.3% 0.79 / 0.91 / -12.6%
tpcds_q40/duckdb:parquet 16558063 / 16662290 / -0.6% 20907811 / 20764302 / +0.7% 0.79 / 0.80 / -1.3%
tpcds_q41/duckdb:parquet 8292456 / 7748406 / +7.0% 13588007 / 13528444 / +0.4% 0.61 / 0.57 / +6.6%
tpcds_q42/duckdb:parquet 8708764 / 8741116 / -0.4% 15700305 / 15462068 / +1.5% 0.55 / 0.57 / -1.9%
tpcds_q43/duckdb:parquet 10634753 / 10625450 / +0.1% 15039102 / 15064134 / -0.2% 0.71 / 0.71 / +0.3%
tpcds_q44/duckdb:parquet 16057611 / 16131332 / -0.5% 21190327 / 20801912 / +1.9% 0.76 / 0.78 / -2.3%
tpcds_q45/duckdb:parquet 23608681 / 23598800 / +0.0% 29071884 / 29406000 / -1.1% 0.81 / 0.80 / +1.2%
tpcds_q46/duckdb:parquet 37183184 / 37070168 / +0.3% 45333872 / 45759370 / -0.9% 0.82 / 0.81 / +1.2%
tpcds_q47/duckdb:parquet 31320964 / 31221234 / +0.3% 36668882 / 36904717 / -0.6% 0.85 / 0.85 / +1.0%
tpcds_q48/duckdb:parquet 21816823 / 21516097 / +1.4% 27443859 / 27234639 / +0.8% 0.79 / 0.79 / +0.6%
tpcds_q49/duckdb:parquet 21184928 / 20310640 / +4.3% 28304374 / 28069123 / +0.8% 0.75 / 0.72 / +3.4%
tpcds_q50/duckdb:parquet 17963392 / 17944719 / +0.1% 23702749 / 23836306 / -0.6% 0.76 / 0.75 / +0.7%
tpcds_q51/duckdb:parquet 53184496 / 53149062 / +0.1% 65477774 / 60376973 / +8.4% 0.81 / 0.88 / -7.7%
tpcds_q52/duckdb:parquet 8968621 / 9018178 / -0.5% 15827922 / 15592221 / +1.5% 0.57 / 0.58 / -2.0%
tpcds_q53/duckdb:parquet 11856794 / 11793699 / +0.5% 16803921 / 16847335 / -0.3% 0.71 / 0.70 / +0.8%
tpcds_q54/duckdb:parquet 20406626 / 20680828 / -1.3% 29529701 / 30091436 / -1.9% 0.69 / 0.69 / +0.6%
tpcds_q55/duckdb:parquet 8942712 / 8948714 / -0.1% 20093793 / 15896968 / +26.4% 🔴 0.45 / 0.56 / -20.9%
tpcds_q56/duckdb:parquet 16893820 / 17020380 / -0.7% 23734721 / 24331260 / -2.5% 0.71 / 0.70 / +1.8%
tpcds_q57/duckdb:parquet 28846112 / 29091098 / -0.8% 35245685 / 34276813 / +2.8% 0.82 / 0.85 / -3.6%
tpcds_q58/duckdb:parquet 19257517 / 19176156 / +0.4% 27240661 / 29404654 / -7.4% 0.71 / 0.65 / +8.4%
tpcds_q59/duckdb:parquet 20134008 / 19955410 / +0.9% 28119416 / 24922492 / +12.8% 🔴 0.72 / 0.80 / -10.6%
tpcds_q60/duckdb:parquet 17654917 / 18953792 / -6.9% 24809544 / 24665822 / +0.6% 0.71 / 0.77 / -7.4%
tpcds_q61/duckdb:parquet 22509226 / 22037680 / +2.1% 29511870 / 28700604 / +2.8% 0.76 / 0.77 / -0.7%
tpcds_q62/duckdb:parquet 10905681 / 10841427 / +0.6% 15265797 / 15150551 / +0.8% 0.71 / 0.72 / -0.2%
tpcds_q63/duckdb:parquet 11233168 / 11065260 / +1.5% 16622707 / 16272054 / +2.2% 0.68 / 0.68 / -0.6%
tpcds_q64/duckdb:parquet 53428724 / 56641226 / -5.7% 72716225 / 64306667 / +13.1% 🔴 0.73 / 0.88 / -16.6%
tpcds_q65/duckdb:parquet 14557614 / 14674413 / -0.8% 20734829 / 20222456 / +2.5% 0.70 / 0.73 / -3.2%
tpcds_q66/duckdb:parquet 25030367 / 24857416 / +0.7% 31028364 / 31249352 / -0.7% 0.81 / 0.80 / +1.4%
tpcds_q67/duckdb:parquet 77182031 / 77168048 / +0.0% 83445963 / 83834717 / -0.5% 0.92 / 0.92 / +0.5%
tpcds_q68/duckdb:parquet 30309531 / 29982684 / +1.1% 39664946 / 40030576 / -0.9% 0.76 / 0.75 / +2.0%
tpcds_q69/duckdb:parquet 30576055 / 28920310 / +5.7% 39073178 / 39037982 / +0.1% 0.78 / 0.74 / +5.6%
tpcds_q70/duckdb:parquet 16672305 / 16424496 / +1.5% 25000476 / 23213155 / +7.7% 0.67 / 0.71 / -5.7%
tpcds_q71/duckdb:parquet 15251707 / 15304792 / -0.3% 21007783 / 24308671 / -13.6% 🟢 0.73 / 0.63 / +15.3%
tpcds_q72/duckdb:parquet 81646531 / 81606786 / +0.0% 85988613 / 87321872 / -1.5% 0.95 / 0.93 / +1.6%
tpcds_q73/duckdb:parquet 13728858 / 13832693 / -0.8% 20061085 / 19046791 / +5.3% 0.68 / 0.73 / -5.8%
tpcds_q74/duckdb:parquet 100383730 / 100253452 / +0.1% 107963706 / 108600248 / -0.6% 0.93 / 0.92 / +0.7%
tpcds_q75/duckdb:parquet 42766484 / 41540067 / +3.0% 51212365 / 54180179 / -5.5% 0.84 / 0.77 / +8.9%
tpcds_q76/duckdb:parquet 13949022 / 13862451 / +0.6% 21038094 / 22379729 / -6.0% 0.66 / 0.62 / +7.0%
tpcds_q77/duckdb:parquet 17463884 / 17500806 / -0.2% 25180064 / 25438991 / -1.0% 0.69 / 0.69 / +0.8%
tpcds_q78/duckdb:parquet 49013936 / 48645657 / +0.8% 54239468 / 54262248 / -0.0% 0.90 / 0.90 / +0.8%
tpcds_q79/duckdb:parquet 21214974 / 21154122 / +0.3% 28814351 / 29180538 / -1.3% 0.74 / 0.72 / +1.6%
tpcds_q80/duckdb:parquet 32939421 / 33346132 / -1.2% 39698521 / 43500501 / -8.7% 0.83 / 0.77 / +8.2%
tpcds_q81/duckdb:parquet 31523990 / 31414942 / +0.3% 43688109 / 41088215 / +6.3% 0.72 / 0.76 / -5.6%
tpcds_q82/duckdb:parquet 12406874 / 12617278 / -1.7% 20964060 / 17135759 / +22.3% 🔴 0.59 / 0.74 / -19.6%
tpcds_q83/duckdb:parquet 16624436 / 16494327 / +0.8% 25282904 / 21180717 / +19.4% 🔴 0.66 / 0.78 / -15.6%
tpcds_q84/duckdb:parquet 18518886 / 18573792 / -0.3% 24551091 / 23937149 / +2.6% 0.75 / 0.78 / -2.8%
tpcds_q85/duckdb:parquet 35504508 / 35412107 / +0.3% 44673240 / 44466060 / +0.5% 0.79 / 0.80 / -0.2%
tpcds_q86/duckdb:parquet 11664354 / 11326512 / +3.0% 17461797 / 16257274 / +7.4% 0.67 / 0.70 / -4.1%
tpcds_q87/duckdb:parquet 28455076 / 28652049 / -0.7% 32905758 / 32960291 / -0.2% 0.86 / 0.87 / -0.5%
tpcds_q88/duckdb:parquet 28096822 / 26850612 / +4.6% 32510294 / 30519829 / +6.5% 0.86 / 0.88 / -1.8%
tpcds_q89/duckdb:parquet 12877808 / 12933524 / -0.4% 19346166 / 17616241 / +9.8% 0.67 / 0.73 / -9.3%
tpcds_q90/duckdb:parquet 7030480 / 7051206 / -0.3% 12832282 / 12121907 / +5.9% 0.55 / 0.58 / -5.8%
tpcds_q91/duckdb:parquet 21441756 / 21726274 / -1.3% 29128201 / 28478629 / +2.3% 0.74 / 0.76 / -3.5%
tpcds_q92/duckdb:parquet 12525863 / 12671973 / -1.2% 19466103 / 20428678 / -4.7% 0.64 / 0.62 / +3.7%
tpcds_q93/duckdb:parquet 21628436 / 21579582 / +0.2% 27053007 / 27073336 / -0.1% 0.80 / 0.80 / +0.3%
tpcds_q94/duckdb:parquet 19239284 / 16887281 / +13.9% 🔴 24886979 / 26177002 / -4.9% 0.77 / 0.65 / +19.8%
tpcds_q95/duckdb:parquet 90754251 / 90545120 / +0.2% 97630483 / 98400981 / -0.8% 0.93 / 0.92 / +1.0%
tpcds_q96/duckdb:parquet 7141807 / 7023734 / +1.7% 10719680 / 10438884 / +2.7% 0.67 / 0.67 / -1.0%
tpcds_q97/duckdb:parquet 26178808 / 25847977 / +1.3% 31770338 / 32402583 / -2.0% 0.82 / 0.80 / +3.3%
tpcds_q98/duckdb:parquet 15152321 / 15087052 / +0.4% 22523605 / 22663502 / -0.6% 0.67 / 0.67 / +1.1%
tpcds_q99/duckdb:parquet 17275783 / 17187694 / +0.5% 21928423 / 21075589 / +4.0% 0.79 / 0.82 / -3.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+2.1%, environment too noisy confidence)
Vortex (geomean): hot 1.008x ➖ · cold 1.004x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1262138 / 1258558 / +0.3% 20475217 / 20563034 / -0.4% 0.06 / 0.06 / +0.7%
clickbench_q01/datafusion:vortex-file-compressed 6278806 / 5778206 / +8.7% 33017020 / 33966257 / -2.8% 0.19 / 0.17 / +11.8%
clickbench_q02/datafusion:vortex-file-compressed 10660593 / 10889448 / -2.1% 38677076 / 39331073 / -1.7% 0.28 / 0.28 / -0.4%
clickbench_q03/datafusion:vortex-file-compressed 11452975 / 11682780 / -2.0% 53902443 / 54828505 / -1.7% 0.21 / 0.21 / -0.3%
clickbench_q04/datafusion:vortex-file-compressed 56300304 / 56025641 / +0.5% 91413277 / 94594003 / -3.4% 0.62 / 0.59 / +4.0%
clickbench_q05/datafusion:vortex-file-compressed 77091046 / 75234489 / +2.5% 115684313 / 121695108 / -4.9% 0.67 / 0.62 / +7.8%
clickbench_q06/datafusion:vortex-file-compressed 1267951 / 1274070 / -0.5% 19880325 / 20542452 / -3.2% 0.06 / 0.06 / +2.8%
clickbench_q07/datafusion:vortex-file-compressed 9748455 / 9631002 / +1.2% 33561673 / 33518071 / +0.1% 0.29 / 0.29 / +1.1%
clickbench_q08/datafusion:vortex-file-compressed 78381872 / 76067284 / +3.0% 111633812 / 121932334 / -8.4% 0.70 / 0.62 / +12.5%
clickbench_q09/datafusion:vortex-file-compressed 169399318 / 172761257 / -1.9% 208226916 / 213676568 / -2.6% 0.81 / 0.81 / +0.6%
clickbench_q10/datafusion:vortex-file-compressed 23803932 / 23698428 / +0.4% 66314831 / 67698084 / -2.0% 0.36 / 0.35 / +2.5%
clickbench_q11/datafusion:vortex-file-compressed 25676578 / 26247624 / -2.2% 69431107 / 70236401 / -1.1% 0.37 / 0.37 / -1.0%
clickbench_q12/datafusion:vortex-file-compressed 73200580 / 71018776 / +3.1% 115364544 / 116040495 / -0.6% 0.63 / 0.61 / +3.7%
clickbench_q13/datafusion:vortex-file-compressed 118207506 / 117404478 / +0.7% 183221972 / 181068814 / +1.2% 0.65 / 0.65 / -0.5%
clickbench_q14/datafusion:vortex-file-compressed 74221123 / 74383993 / -0.2% 119376923 / 117358506 / +1.7% 0.62 / 0.63 / -1.9%
clickbench_q15/datafusion:vortex-file-compressed 60483912 / 61896428 / -2.3% 99903387 / 95385087 / +4.7% 0.61 / 0.65 / -6.7%
clickbench_q16/datafusion:vortex-file-compressed 149147104 / 148625823 / +0.4% 206881254 / 212709377 / -2.7% 0.72 / 0.70 / +3.2%
clickbench_q17/datafusion:vortex-file-compressed 147438356 / 151884548 / -2.9% 215377792 / 207692112 / +3.7% 0.68 / 0.73 / -6.4%
clickbench_q18/datafusion:vortex-file-compressed 293496818 / 299184769 / -1.9% 379186813 / 371448583 / +2.1% 0.77 / 0.81 / -3.9%
clickbench_q19/datafusion:vortex-file-compressed 7818896 / 8008466 / -2.4% 49722703 / 47934861 / +3.7% 0.16 / 0.17 / -5.9%
clickbench_q20/datafusion:vortex-file-compressed 62473174 / 62220358 / +0.4% 235361694 / 227729004 / +3.4% 0.27 / 0.27 / -2.8%
clickbench_q21/datafusion:vortex-file-compressed 89776110 / 93111535 / -3.6% 271668135 / 270975946 / +0.3% 0.33 / 0.34 / -3.8%
clickbench_q22/datafusion:vortex-file-compressed 103500394 / 102328734 / +1.1% 350931303 / 345585395 / +1.5% 0.29 / 0.30 / -0.4%
clickbench_q23/datafusion:vortex-file-compressed 199576199 / 200474947 / -0.4% 512054599 / 522367353 / -2.0% 0.39 / 0.38 / +1.6%
clickbench_q24/datafusion:vortex-file-compressed 15506632 / 16133374 / -3.9% 64303140 / 64353303 / -0.1% 0.24 / 0.25 / -3.8%
clickbench_q25/datafusion:vortex-file-compressed 18315782 / 17597298 / +4.1% 54720903 / 57156162 / -4.3% 0.33 / 0.31 / +8.7%
clickbench_q26/datafusion:vortex-file-compressed 16454834 / 16497084 / -0.3% 65139151 / 66709824 / -2.4% 0.25 / 0.25 / +2.1%
clickbench_q27/datafusion:vortex-file-compressed 98926118 / 97978184 / +1.0% 245178171 / 245240296 / -0.0% 0.40 / 0.40 / +1.0%
clickbench_q28/datafusion:vortex-file-compressed 562653138 / 563098776 / -0.1% 635416797 / 642262437 / -1.1% 0.89 / 0.88 / +1.0%
clickbench_q29/datafusion:vortex-file-compressed 23391014 / 23018320 / +1.6% 50492101 / 51001331 / -1.0% 0.46 / 0.45 / +2.6%
clickbench_q30/datafusion:vortex-file-compressed 60237018 / 58836648 / +2.4% 107738572 / 104015814 / +3.6% 0.56 / 0.57 / -1.2%
clickbench_q31/datafusion:vortex-file-compressed 70836838 / 70206788 / +0.9% 151210348 / 149220125 / +1.3% 0.47 / 0.47 / -0.4%
clickbench_q32/datafusion:vortex-file-compressed 310207274 / 302991034 / +2.4% 406181957 / 386271025 / +5.2% 0.76 / 0.78 / -2.6%
clickbench_q33/datafusion:vortex-file-compressed 334219052 / 337916236 / -1.1% 433328820 / 433820797 / -0.1% 0.77 / 0.78 / -1.0%
clickbench_q34/datafusion:vortex-file-compressed 329719794 / 334573506 / -1.5% 418243140 / 428125186 / -2.3% 0.79 / 0.78 / +0.9%
clickbench_q35/datafusion:vortex-file-compressed 56061800 / 56281698 / -0.4% 88626134 / 88048272 / +0.7% 0.63 / 0.64 / -1.0%
clickbench_q36/datafusion:vortex-file-compressed 37915180 / 37491809 / +1.1% 65771764 / 66828086 / -1.6% 0.58 / 0.56 / +2.8%
clickbench_q37/datafusion:vortex-file-compressed 21933438 / 21791931 / +0.6% 46968686 / 47476534 / -1.1% 0.47 / 0.46 / +1.7%
clickbench_q38/datafusion:vortex-file-compressed 11705178 / 11829119 / -1.0% 38739546 / 39810135 / -2.7% 0.30 / 0.30 / +1.7%
clickbench_q39/datafusion:vortex-file-compressed 77932208 / 77862462 / +0.1% 109732197 / 110154515 / -0.4% 0.71 / 0.71 / +0.5%
clickbench_q40/datafusion:vortex-file-compressed 11284564 / 11118542 / +1.5% 37484278 / 37623900 / -0.4% 0.30 / 0.30 / +1.9%
clickbench_q41/datafusion:vortex-file-compressed 10782981 / 10646709 / +1.3% 35281198 / 36683062 / -3.8% 0.31 / 0.29 / +5.3%
clickbench_q42/datafusion:vortex-file-compressed 10774070 / 11088767 / -2.8% 35906728 / 36227658 / -0.9% 0.30 / 0.31 / -2.0%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1262348 / 1272731 / -0.8% 51711780 / 49471812 / +4.5% 0.02 / 0.03 / -5.1%
clickbench_q01/datafusion:parquet 16093856 / 16234650 / -0.9% 77211822 / 69372947 / +11.3% 🔴 0.21 / 0.23 / -10.9%
clickbench_q02/datafusion:parquet 19007431 / 18900083 / +0.6% 86434721 / 83274069 / +3.8% 0.22 / 0.23 / -3.1%
clickbench_q03/datafusion:parquet 17566901 / 17046474 / +3.1% 86195328 / 84278237 / +2.3% 0.20 / 0.20 / +0.8%
clickbench_q04/datafusion:parquet 61778726 / 63084336 / -2.1% 129772091 / 126336084 / +2.7% 0.48 / 0.50 / -4.7%
clickbench_q05/datafusion:parquet 90033243 / 89190730 / +0.9% 162226642 / 162889825 / -0.4% 0.55 / 0.55 / +1.4%
clickbench_q06/datafusion:parquet 1265420 / 1289004 / -1.8% 50345117 / 50947213 / -1.2% 0.03 / 0.03 / -0.7%
clickbench_q07/datafusion:parquet 16697782 / 16903192 / -1.2% 71118999 / 74922151 / -5.1% 0.23 / 0.23 / +4.1%
clickbench_q08/datafusion:parquet 87512890 / 86907254 / +0.7% 171820245 / 165800927 / +3.6% 0.51 / 0.52 / -2.8%
clickbench_q09/datafusion:parquet 187071650 / 187992568 / -0.5% 270606671 / 278417450 / -2.8% 0.69 / 0.68 / +2.4%
clickbench_q10/datafusion:parquet 36409595 / 36869921 / -1.2% 103165509 / 104484705 / -1.3% 0.35 / 0.35 / +0.0%
clickbench_q11/datafusion:parquet 43443668 / 42864877 / +1.4% 113754281 / 114478313 / -0.6% 0.38 / 0.37 / +2.0%
clickbench_q12/datafusion:parquet 96279742 / 95898229 / +0.4% 165449662 / 164382940 / +0.6% 0.58 / 0.58 / -0.2%
clickbench_q13/datafusion:parquet 148232982 / 146911353 / +0.9% 236928033 / 228099134 / +3.9% 0.63 / 0.64 / -2.9%
clickbench_q14/datafusion:parquet 102044344 / 101934948 / +0.1% 177413986 / 180616826 / -1.8% 0.58 / 0.56 / +1.9%
clickbench_q15/datafusion:parquet 72414356 / 69603305 / +4.0% 134787422 / 138341788 / -2.6% 0.54 / 0.50 / +6.8%
clickbench_q16/datafusion:parquet 158450660 / 156488285 / +1.3% 242978486 / 242696389 / +0.1% 0.65 / 0.64 / +1.1%
clickbench_q17/datafusion:parquet 155592708 / 156006092 / -0.3% 245003955 / 240329614 / +1.9% 0.64 / 0.65 / -2.2%
clickbench_q18/datafusion:parquet 315902161 / 316388062 / -0.2% 421542516 / 418346551 / +0.8% 0.75 / 0.76 / -0.9%
clickbench_q19/datafusion:parquet 18408362 / 19165788 / -4.0% 80393999 / 78634630 / +2.2% 0.23 / 0.24 / -6.1%
clickbench_q20/datafusion:parquet 179025187 / 179474348 / -0.3% 303489541 / 305061105 / -0.5% 0.59 / 0.59 / +0.3%
clickbench_q21/datafusion:parquet 173800052 / 174103088 / -0.2% 317882331 / 316737172 / +0.4% 0.55 / 0.55 / -0.5%
clickbench_q22/datafusion:parquet 260670636 / 259649174 / +0.4% 456736432 / 458125688 / -0.3% 0.57 / 0.57 / +0.7%
clickbench_q23/datafusion:parquet 1183757032 / 1140557231 / +3.8% 1249249446 / 1240357670 / +0.7% 0.95 / 0.92 / +3.0%
clickbench_q24/datafusion:parquet 30422426 / 30337658 / +0.3% 91909574 / 91202393 / +0.8% 0.33 / 0.33 / -0.5%
clickbench_q25/datafusion:parquet 37027726 / 37757184 / -1.9% 106426656 / 105067688 / +1.3% 0.35 / 0.36 / -3.2%
clickbench_q26/datafusion:parquet 30706665 / 30464496 / +0.8% 93597082 / 92221364 / +1.5% 0.33 / 0.33 / -0.7%
clickbench_q27/datafusion:parquet 195411462 / 191852892 / +1.9% 303187176 / 304613308 / -0.5% 0.64 / 0.63 / +2.3%
clickbench_q28/datafusion:parquet 627853855 / 620832714 / +1.1% 714163140 / 714731586 / -0.1% 0.88 / 0.87 / +1.2%
clickbench_q29/datafusion:parquet 28847149 / 28965086 / -0.4% 97178542 / 94463123 / +2.9% 0.30 / 0.31 / -3.2%
clickbench_q30/datafusion:parquet 91478387 / 91595632 / -0.1% 180147638 / 174608695 / +3.2% 0.51 / 0.52 / -3.2%
clickbench_q31/datafusion:parquet 104233057 / 104741356 / -0.5% 204491328 / 201471998 / +1.5% 0.51 / 0.52 / -2.0%
clickbench_q32/datafusion:parquet 319324573 / 328218182 / -2.7% 430070671 / 431072665 / -0.2% 0.74 / 0.76 / -2.5%
clickbench_q33/datafusion:parquet 385054472 / 382745734 / +0.6% 489448973 / 480583219 / +1.8% 0.79 / 0.80 / -1.2%
clickbench_q34/datafusion:parquet 384087300 / 384752856 / -0.2% 483194111 / 479759981 / +0.7% 0.79 / 0.80 / -0.9%
clickbench_q35/datafusion:parquet 64099608 / 65373402 / -1.9% 125166693 / 125651925 / -0.4% 0.51 / 0.52 / -1.6%
clickbench_q36/datafusion:parquet 73573544 / 73524500 / +0.1% 138731778 / 135274104 / +2.6% 0.53 / 0.54 / -2.4%
clickbench_q37/datafusion:parquet 35559508 / 35303918 / +0.7% 91290922 / 91999931 / -0.8% 0.39 / 0.38 / +1.5%
clickbench_q38/datafusion:parquet 47800794 / 47459399 / +0.7% 108948745 / 108736148 / +0.2% 0.44 / 0.44 / +0.5%
clickbench_q39/datafusion:parquet 144560019 / 144082918 / +0.3% 211915936 / 209253729 / +1.3% 0.68 / 0.69 / -0.9%
clickbench_q40/datafusion:parquet 20124744 / 20089084 / +0.2% 78536488 / 79533518 / -1.3% 0.26 / 0.25 / +1.4%
clickbench_q41/datafusion:parquet 18669092 / 18696500 / -0.1% 76168238 / 76074427 / +0.1% 0.25 / 0.25 / -0.3%
clickbench_q42/datafusion:parquet 19297074 / 19301906 / -0.0% 75261666 / 74400584 / +1.2% 0.26 / 0.26 / -1.2%
duckdb / vortex-file-compressed / ns (1.015x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1570445 / 1612292 / -2.6% 27607249 / 24218812 / +14.0% 🔴 0.06 / 0.07 / -14.6%
clickbench_q01/duckdb:vortex-file-compressed 14749228 / 12264270 / +20.3% 🔴 32792854 / 31120342 / +5.4% 0.45 / 0.39 / +14.1%
clickbench_q02/duckdb:vortex-file-compressed 13276317 / 13032264 / +1.9% 32790042 / 30346929 / +8.1% 0.40 / 0.43 / -5.7%
clickbench_q03/duckdb:vortex-file-compressed 18641062 / 18778810 / -0.7% 51733366 / 47134640 / +9.8% 0.36 / 0.40 / -9.6%
clickbench_q04/duckdb:vortex-file-compressed 67593338 / 73418103 / -7.9% 101714189 / 105238587 / -3.3% 0.66 / 0.70 / -4.7%
clickbench_q05/duckdb:vortex-file-compressed 68026654 / 67332162 / +1.0% 97640019 / 91754870 / +6.4% 0.70 / 0.73 / -5.1%
clickbench_q06/duckdb:vortex-file-compressed 1836385 / 1881158 / -2.4% 30986750 / 27619635 / +12.2% 🔴 0.06 / 0.07 / -13.0%
clickbench_q07/duckdb:vortex-file-compressed 13576594 / 14657365 / -7.4% 32464380 / 31709704 / +2.4% 0.42 / 0.46 / -9.5%
clickbench_q08/duckdb:vortex-file-compressed 86002864 / 81998479 / +4.9% 126508304 / 125546140 / +0.8% 0.68 / 0.65 / +4.1%
clickbench_q09/duckdb:vortex-file-compressed 105425288 / 105671572 / -0.2% 151429460 / 150577584 / +0.6% 0.70 / 0.70 / -0.8%
clickbench_q10/duckdb:vortex-file-compressed 32021235 / 32602828 / -1.8% 70727988 / 78712650 / -10.1% 🟢 0.45 / 0.41 / +9.3%
clickbench_q11/duckdb:vortex-file-compressed 34935550 / 35664200 / -2.0% 76663990 / 74601282 / +2.8% 0.46 / 0.48 / -4.7%
clickbench_q12/duckdb:vortex-file-compressed 74344991 / 74166717 / +0.2% 107387988 / 103875310 / +3.4% 0.69 / 0.71 / -3.0%
clickbench_q13/duckdb:vortex-file-compressed 132360778 / 130342378 / +1.5% 186859668 / 179142824 / +4.3% 0.71 / 0.73 / -2.6%
clickbench_q14/duckdb:vortex-file-compressed 79816969 / 77024396 / +3.6% 109196760 / 107221026 / +1.8% 0.73 / 0.72 / +1.8%
clickbench_q15/duckdb:vortex-file-compressed 91244182 / 90466679 / +0.9% 133181040 / 134894641 / -1.3% 0.69 / 0.67 / +2.2%
clickbench_q16/duckdb:vortex-file-compressed 162278272 / 159841308 / +1.5% 208326468 / 216934359 / -4.0% 0.78 / 0.74 / +5.7%
clickbench_q17/duckdb:vortex-file-compressed 171540587 / 159140986 / +7.8% 210111563 / 217641504 / -3.5% 0.82 / 0.73 / +11.7%
clickbench_q18/duckdb:vortex-file-compressed 311397708 / 316006152 / -1.5% 392766925 / 392634174 / +0.0% 0.79 / 0.80 / -1.5%
clickbench_q19/duckdb:vortex-file-compressed 16499412 / 15273606 / +8.0% 45301214 / 40512333 / +11.8% 🔴 0.36 / 0.38 / -3.4%
clickbench_q20/duckdb:vortex-file-compressed 110218724 / 108137848 / +1.9% 194934973 / 194975574 / -0.0% 0.57 / 0.55 / +1.9%
clickbench_q21/duckdb:vortex-file-compressed 152656956 / 154602984 / -1.3% 301950400 / 303388791 / -0.5% 0.51 / 0.51 / -0.8%
clickbench_q22/duckdb:vortex-file-compressed 234879128 / 232494306 / +1.0% 483970548 / 466254738 / +3.8% 0.49 / 0.50 / -2.7%
clickbench_q23/duckdb:vortex-file-compressed 60618409 / 59477550 / +1.9% 101954359 / 103944996 / -1.9% 0.59 / 0.57 / +3.9%
clickbench_q24/duckdb:vortex-file-compressed 26569060 / 25052324 / +6.1% 41222485 / 45547002 / -9.5% 0.64 / 0.55 / +17.2%
clickbench_q25/duckdb:vortex-file-compressed 31006629 / 31415192 / -1.3% 52831602 / 55936188 / -5.6% 0.59 / 0.56 / +4.5%
clickbench_q26/duckdb:vortex-file-compressed 19562755 / 19814084 / -1.3% 37491074 / 41848525 / -10.4% 🟢 0.52 / 0.47 / +10.2%
clickbench_q27/duckdb:vortex-file-compressed 134070869 / 133039878 / +0.8% 244723899 / 245942726 / -0.5% 0.55 / 0.54 / +1.3%
clickbench_q28/duckdb:vortex-file-compressed 676840760 / 657487719 / +2.9% 695796712 / 689193613 / +1.0% 0.97 / 0.95 / +2.0%
clickbench_q29/duckdb:vortex-file-compressed 18774104 / 16785129 / +11.8% 🔴 36536934 / 36092959 / +1.2% 0.51 / 0.47 / +10.5%
clickbench_q30/duckdb:vortex-file-compressed 66265628 / 65109522 / +1.8% 112702301 / 112933316 / -0.2% 0.59 / 0.58 / +2.0%
clickbench_q31/duckdb:vortex-file-compressed 125336852 / 124260858 / +0.9% 209229002 / 207856565 / +0.7% 0.60 / 0.60 / +0.2%
clickbench_q32/duckdb:vortex-file-compressed 452935606 / 439809404 / +3.0% 490830516 / 488810362 / +0.4% 0.92 / 0.90 / +2.6%
clickbench_q33/duckdb:vortex-file-compressed 401686034 / 387381436 / +3.7% 511891890 / 495752046 / +3.3% 0.78 / 0.78 / +0.4%
clickbench_q34/duckdb:vortex-file-compressed 410324606 / 400019746 / +2.6% 525213588 / 533491770 / -1.6% 0.78 / 0.75 / +4.2%
clickbench_q35/duckdb:vortex-file-compressed 100857913 / 102717294 / -1.8% 142986861 / 137141534 / +4.3% 0.71 / 0.75 / -5.8%
clickbench_q36/duckdb:vortex-file-compressed 15740820 / 15229188 / +3.4% 32144048 / 31792701 / +1.1% 0.49 / 0.48 / +2.2%
clickbench_q37/duckdb:vortex-file-compressed 11629090 / 11855120 / -1.9% 27238319 / 26416346 / +3.1% 0.43 / 0.45 / -4.9%
clickbench_q38/duckdb:vortex-file-compressed 12976718 / 12998514 / -0.2% 29973589 / 27741538 / +8.0% 0.43 / 0.47 / -7.6%
clickbench_q39/duckdb:vortex-file-compressed 23301668 / 23087446 / +0.9% 40998311 / 40804413 / +0.5% 0.57 / 0.57 / +0.5%
clickbench_q40/duckdb:vortex-file-compressed 10752544 / 10237318 / +5.0% 30507587 / 26284569 / +16.1% 🔴 0.35 / 0.39 / -9.5%
clickbench_q41/duckdb:vortex-file-compressed 11564732 / 10857144 / +6.5% 29115616 / 30016713 / -3.0% 0.40 / 0.36 / +9.8%
clickbench_q42/duckdb:vortex-file-compressed 11280910 / 11610084 / -2.8% 28288395 / 28054776 / +0.8% 0.40 / 0.41 / -3.6%
duckdb / parquet / ns (0.994x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8989562 / 9436250 / -4.7% 18681978 / 18929514 / -1.3% 0.48 / 0.50 / -3.5%
clickbench_q01/duckdb:parquet 9395696 / 10652034 / -11.8% 🟢 23881747 / 20057696 / +19.1% 🔴 0.39 / 0.53 / -25.9%
clickbench_q02/duckdb:parquet 15522028 / 15537700 / -0.1% 32107038 / 33655564 / -4.6% 0.48 / 0.46 / +4.7%
clickbench_q03/duckdb:parquet 15506346 / 15703996 / -1.3% 54400704 / 54644665 / -0.4% 0.29 / 0.29 / -0.8%
clickbench_q04/duckdb:parquet 71979303 / 69799104 / +3.1% 96935139 / 92408527 / +4.9% 0.74 / 0.76 / -1.7%
clickbench_q05/duckdb:parquet 80498802 / 81749776 / -1.5% 128921161 / 123632629 / +4.3% 0.62 / 0.66 / -5.6%
clickbench_q06/duckdb:parquet 14336756 / 15785188 / -9.2% 26795880 / 24383768 / +9.9% 0.54 / 0.65 / -17.4%
clickbench_q07/duckdb:parquet 10585489 / 13306806 / -20.5% 🟢 22127807 / 24949910 / -11.3% 🟢 0.48 / 0.53 / -10.3%
clickbench_q08/duckdb:parquet 86543691 / 84973278 / +1.8% 126873902 / 128580209 / -1.3% 0.68 / 0.66 / +3.2%
clickbench_q09/duckdb:parquet 113515048 / 114746196 / -1.1% 168645017 / 162378319 / +3.9% 0.67 / 0.71 / -4.7%
clickbench_q10/duckdb:parquet 32814672 / 32212146 / +1.9% 70285823 / 71737418 / -2.0% 0.47 / 0.45 / +4.0%
clickbench_q11/duckdb:parquet 36969304 / 36218352 / +2.1% 76185845 / 76362008 / -0.2% 0.49 / 0.47 / +2.3%
clickbench_q12/duckdb:parquet 95888172 / 88126738 / +8.8% 140118898 / 130906471 / +7.0% 0.68 / 0.67 / +1.7%
clickbench_q13/duckdb:parquet 153918734 / 146571838 / +5.0% 206260366 / 216574672 / -4.8% 0.75 / 0.68 / +10.3%
clickbench_q14/duckdb:parquet 95432176 / 96130270 / -0.7% 144812516 / 143402744 / +1.0% 0.66 / 0.67 / -1.7%
clickbench_q15/duckdb:parquet 93631653 / 91456438 / +2.4% 124544793 / 139551214 / -10.8% 🟢 0.75 / 0.66 / +14.7%
clickbench_q16/duckdb:parquet 178539182 / 173860585 / +2.7% 239054698 / 226210988 / +5.7% 0.75 / 0.77 / -2.8%
clickbench_q17/duckdb:parquet 176782846 / 175173738 / +0.9% 233775362 / 241848170 / -3.3% 0.76 / 0.72 / +4.4%
clickbench_q18/duckdb:parquet 322759056 / 322814666 / -0.0% 409165549 / 399644017 / +2.4% 0.79 / 0.81 / -2.3%
clickbench_q19/duckdb:parquet 13479893 / 12953952 / +4.1% 41656401 / 41963606 / -0.7% 0.32 / 0.31 / +4.8%
clickbench_q20/duckdb:parquet 136382660 / 134164556 / +1.7% 243430931 / 244092101 / -0.3% 0.56 / 0.55 / +1.9%
clickbench_q21/duckdb:parquet 182213612 / 175389816 / +3.9% 324987895 / 314500394 / +3.3% 0.56 / 0.56 / +0.5%
clickbench_q22/duckdb:parquet 241209994 / 257003465 / -6.1% 417160094 / 413829871 / +0.8% 0.58 / 0.62 / -6.9%
clickbench_q23/duckdb:parquet 145852862 / 144828962 / +0.7% 165166843 / 166610143 / -0.9% 0.88 / 0.87 / +1.6%
clickbench_q24/duckdb:parquet 42533174 / 42933824 / -0.9% 60966300 / 59917401 / +1.8% 0.70 / 0.72 / -2.6%
clickbench_q25/duckdb:parquet 39586578 / 39976946 / -1.0% 90758523 / 92082974 / -1.4% 0.44 / 0.43 / +0.5%
clickbench_q26/duckdb:parquet 29629460 / 32122542 / -7.8% 46257657 / 45853389 / +0.9% 0.64 / 0.70 / -8.6%
clickbench_q27/duckdb:parquet 141485988 / 142922988 / -1.0% 264112992 / 256111676 / +3.1% 0.54 / 0.56 / -4.0%
clickbench_q28/duckdb:parquet 903017870 / 895910675 / +0.8% 1021205991 / 1011876531 / +0.9% 0.88 / 0.89 / -0.1%
clickbench_q29/duckdb:parquet 17593853 / 17513606 / +0.5% 30784210 / 30462602 / +1.1% 0.57 / 0.57 / -0.6%
clickbench_q30/duckdb:parquet 90114720 / 90342822 / -0.3% 179151675 / 172307121 / +4.0% 0.50 / 0.52 / -4.1%
clickbench_q31/duckdb:parquet 143637785 / 143760290 / -0.1% 292898379 / 293422142 / -0.2% 0.49 / 0.49 / +0.1%
clickbench_q32/duckdb:parquet 458520184 / 448719700 / +2.2% 542238957 / 517495700 / +4.8% 0.85 / 0.87 / -2.5%
clickbench_q33/duckdb:parquet 451388344 / 443433836 / +1.8% 470996568 / 517691171 / -9.0% 0.96 / 0.86 / +11.9%
clickbench_q34/duckdb:parquet 443871934 / 446836720 / -0.7% 493903159 / 479542975 / +3.0% 0.90 / 0.93 / -3.6%
clickbench_q35/duckdb:parquet 99924888 / 103771381 / -3.7% 123271107 / 119599404 / +3.1% 0.81 / 0.87 / -6.6%
clickbench_q36/duckdb:parquet 31096257 / 30765018 / +1.1% 40954327 / 41221480 / -0.6% 0.76 / 0.75 / +1.7%
clickbench_q37/duckdb:parquet 22540100 / 23074134 / -2.3% 31545682 / 31115144 / +1.4% 0.71 / 0.74 / -3.6%
clickbench_q38/duckdb:parquet 24728928 / 23302332 / +6.1% 32797560 / 33779361 / -2.9% 0.75 / 0.69 / +9.3%
clickbench_q39/duckdb:parquet 55894698 / 56655067 / -1.3% 66056143 / 67502819 / -2.1% 0.85 / 0.84 / +0.8%
clickbench_q40/duckdb:parquet 12824546 / 12469982 / +2.8% 21852749 / 22133486 / -1.3% 0.59 / 0.56 / +4.2%
clickbench_q41/duckdb:parquet 12903598 / 13099450 / -1.5% 22614268 / 22317950 / +1.3% 0.57 / 0.59 / -2.8%
clickbench_q42/duckdb:parquet 14336874 / 14123299 / +1.5% 23809268 / 25019132 / -4.8% 0.60 / 0.56 / +6.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.998x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95172083 / 98811198 / -3.7% 172680481 / 171645822 / +0.6% 0.55 / 0.58 / -4.3%
tpch_q02/datafusion:vortex-file-compressed 64475421 / 65030619 / -0.9% 97530818 / 97935865 / -0.4% 0.66 / 0.66 / -0.4%
tpch_q03/datafusion:vortex-file-compressed 64462571 / 65065443 / -0.9% 126530427 / 113792692 / +11.2% 🔴 0.51 / 0.57 / -10.9%
tpch_q04/datafusion:vortex-file-compressed 34900626 / 35947899 / -2.9% 80641741 / 81249505 / -0.7% 0.43 / 0.44 / -2.2%
tpch_q05/datafusion:vortex-file-compressed 119590189 / 117445388 / +1.8% 184178343 / 178914641 / +2.9% 0.65 / 0.66 / -1.1%
tpch_q06/datafusion:vortex-file-compressed 14233005 / 14246608 / -0.1% 68716326 / 78213388 / -12.1% 🟢 0.21 / 0.18 / +13.7%
tpch_q07/datafusion:vortex-file-compressed 139589162 / 141571195 / -1.4% 206020723 / 188884597 / +9.1% 0.68 / 0.75 / -9.6%
tpch_q08/datafusion:vortex-file-compressed 142133958 / 144268050 / -1.5% 211187062 / 210649911 / +0.3% 0.67 / 0.68 / -1.7%
tpch_q09/datafusion:vortex-file-compressed 187812996 / 186163210 / +0.9% 252915337 / 264159191 / -4.3% 0.74 / 0.70 / +5.4%
tpch_q10/datafusion:vortex-file-compressed 73487676 / 72964813 / +0.7% 141122458 / 145131681 / -2.8% 0.52 / 0.50 / +3.6%
tpch_q11/datafusion:vortex-file-compressed 42844311 / 43117716 / -0.6% 67725413 / 68131918 / -0.6% 0.63 / 0.63 / -0.0%
tpch_q12/datafusion:vortex-file-compressed 45218763 / 43265048 / +4.5% 93208920 / 93708601 / -0.5% 0.49 / 0.46 / +5.1%
tpch_q13/datafusion:vortex-file-compressed 46812636 / 46836418 / -0.1% 85734116 / 76392436 / +12.2% 🔴 0.55 / 0.61 / -10.9%
tpch_q14/datafusion:vortex-file-compressed 25156534 / 24623508 / +2.2% 98297724 / 101779137 / -3.4% 0.26 / 0.24 / +5.8%
tpch_q15/datafusion:vortex-file-compressed 36966350 / 36817834 / +0.4% 100392834 / 104776482 / -4.2% 0.37 / 0.35 / +4.8%
tpch_q16/datafusion:vortex-file-compressed 37714958 / 37147755 / +1.5% 69326863 / 68219523 / +1.6% 0.54 / 0.54 / -0.1%
tpch_q17/datafusion:vortex-file-compressed 173857220 / 175368354 / -0.9% 224748404 / 229262783 / -2.0% 0.77 / 0.76 / +1.1%
tpch_q18/datafusion:vortex-file-compressed 201719457 / 201675448 / +0.0% 265975824 / 266596269 / -0.2% 0.76 / 0.76 / +0.3%
tpch_q19/datafusion:vortex-file-compressed 35589449 / 34616831 / +2.8% 93004354 / 94638636 / -1.7% 0.38 / 0.37 / +4.6%
tpch_q20/datafusion:vortex-file-compressed 62733774 / 63183058 / -0.7% 128636404 / 123486117 / +4.2% 0.49 / 0.51 / -4.7%
tpch_q21/datafusion:vortex-file-compressed 184924540 / 182641521 / +1.2% 243388716 / 247431751 / -1.6% 0.76 / 0.74 / +2.9%
tpch_q22/datafusion:vortex-file-compressed 25856725 / 25594140 / +1.0% 55161091 / 56052588 / -1.6% 0.47 / 0.46 / +2.7%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87186713 / 86706474 / +0.6% 132532557 / 130933828 / +1.2% 0.66 / 0.66 / -0.7%
tpch_q02/datafusion:parquet 157940078 / 158977576 / -0.7% 183416895 / 183537301 / -0.1% 0.86 / 0.87 / -0.6%
tpch_q03/datafusion:parquet 142959640 / 142585889 / +0.3% 196970081 / 194904028 / +1.1% 0.73 / 0.73 / -0.8%
tpch_q04/datafusion:parquet 59433596 / 58874234 / +1.0% 100123497 / 99132635 / +1.0% 0.59 / 0.59 / -0.0%
tpch_q05/datafusion:parquet 180472442 / 182261706 / -1.0% 238755072 / 241196826 / -1.0% 0.76 / 0.76 / +0.0%
tpch_q06/datafusion:parquet 35264219 / 35146841 / +0.3% 79515977 / 83422059 / -4.7% 0.44 / 0.42 / +5.3%
tpch_q07/datafusion:parquet 232027008 / 230546358 / +0.6% 304916958 / 290846147 / +4.8% 0.76 / 0.79 / -4.0%
tpch_q08/datafusion:parquet 233182561 / 234977546 / -0.8% 300610190 / 303307989 / -0.9% 0.78 / 0.77 / +0.1%
tpch_q09/datafusion:parquet 314597817 / 315210514 / -0.2% 386739345 / 381170156 / +1.5% 0.81 / 0.83 / -1.6%
tpch_q10/datafusion:parquet 404660594 / 405669083 / -0.2% 463522867 / 466290018 / -0.6% 0.87 / 0.87 / +0.3%
tpch_q11/datafusion:parquet 105520943 / 105327773 / +0.2% 132855796 / 130797615 / +1.6% 0.79 / 0.81 / -1.4%
tpch_q12/datafusion:parquet 84443299 / 85434722 / -1.2% 127595191 / 128252226 / -0.5% 0.66 / 0.67 / -0.7%
tpch_q13/datafusion:parquet 228369967 / 228136633 / +0.1% 259040179 / 258010056 / +0.4% 0.88 / 0.88 / -0.3%
tpch_q14/datafusion:parquet 87328607 / 87307631 / +0.0% 191643626 / 186797407 / +2.6% 0.46 / 0.47 / -2.5%
tpch_q15/datafusion:parquet 90224250 / 90916419 / -0.8% 138944129 / 141172403 / -1.6% 0.65 / 0.64 / +0.8%
tpch_q16/datafusion:parquet 95420519 / 94330875 / +1.2% 125233830 / 120620832 / +3.8% 0.76 / 0.78 / -2.6%
tpch_q17/datafusion:parquet 216616920 / 217413293 / -0.4% 272858119 / 271380756 / +0.5% 0.79 / 0.80 / -0.9%
tpch_q18/datafusion:parquet 292190358 / 287094261 / +1.8% 337168380 / 338817116 / -0.5% 0.87 / 0.85 / +2.3%
tpch_q19/datafusion:parquet 108963580 / 109630485 / -0.6% 172658210 / 176243447 / -2.0% 0.63 / 0.62 / +1.5%
tpch_q20/datafusion:parquet 183265463 / 184087430 / -0.4% 245241240 / 242947888 / +0.9% 0.75 / 0.76 / -1.4%
tpch_q21/datafusion:parquet 245543855 / 242693283 / +1.2% 313470117 / 316169628 / -0.9% 0.78 / 0.77 / +2.0%
tpch_q22/datafusion:parquet 199297371 / 199427842 / -0.1% 224307644 / 223374179 / +0.4% 0.89 / 0.89 / -0.5%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 56930678 / 52908091 / +7.6% 104691980 / 97897182 / +6.9% 0.54 / 0.54 / +0.6%
tpch_q02/duckdb:vortex-file-compressed 32897141 / 33109271 / -0.6% 49007413 / 47634903 / +2.9% 0.67 / 0.70 / -3.4%
tpch_q03/duckdb:vortex-file-compressed 58664950 / 59481580 / -1.4% 117235052 / 123126336 / -4.8% 0.50 / 0.48 / +3.6%
tpch_q04/duckdb:vortex-file-compressed 80402021 / 81843314 / -1.8% 122778237 / 123403840 / -0.5% 0.65 / 0.66 / -1.3%
tpch_q05/duckdb:vortex-file-compressed 63212232 / 63661346 / -0.7% 123465814 / 122112837 / +1.1% 0.51 / 0.52 / -1.8%
tpch_q06/duckdb:vortex-file-compressed 21864999 / 21102632 / +3.6% 69611235 / 69154680 / +0.7% 0.31 / 0.31 / +2.9%
tpch_q07/duckdb:vortex-file-compressed 60362743 / 59258247 / +1.9% 136122191 / 136702480 / -0.4% 0.44 / 0.43 / +2.3%
tpch_q08/duckdb:vortex-file-compressed 85151404 / 84366421 / +0.9% 149121593 / 157747159 / -5.5% 0.57 / 0.53 / +6.8%
tpch_q09/duckdb:vortex-file-compressed 162183004 / 166743130 / -2.7% 240506713 / 244811517 / -1.8% 0.67 / 0.68 / -1.0%
tpch_q10/duckdb:vortex-file-compressed 108895084 / 109065294 / -0.2% 170868561 / 177801767 / -3.9% 0.64 / 0.61 / +3.9%
tpch_q11/duckdb:vortex-file-compressed 17406385 / 17706587 / -1.7% 31011193 / 30840111 / +0.6% 0.56 / 0.57 / -2.2%
tpch_q12/duckdb:vortex-file-compressed 54660113 / 59234310 / -7.7% 106992750 / 120234173 / -11.0% 🟢 0.51 / 0.49 / +3.7%
tpch_q13/duckdb:vortex-file-compressed 91542955 / 91702340 / -0.2% 146223640 / 143375754 / +2.0% 0.63 / 0.64 / -2.1%
tpch_q14/duckdb:vortex-file-compressed 31176025 / 30424790 / +2.5% 86613850 / 73233270 / +18.3% 🔴 0.36 / 0.42 / -13.4%
tpch_q15/duckdb:vortex-file-compressed 40551922 / 37286216 / +8.8% 98820797 / 88015141 / +12.3% 🔴 0.41 / 0.42 / -3.1%
tpch_q16/duckdb:vortex-file-compressed 42458372 / 42156500 / +0.7% 53925441 / 58305576 / -7.5% 0.79 / 0.72 / +8.9%
tpch_q17/duckdb:vortex-file-compressed 66513502 / 56281413 / +18.2% 🔴 139162970 / 112474931 / +23.7% 🔴 0.48 / 0.50 / -4.5%
tpch_q18/duckdb:vortex-file-compressed 137208836 / 137744321 / -0.4% 172703068 / 173685651 / -0.6% 0.79 / 0.79 / +0.2%
tpch_q19/duckdb:vortex-file-compressed 41913717 / 45491508 / -7.9% 94451829 / 106114384 / -11.0% 🟢 0.44 / 0.43 / +3.5%
tpch_q20/duckdb:vortex-file-compressed 60303463 / 63395013 / -4.9% 128645745 / 148546080 / -13.4% 🟢 0.47 / 0.43 / +9.8%
tpch_q21/duckdb:vortex-file-compressed 243671124 / 247458182 / -1.5% 294741252 / 297307676 / -0.9% 0.83 / 0.83 / -0.7%
tpch_q22/duckdb:vortex-file-compressed 42230620 / 42054197 / +0.4% 61280483 / 68058007 / -10.0% 0.69 / 0.62 / +11.5%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 72531036 / 72126796 / +0.6% 88387307 / 89237022 / -1.0% 0.82 / 0.81 / +1.5%
tpch_q02/duckdb:parquet 80996900 / 81108592 / -0.1% 95926109 / 91135885 / +5.3% 0.84 / 0.89 / -5.1%
tpch_q03/duckdb:parquet 119177885 / 119294443 / -0.1% 148499115 / 156926838 / -5.4% 0.80 / 0.76 / +5.6%
tpch_q04/duckdb:parquet 78319649 / 76200938 / +2.8% 98401022 / 103162834 / -4.6% 0.80 / 0.74 / +7.8%
tpch_q05/duckdb:parquet 130001561 / 130283839 / -0.2% 168204815 / 164742419 / +2.1% 0.77 / 0.79 / -2.3%
tpch_q06/duckdb:parquet 33670337 / 34042626 / -1.1% 61641720 / 47199612 / +30.6% 🔴 0.55 / 0.72 / -24.3%
tpch_q07/duckdb:parquet 94117327 / 93533615 / +0.6% 132520137 / 130436159 / +1.6% 0.71 / 0.72 / -1.0%
tpch_q08/duckdb:parquet 150864819 / 150635143 / +0.2% 208192812 / 191104913 / +8.9% 0.72 / 0.79 / -8.1%
tpch_q09/duckdb:parquet 230570522 / 231035529 / -0.2% 290411558 / 264185740 / +9.9% 0.79 / 0.87 / -9.2%
tpch_q10/duckdb:parquet 514088021 / 512186217 / +0.4% 554887205 / 552442633 / +0.4% 0.93 / 0.93 / -0.1%
tpch_q11/duckdb:parquet 33929091 / 34040662 / -0.3% 39190105 / 39170672 / +0.0% 0.87 / 0.87 / -0.4%
tpch_q12/duckdb:parquet 78717705 / 76856768 / +2.4% 91094013 / 97067779 / -6.2% 0.86 / 0.79 / +9.1%
tpch_q13/duckdb:parquet 325018627 / 324867385 / +0.0% 339540682 / 339322004 / +0.1% 0.96 / 0.96 / -0.0%
tpch_q14/duckdb:parquet 111865456 / 115097586 / -2.8% 141186188 / 138443872 / +2.0% 0.79 / 0.83 / -4.7%
tpch_q15/duckdb:parquet 44031915 / 43524992 / +1.2% 74198062 / 80090694 / -7.4% 0.59 / 0.54 / +9.2%
tpch_q16/duckdb:parquet 119026670 / 118884817 / +0.1% 129939620 / 128842458 / +0.9% 0.92 / 0.92 / -0.7%
tpch_q17/duckdb:parquet 80581571 / 82616847 / -2.5% 105223734 / 110604142 / -4.9% 0.77 / 0.75 / +2.5%
tpch_q18/duckdb:parquet 208054227 / 211274956 / -1.5% 170464492 / 177020972 / -3.7% 1.22 / 1.19 / +2.3%
tpch_q19/duckdb:parquet 167156762 / 166284221 / +0.5% 196602687 / 195716537 / +0.5% 0.85 / 0.85 / +0.1%
tpch_q20/duckdb:parquet 135820967 / 135793432 / +0.0% 183630456 / 169975353 / +8.0% 0.74 / 0.80 / -7.4%
tpch_q21/duckdb:parquet 280226950 / 278409214 / +0.7% 303516478 / 283163840 / +7.2% 0.92 / 0.98 / -6.1%
tpch_q22/duckdb:parquet 269598887 / 267148091 / +0.9% 282410750 / 279255229 / +1.1% 0.95 / 0.96 / -0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR b4804b5a vs base d9ad4cfe
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -15.8%
Engines: DataFusion No clear signal (-11.2%, environment too noisy confidence) · DuckDB No clear signal (-20.2%, environment too noisy confidence)
Vortex (geomean): hot 0.821x ➖ · cold 0.809x ➖
Parquet (geomean): hot 0.975x ➖ · cold 0.972x ➖
Shifts: Parquet (control) -2.5% · Median polish -7.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.856x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 238422493 / 245470931 / -2.9% 783101412 / 700007726 / +11.9% 0.30 / 0.35 / -13.2%
tpch_q02/datafusion:vortex-file-compressed 355735158 / 429527907 / -17.2% 772691816 / 757055236 / +2.1% 0.46 / 0.57 / -18.9%
tpch_q03/datafusion:vortex-file-compressed 444921743 / 509126044 / -12.6% 1130079476 / 1150672683 / -1.8% 0.39 / 0.44 / -11.0%
tpch_q04/datafusion:vortex-file-compressed 233573740 / 218909867 / +6.7% 491617782 / 530666697 / -7.4% 0.48 / 0.41 / +15.2%
tpch_q05/datafusion:vortex-file-compressed 417095533 / 467951863 / -10.9% 608703040 / 727011493 / -16.3% 0.69 / 0.64 / +6.5%
tpch_q06/datafusion:vortex-file-compressed 313714116 / 323398159 / -3.0% 515514608 / 617084670 / -16.5% 0.61 / 0.52 / +16.1%
tpch_q07/datafusion:vortex-file-compressed 547285408 / 598251546 / -8.5% 711637093 / 755912586 / -5.9% 0.77 / 0.79 / -2.8%
tpch_q08/datafusion:vortex-file-compressed 475099564 / 656821282 / -27.7% 655355684 / 910436113 / -28.0% 0.72 / 0.72 / +0.5%
tpch_q09/datafusion:vortex-file-compressed 503396975 / 453035886 / +11.1% 548730811 / 586043181 / -6.4% 0.92 / 0.77 / +18.7%
tpch_q10/datafusion:vortex-file-compressed 443728501 / 507767003 / -12.6% 937102956 / 685321737 / +36.7% 🔴 0.47 / 0.74 / -36.1%
tpch_q11/datafusion:vortex-file-compressed 317492982 / 308510284 / +2.9% 450508138 / 456115250 / -1.2% 0.70 / 0.68 / +4.2%
tpch_q12/datafusion:vortex-file-compressed 391784960 / 461112828 / -15.0% 572089909 / 655280430 / -12.7% 0.68 / 0.70 / -2.7%
tpch_q13/datafusion:vortex-file-compressed 140165838 / 148344471 / -5.5% 366963712 / 360805934 / +1.7% 0.38 / 0.41 / -7.1%
tpch_q14/datafusion:vortex-file-compressed 190901650 / 224695653 / -15.0% 290163875 / 386238759 / -24.9% 0.66 / 0.58 / +13.1%
tpch_q15/datafusion:vortex-file-compressed 317250563 / 415149655 / -23.6% 604912370 / 690281813 / -12.4% 0.52 / 0.60 / -12.8%
tpch_q16/datafusion:vortex-file-compressed 181828799 / 185112971 / -1.8% 356529880 / 410052792 / -13.1% 0.51 / 0.45 / +13.0%
tpch_q17/datafusion:vortex-file-compressed 322041871 / 488869662 / -34.1% 🟢 452267887 / 752034428 / -39.9% 🟢 0.71 / 0.65 / +9.5%
tpch_q18/datafusion:vortex-file-compressed 252255248 / 564879752 / -55.3% 🟢 531602851 / 785382412 / -32.3% 🟢 0.47 / 0.72 / -34.0%
tpch_q19/datafusion:vortex-file-compressed 365474164 / 432537280 / -15.5% 521058122 / 530352158 / -1.8% 0.70 / 0.82 / -14.0%
tpch_q20/datafusion:vortex-file-compressed 309629332 / 349609396 / -11.4% 509233762 / 572425226 / -11.0% 0.61 / 0.61 / -0.4%
tpch_q21/datafusion:vortex-file-compressed 556005905 / 669375552 / -16.9% 803209595 / 1415712924 / -43.3% 🟢 0.69 / 0.47 / +46.4%
tpch_q22/datafusion:vortex-file-compressed 180121481 / 220663599 / -18.4% 330804465 / 556091997 / -40.5% 🟢 0.54 / 0.40 / +37.2%
datafusion / parquet / ns (0.964x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 190033778 / 253605368 / -25.1% 533784142 / 647861976 / -17.6% 0.36 / 0.39 / -9.1%
tpch_q02/datafusion:parquet 307418434 / 296646241 / +3.6% 750585293 / 444110369 / +69.0% 🔴 0.41 / 0.67 / -38.7%
tpch_q03/datafusion:parquet 278232858 / 346190605 / -19.6% 845969933 / 742838136 / +13.9% 0.33 / 0.47 / -29.4%
tpch_q04/datafusion:parquet 186640508 / 205085756 / -9.0% 428979484 / 416096976 / +3.1% 0.44 / 0.49 / -11.7%
tpch_q05/datafusion:parquet 375179606 / 400068183 / -6.2% 486284128 / 527138229 / -7.8% 0.77 / 0.76 / +1.7%
tpch_q06/datafusion:parquet 141980933 / 147554321 / -3.8% 267479729 / 250952141 / +6.6% 0.53 / 0.59 / -9.7%
tpch_q07/datafusion:parquet 371540746 / 355409157 / +4.5% 425651141 / 453560405 / -6.2% 0.87 / 0.78 / +11.4%
tpch_q08/datafusion:parquet 500842859 / 433563342 / +15.5% 625077766 / 531804988 / +17.5% 0.80 / 0.82 / -1.7%
tpch_q09/datafusion:parquet 418205624 / 453298830 / -7.7% 613092567 / 726965206 / -15.7% 0.68 / 0.62 / +9.4%
tpch_q10/datafusion:parquet 368379570 / 341187507 / +8.0% 458059502 / 521568378 / -12.2% 0.80 / 0.65 / +22.9%
tpch_q11/datafusion:parquet 254780426 / 255603050 / -0.3% 441127669 / 440501333 / +0.1% 0.58 / 0.58 / -0.5%
tpch_q12/datafusion:parquet 209833063 / 198240994 / +5.8% 480753007 / 397704338 / +20.9% 0.44 / 0.50 / -12.4%
tpch_q13/datafusion:parquet 387039080 / 364083119 / +6.3% 568872999 / 512645222 / +11.0% 0.68 / 0.71 / -4.2%
tpch_q14/datafusion:parquet 191440983 / 191489376 / -0.0% 457890188 / 405123263 / +13.0% 0.42 / 0.47 / -11.5%
tpch_q15/datafusion:parquet 311930400 / 344111642 / -9.4% 444183291 / 520145551 / -14.6% 0.70 / 0.66 / +6.2%
tpch_q16/datafusion:parquet 116987913 / 102883650 / +13.7% 275347146 / 298644182 / -7.8% 0.42 / 0.34 / +23.3%
tpch_q17/datafusion:parquet 308585655 / 406936433 / -24.2% 512898914 / 665631078 / -22.9% 0.60 / 0.61 / -1.6%
tpch_q18/datafusion:parquet 395417736 / 350840943 / +12.7% 546979185 / 450177015 / +21.5% 0.72 / 0.78 / -7.2%
tpch_q19/datafusion:parquet 168374985 / 278985054 / -39.6% 🟢 285635018 / 482048359 / -40.7% 🟢 0.59 / 0.58 / +1.9%
tpch_q20/datafusion:parquet 288555033 / 274095943 / +5.3% 547439881 / 417309879 / +31.2% 🔴 0.53 / 0.66 / -19.7%
tpch_q21/datafusion:parquet 344013374 / 376391164 / -8.6% 462796965 / 482379654 / -4.1% 0.74 / 0.78 / -4.7%
tpch_q22/datafusion:parquet 196584746 / 154091207 / +27.6% 353707803 / 301112710 / +17.5% 0.56 / 0.51 / +8.6%
duckdb / vortex-file-compressed / ns (0.787x ➖, 6↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 206522638 / 249090871 / -17.1% 274418157 / 699902387 / -60.8% 🟢 0.75 / 0.36 / +111.5%
tpch_q02/duckdb:vortex-file-compressed 477668045 / 575100736 / -16.9% 473086951 / 1015306689 / -53.4% 🟢 1.01 / 0.57 / +78.3%
tpch_q03/duckdb:vortex-file-compressed 563680665 / 605721069 / -6.9% 798513848 / 640954707 / +24.6% 0.71 / 0.95 / -25.3%
tpch_q04/duckdb:vortex-file-compressed 279317476 / 428356488 / -34.8% 🟢 312992830 / 570323114 / -45.1% 🟢 0.89 / 0.75 / +18.8%
tpch_q05/duckdb:vortex-file-compressed 444474038 / 634012160 / -29.9% 458775473 / 843318348 / -45.6% 🟢 0.97 / 0.75 / +28.9%
tpch_q06/duckdb:vortex-file-compressed 309628566 / 309191940 / +0.1% 301636325 / 332386121 / -9.3% 1.03 / 0.93 / +10.3%
tpch_q07/duckdb:vortex-file-compressed 482532565 / 541571160 / -10.9% 513279650 / 685603016 / -25.1% 0.94 / 0.79 / +19.0%
tpch_q08/duckdb:vortex-file-compressed 594731179 / 767507184 / -22.5% 689030431 / 808627526 / -14.8% 0.86 / 0.95 / -9.1%
tpch_q09/duckdb:vortex-file-compressed 513314459 / 570585935 / -10.0% 489811462 / 597643517 / -18.0% 1.05 / 0.95 / +9.8%
tpch_q10/duckdb:vortex-file-compressed 503773967 / 613324410 / -17.9% 614368145 / 591291928 / +3.9% 0.82 / 1.04 / -20.9%
tpch_q11/duckdb:vortex-file-compressed 202739778 / 323731926 / -37.4% 🟢 214423318 / 309844887 / -30.8% 🟢 0.95 / 1.04 / -9.5%
tpch_q12/duckdb:vortex-file-compressed 530076165 / 544892491 / -2.7% 534073830 / 611603320 / -12.7% 0.99 / 0.89 / +11.4%
tpch_q13/duckdb:vortex-file-compressed 338410817 / 421000968 / -19.6% 430388092 / 557220159 / -22.8% 0.79 / 0.76 / +4.1%
tpch_q14/duckdb:vortex-file-compressed 236236147 / 355302584 / -33.5% 🟢 386525620 / 337701974 / +14.5% 0.61 / 1.05 / -41.9%
tpch_q15/duckdb:vortex-file-compressed 147648513 / 237828453 / -37.9% 🟢 233745906 / 211819966 / +10.4% 0.63 / 1.12 / -43.7%
tpch_q16/duckdb:vortex-file-compressed 183340261 / 202534077 / -9.5% 233424366 / 263743556 / -11.5% 0.79 / 0.77 / +2.3%
tpch_q17/duckdb:vortex-file-compressed 471533356 / 676614075 / -30.3% 🟢 450052429 / 575066101 / -21.7% 1.05 / 1.18 / -11.0%
tpch_q18/duckdb:vortex-file-compressed 337351586 / 475727057 / -29.1% 328437191 / 521646113 / -37.0% 🟢 1.03 / 0.91 / +12.6%
tpch_q19/duckdb:vortex-file-compressed 351192656 / 361252679 / -2.8% 326523938 / 432263462 / -24.5% 1.08 / 0.84 / +28.7%
tpch_q20/duckdb:vortex-file-compressed 372544356 / 455160385 / -18.2% 403464822 / 563658313 / -28.4% 0.92 / 0.81 / +14.3%
tpch_q21/duckdb:vortex-file-compressed 640302233 / 851744859 / -24.8% 689154025 / 981531673 / -29.8% 0.93 / 0.87 / +7.1%
tpch_q22/duckdb:vortex-file-compressed 182252499 / 284716802 / -36.0% 🟢 216499160 / 294591349 / -26.5% 0.84 / 0.97 / -12.9%
duckdb / parquet / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 291774722 / 301531981 / -3.2% 315064939 / 355619548 / -11.4% 0.93 / 0.85 / +9.2%
tpch_q02/duckdb:parquet 653021577 / 619684481 / +5.4% 721562988 / 626983815 / +15.1% 0.91 / 0.99 / -8.4%
tpch_q03/duckdb:parquet 715173412 / 751020443 / -4.8% 780743601 / 824456865 / -5.3% 0.92 / 0.91 / +0.6%
tpch_q04/duckdb:parquet 477252446 / 490004196 / -2.6% 492971605 / 623708502 / -21.0% 0.97 / 0.79 / +23.2%
tpch_q05/duckdb:parquet 919465658 / 970777887 / -5.3% 880702653 / 1159627242 / -24.1% 1.04 / 0.84 / +24.7%
tpch_q06/duckdb:parquet 301226816 / 395446553 / -23.8% 329837763 / 306431340 / +7.6% 0.91 / 1.29 / -29.2%
tpch_q07/duckdb:parquet 859973222 / 853849531 / +0.7% 817245164 / 893442889 / -8.5% 1.05 / 0.96 / +10.1%
tpch_q08/duckdb:parquet 1105138601 / 1097970503 / +0.7% 1019475593 / 1667042198 / -38.8% 🟢 1.08 / 0.66 / +64.6%
tpch_q09/duckdb:parquet 1007225502 / 935758267 / +7.6% 933043029 / 892383630 / +4.6% 1.08 / 1.05 / +2.9%
tpch_q10/duckdb:parquet 980357127 / 964002717 / +1.7% 913065563 / 878669060 / +3.9% 1.07 / 1.10 / -2.1%
tpch_q11/duckdb:parquet 420806172 / 464394180 / -9.4% 383570742 / 599312086 / -36.0% 🟢 1.10 / 0.77 / +41.6%
tpch_q12/duckdb:parquet 554553963 / 514498310 / +7.8% 645341578 / 709174514 / -9.0% 0.86 / 0.73 / +18.4%
tpch_q13/duckdb:parquet 701783443 / 735027937 / -4.5% 768949623 / 770373638 / -0.2% 0.91 / 0.95 / -4.3%
tpch_q14/duckdb:parquet 507121649 / 487719747 / +4.0% 819605804 / 591135786 / +38.6% 🔴 0.62 / 0.83 / -25.0%
tpch_q15/duckdb:parquet 406692126 / 373366115 / +8.9% 339647968 / 409162208 / -17.0% 1.20 / 0.91 / +31.2%
tpch_q16/duckdb:parquet 471847843 / 500473064 / -5.7% 461944303 / 465545901 / -0.8% 1.02 / 1.08 / -5.0%
tpch_q17/duckdb:parquet 474278580 / 528291228 / -10.2% 450260313 / 511645404 / -12.0% 1.05 / 1.03 / +2.0%
tpch_q18/duckdb:parquet 637351746 / 642518264 / -0.8% 582578574 / 626336924 / -7.0% 1.09 / 1.03 / +6.6%
tpch_q19/duckdb:parquet 688939668 / 660490727 / +4.3% 627555099 / 615125534 / +2.0% 1.10 / 1.07 / +2.2%
tpch_q20/duckdb:parquet 892738396 / 825846248 / +8.1% 1000336550 / 949155795 / +5.4% 0.89 / 0.87 / +2.6%
tpch_q21/duckdb:parquet 731547832 / 723699190 / +1.1% 703960005 / 793935903 / -11.3% 1.04 / 0.91 / +14.0%
tpch_q22/duckdb:parquet 406773864 / 418749425 / -2.9% 489150608 / 440455088 / +11.1% 0.83 / 0.95 / -12.5%

@jackylee-ch jackylee-ch mentioned this pull request Oct 14, 2026
Merged
claude added 2 commits October 15, 2026 11:02
@claude
fix(datafusion): import VortexSessionDefault in stats tests and run fmt
b5f3d66 
The stats tests called `VortexSession::default()` without the trait in
scope, which broke every `--all-targets` build. Also apply the pinned
nightly rustfmt.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EUqrqh9T3YZqy49vq9Tx4i
Signed-off-by: Claude <[email protected]>
@claude
test(sqllogictest): update TPC-DS q70 plan for singleton s_state
54f4e1b 
`store.s_state` has equal exact min/max bounds in TPC-DS SF=1, so it now
reports an exact distinct count of 1. DataFusion uses that to make the
smaller rank-filtered subquery the build side of the semi join, which
turns the `LeftSemi` join into a `RightSemi` join with swapped inputs.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EUqrqh9T3YZqy49vq9Tx4i
Signed-off-by: Claude <[email protected]>
@joseph-isaacs joseph-isaacs added the changelog/fix A bug fix label Oct 15, 2026 — with Claude
@claude
test(sqllogictest): update TPC-DS q77 plan for exact distinct counts
519b361 
With the new exact singleton distinct counts, DataFusion picks the
store_sales aggregate as the build side of the store-channel left join
and plans the union as a UnionExec instead of an InterleaveExec.
Regenerated with `--complete` against SF=0.1 fixtures; the full SLT
suite passes locally.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01EUqrqh9T3YZqy49vq9Tx4i
Signed-off-by: Claude <[email protected]>
@joseph-isaacs Claude

joseph-isaacs commented Oct 15, 2026

Copy link
Copy Markdown
Contributor Author

CodSpeed Performance Analysis fails on this PR, but the regressions don't come from it.

  • The 4 regressed benchmarks are filter_neon[64], filter_neon[80], bitpack_blocked_compress_avx2 (FastLanes bit-packing, WallTime) and test_repeated_scan_scalar_at[int_float] (Python scan).
  • This PR only changes vortex-datafusion statistics conversion (convert/stats, persistent/format.rs) plus SLT expected plans. None of those benchmarks touch that code.
  • CodSpeed itself warns that WallTime on hosted runners is inconsistent and that the comparison used different runtime environments. It also reports two similar-sized improvements in Python scan benchmarks that this PR can't affect either.

No fix to port; this needs acknowledging on CodSpeed. I don't have the means to re-run or acknowledge it from here.

Generated by Claude Code

@joseph-isaacs
joseph-isaacs merged commit c087cd9 into develop Oct 15, 2026
90 of 91 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/constant-stats-min-max branch October 15, 2026 11:39
This was referenced Oct 17, 2026
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/fix A bug fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@joseph-isaacs @robert3005 @claude