Repository navigation
Commit 702f479
authored
Add ClickBench URL pushdown benchmark (#21945)
## Which issue does this PR close?
N/A. This is a benchmark follow-up for #21637.
## Rationale for this change
This adds a ClickBench extended query that exercises Parquet filter
pushdown when row group statistics can prove a string range predicate
matches every row in the row group.
This case is useful for validating the optimization in #21637: when
Parquet statistics prove a row group is fully matched, DataFusion can
avoid evaluating the pushed-down RowFilter for that row group.
## What changes are included in this PR?
- Add `benchmarks/queries/clickbench/extended/q13.sql`.
- Document Q13 in the ClickBench query README.
## Are these changes tested?
I ran a local synthetic-data comparison for this query. With
`target_partitions=1`, the #21637 branch reduced scan processing time
from about 85.82ms to 24.89ms, reduced `bytes_scanned` from 26.12M to
400.6K, and reduced `row_pushdown_eval_time` from 4.12ms to effectively
zero.
## Are there any user-facing changes?
No public API changes. This adds a benchmark query and benchmark
documentation.1 parent d09a919 commit 702f479
2 files changed
Lines changed: 25 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
241 | 241 | | |
242 | 242 | | |
243 | 243 | | |
| 244 | + | |
| 245 | + | |
| 246 | + | |
| 247 | + | |
| 248 | + | |
| 249 | + | |
| 250 | + | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
| 254 | + | |
| 255 | + | |
| 256 | + | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
244 | 263 | | |
245 | 264 | | |
246 | 265 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
0 commit comments