You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 1ef3990
Browse filesBrowse the repository at this point in the historyBrowse files
Per @alamb's review on #23420:
1. Config opt-out: new
`datafusion.execution.parquet.pushdown_filter_narrow_projection_gate`
(default true). Set to false to restore the pre-existing unconditional
pushdown behavior. Proto + serde support included so the option
round-trips through the physical plan.
2. Plan-display marker: when the gate declines pushdown for a scan,
the ParquetSource fmt_extra output includes
`pushdown_declined=narrow_projection` so profiling / EXPLAIN
ANALYZE can see the heuristic fired without needing to correlate
config against per-query symptoms.
3. Upgrade guide: docs/source/library-user-guide/upgrading/55.0.0.md
documents the new behavior and how to opt out.
Kept the heuristic itself unchanged (single hardcoded
PUSHDOWN_MIN_NON_FILTER_COLS = 3 with no tuning knob) per @alamb's
'complexity budget' note.
0 commit comments