Repository navigation
Commit 07a1b5e
committed
fix(planner): keep ON keys that span cross-joined relations
DataFusion 55.1's eliminate_cross_join pools the on-pairs of every
inner join in a flattened tree and rebuilds it greedily; a pair the
rebuild cannot place as an equi-key (it spans relations only joined
through the cross product, or leaf order leaves it unplaceable) is
dropped, and the query returns the unfiltered product.
SQE now runs a copy of the rule from datafusion-optimizer 55.1.0 that
keeps every unplaced pair as a filter (= or IS NOT DISTINCT FROM by the
join's null equality), installed through engine_context so the
coordinator, sqe-cli and Hive view planning share it. A tripwire test
fails once plain DataFusion stops dropping the key.
Closes #806
Refs apache/datafusion#260581 parent a83ea0e commit 07a1b5e
4 files changed
Lines changed: 673 additions & 1 deletion
0 commit comments