Skip to content

Commit 07a1b5e

Browse files
committed
fix(planner): keep ON keys that span cross-joined relations
DataFusion 55.1's eliminate_cross_join pools the on-pairs of every inner join in a flattened tree and rebuilds it greedily; a pair the rebuild cannot place as an equi-key (it spans relations only joined through the cross product, or leaf order leaves it unplaceable) is dropped, and the query returns the unfiltered product. SQE now runs a copy of the rule from datafusion-optimizer 55.1.0 that keeps every unplaced pair as a filter (= or IS NOT DISTINCT FROM by the join's null equality), installed through engine_context so the coordinator, sqe-cli and Hive view planning share it. A tripwire test fails once plain DataFusion stops dropping the key. Closes #806 Refs apache/datafusion#26058
1 parent a83ea0e commit 07a1b5e

4 files changed

Lines changed: 673 additions & 1 deletion

File tree

0 commit comments

Comments
 (0)