Repository navigation
Support BroadcastNestedLoopJoinExec #198
Description
What is the problem the feature request solves?
Datafusion supports
Cross and NestedLoop joins as well : https://docs.rs/datafusion-physical-plan/36.0.0/datafusion_physical_plan/joins/index.html
It will really nice if we can add support for it like Hash and SortMergeJoin.
Describe the potential solution
No response
Additional context
SHJ pr
Activity
singhpk234 commentedon Mar 12, 2024
@viirya can i pick this up ?
viirya commentedon Mar 12, 2024
Sure. I've not begun working on this yet. Which one you will work, NestedLoop or Cross Join? In Spark, they are two difference join operators, I think we should have different tickets for them instead of one.
[-]Support NestedLoop and Cross Join [/-][+]Support BroadcastNestedLoopJoinExec[/+]singhpk234 commentedon Mar 12, 2024
I can start with BNLJ :) !
singhpk234 commentedon Mar 28, 2024
still working on it, will publish a pr by early next week, apologies for the delay.
viirya commentedon Mar 28, 2024
No problem. Thank you for working on this.
viirya commentedon Apr 5, 2024
Note that I found several bugs in current broadcast implementation when trying to enable broadcast by default in #213. Since BroadcastNestedLoopJoinExec uses broadcast, I suggest that you can work on the operator after #213 is merged.
singhpk234 commentedon Apr 5, 2024
Ack, let me rebase with this branch meanwhile
coderfender commentedon May 6, 2026
I will be picking this up
coderfender commentedon May 6, 2026
#12
contrib(delta) apache#198: DPP prunes partitions in the MERGE/join (n…
contrib(delta) repros for remaining regression failures (F3/F4/F6)
contrib(delta) fix: DPP CSAB crash on MERGE target read (standard wai…