Repository navigation
Support SubqueryBroadcastExec in Comet #242
Description
What is the problem the feature request solves?
Currently we support BroadcastExchange if it is under BroadcastHashJoin in Comet.
Besides broadcast join, BroadcastExchange can also occur under SubqueryBroadcastExec for dynamic pruning expression. Because Spark BroadcastExchange assumes it is row-based so we cannot simply transform BroadcastExchange under SubqueryBroadcastExec into Comet's broadcast operator.
We need to come out with a Comet SubqueryBroadcastExec which supports Comet's BroadcastExchange.
Describe the potential solution
No response
Additional context
No response
Activity
Enable tests in RemoveRedundantProjectsSuite.scala related to apache#242
Enable tests in RemoveRedundantProjectsSuite.scala related to #242 (#…
Enable tests in RemoveRedundantProjectsSuite.scala related to apache#242
andygrove commentedon May 1, 2026
we still have some Spark SQL tests ignored and linked to this issue so we should update those tests before closing. I will do this.
mbutrovich commentedon May 1, 2026
My bad. I thought I got all of the subquery/DPP filter related Spark SQL tests. I can take a look on Monday if you don’t beat me to it.
test: unignore InjectRuntimeFilterSuite tests gated on issue #242 (#4178
mbutrovich commentedon Jun 11, 2026
Closed by #4178. I don't see any references to this issue in the codebase anymore and I think we're fully exercising this now in Spark SQL tests.