Skip to content

Commit 0ac4dad

Browse files
authored
docs: name the AQE query stages on the operator support page (#6660)
The Wrapper nodes section counted every AQE query stage as a wrapper but named only ResultQueryStage, so a search for TableCacheQueryStage found nothing and the stage looked like an operator Comet does not support. Name all four stages, matching the contributor guide's list of nodes Comet does not convert.
1 parent 7425780 commit 0ac4dad

1 file changed

Lines changed: 5 additions & 4 deletions

File tree

‎docs/source/user-guide/latest/operators.md‎

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -40,10 +40,11 @@ all native execution can be turned off with `spark.comet.exec.enabled=false`. Se
4040
## Wrapper nodes
4141

4242
Some nodes in a Spark plan do no work of their own: `AdaptiveSparkPlan`, the AQE query stages
43-
(including `ResultQueryStage` on Spark 4.0 and later), `AQEShuffleRead`, `InputAdapter`,
44-
`WholeStageCodegen`, and the reuse markers `ReusedExchange` and `ReusedSubquery`. Comet leaves
45-
them in place around the operators it converts, so this page does not list them, and seeing one in
46-
a plan does not mean that part of the query fell back to Spark. The coverage summary described in
43+
(`ShuffleQueryStage`, `BroadcastQueryStage`, `TableCacheQueryStage` on Spark 3.5 and later, and
44+
`ResultQueryStage` on Spark 4.0 and later), `AQEShuffleRead`, `InputAdapter`, `WholeStageCodegen`,
45+
and the reuse markers `ReusedExchange` and `ReusedSubquery`. Comet leaves them in place around the
46+
operators it converts, so this page does not list them, and seeing one in a plan does not mean
47+
that part of the query fell back to Spark. The coverage summary described in
4748
[Understanding Comet Plans](understanding-comet-plans.md) does not count them.
4849

4950
## Not currently planned

0 commit comments

Comments
 (0)