Repository navigation
Commit 2d5e9cf
committed
test: count a range-partitioned conversion's rows once, and range-partition every column in the benchmark
Before the sampling change, the range partitioner's sampling job ran through the conversion and
added its rows to the conversion's metrics, so a range-partitioned shuffle reported twice the
rows it wrote.1 parent ef1d8ec commit 2d5e9cf
2 files changed
Lines changed: 6 additions & 3 deletions
File tree
- spark/src/test/scala/org/apache
- comet/exec
- spark/sql/benchmark
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
396 | 396 | | |
397 | 397 | | |
398 | 398 | | |
| 399 | + | |
| 400 | + | |
| 401 | + | |
399 | 402 | | |
400 | 403 | | |
401 | 404 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
131 | 131 | | |
132 | 132 | | |
133 | 133 | | |
134 | | - | |
| 134 | + | |
135 | 135 | | |
136 | 136 | | |
137 | | - | |
138 | 137 | | |
139 | | - | |
| 138 | + | |
| 139 | + | |
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| |||
0 commit comments