Repository navigation
Commit 199a910
test: cover struct data columns in native shuffle (#5564)
`CometShuffleExchangeExec.supportedSerializableDataType` allows struct data
columns in native shuffle, but `CometNativeShuffleSuite` never exercised one:
the only nested coverage was `array<array<int>>` and `map<int, null>`, and the
word "struct" did not appear in the suite at all. The columnar suite has
extensive nested coverage, so the gap was specific to native shuffle.
Struct columns can only reach native shuffle as DATA columns, since
`supportedHashPartitioningDataType` rejects nested types as a hash key, so
these tests partition on a primitive and carry the struct along.
Adds four tests:
- a plain `struct<int, string>` data column
- a struct data column with a null struct and a null field inside a struct
- `struct<array<int>, string>` and `array<struct<int, string>>`, covering the
recursive branches of the type gate
- a struct data column with a map field
Co-authored-by: Claude Code <[email protected]>1 parent 918bc7d commit 199a910
1 file changed
Lines changed: 57 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
615 | 615 | | |
616 | 616 | | |
617 | 617 | | |
| 618 | + | |
| 619 | + | |
| 620 | + | |
| 621 | + | |
| 622 | + | |
| 623 | + | |
| 624 | + | |
| 625 | + | |
| 626 | + | |
| 627 | + | |
| 628 | + | |
| 629 | + | |
| 630 | + | |
| 631 | + | |
| 632 | + | |
| 633 | + | |
| 634 | + | |
| 635 | + | |
| 636 | + | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
| 650 | + | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
| 657 | + | |
| 658 | + | |
| 659 | + | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
| 664 | + | |
| 665 | + | |
| 666 | + | |
| 667 | + | |
| 668 | + | |
| 669 | + | |
| 670 | + | |
| 671 | + | |
| 672 | + | |
| 673 | + | |
| 674 | + | |
618 | 675 | | |
619 | 676 | | |
620 | 677 | | |
| |||
0 commit comments