Repository navigation
Commit 1e47bbc
committed
fix(spark): reject MapType instead of emitting a childless Arrow List
SparkToArrowSchema mapped MapType to a childless ArrowType.List, which is
an invalid Arrow list (List requires exactly one child). Drop the branch so
MapType falls through to the fail-fast UnsupportedOperationException, and
add a test.
Signed-off-by: jackylee <[email protected]>1 parent 3975895 commit 1e47bbc
2 files changed
Lines changed: 10 additions & 4 deletions
File tree
- java/vortex-spark/src
- main/java/dev/vortex/spark/write
- test/java/dev/vortex/spark/write
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
27 | 26 | | |
28 | 27 | | |
29 | 28 | | |
| |||
125 | 124 | | |
126 | 125 | | |
127 | 126 | | |
128 | | - | |
129 | | - | |
130 | | - | |
131 | 127 | | |
132 | 128 | | |
133 | 129 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
173 | 173 | | |
174 | 174 | | |
175 | 175 | | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
176 | 186 | | |
0 commit comments