Repository navigation
Commit 7d0ebe5
fix(operator): leave a binning column of stored NaN uncut
A nullable Float64 column read from Arrow can hold NaN as a value, which
notna() reports present, so an all-NaN column reached pd.cut and raised on
duplicate edges while the engine path left it uncut. The guard now tests a
float64 view. Adds a stored-NaN case to the runtime test.
Co-Authored-By: Claude Opus 5.5 <[email protected]>1 parent b040c1b commit 7d0ebe5
2 files changed
Lines changed: 15 additions & 4 deletions
File tree
- common/workflow-operator/src
- main/scala/org/apache/texera/amber/operator/binning
- test/scala/org/apache/texera/amber/operator/binning
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
118 | 118 | | |
119 | 119 | | |
120 | 120 | | |
121 | | - | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
122 | 124 | | |
123 | 125 | | |
124 | 126 | | |
| |||
129 | 131 | | |
130 | 132 | | |
131 | 133 | | |
132 | | - | |
| 134 | + | |
133 | 135 | | |
134 | 136 | | |
135 | 137 | | |
| |||
140 | 142 | | |
141 | 143 | | |
142 | 144 | | |
143 | | - | |
| 145 | + | |
144 | 146 | | |
145 | 147 | | |
146 | 148 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
106 | 106 | | |
107 | 107 | | |
108 | 108 | | |
109 | | - | |
| 109 | + | |
110 | 110 | | |
111 | 111 | | |
112 | 112 | | |
| |||
168 | 168 | | |
169 | 169 | | |
170 | 170 | | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
171 | 178 | | |
172 | 179 | | |
173 | 180 | | |
174 | 181 | | |
| 182 | + | |
175 | 183 | | |
176 | 184 | | |
177 | 185 | | |
| |||
220 | 228 | | |
221 | 229 | | |
222 | 230 | | |
| 231 | + | |
223 | 232 | | |
224 | 233 | | |
225 | 234 | | |
| |||
0 commit comments