You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Spark 4.2: Comet native collect_set does not normalize NaN / -0.0 (SPARK-57298) #4966
Spark 4.2 (SPARK-57298) makes collect_set normalize NaN and -0.0 for floating-point types. Comet's native collect_set aggregate does not perform this normalization, so results differ from Spark.
Failing Spark SQL test (currently marked IgnoreComet in dev/diffs/4.2.0.diff):
DataFrameAggregateSuite: "SPARK-57298: collect_set normalizes NaN and -0.0 for floating-point types"
Note: the array-expression normalization path (array_distinct / array_except) is already handled; this issue tracks the aggregate collect_set path.
Activity
test: resolve Spark 4.2 SQL test failures and file specific tracking …
peterxcli commentedon Jul 31, 2026
take
build: enable Spark SQL tests for released Spark 4.2.0 (apache#4950)