-
Notifications
You must be signed in to change notification settings - Fork 289
Closed
Labels
bugSomething isn't workingSomething isn't working
Milestone
Description
Describe the bug
Spark supports grouping by structs in aggregates, but Comet fails the following error:
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1296.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1296.0 (TID 1312) (192.168.86.37 executor driver): java.lang.UnsupportedOperationException: Unsupported data type org.apache.spark.sql.Row
at org.apache.spark.sql.catalyst.expressions.SpecializedGettersReader.read(SpecializedGettersReader.java:83)
at org.apache.spark.sql.catalyst.expressions.UnsafeRow.get(UnsafeRow.java:334)
at org.apache.spark.sql.Dataset.$anonfun$rdd$2(Dataset.scala:3736)
Steps to reproduce
See repro test test("aggregate group by single column") in #1610
Expected behavior
No response
Additional context
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working