Skip to content

org.apache.spark.sql.catalyst.expressions.BoundReference cannot be cast to class org.apache.spark.sql.ColumnarExpression #1197

Closed

Description

@kazuyukitanimura

Describe the bug

In SparkSessionExtensionSuite, there are 4 test failures with org.apache.spark.sql.catalyst.expressions.BoundReference cannot be cast to class org.apache.spark.sql.ColumnarExpression
when spark.comet.enabled=true is set.

inject columnar AQE on
inject columnar AQE off
SPARK-39991: AQE should retain column statistics from completed query stages
reset column vectors

Steps to reproduce

SparkSessionExtensionSuite is not using SharedSparkSessionBase, so add spark.comet.enabled=true by changing code

Expected behavior

No response

Additional context

No response

Activity

  1. added this to the 0.5.0 milestone on Dec 24, 2024
  2. modified the milestones: 0.5.0, 0.6.0 on Jan 13, 2025
  3. modified the milestones: 0.6.0, 0.7.0, 0.8.0 on Feb 3, 2025
  4. andygrove commented on Apr 17, 2025

    @andygrove
    Member

    @kazuyukitanimura Is this issue still valid?

  5. kazuyukitanimura commented on Apr 18, 2025

    @kazuyukitanimura
    ContributorAuthor

    @andygrove
    Yes, I think so

    + // https://github.com/apache/datafusion-comet/issues/1197

  6. removed this from the 0.8.0 milestone on May 13, 2025
  7. 2 remaining items

  8. modified the milestones: 0.9.0, 0.10.0 on Jul 3, 2025
  9. removed their assignment
    on Aug 11, 2025
  10. modified the milestones: 0.13.0, 0.14.0 on Jan 30, 2026
  11. removed this from the 0.14.0 milestone on Mar 12, 2026
  12. added
    priority:mediumFunctional bugs, performance regressions, broken features
    on Mar 27, 2026
  13. self-assigned this
    on Jun 30, 2026
  14. added this to the 1.0.0 milestone on Jun 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken features

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions