Skip to content

Spark SQL test failures in native_iceberg_compat mode #1542

@andygrove

Description

@andygrove

Describe the bug

This issue is to track Spark SQL test failures in native_iceberg_compat mode.

core1

2025-03-17T18:45:32.4547575Z [info] - SPARK-44185: relative LOCATION with Append SaveMode shall check the qualified path *** FAILED *** (290 milliseconds)
2025-03-17T18:46:18.2321668Z [info] - add a nested column at the end of the leaf struct column *** FAILED *** (205 milliseconds)
2025-03-17T18:46:18.4251766Z [info] - add a nested column in the middle of the leaf struct column *** FAILED *** (186 milliseconds)
2025-03-17T18:46:18.6388827Z [info] - add a nested column at the end of the middle struct column *** FAILED *** (213 milliseconds)
2025-03-17T18:46:18.8659932Z [info] - add a nested column in the middle of the middle struct column *** FAILED *** (224 milliseconds)
2025-03-17T18:46:19.1230175Z [info] - hide a nested column at the end of the leaf struct column *** FAILED *** (251 milliseconds)
2025-03-17T18:46:19.3753704Z [info] - hide a nested column in the middle of the leaf struct column *** FAILED *** (250 milliseconds)
2025-03-17T18:46:19.6467631Z [info] - hide a nested column at the end of the middle struct column *** FAILED *** (269 milliseconds)
2025-03-17T18:46:19.8920982Z [info] - hide a nested column in the middle of the middle struct column *** FAILED *** (236 milliseconds)
2025-03-17T18:49:42.7623123Z [info] - SPARK-44334: Status of execution w/ error and w/o jobs shall be FAILED not COMPLETED (0 milliseconds)
2025-03-17T18:54:31.4491764Z [info] - SPARK-36182: can't read TimestampLTZ as TimestampNTZ *** FAILED *** (92 milliseconds)
2025-03-17T18:54:31.6017852Z [info] - SPARK-36182: read TimestampNTZ as TimestampLTZ *** FAILED *** (150 milliseconds)
2025-03-17T18:54:35.0992821Z [info] - SPARK-10005 Schema merging for nested struct *** FAILED *** (194 milliseconds)
2025-03-17T18:54:35.7665789Z [info] - SPARK-10301 requested schema clipping - requested schema contains physical schema *** FAILED *** (97 milliseconds)
2025-03-17T18:54:36.0964621Z [info] - SPARK-10301 requested schema clipping - schemas overlap but don't contain each other *** FAILED *** (107 milliseconds)
2025-03-17T18:54:36.3870161Z [info] - SPARK-10301 requested schema clipping - out of order *** FAILED *** (149 milliseconds)
2025-03-17T18:55:17.8419088Z [info] *** 15 TESTS FAILED ***

core3

2025-03-17T18:55:35.0503526Z [info] - row index generation - vectorized reader, filtered, small pages, small row groups, small splits *** FAILED *** (3 seconds, 397 milliseconds)
2025-03-17T18:55:35.2843564Z [info] - row index generation - vectorized reader, filtered, small pages, small row groups *** FAILED *** (230 milliseconds)
2025-03-17T18:55:48.2463130Z [info] - row index generation - vectorized reader, filtered, small row groups, small splits *** FAILED *** (4 seconds, 579 milliseconds)
2025-03-17T18:55:48.4971115Z [info] - row index generation - vectorized reader, filtered, small row groups *** FAILED *** (245 milliseconds)
2025-03-17T18:57:00.5751334Z [info] - row index generation - parquet-mr reader, filtered, small pages, small row groups, small splits *** FAILED *** (3 seconds, 657 milliseconds)
2025-03-17T18:57:00.8519000Z [info] - row index generation - parquet-mr reader, filtered, small pages, small row groups *** FAILED *** (271 milliseconds)
2025-03-17T18:57:13.4412427Z [info] - row index generation - parquet-mr reader, filtered, small row groups, small splits *** FAILED *** (4 seconds, 54 milliseconds)
2025-03-17T18:57:13.6855645Z [info] - row index generation - parquet-mr reader, filtered, small row groups *** FAILED *** (238 milliseconds)
2025-03-17T18:57:26.6695011Z [info] - invalid row index column type - vectorized reader *** FAILED *** (118 milliseconds)
2025-03-17T19:10:02.6603053Z [info] *** 9 TESTS FAILED ***

hive1

2025-03-17T18:42:54.3447649Z [info] - SPARK-25206: wrong records are returned by filter pushdown when Hive metastore schema and parquet schema are in different letter cases *** FAILED *** (4 seconds, 123 milliseconds)
2025-03-17T18:55:16.6694268Z [info] - SPARK-34990: Write and read an encrypted parquet *** FAILED *** (273 milliseconds)
2025-03-17T18:55:16.8861010Z [info] - SPARK-37117: Can't read files in Parquet encryption external key material mode *** FAILED *** (213 milliseconds)
2025-03-17T18:55:17.0853363Z [info] - SPARK-42114: Test of uniform parquet encryption *** FAILED *** (192 milliseconds)
2025-03-17T19:01:52.8977652Z [info] - SPARK-5775 read struct from partitioned_parquet_with_key_and_complextypes *** FAILED *** (72 milliseconds)
2025-03-17T19:01:53.0397371Z [info] - SPARK-5775 read struct from partitioned_parquet_with_complextypes *** FAILED *** (40 milliseconds)
2025-03-17T19:16:45.8867978Z [info] - test all data types *** FAILED *** (32 seconds, 185 milliseconds)
2025-03-17T19:17:54.4172632Z [info] - SPARK-5775 read struct from partitioned_parquet_with_key_and_complextypes *** FAILED *** (151 milliseconds)
2025-03-17T19:17:54.7035979Z [info] - SPARK-5775 read struct from partitioned_parquet_with_complextypes *** FAILED *** (103 milliseconds)
2025-03-17T19:18:34.9716557Z [info] *** 9 TESTS FAILED ***

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions