feat: Support read array type using native reader #1454
Description
What is the problem the feature request solves?
Currently array type not supported when reading complex types with native reader
Reading a data with schema
root
|-- id: integer (nullable = true)
|-- first_name: string (nullable = true)
|-- personal_info: struct (nullable = true)
| |-- firstName: string (nullable = true)
| |-- lastName: string (nullable = true)
| |-- ageInYears: integer (nullable = true)
|-- firstName: string (nullable = true)
I would expect a native scan
== Physical Plan ==
* CometColumnarToRow (3)
+- CometProject (2)
+- CometNativeScan: (1)
Because of array in schema the plan falls back to Spark
== Physical Plan ==
* Project (3)
+- * ColumnarToRow (2)
+- Scan parquet (1)
Describe the potential solution
No response
Additional context
No response