First read_parquet() query fails after Parquet file schema changes #6469
Description
To reproduce
2025-11-28T07:52:04.357007Z E i.q.g.e.QueryProgress err [id=103, sql=`select * from read_parquet('test_table1.parquet')`, principal=admin, cache=true, jit=true, time=1297000, exception=
java.lang.NullPointerException: Cannot invoke "io.questdb.cairo.TableColumnMetadata.getColumnName()" because the return value of "io.questdb.cairo.AbstractRecordMetadata.getColumnMetadata(int)" is null
at io.questdb.cairo.AbstractRecordMetadata.getColumnName(AbstractRecordMetadata.java:68)
at io.questdb.griffin.engine.functions.table.ReadParquetRecordCursor.metadataHasChanged(ReadParquetRecordCursor.java:113)
at io.questdb.griffin.engine.functions.table.ReadParquetPageFrameCursor.of(ReadParquetPageFrameCursor.java:135)
at io.questdb.griffin.engine.functions.table.ReadParquetPageFrameRecordCursorFactory.getCursor(ReadParquetPageFrameRecordCursorFactory.java:72)
at io.questdb.griffin.engine.QueryProgress.getCursor(QueryProgress.java:298)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeSelect0(JsonQueryProcessor.java:678)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeSelect(JsonQueryProcessor.java:661)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeCachedSelect(JsonQueryProcessor.java:589)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.execute0(JsonQueryProcessor.java:209)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.onRequestComplete(JsonQueryProcessor.java:306)
at io.questdb.cutlass.http.HttpConnectionContext.handleClientRecv(HttpConnectionContext.java:985)
at io.questdb.cutlass.http.HttpConnectionContext.handleClientOperation(HttpConnectionContext.java:323)
at io.questdb.cutlass.http.HttpServer.handleClientOperation(HttpServer.java:350)
at io.questdb.cutlass.http.HttpServer$1.lambda$$0(HttpServer.java:114)
at io.questdb.network.AbstractIODispatcher.processIOQueue(AbstractIODispatcher.java:224)
at io.questdb.cutlass.http.HttpServer$1.run(HttpServer.java:118)
at io.questdb.mp.Worker.run(Worker.java:152)
]
2025-11-28T07:52:04.357755Z C i.q.c.h.p.JsonQueryProcessorState [130996503590] internal error [ex=
java.lang.NullPointerException: Cannot invoke "io.questdb.cairo.TableColumnMetadata.getColumnName()" because the return value of "io.questdb.cairo.AbstractRecordMetadata.getColumnMetadata(int)" is null
at io.questdb.cairo.AbstractRecordMetadata.getColumnName(AbstractRecordMetadata.java:68)
at io.questdb.griffin.engine.functions.table.ReadParquetRecordCursor.metadataHasChanged(ReadParquetRecordCursor.java:113)
at io.questdb.griffin.engine.functions.table.ReadParquetPageFrameCursor.of(ReadParquetPageFrameCursor.java:135)
at io.questdb.griffin.engine.functions.table.ReadParquetPageFrameRecordCursorFactory.getCursor(ReadParquetPageFrameRecordCursorFactory.java:72)
at io.questdb.griffin.engine.QueryProgress.getCursor(QueryProgress.java:298)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeSelect0(JsonQueryProcessor.java:678)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeSelect(JsonQueryProcessor.java:661)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.executeCachedSelect(JsonQueryProcessor.java:589)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.execute0(JsonQueryProcessor.java:209)
at io.questdb.cutlass.http.processors.JsonQueryProcessor.onRequestComplete(JsonQueryProcessor.java:306)
at io.questdb.cutlass.http.HttpConnectionContext.handleClientRecv(HttpConnectionContext.java:985)
at io.questdb.cutlass.http.HttpConnectionContext.handleClientOperation(HttpConnectionContext.java:323)
at io.questdb.cutlass.http.HttpServer.handleClientOperation(HttpServer.java:350)
at io.questdb.cutlass.http.HttpServer$1.lambda$$0(HttpServer.java:114)
at io.questdb.network.AbstractIODispatcher.processIOQueue(AbstractIODispatcher.java:224)
at io.questdb.cutlass.http.HttpServer$1.run(HttpServer.java:118)
at io.questdb.mp.Worker.run(Worker.java:152)
QuestDB version:
master
OS, in case of Docker specify Docker and the Host OS:
Macos
File System, in case of Docker specify Host File System:
APFS
Full Name:
Victor
Affiliation:
None
Have you followed Linux, MacOs kernel configuration steps to increase Maximum open files and Maximum virtual memory areas limit?
- Yes, I have
Additional context
No response