Skip to content

ThriftMetadataWriter::write_column_indexes cannot handle a ColumnIndexMetaData::NONE #8815

@etseidl

Description

@etseidl

Describe the bug
While testing #8811 I found that trying to concatenate alltypes_tiny_pages.parquet from the parquet-testing repo fails with the error "Cannot serialize NONE index". While creating a Parquet file from scratch, the column index may contain None entries. But when reading from a file with missing indexes, a ColumnIndexMetaData::NONE will be inserted because the current metadata requires a value. When trying to serialize this, the ColumnIndexMetaData::NONE is encountered and triggers the error.

To Reproduce
Use parquet-concat from #8811 on parquet-testing/data/alltypes_tiny_pages.parquet.

Expected behavior
A ColumnIndexMetaData::NONE should simply be skipped.

Additional context

Metadata

Metadata

Assignees

Labels

bugparquetChanges to the parquet crate

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions