Skip to content

Iceberg Integration: Support compressed manifest files #70874

@netapp-vaughan

Description

@netapp-vaughan

Use case

Our Iceberg catalog provider enables compression of the manifest.json file by default. The current Clickhouse Iceberg integration makes it impossible to open this file.

Describe the solution you'd like

Clickhouse can read compressed Iceberg manifest files where write.metadata.compression-codec = gzip is set on the table.

Describe alternatives you've considered

A workaround is to disable the compression of the manifest file by setting write.metadata.compression-codec = none

Additional context

https://iceberg.apache.org/docs/latest/configuration/#write-properties

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions