Skip to content

Cache Parquet footer in LRU Cache #89102

@alesapin

Description

@alesapin

Key for cache should be file path + etag (works only for object storages). Similar to metadata cache for Iceberg. Should be implemented at InputFormat implementation for parquet. May cache also column chunks/index pages.

Image

For reference, Iceberg metadata cache: #77156

Metadata

Metadata

Labels

comp-datalakeData lake table formats (Iceberg/Delta/Hudi) integration.comp-formatsInput/output formats (CSV/JSON/Parquet/ORC/Arrow/Protobuf/etc.).performancewarmup taskThe task for new ClickHouse team members. Low risk, moderate complexity, no urgency.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions