Changelog category (leave one):

• New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add support for prewhere in parquet native reader (StorageFile is supported)

Documentation entry for user-facing changes

When reading a Parquet file, if the prewhere_info is provided, the Parquet native reader should:

1. Read the columns with the prewhere predicate (active columns) .
2. Filter the result and get the filter mask.
3. Read the remaining columns (lazy columns) and filter the page using the filter mask. If no row is selected in the page, it should skip the page.
4. Build the final result chunk

A performance benchmark will be added here later.

TODO:

• Currently, only explicit use of PREWHERE in SQL is supported. Automatic moving of some predicates to prewhere clause based on column sizes should be supported. This can reuse the logic from the merge tree i guess.

• Support other storage engines

Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/

CI Settings (Only check the boxes if you know what you are doing):

• Allow: All Required Checks
• Allow: Stateless tests
• Allow: Stateful tests
• Allow: Integration Tests
• Allow: Performance tests
• Allow: All Builds
• Allow: batch 1, 2 for multi-batch jobs
• Allow: batch 3, 4, 5, 6 for multi-batch jobs

• Exclude: Style check
• Exclude: Fast test
• Exclude: All with ASAN
• Exclude: All with TSAN, MSAN, UBSAN, Coverage
• Exclude: All with aarch64, release, debug

• Do not test
• Woolen Wolfdog
• Upload binaries for special builds
• Disable merge-commit
• Disable CI cache