Skip to content

Parquet reader not compatible with parquet modular encryption specification #18524

Closed

Description

@rok

What happens?

Encrypted parquet written with parquet C++ can not be read by DuckDB, see apache/arrow#47254 for details. I suspect the same holds for other parquet writer implementations.

To Reproduce

Attempt to read example uniformly encrypted file from parquet testing repo, write a new file with this gist and read it in DuckDB. See arrow c++ and arrow-rs for more data or apache/arrow#47254 for more details.

OS:

any

DuckDB Version:

1.3.2

DuckDB Client:

Python

Hardware:

any

Full Name:

Rok Mihevc

Affiliation:

Insight Softmax

What is the latest build you tested with? If possible, we recommend testing with the latest nightly build.

I have tested with a stable release

Did you include all relevant data sets for reproducing the issue?

Yes

Did you include all code required to reproduce the issue?

  • Yes, I have

Did you include all relevant configuration (e.g., CPU architecture, Python version, Linux distribution) to reproduce the issue?

  • Yes, I have

Activity

  1. runkelcorey commented on Nov 10, 2025

    @runkelcorey

    adding my use case to this issue: fully supporting Parquet Modular Encryption would let my team implement column-level access control through our key management service (AWS), offloading RBAC features that we'd love from DuckDB/DuckLake but which would be an awkward fit design-wise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions