Repository navigation
[C++][Parquet] Enable external material and rotation for encryption keys #25986
Description
Encryption key material keeps the information required to recover the keys by Parquet readers. Currently, only "internal storage mode" is supported, where the key material is stored inside Parquet file footers, and therefore can't be rotated (re-wrapped with refreshed master keys) in immutable files. The new mechanism in this Jira adds the advanced "external storage mode" for the key material, where the key material is stored in separate small files, that enable the key rotation. This mechanism will also implement the key rotation functionality.
Reporter: Gidon Gershinsky / @ggershinsky
Related issues:
- [C++][Dataset][Parquet] Support parquet modular encryption in the new Dataset API (Dependency)
- [C++][Parquet] Encryption key management tools (depends upon)
- [Python][Parquet] Enable usage of external key material and rotation for encryption keys in PyArrow (is depended upon by)
PRs and other links:
Note: This issue was originally created as ARROW-9960. Please see the migration documentation for further details.
Activity
asfimport commentedon Aug 26, 2022
Todd Farmer / @toddfarmer:
This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned per project policy. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.
wjones127 commentedon Feb 27, 2023
@adamreeve is working on this.
wjones127 commentedon Feb 27, 2023
@adamreeve could you comment "take" on this issue? Once you do, this issue should be assigned to you and I can merge the PR. (Also I'm looking into improving this process.)
adamreeve commentedon Feb 27, 2023
take
GH-25986: [C++] Enable external material and rotation for encryption …