Repository navigation
Commit 3aff81c
apacheGH-48701: [C++][Parquet] Refactor and harden ALP encoding
Split the ALP implementation into constants, metadata, compression,
sampler, and codec units. Simplify the internal APIs and update the
CMake/Meson build integration.
Remove the separate writer opt-in flag. ALP is selected explicitly with
Encoding::ALP while dictionary encoding is disabled.
Harden encoding and decoding:
- validate page headers, vector metadata, offset chains, bit widths,
element counts, and exception positions;
- reject pages that leave ALP values unconsumed after all levels are read;
- reuse pool-backed scratch buffers and cache partially decoded vectors;
- use typed power-of-ten constants for exact decode semantics;
- emit a valid header-only page for all-null input.
Rework the ALP tests around the production APIs, remove redundant cases,
and add malformed-input, boundary, exception, and all-null coverage.
Move the end-to-end tests to arrow_encoding_test.cc and enable real
parquet-testing interoperability coverage. Update the submodule pin,
benchmarks, and C++ documentation.1 parent 892b195 commit 3aff81c
27 files changed
Lines changed: 3003 additions & 5365 deletions
File tree
- cpp
- src
- arrow
- util
- alp
- parquet
- arrow
- submodules
- docs/source/cpp
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
550 | 550 | | |
551 | 551 | | |
552 | 552 | | |
553 | | - | |
554 | | - | |
| 553 | + | |
| 554 | + | |
555 | 555 | | |
| 556 | + | |
556 | 557 | | |
557 | 558 | | |
558 | 559 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
165 | 165 | | |
166 | 166 | | |
167 | 167 | | |
168 | | - | |
169 | | - | |
| 168 | + | |
| 169 | + | |
170 | 170 | | |
| 171 | + | |
171 | 172 | | |
172 | 173 | | |
173 | 174 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
111 | 111 | | |
112 | 112 | | |
113 | 113 | | |
114 | | - | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
115 | 117 | | |
116 | 118 | | |
117 | 119 | | |
| |||
0 commit comments