Repository navigation
Commit df98590
authored
Tracking Issue: #10167
## Summary
Support blocked `BitPacked` encoding in the compressor by adding a new
`V2` mode to `BitPackingScheme`. Like `FoRScheme V2` and `DecimalScheme
V2`, the new versions use the current `V1` by default and are only
"refined" to `V2` when the corresponding edition is enabled.
The new scheme mode is quite naive for now. Compression estimate for V2
is the same as for V1. In general, blocked BP will compress an array
**at least as much** as regular BP, so this estimate is a decent
approximate lower bound on compression ratio.
## CUDA
The CUDA preset excludes `fastlanes.bitpacked.v2`, as it does
`fastlanes.for.v2`. CUDA decoding returns an error for per-block bit
widths.
---------
Signed-off-by: Matt Katz <[email protected]>
1 parent df8c104 commit df98590
11 files changed
Lines changed: 412 additions & 61 deletions
File tree
- encodings/fastlanes/src/bitpacking/array/bitpack_compress
- vortex-btrblocks
- src
- schemes/integer
- tests
- vortex-file/src
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
53 | 70 | | |
54 | 71 | | |
55 | | - | |
56 | | - | |
57 | | - | |
58 | | - | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
59 | 75 | | |
60 | 76 | | |
61 | 77 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
| 9 | + | |
9 | 10 | | |
10 | 11 | | |
11 | 12 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
| 8 | + | |
8 | 9 | | |
9 | 10 | | |
10 | 11 | | |
| |||
94 | 95 | | |
95 | 96 | | |
96 | 97 | | |
97 | | - | |
98 | | - | |
99 | | - | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
100 | 101 | | |
101 | 102 | | |
102 | 103 | | |
| |||
249 | 250 | | |
250 | 251 | | |
251 | 252 | | |
| 253 | + | |
252 | 254 | | |
253 | 255 | | |
254 | 256 | | |
| 257 | + | |
| 258 | + | |
255 | 259 | | |
256 | 260 | | |
257 | 261 | | |
| |||
264 | 268 | | |
265 | 269 | | |
266 | 270 | | |
| 271 | + | |
| 272 | + | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
267 | 286 | | |
268 | 287 | | |
269 | 288 | | |
| |||
0 commit comments