Repository navigation
Commit 5fc5cb8
authored
Decode short RunEnd runs with fixed-size block writes (#10488)
In TPC-DS, the RunEnd arrays that scans decode are mostly dictionary
codes (`u16`, ~6 rows per run) and nullable `i64` keys (~7 rows per
run). Filling each run with a loop sized to its length cost more than
the fill: about 9 ns per 2-row run.
## Changes
A run that fits in a block of at least 8 elements and 32 bytes (8 for
`i64`, 16 for `u16`) now writes the whole block, which compiles to a few
vector stores, and the next run overwrites the excess. Longer runs are
filled exactly. The buffer keeps one block of spare capacity so the last
run's block stays in bounds. Both the all-valid and nullable decode
paths use it.
Adds the `run_end_decode_primitive` benchmark. 65,536 rows, fastest of
200:
| rows/run, nulls | i64 before | i64 after | u16 before | u16 after |
| --------------- | ---------- | --------- | ---------- | --------- |
| 1 | 164 µs | 224 µs | 136 µs | 198 µs |
| 2, 4% | 345 µs | 138 µs | 362 µs | 123 µs |
| 7 | 109 µs | 54 µs | 127 µs | 34 µs |
| 7, 4% | 138 µs | 70 µs | 147 µs | 47 µs |
| 26 | 24 µs | 25 µs | 12 µs | 14 µs |
| 100 | 18 µs | 18 µs | 6.6 µs | 7.5 µs |1 parent 94d2782 commit 5fc5cb8
3 files changed
Lines changed: 174 additions & 26 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
226 | 226 | | |
227 | 227 | | |
228 | 228 | | |
229 | | - | |
230 | | - | |
231 | | - | |
232 | | - | |
233 | | - | |
234 | | - | |
235 | | - | |
236 | | - | |
237 | | - | |
238 | | - | |
239 | | - | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
240 | 232 | | |
241 | | - | |
| 233 | + | |
242 | 234 | | |
243 | 235 | | |
244 | 236 | | |
245 | 237 | | |
246 | 238 | | |
247 | | - | |
| 239 | + | |
248 | 240 | | |
249 | 241 | | |
250 | 242 | | |
251 | 243 | | |
252 | 244 | | |
253 | 245 | | |
254 | | - | |
255 | | - | |
256 | | - | |
257 | | - | |
258 | | - | |
259 | | - | |
260 | | - | |
261 | | - | |
262 | | - | |
| 246 | + | |
263 | 247 | | |
264 | 248 | | |
265 | 249 | | |
| |||
270 | 254 | | |
271 | 255 | | |
272 | 256 | | |
| 257 | + | |
273 | 258 | | |
274 | | - | |
275 | | - | |
276 | | - | |
| 259 | + | |
| 260 | + | |
277 | 261 | | |
278 | 262 | | |
279 | | - | |
| 263 | + | |
280 | 264 | | |
281 | 265 | | |
282 | 266 | | |
283 | 267 | | |
| 268 | + | |
| 269 | + | |
| 270 | + | |
| 271 | + | |
| 272 | + | |
| 273 | + | |
| 274 | + | |
| 275 | + | |
| 276 | + | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
284 | 341 | | |
285 | 342 | | |
286 | 343 | | |
| |||
0 commit comments