Repository navigation
Commit 22871ce
committed
feat(file): a coalescing IO service for planning-protocol scans
Serves the planning protocol's `IoService` reads of a file:
- `FileIoService` coalesces the ranges a batch of requests or announcements
asks for, reads each range once for every session interested in it, and
withdraws a dropped session's interest. `FileScanIo` serves the same
protocol through the file's segment source and read driver.
- Local files reuse their handles and admit native reads up to a bound;
object-store reads stream completions as they land.
- The read driver keeps its coalescing scratch between passes and can
leave optional requests out of coalescing.
- Segment caches can answer synchronously from `get_if_ready`.
- Request tracing ids for diagnostics.
A file opened over a reader carries the service as `VortexFile::scan_io`.
Nothing drives it yet; the planning scan that does follows separately.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01P1oQtzTgSzkvrGDKisoNko
Signed-off-by: Claude <[email protected]>1 parent ce04bf9 commit 22871ce
17 files changed
Lines changed: 3301 additions & 76 deletions
File tree
- vortex-file/src
- read
- segments
- vortex-io
- src
- object_store
- request
- source
- std_file
- vortex-layout/src/segments
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| 20 | + | |
20 | 21 | | |
21 | 22 | | |
22 | 23 | | |
| |||
48 | 49 | | |
49 | 50 | | |
50 | 51 | | |
| 52 | + | |
| 53 | + | |
51 | 54 | | |
52 | 55 | | |
53 | 56 | | |
| |||
84 | 87 | | |
85 | 88 | | |
86 | 89 | | |
| 90 | + | |
87 | 91 | | |
88 | 92 | | |
89 | 93 | | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
90 | 105 | | |
91 | 106 | | |
92 | 107 | | |
| |||
103 | 118 | | |
104 | 119 | | |
105 | 120 | | |
| 121 | + | |
106 | 122 | | |
107 | 123 | | |
108 | 124 | | |
| |||
158 | 174 | | |
159 | 175 | | |
160 | 176 | | |
| 177 | + | |
| 178 | + | |
161 | 179 | | |
162 | 180 | | |
163 | 181 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
14 | 14 | | |
15 | 15 | | |
16 | 16 | | |
| 17 | + | |
17 | 18 | | |
18 | 19 | | |
19 | 20 | | |
| |||
35 | 36 | | |
36 | 37 | | |
37 | 38 | | |
| 39 | + | |
38 | 40 | | |
39 | 41 | | |
40 | 42 | | |
| |||
281 | 283 | | |
282 | 284 | | |
283 | 285 | | |
| 286 | + | |
284 | 287 | | |
285 | 288 | | |
286 | 289 | | |
| |||
327 | 330 | | |
328 | 331 | | |
329 | 332 | | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
330 | 344 | | |
331 | | - | |
| 345 | + | |
332 | 346 | | |
333 | 347 | | |
334 | 348 | | |
335 | 349 | | |
336 | | - | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
337 | 353 | | |
338 | 354 | | |
339 | 355 | | |
| |||
348 | 364 | | |
349 | 365 | | |
350 | 366 | | |
| 367 | + | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
351 | 374 | | |
352 | 375 | | |
353 | 376 | | |
| |||
0 commit comments