Context
Sparse data overlays (one file carrying a different set of rows per field) require the v2 file writer to emit columns whose item counts differ within a single file. The current v2 writer advances all columns from one global row counter and cannot do this. It is technically allowed by the file format but unused today. This is the foundation for Data Overlay Files (see "Physical layout" and "Writer support" in the spec).
Acceptance criteria
Out of scope
- The
DataOverlayFile concept, coverage bitmaps, and rank-vs-offset resolution semantics — this issue delivers only the file-level capability; overlay write/read is OSS-1322.
- Scanner / take / index / compaction integration.
- Dense (rectangular) overlays, which already write with the existing equal-length writer and do not depend on this work.
Dependencies
Context
Sparse data overlays (one file carrying a different set of rows per field) require the v2 file writer to emit columns whose item counts differ within a single file. The current v2 writer advances all columns from one global row counter and cannot do this. It is technically allowed by the file format but unused today. This is the foundation for Data Overlay Files (see "Physical layout" and "Writer support" in the spec).
Acceptance criteria
Out of scope
DataOverlayFileconcept, coverage bitmaps, and rank-vs-offset resolution semantics — this issue delivers only the file-level capability; overlay write/read is OSS-1322.Dependencies