You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 0e93720
Browse filesBrowse the repository at this point in the historyBrowse files
docs(delta): audit + correct all contrib/delta design docs for drift (apache#85)
The design docs had drifted from the kernel-read refactor (apache#76/apache#77/apache#80/apache#81/apache#82/
apache#84/#2/apache#78/apache#86). Audited all 13 docs against current code and corrected:
- Removed the deleted ParquetSource + DV-sweep + DeltaSyntheticColumnsExec read
stack as the "current" path everywhere; it is now kernel-read only (apache#50/apache#82),
with DeltaKernelScanExec doing in-worker synthesis. The old stack is kept only
as clearly-labeled history / rejected alternatives.
- delta_scan.rs is a ~72-line shim delegating to comet_contrib_delta::planner
(apache#77); column-mapping physicalisation dropped, kernel ships the schemas (apache#76).
- CDF (readChangeFeed) is kernel-native via TableChanges -> CometDeltaCdfScanExec,
split multi-partition (apache#84/#2) -- corrected docs that called it unsupported,
declined, or a synthetic-columns fallback.
- 08-known-limitations.md: removed all of Part B (B1-B9 were development-time
regressions, all now fixed + guarded) and A3 (path-based CDF now engages
native, apache#84); kept only genuine current limitations (A1 DPP residual, A2e
credential residual, A4 VARIANT, A5 decline gates, A6 INT96 kernel gap, A7
CM-id repoint). 466 -> 230 lines.
- Fixed config keys, build/module layout, JNI symbols, file paths, CI workflow
references, and supported-feature lists (added CDF, _metadata, INT96) across
the build / README / user-guide docs.
Every claim verified against code; markdown passes prettier.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
0 commit comments