You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Overlap DV bitmap and Parquet footer reads during native Delta scan preparation #5657
Follow-up from the native Delta Lake scan review (#5365). For on-disk deletion vectors, the DV bitmap read and the Parquet footer read are independent, but preparation currently completes bitmap fetch, decode, and validation before starting the footer read. Overlapping them could reduce remote-storage preparation latency.
Any change should retain bounded concurrency across files, preserve cancellation, error handling, and memory reservations, and measure peak memory alongside latency since overlap raises concurrent resource use. Inline DVs have no bitmap network read to overlap.
Activity
dwsmith1983 commentedon Oct 9, 2026
take