You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 06c0770
Browse filesBrowse the repository at this point in the historyBrowse files
[improvement](be) Add page read-ahead and hole-fill observability
### What problem does this PR solve?
Issue Number: apache#67611 (tracking; keep open)
Related PR: apache#67292
Problem Summary: Page read-ahead, IO coalescing and partial-block writeback lack query-level attribution and BE-wide capacity and IO signals. Add named RuntimeProfile counters for planning, compressed candidate and cache-hit bytes, submission outcomes, source IO, page consumption and foreground writeback. Distinguish Query/BE budget rejection and executor rejection from failures of accepted reads, and account queued cancellations only for accepted tasks. Add successful-source and BE cumulative IO/consumption bytes so asynchronous tail work remains observable after the final Profile snapshot without delaying query completion. Record synchronous data-page fallback attempts, requested bytes and time at PageIO, including decode retries while excluding Page Cache hits and index/dictionary reads. Add aggregate hole-fill failure/read-time metrics and keep detailed failure causes in logs. Use COUNTER_UPDATE and scoped timers, with statistics owned independently of the reporting profile so outstanding reads can finish safely. Append point-query statistics to the existing sampled diagnostic log.
### Release note
Expose PageReadAhead query profile counters and BE-wide metrics for read-ahead IO, data-page fallback, buffer capacity and background cache-block hole filling.
### Check List (For Author)
- Test: Unit Test
- 131 targeted ASAN tests from 18 suites passed via run-be-ut.sh -j100 with PCH enabled, as recorded in the original accounting commit.
- clang-format 16, check-format, build hygiene and git diff --check passed before squashing.
- The historical results above predate removal of TopN-specific collection; current branch validation is recorded in apache#67611.
- Behavior changed: Yes (observability only; read scheduling, cancellation, fallback and writeback policies are unchanged)
- Does this need documentation: Yes (doris-io/phase2_page_prefetch_and_io_coalescing/observability.md)
0 commit comments