Repository navigation
Commit 82ad886
[fix](test) drive data to converge adaptive timeout in test_routine_load_adaptive_param restore phase
The restore-phase checkTaskTimeout("100") is flaky and timed out after 60s
(build 970376). Root cause is observability, not a product bug: a routine load
task's adaptive timeout is only (re)computed when the task is actually scheduled
WITH data to consume (updateAdaptiveTimeout runs after the hasMoreDataToConsume
gate in RoutineLoadTaskScheduler). Once a job drains its data it reaches EOF and
the renewed task stays idle with txnId == -1, inheriting the timeout from the
previous schedule round. So when the single restore batch is consumed atomically
by one task that still carries the isEof=false inertia from the debug-on phase
(timeout 3600), the EOF timeout 100 is never computed on any task, and
checkTaskTimeout's "txnId != -1 && timeout == 100" condition can never be met.
Add checkTaskTimeoutWithData, which feeds a small batch each poll round to force
an isEof task to be scheduled and recompute the timeout, and reads the value
without skipping txnId == -1 (after EOF the converged value settles on the idle
task). Use it for the restore phase; leave checkTaskTimeout (increase phase,
where the converged value lives on the running task) untouched.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>1 parent da471d4 commit 82ad886
2 files changed
Lines changed: 37 additions & 1 deletion
File tree
- regression-test
- framework/src/main/groovy/org/apache/doris/regression/util
- suites/load_p0/routine_load
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
114 | 114 | | |
115 | 115 | | |
116 | 116 | | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
117 | 151 | | |
118 | 152 | | |
119 | 153 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
87 | | - | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
88 | 90 | | |
89 | 91 | | |
90 | 92 | | |
| |||
0 commit comments