Repository navigation
Commit bcbbda1
streaming: fetch small files in a single wave
The required-only first fetch keeps TTFB low on large files, but for a
file whose whole plan fits the readahead window it turns one fetch wave
into two serial waves — an extra round trip per file, which dominates
many-small-file workloads (TPC-DS under simulated latency regressed
1.3x). Fetch the entire plan in one wave when it fits the window;
required-only kicks in only for plans larger than the window, preserving
the giant-row-group TTFB and memory wins.
Co-Authored-By: Claude Fable 5 <[email protected]>1 parent 5ff7af6 commit bcbbda1
1 file changed
Lines changed: 18 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
976 | 976 | | |
977 | 977 | | |
978 | 978 | | |
| 979 | + | |
979 | 980 | | |
980 | 981 | | |
| 982 | + | |
981 | 983 | | |
982 | 984 | | |
983 | 985 | | |
| |||
1001 | 1003 | | |
1002 | 1004 | | |
1003 | 1005 | | |
| 1006 | + | |
| 1007 | + | |
| 1008 | + | |
| 1009 | + | |
| 1010 | + | |
| 1011 | + | |
1004 | 1012 | | |
1005 | 1013 | | |
1006 | 1014 | | |
| |||
1125 | 1133 | | |
1126 | 1134 | | |
1127 | 1135 | | |
1128 | | - | |
1129 | | - | |
1130 | | - | |
1131 | | - | |
| 1136 | + | |
| 1137 | + | |
| 1138 | + | |
| 1139 | + | |
| 1140 | + | |
| 1141 | + | |
| 1142 | + | |
| 1143 | + | |
| 1144 | + | |
| 1145 | + | |
1132 | 1146 | | |
1133 | 1147 | | |
1134 | 1148 | | |
| |||
0 commit comments