Repository navigation
Commit ac33193
committed
[fix](cloud) Invalidate caches after visible commit retries
### What problem does this PR solve?
Issue Number: close apache#67099
Related PR: apache#67813
Problem Summary: A cloud commit retry may return a VISIBLE transaction without version results. Invalidate the affected table and partition caches and notify peer FEs through the existing version RPC, so subsequent reads fetch fresh versions without making a durable commit fail on a version-service outage. Protect batch cache publication with version write locks and use in-memory epochs to prevent older RPC completions from clearing invalidation.
### Release note
Prevent stale reads and false commit failures after cloud commit retries.
### Check List (For Author)
- Test: Unit Test
- 55 FE tests passed via run-fe-ut.sh (CloudGlobalTransactionMgrTest, CloudPartitionTest, OlapTableTest); FE Checkstyle: 0 violations; git diff --check passed.
- Behavior changed: Yes. Missing-version VISIBLE responses invalidate caches; successful commit callbacks and return semantics are preserved.
- Does this need documentation: No1 parent a22b311 commit ac33193
7 files changed
Lines changed: 409 additions & 87 deletions
File tree
- fe/fe-core/src
- main/java/org/apache/doris
- catalog
- cloud
- catalog
- transaction
- service
- transaction
- test/java/org/apache/doris/cloud/transaction
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
248 | 248 | | |
249 | 249 | | |
250 | 250 | | |
| 251 | + | |
| 252 | + | |
| 253 | + | |
| 254 | + | |
251 | 255 | | |
252 | 256 | | |
253 | 257 | | |
| |||
3591 | 3595 | | |
3592 | 3596 | | |
3593 | 3597 | | |
3594 | | - | |
| 3598 | + | |
3595 | 3599 | | |
3596 | 3600 | | |
3597 | 3601 | | |
| |||
3605 | 3609 | | |
3606 | 3610 | | |
3607 | 3611 | | |
3608 | | - | |
| 3612 | + | |
| 3613 | + | |
3609 | 3614 | | |
3610 | 3615 | | |
3611 | 3616 | | |
3612 | 3617 | | |
3613 | 3618 | | |
3614 | | - | |
| 3619 | + | |
| 3620 | + | |
| 3621 | + | |
| 3622 | + | |
| 3623 | + | |
3615 | 3624 | | |
3616 | 3625 | | |
3617 | 3626 | | |
| |||
3632 | 3641 | | |
3633 | 3642 | | |
3634 | 3643 | | |
| 3644 | + | |
3635 | 3645 | | |
3636 | 3646 | | |
3637 | 3647 | | |
| |||
3658 | 3668 | | |
3659 | 3669 | | |
3660 | 3670 | | |
| 3671 | + | |
3661 | 3672 | | |
3662 | 3673 | | |
3663 | 3674 | | |
| |||
3722 | 3733 | | |
3723 | 3734 | | |
3724 | 3735 | | |
| 3736 | + | |
3725 | 3737 | | |
3726 | 3738 | | |
3727 | 3739 | | |
| 3740 | + | |
3728 | 3741 | | |
3729 | 3742 | | |
3730 | 3743 | | |
| |||
3733 | 3746 | | |
3734 | 3747 | | |
3735 | 3748 | | |
| 3749 | + | |
3736 | 3750 | | |
3737 | 3751 | | |
3738 | 3752 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
52 | 55 | | |
53 | 56 | | |
54 | 57 | | |
| |||
57 | 60 | | |
58 | 61 | | |
59 | 62 | | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
60 | 111 | | |
61 | 112 | | |
62 | 113 | | |
| |||
154 | 205 | | |
155 | 206 | | |
156 | 207 | | |
| 208 | + | |
157 | 209 | | |
158 | 210 | | |
159 | 211 | | |
160 | 212 | | |
161 | 213 | | |
162 | 214 | | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
163 | 219 | | |
164 | 220 | | |
165 | 221 | | |
166 | 222 | | |
167 | 223 | | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
168 | 227 | | |
169 | 228 | | |
170 | 229 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
| 51 | + | |
51 | 52 | | |
52 | 53 | | |
53 | 54 | | |
| |||
66 | 67 | | |
67 | 68 | | |
68 | 69 | | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
69 | 74 | | |
70 | 75 | | |
71 | 76 | | |
| |||
127 | 132 | | |
128 | 133 | | |
129 | 134 | | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
130 | 139 | | |
131 | 140 | | |
132 | | - | |
| 141 | + | |
133 | 142 | | |
134 | 143 | | |
135 | 144 | | |
| |||
155 | 164 | | |
156 | 165 | | |
157 | 166 | | |
| 167 | + | |
158 | 168 | | |
159 | 169 | | |
160 | 170 | | |
| |||
183 | 193 | | |
184 | 194 | | |
185 | 195 | | |
| 196 | + | |
186 | 197 | | |
187 | 198 | | |
188 | 199 | | |
| |||
193 | 204 | | |
194 | 205 | | |
195 | 206 | | |
| 207 | + | |
196 | 208 | | |
197 | 209 | | |
198 | 210 | | |
| |||
248 | 260 | | |
249 | 261 | | |
250 | 262 | | |
| 263 | + | |
251 | 264 | | |
252 | 265 | | |
253 | 266 | | |
254 | 267 | | |
| 268 | + | |
255 | 269 | | |
256 | 270 | | |
257 | 271 | | |
| |||
260 | 274 | | |
261 | 275 | | |
262 | 276 | | |
263 | | - | |
264 | | - | |
265 | | - | |
266 | | - | |
267 | | - | |
268 | | - | |
269 | | - | |
270 | | - | |
271 | | - | |
| 277 | + | |
| 278 | + | |
| 279 | + | |
| 280 | + | |
| 281 | + | |
| 282 | + | |
| 283 | + | |
| 284 | + | |
| 285 | + | |
| 286 | + | |
| 287 | + | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
272 | 298 | | |
273 | 299 | | |
274 | 300 | | |
| |||
0 commit comments