Repository navigation
Commit 73388f7
committed
[fix](fe) Preserve Paimon cache semantics in MetaCache wrapper
### What problem does this PR solve?
Issue Number: N/A
Problem Summary: The Doris-owned Paimon MetaCache wrapper replaced the SDK CachingCatalog but did not preserve all of its cache, expiry, identifier, REST dispatch, and DDL invalidation semantics. This could leave stale metadata after partial DDL failures, bypass a configured memory budget through nested SDK caches, or route wrapped REST catalogs through the filesystem fallback. Preserve the user cache setting and access/write expiry, scope branch and system variants by their base table, unwrap REST catalogs for partition dispatch, and invalidate all shared metadata scopes after every possibly partial mutation. Mutable SDK table caches are omitted when an enclosing weight limit governs the catalog.
### Release note
Fix Paimon metadata cache invalidation and configuration semantics while keeping REST catalog partition dispatch intact.
### Check List (For Author)
- Test: Unit Test
- Paimon focused tests: 31 passed
- Paimon reactor install: 631 passed, 1 skipped
- Full FE build: ./build.sh --fe
- Behavior changed: Yes. Paimon cache configuration, expiry, invalidation, and memory governance now match the intended SDK semantics.
- Does this need documentation: No1 parent e7b387c commit 73388f7
7 files changed
Lines changed: 617 additions & 74 deletions
File tree
- fe/fe-connector/fe-connector-paimon/src
- main/java/org/apache/doris/connector/paimon
- test/java/org/apache/doris/connector/paimon
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
103 | 103 | | |
104 | 104 | | |
105 | 105 | | |
106 | | - | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
107 | 112 | | |
108 | 113 | | |
109 | | - | |
110 | | - | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
111 | 119 | | |
112 | 120 | | |
113 | 121 | | |
| |||
141 | 149 | | |
142 | 150 | | |
143 | 151 | | |
144 | | - | |
145 | | - | |
146 | | - | |
147 | | - | |
148 | | - | |
149 | | - | |
150 | | - | |
151 | 152 | | |
152 | 153 | | |
153 | 154 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
| 25 | + | |
25 | 26 | | |
26 | 27 | | |
27 | 28 | | |
| |||
310 | 311 | | |
311 | 312 | | |
312 | 313 | | |
313 | | - | |
| 314 | + | |
| 315 | + | |
314 | 316 | | |
315 | 317 | | |
316 | 318 | | |
317 | | - | |
| 319 | + | |
318 | 320 | | |
319 | 321 | | |
320 | 322 | | |
321 | 323 | | |
322 | 324 | | |
323 | 325 | | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
324 | 331 | | |
325 | 332 | | |
326 | 333 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
498 | 498 | | |
499 | 499 | | |
500 | 500 | | |
501 | | - | |
| 501 | + | |
502 | 502 | | |
503 | 503 | | |
504 | 504 | | |
| |||
546 | 546 | | |
547 | 547 | | |
548 | 548 | | |
549 | | - | |
| 549 | + | |
550 | 550 | | |
551 | | - | |
| 551 | + | |
| 552 | + | |
552 | 553 | | |
553 | 554 | | |
554 | 555 | | |
| |||
0 commit comments