Repository navigation
Commit a03c727
[P4-T02] MaxCompute connector partition listing via ConnectorTableOps SPI
Implement listPartitionNames / listPartitions / listPartitionValues on
MaxComputeConnectorMetadata. All three read partitions directly from ODPS
via McStructureHelper.getPartitions, mirroring the legacy SHOW PARTITIONS
path (MaxComputeExternalCatalog:283 / MaxComputeExternalTable:201).
Partition names use PartitionSpec.toString(false, true); listPartitions
ignores the filter and returns the full set (per-partition values from
PartitionSpec.keys()/get(k), empty properties), matching legacy SHOW
PARTITIONS which does no pruning; listPartitionValues reads spec.get(col)
in the requested column order.
No connector-side partition cache (OQ-4: read ODPS directly, as the legacy
catalog getPartitions path does; the fe-core SPI meta-cache covers schema;
Rule 2, nothing speculative). The legacy catalog path has no
non-partitioned-table guard (unlike MaxComputeExternalTable:200), so the SPI
mirrors the catalog path and adds none. ODPS PartitionSpec API verified
against odps-sdk-commons (keys() / get(String) / toString(boolean,boolean)).
Gate closed / dormant: no behavior change until cutover (Batch C).
Verified: connector compile BUILD SUCCESS + checkstyle 0 + import-gate.
Connector unit tests are deferred to P4-T10 (hand-written JUnit5 doubles);
T02's gate is compile + checkstyle + import-gate.
Docs: tasks/P4 (T02 done, OQ-4 resolved), PROGRESS, connectors/maxcompute.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>1 parent 5c1548d commit a03c727
4 files changed
Lines changed: 76 additions & 9 deletions
File tree
- fe/fe-connector/fe-connector-maxcompute/src/main/java/org/apache/doris/connector/maxcompute
- plan-doc
- connectors
- tasks
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
19 | 19 | | |
20 | 20 | | |
21 | 21 | | |
| 22 | + | |
22 | 23 | | |
23 | 24 | | |
24 | 25 | | |
| |||
28 | 29 | | |
29 | 30 | | |
30 | 31 | | |
| 32 | + | |
31 | 33 | | |
32 | 34 | | |
33 | 35 | | |
34 | 36 | | |
| 37 | + | |
| 38 | + | |
35 | 39 | | |
36 | 40 | | |
37 | 41 | | |
| |||
40 | 44 | | |
41 | 45 | | |
42 | 46 | | |
| 47 | + | |
43 | 48 | | |
44 | 49 | | |
45 | 50 | | |
| |||
167 | 172 | | |
168 | 173 | | |
169 | 174 | | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
| 182 | + | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
170 | 234 | | |
171 | 235 | | |
172 | 236 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
16 | | - | |
| 16 | + | |
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| |||
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
47 | | - | |
| 47 | + | |
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | | - | |
| 53 | + | |
54 | 54 | | |
55 | 55 | | |
56 | 56 | | |
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
143 | 144 | | |
144 | 145 | | |
145 | 146 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
| 14 | + | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
| |||
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
52 | | - | |
| 52 | + | |
53 | 53 | | |
54 | 54 | | |
55 | 55 | | |
| |||
74 | 74 | | |
75 | 75 | | |
76 | 76 | | |
| 77 | + | |
77 | 78 | | |
78 | 79 | | |
79 | 80 | | |
| |||
0 commit comments