Skip to content

Commit a03c727

Browse files
morningmanclaude
andcommitted
[P4-T02] MaxCompute connector partition listing via ConnectorTableOps SPI
Implement listPartitionNames / listPartitions / listPartitionValues on MaxComputeConnectorMetadata. All three read partitions directly from ODPS via McStructureHelper.getPartitions, mirroring the legacy SHOW PARTITIONS path (MaxComputeExternalCatalog:283 / MaxComputeExternalTable:201). Partition names use PartitionSpec.toString(false, true); listPartitions ignores the filter and returns the full set (per-partition values from PartitionSpec.keys()/get(k), empty properties), matching legacy SHOW PARTITIONS which does no pruning; listPartitionValues reads spec.get(col) in the requested column order. No connector-side partition cache (OQ-4: read ODPS directly, as the legacy catalog getPartitions path does; the fe-core SPI meta-cache covers schema; Rule 2, nothing speculative). The legacy catalog path has no non-partitioned-table guard (unlike MaxComputeExternalTable:200), so the SPI mirrors the catalog path and adds none. ODPS PartitionSpec API verified against odps-sdk-commons (keys() / get(String) / toString(boolean,boolean)). Gate closed / dormant: no behavior change until cutover (Batch C). Verified: connector compile BUILD SUCCESS + checkstyle 0 + import-gate. Connector unit tests are deferred to P4-T10 (hand-written JUnit5 doubles); T02's gate is compile + checkstyle + import-gate. Docs: tasks/P4 (T02 done, OQ-4 resolved), PROGRESS, connectors/maxcompute. Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
1 parent 5c1548d commit a03c727

4 files changed

Lines changed: 76 additions & 9 deletions

File tree

‎fe/fe-connector/fe-connector-maxcompute/src/main/java/org/apache/doris/connector/maxcompute/MaxComputeConnectorMetadata.java‎

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@
1919

2020
import org.apache.doris.connector.api.ConnectorColumn;
2121
import org.apache.doris.connector.api.ConnectorMetadata;
22+
import org.apache.doris.connector.api.ConnectorPartitionInfo;
2223
import org.apache.doris.connector.api.ConnectorSession;
2324
import org.apache.doris.connector.api.ConnectorTableSchema;
2425
import org.apache.doris.connector.api.DorisConnectorException;
@@ -28,10 +29,13 @@
2829
import org.apache.doris.connector.api.ddl.ConnectorPartitionSpec;
2930
import org.apache.doris.connector.api.handle.ConnectorColumnHandle;
3031
import org.apache.doris.connector.api.handle.ConnectorTableHandle;
32+
import org.apache.doris.connector.api.pushdown.ConnectorExpression;
3133

3234
import com.aliyun.odps.Column;
3335
import com.aliyun.odps.Odps;
3436
import com.aliyun.odps.OdpsException;
37+
import com.aliyun.odps.Partition;
38+
import com.aliyun.odps.PartitionSpec;
3539
import com.aliyun.odps.Table;
3640
import com.aliyun.odps.TableSchema;
3741
import com.aliyun.odps.Tables;
@@ -40,6 +44,7 @@
4044
import org.apache.logging.log4j.Logger;
4145

4246
import java.util.ArrayList;
47+
import java.util.Collections;
4348
import java.util.HashMap;
4449
import java.util.HashSet;
4550
import java.util.LinkedHashMap;
@@ -167,6 +172,65 @@ public Map<String, ConnectorColumnHandle> getColumnHandles(
167172
return result;
168173
}
169174

175+
// ==================== Partition listing ====================
176+
177+
@Override
178+
public List<String> listPartitionNames(ConnectorSession session,
179+
ConnectorTableHandle handle) {
180+
MaxComputeTableHandle mcHandle = (MaxComputeTableHandle) handle;
181+
List<Partition> partitions = structureHelper.getPartitions(
182+
odps, mcHandle.getDbName(), mcHandle.getTableName());
183+
List<String> names = new ArrayList<>(partitions.size());
184+
for (Partition partition : partitions) {
185+
names.add(partition.getPartitionSpec().toString(false, true));
186+
}
187+
return names;
188+
}
189+
190+
/**
191+
* Lists all partitions. The {@code filter} is intentionally ignored: the
192+
* legacy SHOW PARTITIONS path ({@code MaxComputeExternalCatalog
193+
* #listPartitionNames}) returns the full partition set without pushing
194+
* predicates into ODPS, and this preserves that behavior. Partitions are
195+
* read directly from ODPS with no connector-side cache (P4-T02 / OQ-4).
196+
*/
197+
@Override
198+
public List<ConnectorPartitionInfo> listPartitions(ConnectorSession session,
199+
ConnectorTableHandle handle, Optional<ConnectorExpression> filter) {
200+
MaxComputeTableHandle mcHandle = (MaxComputeTableHandle) handle;
201+
List<Partition> partitions = structureHelper.getPartitions(
202+
odps, mcHandle.getDbName(), mcHandle.getTableName());
203+
List<ConnectorPartitionInfo> result = new ArrayList<>(partitions.size());
204+
for (Partition partition : partitions) {
205+
PartitionSpec spec = partition.getPartitionSpec();
206+
Map<String, String> values = new LinkedHashMap<>();
207+
for (String key : spec.keys()) {
208+
values.put(key, spec.get(key));
209+
}
210+
result.add(new ConnectorPartitionInfo(
211+
spec.toString(false, true), values, Collections.emptyMap()));
212+
}
213+
return result;
214+
}
215+
216+
@Override
217+
public List<List<String>> listPartitionValues(ConnectorSession session,
218+
ConnectorTableHandle handle, List<String> partitionColumns) {
219+
MaxComputeTableHandle mcHandle = (MaxComputeTableHandle) handle;
220+
List<Partition> partitions = structureHelper.getPartitions(
221+
odps, mcHandle.getDbName(), mcHandle.getTableName());
222+
List<List<String>> result = new ArrayList<>(partitions.size());
223+
for (Partition partition : partitions) {
224+
PartitionSpec spec = partition.getPartitionSpec();
225+
List<String> values = new ArrayList<>(partitionColumns.size());
226+
for (String column : partitionColumns) {
227+
values.add(spec.get(column));
228+
}
229+
result.add(values);
230+
}
231+
return result;
232+
}
233+
170234
// ==================== DDL: Create/Drop Table ====================
171235

172236
@Override

‎plan-doc/PROGRESS.md‎

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# 📊 项目进度仪表盘
22

3-
> 最后更新:**2026-06-06** | 当前阶段:**P4 maxcompute·scope=C(写-SPI RFC 先行)**——写/事务 SPI RFC 已批准;**W-phase(W1–W7)全部落地**:W1+W2 `be945476ba7` + W3+W6 `9ad2bbe40ec` + W4 `759cc0874c8` + W5 `9ebe5e27fa4` + W7 文档(D-021/D-022 入 log、01-spi-rfc §20 E11、DV-009),behind gate、零行为变更、golden 等价 ✅;**P4 adopter 设计已批准**([D-023],5 批/11 task,见 [tasks/P4](./tasks/P4-maxcompute-migration.md));下一步 = **Batch A**(连接器 DDL+分区,gate 关)。P3 hybrid 已 **#64143 合入** `branch-catalog-spi`(`5c240dc7a34`)| 项目总进度:**36%**
3+
> 最后更新:**2026-06-06** | 当前阶段:**P4 maxcompute·scope=C(写-SPI RFC 先行)**——写/事务 SPI RFC 已批准;**W-phase(W1–W7)全部落地**:W1+W2 `be945476ba7` + W3+W6 `9ad2bbe40ec` + W4 `759cc0874c8` + W5 `9ebe5e27fa4` + W7 文档(D-021/D-022 入 log、01-spi-rfc §20 E11、DV-009),behind gate、零行为变更、golden 等价 ✅;**P4 adopter 设计已批准**([D-023],5 批/11 task,见 [tasks/P4](./tasks/P4-maxcompute-migration.md));**Batch A** 完成(T01 DDL ✅ + T02 分区 ✅);下一步 = **Batch B**(写/事务 SPI,gate 关,A∥B)。P3 hybrid 已 **#64143 合入** `branch-catalog-spi`(`5c240dc7a34`)| 项目总进度:**37%**
44
> [README](./README.md) · [Master Plan](./00-connector-migration-master-plan.md) · [SPI RFC](./01-spi-extensions-rfc.md) · [Decisions](./decisions-log.md) · [Deviations](./deviations-log.md) · [Risks](./risks.md) · [Agent Playbook](./AGENT-PLAYBOOK.md) · [Handoff](./HANDOFF.md)
55
66
---
@@ -13,7 +13,7 @@
1313
| **P1** | scan-node 收口 + 重复清理 | 1 周 | ▰▰▰▰▰▰▰▰▰▰ 100% | ✅ 完成(PR [#63641](https://github.com/apache/doris/pull/63641) squash-merged `778c5dd610f`;T1 推迟 P8;T2 推迟 P4/P5)| [tasks/P1](./tasks/P1-scan-node-cleanup.md) |
1414
| **P2** | trino-connector 迁移 | 2 周 | ▰▰▰▰▰▰▰▰▰▰ 100% | ✅ 已合入 `branch-catalog-spi`(#64096,squash `0793f032662`;T12 回归推迟 DV-003)| [tasks/P2](./tasks/P2-trino-connector-migration.md) |
1515
| P3 | hudi 迁移 | 2 周 | ▰▰▰▰▰▱▱▱▱▱ 45% | ✅ hybrid(D-019)批 A–D 已合入 `branch-catalog-spi`(**#64143** squash `5c240dc7a34`);批 E(live cutover)并入 P7 | [tasks/P3](./tasks/P3-hudi-migration.md) |
16-
| P4 | maxcompute 迁移 | 2 周 | ▰▰▰▰▱▱▱▱▱▱ 35% | 🚧 **W-phase 全落地** ✅(W1+W2 `be945476ba7` / W3+W6 `9ad2bbe40ec` / W4 `759cc0874c8` / W5 `9ebe5e27fa4` / W7 文档);**adopter 设计已批准**([D-023],5 批/11 task);**Batch A 进行中**(P4-T01 DDL ✅、T02 分区中)| [tasks/P4](./tasks/P4-maxcompute-migration.md) |
16+
| P4 | maxcompute 迁移 | 2 周 | ▰▰▰▰▱▱▱▱▱▱ 40% | 🚧 **W-phase 全落地** ✅(W1+W2 `be945476ba7` / W3+W6 `9ad2bbe40ec` / W4 `759cc0874c8` / W5 `9ebe5e27fa4` / W7 文档);**adopter 设计已批准**([D-023],5 批/11 task);**Batch A 完成**(P4-T01 DDL ✅ / P4-T02 分区 ✅),下一 = Batch B 写/事务| [tasks/P4](./tasks/P4-maxcompute-migration.md) |
1717
| P5 | paimon 迁移 | 3 周 | ▱▱▱▱▱▱▱▱▱▱ 0% | ⏸ 待启动 | — |
1818
| P6 | iceberg 迁移 | 5 周 | ▱▱▱▱▱▱▱▱▱▱ 0% | ⏸ 待启动 | — |
1919
| P7 | hive (+HMS) 迁移 | 6 周 | ▱▱▱▱▱▱▱▱▱▱ 0% | ⏸ 待启动 | — |
@@ -44,13 +44,13 @@
4444

4545
> 状态非 ✅ 的项,按阶段聚合。详细见各阶段 task 文件。
4646
47-
### P4 — maxcompute 迁移(🚧 full adopter;**设计已批准** [D-023],5 批/11 task;下一步 Batch A)
47+
### P4 — maxcompute 迁移(🚧 full adopter;**设计已批准** [D-023],5 批/11 task;Batch A ✅,下一步 Batch B)
4848

4949
> 策略 = **full adopter + 翻闸**([D-023],非 P3 hybrid);前置 W-phase(W1–W7)✅。批次计划 + 完整 task 表见 [tasks/P4](./tasks/P4-maxcompute-migration.md)。
5050
5151
| 批 | 范围 | gate | task | 状态 |
5252
|---|---|---|---|---|
53-
| A | 连接器 DDL + 分区 parity | 🔒 关 | P4-T01 ✅ / T02 🚧 | 🚧 T01 DDL 完成(gate 全绿);T02 分区进行中 |
53+
| A | 连接器 DDL + 分区 parity | 🔒 关 | P4-T01 ✅ / T02 ✅ | ✅ T01 DDL + T02 分区 listing 完成(gate 全绿:compile + checkstyle 0 + import-gate)|
5454
| B | 写/事务 SPI(`ConnectorTransaction`/`WriteOps` + `WritePlanProvider`→`TMaxComputeTableSink`)| 🔒 关 | P4-T03/T04 | ⏳ |
5555
| C | 翻闸(`SPI_READY_TYPES` + GSON + `getEngine`;含 R-004 防御测)| 🔓 **live** | P4-T05/T06 | ⏳ |
5656
| D | 清 ~19 反向引用 + 删 `datasource/maxcompute/`(收口 P1-T02)| 🔓 live | P4-T07/T08/T09 | ⏳ |
@@ -140,6 +140,7 @@
140140

141141
> 倒序,新内容置顶;超过 14 天的条目移除(git log 保留历史)。
142142
143+
- **2026-06-06(实现 ⑤·P4-T02)** ✅ **P4 Batch A 收尾 — P4-T02 连接器分区 listing 完成**(gate 关、dormant、零 live 风险):`MaxComputeConnectorMetadata` impl SPI `listPartitionNames`/`listPartitions`/`listPartitionValues`,三方法均直取 `structureHelper.getPartitions(odps, db, tbl)`:names = `PartitionSpec.toString(false,true)`(镜像 legacy `MaxComputeExternalCatalog:283`/`MaxComputeExternalTable:201`);`listPartitions` filter **忽略**返全量(values 由 `PartitionSpec.keys()`/`get(k)` 抽、props=emptyMap,镜像 SHOW PARTITIONS 不裁剪);`listPartitionValues` 按入参 `partitionColumns` 列序取 `spec.get(col)`。**OQ-4 定**:不建连接器自有 cache,直取 ODPS(Rule 2 不投机)。**保真说明**:legacy 双路径分歧(catalog:266 无 emptiness guard / table:200 有 `!partitionColumns.isEmpty()` guard),SPI 锚 catalog SHOW PARTITIONS 路径故**不加** guard;写前 javap 核 ODPS `PartitionSpec` 真实 API(`Set keys()`/`String get(String)`/`toString(boolean,boolean)`)。**测试**:按计划延至 **P4-T10** 连接器测试基线(无 mockito 手写替身),T02 gate = compile + checkstyle + import(R12 不静默)。守门全绿(连接器 compile BUILD SUCCESS/MVN_EXIT=0 + checkstyle 0/CS_EXIT=0 + import-gate 0,真实 EXIT 核验)。**下一步 = Batch B(P4-T03 写/事务 SPI)**。
143144
- **2026-06-06(实现 ④·P4-T01)** ✅ **P4 Batch A 启动 — P4-T01 连接器 DDL 完成**(gate 关、dormant、零 live 风险):`MaxComputeConnectorMetadata` impl SPI `createTable(ConnectorCreateTableRequest)` / `dropTable` / `createDatabase` / `dropDatabase`(忠实港 legacy `MaxComputeMetadataOps` 的 create/drop/validate/schema-build/lifecycle/bucket,**消费 P0 request 非 fe-core `CreateTableInfo`**)+ 新 `MCTypeMapping.toMcType(ConnectorType)` 反向类型映射(按 `PrimitiveType.toString()` switch,递归 ARRAY/MAP/STRUCT,不支持类型抛异常);连接器 `McStructureHelper` 已含全部 ODPS DDL 原语,无需新建。**附带修 fe-core 共享转换器 `ConnectorColumnConverter.toConnectorType` 丢 CHAR/VARCHAR 长度 [DV-010]**(用户 AskUserQuestion 签字;逆一致性 bug,影响 live jdbc/es CREATE TABLE,更正确)+ 回归测 `testCharVarcharLengthPreserved`。守门全绿(连接器 compile + checkstyle 0 + import-gate + fe-core `ConnectorColumnConverterTest` **9/0F0E**,真实 EXIT 核验)。**坑**:守门 maven `-pl` 须用 `:fe-connector-maxcompute`(冒号=artifactId);裸名被当相对路径 → reactor-not-found。下一步 = **P4-T02** 分区 listing。
144145
- **2026-06-06(设计 ④)** ✅ **P4 maxcompute adopter 设计批准**([D-023]):读 HANDOFF/PROGRESS/playbook + recon + 写-RFC §12,code-grounded re-grep(反向引用 post-W-phase **~19**,证 W-phase 灭 `Coordinator`/`LoadProcessor`/`FrontendServiceImpl` 3 热点 txn 站;`MCTransaction` 已含 W2 `addCommitData(byte[])`;`TMaxComputeTableSink` 18 字段齐)。产 [tasks/P4](./tasks/P4-maxcompute-migration.md):**5 批/11 task**(A 读/DDL parity → B 写/事务 → **C 翻闸(唯一 live 切点,含 R-004 防御测)** → D 清 ~19 引用+删 legacy → E 测+PR),用户批准。同步跟踪文档 + 修 §三 stale「P3 CI中」→ 已合 `5c240dc7a34`。**下一步 = Batch A**(P4-T01 DDL + P4-T02 分区,gate 关)。未动代码。
145146
- **2026-06-06(实现 ③)** ✅ **W-phase W4+W5+W7 落地(plugin-driven 写接线收口 + 文档)= W-phase(W1–W7)全完成**:**W4**(commit `759cc0874c8`)`PluginDrivenTransaction`(`PluginDrivenTransactionManager` 内类)override 4 个 fe-core `Transaction` 写 default 委派 wrap 的 SPI `ConnectorTransaction`(`addCommitData`/`supportsWriteBlockAllocation`/`allocateWriteBlockRange`/`getUpdateCnt`),legacy null marker 保持 inert(`allocateWriteBlockRange` 保 `throws UserException` 对齐接口,SPI 调用 unchecked);TDD RED 3F1E→GREEN 5/5。**W5**(commit `9ebe5e27fa4`)把 W1 写-plan SPI **layer 进既有** plugin-driven 写路径:`PhysicalPlanTranslator.visitPhysicalConnectorTableSink` + `PluginDrivenTableSink.bindDataSink` 在 `connector.getWritePlanProvider()!=null` 时走 `planWrite()` 产 opaque `TDataSink`,config-bag(jdbc)为 fallback。**关键修正 [DV-009]**:RFC/handoff W5 措辞(route 3 个 `visitPhysicalXxxTableSink` + 新建 sink)与代码不符——`PluginDrivenTableSink` 已存在、plugin-driven 写走 `visitPhysicalConnectorTableSink` 专路;那 3 个 concrete 方法服务 legacy 表,加路由是死代码。用户 AskUserQuestion 签字「Corrected W5 (layer planWrite)」;TDD RED(缺 ctor 编译失败)→GREEN 1/1。**W7** 文档:补 **[D-021]**(scope=C)+**[D-022]**(写 SPI A/B1/C1/D/E) 入 decisions-log(两 session 前签字未 log,traceability 缺口补齐);deviations-log 加 [DV-009] + 修 stale 索引(共 7→9、补 DV-008 行);01-spi-rfc 加 §20 E11 节(脚注 D-022)+ §3 矩阵 E11 行;同步本 PROGRESS / connectors/maxcompute / HANDOFF。三 commit 独立、behind gate、gate 全绿(compile + 定向测 + checkstyle 0 + import-gate,真实 exit code 核验)。**下一步 = P4 maxcompute adopter**(搬 `datasource/maxcompute/` → fe-connector-maxcompute、impl 写 SPI、翻闸 `max_compute`)。

‎plan-doc/connectors/maxcompute.md‎

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
| **fe-core 旧路径** | `fe/fe-core/src/main/java/org/apache/doris/datasource/maxcompute/` |
1212
| **共享依赖** | 无 |
1313
| **计划迁移阶段** | **P4** |
14-
| **当前状态** | 🚧 Batch A 进行中(P4-T01 DDL ✅;T02 分区中)|
14+
| **当前状态** | 🚧 Batch A ✅ 完成(P4-T01 DDL ✅ / P4-T02 分区 ✅,gate 关);下一 = Batch B 写/事务 |
1515
| **完成度** | 35% |
1616
| **主 owner** | @me |
1717

@@ -24,7 +24,7 @@
2424
| 1 | 🟡 | fe-core 8 个顶层(ExternalCatalog/Database/Table、MetaCache、MetadataOps、MCTransaction、SchemaCacheValue、McStructureHelper)+ `source/` 2 个 |
2525
| 2 | 🟡 | fe-connector 13 个文件,scan 路径已迁 |
2626
| 3 | ⏳ | 反向 instanceof:12 处(`PhysicalPlanTranslator`、`ShowPartitionsCommand`、`PartitionsTableValuedFunction` 等)|
27-
| 4 | 🟡 | Metadata 读 + **DDL(create/drop table+db,P4-T01 ✅)** 已实现;分区 listing(T02) / 写事务(批 B) 待补 |
27+
| 4 | 🟡 | Metadata 读 + **DDL(create/drop table+db,P4-T01 ✅)** + **分区 listing(P4-T02 ✅)** 已实现;写事务(批 B) 待补 |
2828
| 5 | ⏳ | |
2929
| 6 | ✅ | META-INF/services 已注册 |
3030
| 7 | ⏳ | |
@@ -49,7 +49,7 @@
4949
| E7 SysTables | ❌ | n/a | |
5050
| E8 ColumnStatistics | 🟡 | |
5151
| E9 Delete/Merge sink | ❌ | |
52-
| E10 listPartitions | ✅ 需要 | 走 SPI |
52+
| E10 listPartitions | ✅ 需要 | ✅ P4-T02 | `listPartitions/Names/Values` 直取 ODPS `getPartitions`,filter 忽略返全量(OQ-4 无自有 cache)|
5353

5454
---
5555

@@ -74,6 +74,7 @@
7474
## 进度日志
7575

7676
### 2026-06-06
77+
- **P4-T02 连接器分区 listing 完成**(Batch A 收尾,gate 关、dormant、零 live 风险):`MaxComputeConnectorMetadata` impl SPI `listPartitionNames`/`listPartitions`/`listPartitionValues`,三方法直取 `structureHelper.getPartitions(odps, db, tbl)`:names = `PartitionSpec.toString(false,true)`(镜像 legacy `MaxComputeExternalCatalog:283`/`MaxComputeExternalTable:201`);`listPartitions` filter **忽略**返全量(values 由 `PartitionSpec.keys()`/`get(k)`、props=emptyMap);`listPartitionValues` 按入参列序 `spec.get(col)`。**OQ-4 定**:不建连接器自有 cache,直取 ODPS(Rule 2 不投机)。**保真**:legacy 双路径分歧(catalog 无 emptiness guard / table 有),SPI 锚 catalog SHOW PARTITIONS 故不加 guard;写前 javap 验 ODPS `PartitionSpec` API。测试延至 **P4-T10**(无 mockito 基线)。守门全绿(compile BUILD SUCCESS + checkstyle 0 + import-gate,真实 EXIT 核验)。下一步 = Batch B(P4-T03 写/事务 SPI)。
7778
- **P4-T01 连接器 DDL 完成**(Batch A,gate 关、dormant、零 live 风险):`MaxComputeConnectorMetadata` impl SPI `createTable(ConnectorCreateTableRequest)` / `dropTable` / `createDatabase` / `dropDatabase`(忠实港 legacy `MaxComputeMetadataOps`,消费 P0 request 非 fe-core `CreateTableInfo`;连接器 `McStructureHelper` ODPS DDL 原语已具备)+ 新 `MCTypeMapping.toMcType(ConnectorType)` 反向类型映射(递归 ARRAY/MAP/STRUCT)。附带修 fe-core 共享转换器 CHAR/VARCHAR 长度 [DV-010](../deviations-log.md)(用户签字)+ 回归测。守门全绿(compile + checkstyle 0 + import-gate + `ConnectorColumnConverterTest` 9/0F0E)。下一步 = P4-T02 分区 listing。
7879
- **P4 adopter 设计批准**([D-023](../decisions-log.md)):5 批 / 11 task 计划见 [tasks/P4](../tasks/P4-maxcompute-migration.md)。re-grep 校正反向引用 **~19**(旧称「12」失真;W-phase 已灭 `Coordinator`/`LoadProcessor`/`FrontendServiceImpl` 3 热点 txn 站)。连接器现状核实:写 SPI **全缺**(无 `getWritePlanProvider`/`beginTransaction`/`ConnectorWriteOps`)、DDL **缺**(仅 `McStructureHelper` 低层 helper)、分区 listing **缺**;`MCTransaction` 已含 W2 `addCommitData(byte[])`,`TMaxComputeTableSink` 18 字段齐。**下一步 = Batch A**(P4-T01 DDL + P4-T02 分区,gate 关)。
7980
- **W-phase(共享写/事务 SPI)全落地**([D-021](../decisions-log.md) / [D-022](../decisions-log.md)):maxcompute 是首个 adopter 的靶。**写接线 seam 已就位**——fe-core `Transaction` 写回调 + `PluginDrivenTransaction` 桥(W4 `759cc0874c8`)、写-plan-provider layer 进既有 plugin-driven 写路径(W5 `9ebe5e27fa4`,[DV-009](../deviations-log.md))。**P4 adopter 待做**:搬 `datasource/maxcompute/` → `fe-connector-maxcompute`;impl `ConnectorWriteOps`(insert) / `ConnectorTransaction`(over `addCommitData` + `allocateWriteBlockRange`,仅 mc 需 block-id seam) / `ConnectorWritePlanProvider`(产 `TMaxComputeTableSink`);翻闸 `SPI_READY_TYPES+="max_compute"` + 删 `CatalogFactory` case + GSON 兼容 + `getEngine` 分支;清 ~12 反向 instanceof;连接器测试基线。详见 [写 RFC §12](../tasks/designs/connector-write-spi-rfc.md)。

0 commit comments

Comments
 (0)