You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 68e9df4
Browse filesBrowse the repository at this point in the historyBrowse files
### What problem does this PR solve?
Issue Number: closeapache#66816
Related PR: apache#67207
Problem Summary: External Paimon tables may contain names used by Doris virtual metadata columns, and Iceberg streaming scans could bypass the FileScannerV2 reader validation. This could overwrite a physical Paimon column with a synthetic handle or route Iceberg metadata-column queries to an unsupported reader. Reject Paimon name collisions safely, validate Iceberg streaming scans before empty-snapshot handling, and keep BE metadata classification and materialization consistent.
### Release note
Paimon external tables with reserved physical metadata names now fail safely; Iceberg streaming metadata-column scans reject unsupported readers.
### Check List (For Author)
- Test: Unit Test\n - Java connector tests: IcebergScanPlanProviderTest, PaimonConnectorMetadataTest, and PaimonScanPlanProviderTest\n - BE unit tests: FileScannerV2 classification tests and Paimon reader tests\n- Behavior changed: Yes (safe error on Paimon physical metadata-name collisions and unsupported Iceberg streaming readers)\n- Does this need documentation: No
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-iceberg/src/main/java/org/apache/doris/connector/iceberg/IcebergScanPlanProvider.java
+1Lines changed: 1 addition & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -526,6 +526,7 @@ public boolean canServeMetadataOnlyCount(ConnectorSession session, ConnectorTabl
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-iceberg/src/test/java/org/apache/doris/connector/iceberg/IcebergScanPlanProviderTest.java
+35Lines changed: 35 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -936,6 +936,41 @@ public void metadataColumnsRejectDisabledFileScannerV2DuringPlanning() {
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/main/java/org/apache/doris/connector/paimon/PaimonConnectorMetadata.java
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/main/java/org/apache/doris/connector/paimon/PaimonScanPlanProvider.java
+28-16Lines changed: 28 additions & 16 deletions
Original file line number
Diff line number
Diff line change
@@ -609,6 +609,31 @@ private boolean isIncrementalBinlogScan(PaimonTableHandle handle, Map<String, St
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/test/java/org/apache/doris/connector/paimon/PaimonConnectorMetadataTest.java
0 commit comments