You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 5bfd030
Browse filesBrowse the repository at this point in the historyBrowse files
[fix](paimon) Adapt Rust reader compatibility to master
### What problem does this PR solve?
Issue Number: None
Related PR: #66227
Problem Summary: The master connector framework did not propagate name-based nested projections when no stable nested field IDs were available. Paimon could therefore select the Rust reader for a projected nested value and BE decoded the projected Arrow struct as the full Doris struct. Master also differs from branch-4.1 in credential selection, branch resolution, and TIMESTAMP_LTZ mapping. Propagate nested projection state to connector handles, make Paimon fall back to JNI for nested projections, and align the regression fixtures with master semantics.
### Release note
None
### Check List (For Author)
- Test: Unit Test, FE build, and Regression test
- PaimonRustReaderSelectorTest
- PluginDrivenScanNodeProjectionTest
- test_paimon_rust_reader_compatibility
- test_paimon_rust_reader_eq_for_null
- Behavior changed: No. The Rust reader remains disabled by default and unsupported nested projections fall back to JNI.
- Does this need documentation: No
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/main/java/org/apache/doris/connector/paimon/PaimonColumnHandle.java
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/test/java/org/apache/doris/connector/paimon/PaimonRustReaderSelectorTest.java
+21-1Lines changed: 21 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -71,6 +71,16 @@ public void compatibleSplitUsesRustOnlyWhenEveryPlanGateIsEnabled() throws Excep
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-spi/src/main/java/org/apache/doris/connector/spi/handle/ConnectorColumnHandle.java
+3-1Lines changed: 3 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -28,7 +28,9 @@ public interface ConnectorColumnHandle extends Serializable {
28
28
29
29
/**
30
30
* Returns a handle scoped to the stable field IDs that the engine actually projected below this
31
-
* top-level column. Connectors that do not use stable nested IDs keep the original opaque handle.
31
+
* top-level column. The engine also invokes this method with an empty set for a name-based nested
32
+
* projection whose schema does not publish stable field IDs. Connectors that do not need nested
33
+
* projection information keep the original opaque handle.
0 commit comments