You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit b584341
Browse filesBrowse the repository at this point in the historyBrowse files
[fix](paimon) Keep CHAR routing fields off the native bucket route while padding
With padding on, the writer pads a CHAR value before Paimon computes the
partition and the bucket of the row, but the fixed-bucket route
(paimon_fixed_bucket) hashes the routing values that BE sends, unpadded.
Rows of one bucket then reached several writers. In a full-compaction
table each of them compacted the bucket, and Paimon gave up committing
the compaction after the rows were committed (LSM conflicts, then file
deletion conflicts), so the INSERT reported success without its
changelog. A CHAR partition or bucket field is now routed only while
padding is off; with padding on the table gets the distribution of a
routing field BE cannot hash, a single writer for a primary-key table.
The writer also leaves the value of the table's rowkind.field alone:
Paimon takes the row kind from it as it is, and a CHAR(3) '+I' padded to
'+I ' failed the write.
Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/main/java/org/apache/doris/connector/paimon/PaimonWritePlanProvider.java
+16-8Lines changed: 16 additions & 8 deletions
Original file line number
Diff line number
Diff line change
@@ -347,7 +347,7 @@ public boolean requiresMaterializeStaticPartitionValues() {
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-paimon/src/test/java/org/apache/doris/connector/paimon/PaimonWritePlanProviderTest.java
+37-4Lines changed: 37 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -262,37 +262,70 @@ public void defaultedFixedBucketRouteFieldsFallBackToSingleWriter() {
0 commit comments