Repository navigation
Commit 2cf14a4
committed
[fix](be) Preserve legacy metadata-named physical columns
### What problem does this PR solve?
Issue Number: close apache#66816
Related PR: apache#67207
Problem Summary: FileScannerV2 globally classified the new Iceberg and Paimon metadata names as virtual columns in its legacy compatibility path. During an old-FE/new-BE rolling upgrade, unrelated physical columns with the same names could therefore be removed from file projection. Current FE versions send explicit synthesized-column categories for these metadata columns, so keep the name-based legacy fallback only for the pre-existing row-id columns and let metadata-like physical names from an old FE follow is_file_slot.
### Release note
None
### Check List (For Author)
- Test: Unit Test
- Compiled the FileScannerV2 unit-test source and the production unity target; git diff --check passed
- Behavior changed: No
- Does this need documentation: No1 parent 255ecad commit 2cf14a4
2 files changed
Lines changed: 12 additions & 16 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
200 | | - | |
201 | | - | |
202 | | - | |
203 | | - | |
204 | | - | |
| 200 | + | |
205 | 201 | | |
206 | 202 | | |
207 | 203 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
875 | 875 | | |
876 | 876 | | |
877 | 877 | | |
878 | | - | |
879 | | - | |
880 | | - | |
| 878 | + | |
| 879 | + | |
| 880 | + | |
881 | 881 | | |
882 | 882 | | |
883 | 883 | | |
| |||
915 | 915 | | |
916 | 916 | | |
917 | 917 | | |
918 | | - | |
919 | | - | |
920 | | - | |
921 | | - | |
| 918 | + | |
| 919 | + | |
| 920 | + | |
| 921 | + | |
922 | 922 | | |
923 | 923 | | |
924 | 924 | | |
| |||
969 | 969 | | |
970 | 970 | | |
971 | 971 | | |
972 | | - | |
973 | | - | |
974 | | - | |
975 | | - | |
| 972 | + | |
| 973 | + | |
| 974 | + | |
| 975 | + | |
976 | 976 | | |
977 | 977 | | |
978 | 978 | | |
| |||
0 commit comments