Repository navigation
Commit a78aeb4
committed
[fix](be) Ignore Iceberg position deletes when DV exists
### What problem does this PR solve?
Issue Number: None
Related PR: #65281
Problem Summary: The format v2 Iceberg table reader parsed deletion vector rows and then still merged position delete files for the same data file. Iceberg scan planning applies position delete files only when there is no deletion vector for the data file, so this could filter extra rows in scanner v2. This commit keeps the deletion vector rows and skips position delete files when a deletion vector is present, while continuing to initialize equality delete predicates. The v2 unit test now asserts that position delete rows are ignored in this case.
### Release note
None
### Check List (For Author)
- Test: Unit Test
- Remote BE UT: ./run-be-ut.sh --run --filter="IcebergV2ReaderTest.IcebergTableReaderIgnoresPositionDeleteFilesWhenDeletionVectorPresent:IcebergDeleteFileReaderHelperTest.DeletionVectorCacheKey*"
- Behavior changed: No
- Does this need documentation: No1 parent 50cb8ba commit a78aeb4
2 files changed
Lines changed: 9 additions & 8 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
360 | 360 | | |
361 | 361 | | |
362 | 362 | | |
363 | | - | |
| 363 | + | |
| 364 | + | |
364 | 365 | | |
365 | 366 | | |
366 | 367 | | |
| 368 | + | |
367 | 369 | | |
368 | | - | |
369 | | - | |
370 | | - | |
371 | | - | |
372 | | - | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
373 | 374 | | |
374 | 375 | | |
375 | 376 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1788 | 1788 | | |
1789 | 1789 | | |
1790 | 1790 | | |
1791 | | - | |
| 1791 | + | |
1792 | 1792 | | |
1793 | 1793 | | |
1794 | 1794 | | |
| |||
1831 | 1831 | | |
1832 | 1832 | | |
1833 | 1833 | | |
1834 | | - | |
| 1834 | + | |
1835 | 1835 | | |
1836 | 1836 | | |
1837 | 1837 | | |
| |||
0 commit comments