Repository navigation
Commit 8566834
committed
Check the full task schema for nested evolution
The full task schema of a VERSION AS OF read can be older than the
table's schema and hold a nested field that an earlier data file lacks,
which the native scan cannot read. Walk it in the nested-evolution check
too, so such a scan falls back to Spark.1 parent 6213d05 commit 8566834
2 files changed
Lines changed: 29 additions & 6 deletions
File tree
- spark/src
- main/scala/org/apache/comet/rules
- test/scala/org/apache/comet
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
781 | 781 | | |
782 | 782 | | |
783 | 783 | | |
784 | | - | |
785 | | - | |
786 | | - | |
| 784 | + | |
| 785 | + | |
| 786 | + | |
| 787 | + | |
787 | 788 | | |
788 | 789 | | |
789 | 790 | | |
790 | | - | |
| 791 | + | |
| 792 | + | |
791 | 793 | | |
792 | 794 | | |
793 | 795 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1827 | 1827 | | |
1828 | 1828 | | |
1829 | 1829 | | |
1830 | | - | |
| 1830 | + | |
| 1831 | + | |
1831 | 1832 | | |
1832 | 1833 | | |
1833 | 1834 | | |
1834 | 1835 | | |
1835 | 1836 | | |
1836 | 1837 | | |
1837 | 1838 | | |
1838 | | - | |
| 1839 | + | |
| 1840 | + | |
| 1841 | + | |
| 1842 | + | |
| 1843 | + | |
| 1844 | + | |
| 1845 | + | |
| 1846 | + | |
| 1847 | + | |
| 1848 | + | |
| 1849 | + | |
| 1850 | + | |
| 1851 | + | |
| 1852 | + | |
| 1853 | + | |
| 1854 | + | |
| 1855 | + | |
| 1856 | + | |
| 1857 | + | |
| 1858 | + | |
| 1859 | + | |
1839 | 1860 | | |
1840 | 1861 | | |
1841 | 1862 | | |
| |||
0 commit comments