You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge?
@appletreeisyellow added PruningStatistics::row_counts() in #9223 which allows better pruning of columns which are all null.
However, I believe we have not hooked that API up into the ParquetExec, so it won't prune row groups based on this information.
For example, if column a is all NULL, a predicate `a > 5' can never be true, but the the ParquetExec won't be able to prune row groups or pages for this case