-
Notifications
You must be signed in to change notification settings - Fork 2k
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
While looking at adding support for more statistics on the Delta Lake TableProvider implementation I bumped into some limitation in our statistics API.
Currently columnstatistics is a Option<Vec<ColumnStatistics>>.
So, it should return the statistics by (correct) index regardless of the order in the files.
Describe the solution you'd like
Either:
- Return a
HashMap<String, ColumnStatistics>rather than aOption<Vec<ColumnStatistics>> - Pass a
Schemaparameter toTableProvider::statisiticsso the positions of the fields can be calculated.
FWIW, Delta Lake / delta-rs takes the first approach and seems straightforward to implement and use.
Describe alternatives you've considered
Additional context
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request