-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Closed
Labels
arrowChanges to the arrow crateChanges to the arrow cratearrow-flightChanges to the arrow-flight crateChanges to the arrow-flight crateenhancementAny new improvement worthy of a entry in the changelogAny new improvement worthy of a entry in the changelog
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We are consider using the "don't use dictionary interning" in DataFusion for high cardinality columns: apache/datafusion#7200 (comment)
@tustvold mentioned this mode could be made faster
Describe the solution you'd like
Review and optimize Code::DictionaryValues
Perhaps this could be made faster:
Line 1417 in b810e8f
| Codec::DictionaryValues(converter, _) => { |
(I am not sure)
Describe alternatives you've considered
There may not be any way to make this faster, but I wanted to file the ticket as follow on to the meeting
Additional context
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
arrowChanges to the arrow crateChanges to the arrow cratearrow-flightChanges to the arrow-flight crateChanges to the arrow-flight crateenhancementAny new improvement worthy of a entry in the changelogAny new improvement worthy of a entry in the changelog