-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Closed
Labels
arrowChanges to the arrow crateChanges to the arrow cratearrow-flightChanges to the arrow-flight crateChanges to the arrow-flight crateenhancementAny new improvement worthy of a entry in the changelogAny new improvement worthy of a entry in the changelog
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Something I discovered while working on code base at Coralogix and in Ballista.
arrow_flight::utils::flight_data_from_arrow_batch is used as method to convert a singleRecordBatch to FlightData.
This method extracts both the dictionaries as the RecordBatches.
While convenient, if the dictionary is the shared across batches, the caller will probably send the FlightData for these dictionaries over and over again over in the stream.
Describe the solution you'd like
Mark the method as deprecated to encourage users to use the IpcDataGenerator API instead.
Describe alternatives you've considered
Additional context
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
arrowChanges to the arrow crateChanges to the arrow cratearrow-flightChanges to the arrow-flight crateChanges to the arrow-flight crateenhancementAny new improvement worthy of a entry in the changelogAny new improvement worthy of a entry in the changelog