Repository navigation
Avoid reading metadata for LocalFileSystem::read_ranges (and other methods) #614
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
See #595 (comment)
Describe the solution you'd like
- open the file
- try getting bytes from it, if succeeds: it was fine (and we avoided reading the metadata), if it fails, we can read the metadata and "reproduce" the original error
Describe alternatives you've considered
Additional context
Reacted by Kyle Barron
Activity
[-]Avoid reading metadata for `LocalFileSystem::read_ranges`[/-][+]Avoid reading metadata for `LocalFileSystem::read_ranges` (and other methods)[/+]alamb commentedon Jan 23, 2026
I would be very happy to review a PR for this issue -- please ping me
Dandandan commentedon Jan 24, 2026
FYI @alamb my try for read_ranges
Dandandan commentedon Jan 25, 2026
I did not see a huge difference in performance.
I did see however a difference when avoiding
File::openwhich is much more costly (5-10% difference on my machine for the clickbench benchmark in arrow-rs).