Skip to content

Expose public API for determining if Arrow IPC file is using compression #7816

@corasaurus-hex

Description

@corasaurus-hex

I'm writing a library for converting from Arrow IPC stream format to Arrow IPC file format, Parquet, and others. For the Arrow -> Arrow conversion I would love to be able to check that the file that has been written is using compression, and what compression it is using.

It's tricky since compression is per-buffer, and only applied if the compression actually saves space, but it would be nice to be able to access what compression was attempted. Maybe in metadata? I'd love thoughts on how this could work and if it's something that the project would be interested in having.

Thanks!!

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementAny new improvement worthy of a entry in the changelog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions