Skip to content

Implement arrow_buffer::MemoryPool for DataFusion's MemoryPool #18926

Description

@notfilippo

Is your feature request related to a problem or challenge?

Related to #16841. The ability to correctly account for memory usage of arrow buffers in execution nodes is crucial to maximise resource usage while preventing OOMs.

Describe the solution you'd like

Implement the arrow_buffer::MemoryPool trait for DataFusion's MemoryPool to make Arrow arrays claimable.

Describe alternatives you've considered

See the discussion at #16841

Additional context

No response

Activity

  1. notfilippo commented on Nov 25, 2025

    @notfilippo
    MemberAuthor

    take

  2. added 2 commits that reference this issue on Nov 25, 2025
    fd33751
    8c6998c
  3. added a commit that references this issue on Feb 11, 2026
    7e9bcd2
  4. added a commit that references this issue on Feb 23, 2026
    7815732
  5. added a commit that references this issue on Mar 24, 2026
    7de492c
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions