Skip to content

Respect settings: max_block_size for arrayJoin function #54290

@taiyang-li

Description

@taiyang-li

Describe the unexpected behaviour
Currently in CH, arrayJoin action always processes one input chunk and does transforming, finally output another one chunk. The output chunk is probably huge if serveral arrayJoins are calculated continuously in SQL, which is not friendly for memory limited usages(e.g. gluten)

To avoid OOM, we should respect max_block_size settings while executing arrayJoin

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions