Skip to content

Df54 apply expressions - #433

Merged
thinkharderdev merged 2 commits into
v54.1.0from
df54-apply-expressions
Sep 8, 2026
Merged

thinkharderdev merged 2 commits into
v54.1.0from
df54-apply-expressions

Conversation

@thinkharderdev

@thinkharderdev thinkharderdev commented Sep 6, 2026 •

Copy link
Copy Markdown
Collaborator

CX-51808

Upstream DataFusion added an ExecutionPlan::apply_expressions to allow visiting all PhsyicalExprs in an ExecutionPlan. This was reverted prior to the 54.0.0 release because of concerns about breaking changes (see apache@2a19282).

This PR reverts the revert commit since we need apply_expressions to make scalar subqueries work with distributed execution.

The apply_expressions change was later merged back upstream so this commit can be dropped during the DF 55 upgrade.

@thinkharderdev
thinkharderdev requested a review from a team September 6, 2026 15:13
@github-actions github-actions Bot added the core label Sep 6, 2026
@avantgardnerio

Copy link
Copy Markdown

Should we backport the one from 55?

@thinkharderdev

Copy link
Copy Markdown
Collaborator Author

Should we backport the one from 55?

I tried to do this first but there were a ton of conflicts. This is effectively the same though. This change was first merged upstream and then reverted and then reapplied. AFAICT there were not changes to the core implementation but the various merge conflicts when it was reapplied made cherry-picking it from the 55 branch much more painful.

@thinkharderdev
thinkharderdev merged commit 7122c09 into v54.1.0 Sep 8, 2026
13 checks passed
@thinkharderdev
thinkharderdev deleted the df54-apply-expressions branch September 8, 2026 10:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants