You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Repartition is being added incorrectly in some cases #4883
Describe the bug
I am seeing a Repartition being added incorrectly in some cases in our IOx plans (which then causes resorts to happen, which is a huge deal for us)
Expected behavior
If the data is sorted it should not be resorted
To Reproduce
My suspicion is that #4714 / 899c86a is the specific code that is causing this change (as the relies_on_input_order, which I added explicitly for this case, is now ignored -- see #4856).
I think the fix is to update DataFusion to be smarter about knowing how UnionExec is sorted in
In fact, looking at the tests I wrote and were changed in #4714
Activity