Repository navigation
Commit ded3ddf
[fix](test) pin parallel_pipeline_task_num=1 to keep bucket shuffle in prune_bucket_with_bucket_shuffle_join
Root cause: the second extractFragment asserts RIGHT OUTER JOIN(BUCKET_SHUFFLE)
under the new distribute planner, but the bucket-shuffle downgrade heuristic
ChildrenPropertiesRegulator.isBucketShuffleDownGrade
(totalBucketNum < backEndNum*paraNum*0.8) fires on the CloudP0 agent: the left
side prunes to 1 partition x 10 buckets = 10, backEndNum=1, and with the default
parallel_pipeline_task_num=0 paraNum auto-derives to 16 on the 32-core BE, so
10 < 1*16*0.8 = 12.8 -> downgrade -> PARTITIONED. The join is then labeled
PARTITIONED, never BUCKET_SHUFFLE, so all 120 retries fail (~128s, muted).
This became reachable after apache#56279 (302ba2e) replaced the old
Math.min(10, backEndNum*paraNum) cap with the *0.8 formula; the var is also
fuzzy, an additional flake source.
Solution: set parallel_pipeline_task_num=1 in the second-phase multi_sql so
paraNum=1 and the threshold becomes 10 < 0.8 (false) -> no downgrade ->
BUCKET_SHUFFLE kept deterministically, independent of BE core count and fuzz.
Bucket pruning (tablet<20), exchangeNum==1 and result correctness are unaffected.
Tests: existing suite is the test (CloudP0 e2e, CI-gated). TEST-only, no product
change; apache#56279's formula is intentional and left as-is.
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>1 parent 139d919 commit ded3ddf
1 file changed
Lines changed: 4 additions & 0 deletions
File tree
- regression-test/suites/nereids_syntax_p0/distribute
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
76 | 76 | | |
77 | 77 | | |
78 | 78 | | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
79 | 82 | | |
80 | 83 | | |
81 | 84 | | |
82 | 85 | | |
| 86 | + | |
83 | 87 | | |
84 | 88 | | |
85 | 89 | | |
| |||
0 commit comments