fix(core): fix split partitions not being automatically squashed#5924
Merged
bluestreak01 merged 17 commits intomasterfrom Jul 10, 2025
Merged
fix(core): fix split partitions not being automatically squashed#5924bluestreak01 merged 17 commits intomasterfrom
bluestreak01 merged 17 commits intomasterfrom
Conversation
ideoma
changed the title
bluestreak01
reviewed
Jul 9, 2025
ideoma
changed the title
…-usage-checkpoing-fuzz-test
bluestreak01
previously approved these changes
Jul 10, 2025
…-usage-checkpoing-fuzz-test
bluestreak01
approved these changes
Jul 10, 2025
Contributor
[PR Coverage check]😍 pass : 19 / 20 (95.00%) file detail
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes a bug when too many split partitions are created and they are not automatically squashed. This could happen when realtime data is written by multiple connections and the volume of data is big, so that it constantly produces many split partitions. If this process continues non-stop for a long time, longer than the 2 hours for hourly partitioned tables (or 2 days for daily partitioned) at some point splits are not automatically squashed and the number of split partitions constantly grow.
Also, fixes assertion error in processing
The error can happen in the very extreme cases of materialized view processing when a significant data range is removed as a result of the view refresh and there is no logical partition to squash into, for example, when there is no partition
2022-03-24, only a split exists2022-03-24T02:23. The fix is to create an empty logical partition2022-03-24before the force squashing.Also fixes CI failures like
It's done by reducing the sizes of random arrays generated in tests and also reducing the column allocation sizes in Checkpoint Fuzz Tests.