Skip to content

compute: share MV sink batches below 1 MiB by default - #40051

Merged
antiguru merged 1 commit into
MaterializeInc:mainfrom
antiguru:mv-shared-batch-default-1mib
Oct 23, 2026
Merged

antiguru merged 1 commit into
MaterializeInc:mainfrom
antiguru:mv-shared-batch-default-1mib

Conversation

@antiguru

@antiguru antiguru commented Oct 21, 2026 •

Copy link
Copy Markdown
Member

Sets the compiled-in default of compute_mv_sink_shared_batch_max_bytes to 1 MiB, so MV sinks coalesce small per-worker writes into one batch per process (#37591) without a LaunchDarkly override. CI already runs with 1 MiB, and staging and internal production environments serve it today. Staging A/B results are on CPU-30.

Merge after the production LaunchDarkly default moves to 1 MiB. Until then test/launchdarkly-flag-consistency reports the compiled default as diverging from production.

Part of CPU-30.

🤖 Generated with Claude Code

Set the compiled-in default of `compute_mv_sink_shared_batch_max_bytes`
to 1 MiB, the value CI already runs with and the value production serves
through LaunchDarkly. Deployments without LaunchDarkly now coalesce small
per-worker MV sink writes into one batch per process, too.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
@antiguru
antiguru requested a review from mtabebe October 21, 2026 08:33
@antiguru
antiguru marked this pull request as ready for review October 21, 2026 08:33
@antiguru
antiguru requested a review from a team as a code owner October 21, 2026 08:33
@antiguru
antiguru merged commit 120a3b4 into MaterializeInc:main Oct 23, 2026
84 checks passed
@antiguru

Copy link
Copy Markdown
Member Author

Thanks for the review!

@antiguru
antiguru deleted the mv-shared-batch-default-1mib branch October 23, 2026 11:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants