Skip to content

SS-455 - sql server: track committed offsets per capture instance - #39463

Merged
martykulma merged 1 commit into
mainfrom
maz-sql-server-cleanup-per-instance
Oct 5, 2026
Merged

martykulma merged 1 commit into
mainfrom
maz-sql-server-cleanup-per-instance

Conversation

@martykulma

@martykulma martykulma commented Oct 1, 2026 •

Copy link
Copy Markdown
Contributor

Change table cleanup used the upper of the whole source. No capture instance was cleaned while any export of the source was still below the as_of, and every resume upper update re-ran cleanup for every capture instance.

Replication resumes each capture instance from the least resume upper of its own exports, so each change table is now cleaned up to the meet of its exports' committed uppers, and only when that low water mark moves. A failed cleanup is retried once the low water mark moves. Cleanup remains behind CDC_CLEANUP_CHANGE_TABLE, which defaults off.

Adds committed_lsn_is_meet_of_exports.

🤖 Generated with Claude Code

@martykulma
martykulma added this pull request to stack #39464 October 1, 2026 18:35
@martykulma martykulma changed the title sql server: track committed offsets per capture instance SS-455 - sql server: track committed offsets per capture instance Oct 1, 2026
@linear-code

linear-code Bot commented Oct 1, 2026

Copy link
Copy Markdown

SS-455

@martykulma
martykulma marked this pull request as ready for review October 1, 2026 19:30
@martykulma
martykulma requested a review from a team as a code owner October 1, 2026 19:30
@martykulma
martykulma force-pushed the maz-sql-server-cleanup-per-instance branch from 6fabc06 to b6b8bdb Compare October 2, 2026 14:21
@martykulma
martykulma force-pushed the maz-sql-server-cleanup-per-instance branch 2 times, most recently from 1cb659d to 21a661b Compare October 5, 2026 18:13
Base automatically changed from maz-kafka-offset-commit-dedupe to main October 5, 2026 18:44
@martykulma
martykulma requested a review from a team as a code owner October 5, 2026 18:44
@martykulma
martykulma force-pushed the maz-sql-server-cleanup-per-instance branch from 21a661b to 9bad081 Compare October 5, 2026 18:44
@martykulma
martykulma merged commit 2917661 into main Oct 5, 2026
78 checks passed
@martykulma
martykulma deleted the maz-sql-server-cleanup-per-instance branch October 5, 2026 19:26
@bosconi bosconi mentioned this pull request Oct 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants