Skip to content

MOD-7069: Send GC heartbeats to track copy on write behaviour#5503

Merged
DvirDukhan merged 3 commits intomasterfrom
master_jk_report_gc_fork_cow
Jan 15, 2025
Merged

MOD-7069: Send GC heartbeats to track copy on write behaviour#5503
DvirDukhan merged 3 commits intomasterfrom
master_jk_report_gc_fork_cow

Conversation

@kei-nan
Copy link
Collaborator

@kei-nan kei-nan commented Jan 13, 2025

A clear and concise description of what the PR is solving, including:

  1. Current: We don't know how much the copy on write optimization was successful during the run of the GC process.
  2. Change: Use redis API to send heartbeats from the child which will report to the parent process about our copy on write state.
  3. Outcome: Easier to prove or disprove situations where we run out of memory and copy on write is suspected.

Main objects this PR modified

  1. GC

Mark if applicable

  • This PR introduces API changes
  • This PR introduces serialization changes

@kei-nan kei-nan force-pushed the master_jk_report_gc_fork_cow branch from 124543f to 99c47ca Compare January 13, 2025 15:43
Copy link
Collaborator

@raz-mon raz-mon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice
Can we see some change in the INFO response? Somewhere?
Would be nice to add a test accordingly.

@kei-nan kei-nan requested review from DvirDukhan and GuyAv46 January 14, 2025 14:59
@codecov
Copy link

codecov bot commented Jan 14, 2025

Codecov Report

Attention: Patch coverage is 0% with 17 lines in your changes missing coverage. Please review.

Project coverage is 87.18%. Comparing base (decd4fe) to head (3c18c01).
Report is 5 commits behind head on master.

Files with missing lines Patch % Lines
src/fork_gc.c 0.00% 17 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5503      +/-   ##
==========================================
+ Coverage   87.14%   87.18%   +0.03%     
==========================================
  Files         196      196              
  Lines       35061    35110      +49     
==========================================
+ Hits        30554    30610      +56     
+ Misses       4507     4500       -7     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@kei-nan kei-nan requested a review from GuyAv46 January 14, 2025 15:33
@kei-nan kei-nan added this pull request to the merge queue Jan 14, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 14, 2025
@DvirDukhan DvirDukhan added this pull request to the merge queue Jan 15, 2025
Merged via the queue into master with commit 0a5aae0 Jan 15, 2025
8 of 9 checks passed
@DvirDukhan DvirDukhan deleted the master_jk_report_gc_fork_cow branch January 15, 2025 07:43
@redisearch-backport-pull-request
Copy link
Contributor

Backport failed for 2.8, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.8
git worktree add -d .worktree/backport-5503-to-2.8 origin/2.8
cd .worktree/backport-5503-to-2.8
git switch --create backport-5503-to-2.8
git cherry-pick -x 0a5aae0361343ccc533bb56f973559b37854a501

@redisearch-backport-pull-request
Copy link
Contributor

Backport failed for 2.6, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.6
git worktree add -d .worktree/backport-5503-to-2.6 origin/2.6
cd .worktree/backport-5503-to-2.6
git switch --create backport-5503-to-2.6
git cherry-pick -x 0a5aae0361343ccc533bb56f973559b37854a501

@redisearch-backport-pull-request
Copy link
Contributor

Backport failed for 2.10, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.10
git worktree add -d .worktree/backport-5503-to-2.10 origin/2.10
cd .worktree/backport-5503-to-2.10
git switch --create backport-5503-to-2.10
git cherry-pick -x 0a5aae0361343ccc533bb56f973559b37854a501

@redisearch-backport-pull-request
Copy link
Contributor

Successfully created backport PR for 8.0:

redisearch-backport-pull-request bot pushed a commit that referenced this pull request Jan 15, 2025
* * Send gc heartbeats to track copy on write behaviour

* * send heartbeats more frequently to provide a more correct status to the parent process
* add a mock function so tests would pass.

* * add comment for the progress field

(cherry picked from commit 0a5aae0)
github-merge-queue bot pushed a commit that referenced this pull request Jan 20, 2025
…5510)

MOD-7069: Send GC heartbeats to track copy on write behaviour (#5503)

* * Send gc heartbeats to track copy on write behaviour

* * send heartbeats more frequently to provide a more correct status to the parent process
* add a mock function so tests would pass.

* * add comment for the progress field

(cherry picked from commit 0a5aae0)

Co-authored-by: kei-nan <[email protected]>
@GuyAv46 GuyAv46 mentioned this pull request Nov 20, 2025
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants