Skip to content

[2.10] Backport OOM indexing to all branches [MOD-9715] #6262

Merged
lerman25 merged 20 commits into2.10from
backport-oom-indexing-to-2.10
Jun 10, 2025
Merged

[2.10] Backport OOM indexing to all branches [MOD-9715] #6262
lerman25 merged 20 commits into2.10from
backport-oom-indexing-to-2.10

Conversation

@lerman25
Copy link
Collaborator

@lerman25 lerman25 commented Jun 5, 2025

This PR backports all OOM indexing PRs to 2.10.
#5672, #5778, #5941, #6053, #6114, #6140, #6203, #6276

lerman25 added 2 commits May 27, 2025 18:52
* Create dbg ctx and dbgIndScan

* Fix

* fixing mechanism and pytest

* Add pause before scan mechanism and pytest

* Revert "Add pause before scan mechanism and pytest"

This reverts commit b842ce9.

* Re-adding 'Add pause before scan mechanism and pytest'

* fix testDebugHelp

* fixing Guy's comment + skipping on cluster in pytest

* Move volatile pause to BG scanner,  move debug scanner flag to base IndexesScanner

* fix pytest

* thread safety

* Cover more code

* pause before scan coverage

* fix - can't create a flow to reach    'Debug mode enabled but scanner is not a debug scanner' error

* fixing Alon's comment

* wrong arity check and comment on not used function

* format
@lerman25 lerman25 added enforce:coverage Run coverage flow even on draft pull request enforce:sanitize Run sanitizer flow even on draft pull request labels Jun 5, 2025
@codecov
Copy link

codecov bot commented Jun 7, 2025

Codecov Report

Attention: Patch coverage is 98.06452% with 6 lines in your changes missing coverage. Please review.

Project coverage is 86.57%. Comparing base (edd03d1) to head (86642ae).
Report is 5 commits behind head on 2.10.

Files with missing lines Patch % Lines
src/debug_commands.c 96.74% 4 Missing ⚠️
src/spec.c 98.31% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             2.10    #6262      +/-   ##
==========================================
+ Coverage   86.50%   86.57%   +0.06%     
==========================================
  Files         204      204              
  Lines       34691    34981     +290     
==========================================
+ Hits        30011    30285     +274     
- Misses       4680     4696      +16     
Flag Coverage Δ
flow 81.94% <97.74%> (-0.04%) ⬇️
unit 39.64% <0.96%> (-0.32%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@lerman25 lerman25 marked this pull request as ready for review June 8, 2025 10:46
@lerman25 lerman25 changed the title Backport oom indexing to 2.10 [2.10] Backport OOM indexing to all branches [MOD-9715] Jun 8, 2025
@lerman25 lerman25 requested a review from alonre24 June 8, 2025 11:59
Copy link
Collaborator

@alonre24 alonre24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💪

// Indexing Errors
size_t indexing_failures; // Total count of indexing errors
size_t max_indexing_failures; // Maximum number of indexing errors among all specs
size_t background_indexing_failures_OOM; // Total count of background indexing errors due to OOM
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's close this circle and add this metric to the Grafana dashboard - @meiravgri can help you with that

@lerman25 lerman25 added this pull request to the merge queue Jun 10, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jun 10, 2025
@lerman25 lerman25 added this pull request to the merge queue Jun 10, 2025
Merged via the queue into 2.10 with commit 88f146d Jun 10, 2025
9 checks passed
@lerman25 lerman25 deleted the backport-oom-indexing-to-2.10 branch June 10, 2025 11:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enforce:coverage Run coverage flow even on draft pull request enforce:sanitize Run sanitizer flow even on draft pull request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants