Skip to content

[2.10] [MOD-12694] [MOD-12069] Add active_coord_threads metric#7723

Merged
meiravgri merged 4 commits into2.10from
backport-7546-to-2.10
Dec 10, 2025
Merged

[2.10] [MOD-12694] [MOD-12069] Add active_coord_threads metric#7723
meiravgri merged 4 commits into2.10from
backport-7546-to-2.10

Conversation

@meiravgri
Copy link
Collaborator

@meiravgri meiravgri commented Dec 10, 2025

backport #7546 to 2.10


Note

Adds active_coord_threads to multi-threading stats, sourced from the coordinator thread pool and exposed in INFO MODULES.

  • Stats/Info:
    • Add active_coord_threads to MultiThreadingStats and populate it in GlobalStats_GetMultiThreadingStats() via ConcurrentSearchPool_WorkingThreadCount() (under RS_COORDINATOR).
    • Expose active_coord_threads in the multi_threading section of INFO MODULES.
  • Coordinator:
    • Implement ConcurrentSearchPool_WorkingThreadCount() in concurrent_ctx.c and declare it in concurrent_ctx.h (with C++ guards).
  • Tests:
    • C test coord/src/rmr/test/test_io_runtime_ctx.c: initialize/destroy ConcurrentSearch pool for metrics access.
    • Python tests/pytests/test_info_modules.py: assert active_coord_threads is 0 when idle and, in cluster FT.AGGREGATE, equals the number of paused queries; minor wording updates.

Written by Cursor Bugbot for commit 44097c7. This will update automatically on new commits. Configure here.

* Add multi-threading statistics tracking for active I/O threads

* fix comment

* add cpp test

* fix spelling

* address comment

* remove unnecessary nre line

* add "active_worker_threads" metric

* fix comment
imp tests

* test cleanups

* add test comne about the num queries and cleanups

* fix declartion

* remove coord threads

* add active_coord_threads

expose ConcurrentSearchPool_WorkingThreadCount

* make the tests run...

* add "active_worker_threads" metric

* fix declartion

* remove coord threads

* make the tests run...

* introduce workersThreadPool_isInitialized
assert is initizlied in GlobalStats_GetMultiThreadingStats

* cleanup

* rename workersThreadPool_isCreated

* introduce ConcurrentSearchPool_IsCreated

* fix test

* we dont need workers

* remove ConcurrentSearchPool_IsCreated and workersThreadPool_isInitialized

* fix merge

(cherry picked from commit b0fc4ea)
@meiravgri meiravgri changed the title [MOD-12694] [MOD-12069] Add active_coord_threads metric (#7546) [2.10] [MOD-12694] [MOD-12069] Add active_coord_threads metric Dec 10, 2025
@meiravgri meiravgri enabled auto-merge December 10, 2025 12:16
@codecov
Copy link

codecov bot commented Dec 10, 2025

Codecov Report

❌ Patch coverage is 85.71429% with 1 line in your changes missing coverage. Please review.
✅ Project coverage is 89.42%. Comparing base (e7312a8) to head (44097c7).
⚠️ Report is 3 commits behind head on 2.10.

Files with missing lines Patch % Lines
src/concurrent_ctx.c 80.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             2.10    #7723      +/-   ##
==========================================
- Coverage   89.44%   89.42%   -0.03%     
==========================================
  Files         210      210              
  Lines       36027    36034       +7     
==========================================
- Hits        32226    32225       -1     
- Misses       3801     3809       +8     
Flag Coverage Δ
flow 84.07% <85.71%> (-0.15%) ⬇️
unit 42.15% <71.42%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@meiravgri meiravgri added this pull request to the merge queue Dec 10, 2025
Merged via the queue into 2.10 with commit 38541f9 Dec 10, 2025
17 checks passed
@meiravgri meiravgri deleted the backport-7546-to-2.10 branch December 10, 2025 13:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants