Skip to content

Conversation

@jt2594838
Copy link
Contributor

@jt2594838 jt2594838 commented Aug 13, 2025

When a request fails to allocate memory for entering the queue of the first follower, its reference count is not decreased.
Thus, when entering the queues of other followers, its memory allocation is also omitted, resulting in uncontrolled memory of the IoTConsensus request queue and OOM.

@sonarqubecloud
Copy link

@codecov
Copy link

codecov bot commented Aug 13, 2025

Codecov Report

❌ Patch coverage is 41.42857% with 41 lines in your changes missing coverage. Please review.
✅ Project coverage is 38.95%. Comparing base (edba62b) to head (b97405c).
⚠️ Report is 16 commits behind head on master.

Files with missing lines Patch % Lines
...s/iot/logdispatcher/IoTConsensusMemoryManager.java 38.88% 33 Missing ⚠️
.../iotdb/consensus/iot/logdispatcher/SyncStatus.java 50.00% 5 Missing ⚠️
...tdb/consensus/iot/logdispatcher/LogDispatcher.java 50.00% 3 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #16169      +/-   ##
============================================
+ Coverage     38.93%   38.95%   +0.01%     
  Complexity      198      198              
============================================
  Files          4876     4880       +4     
  Lines        318621   318795     +174     
  Branches      40216    40241      +25     
============================================
+ Hits         124065   124177     +112     
- Misses       194556   194618      +62     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jt2594838 jt2594838 merged commit a0f31fe into master Aug 14, 2025
38 of 42 checks passed
@jt2594838 jt2594838 deleted the fix_iot_memory_2 branch August 14, 2025 09:57
jt2594838 added a commit that referenced this pull request Nov 26, 2025
…lure (#16169)

* fix IoTConsensus memory management

* Fix ref count of IoTConsensus request not decreased in allocation failure

* fix log level
jt2594838 added a commit that referenced this pull request Nov 27, 2025
…6812)

* more accurate mermory size (#15713)

* Fix stuck when stopping a DataNode with large unremovable WAL files (#15727)

* Fix stuck when stopping a DataNode with large unremovable WAL files

* spotless

* add shutdown hook watcher

* Fix logDispatcher stuck

* add re-interrupt

* Add a multiplier to avoid receiver OOM in IoTConsensus (#16102)

* Fix negative iot queue size & missing search index for deletion & missed request when performing empty table deleting (#16022)

* Fix double memory free of iotconsensus queue request during region deletion

* Fix missing searchIndex and lost deletion when no TsFile is involved.

* Fix ref count of IoTConsensus request not decreased in allocation failure (#16169)

* fix IoTConsensus memory management

* Fix ref count of IoTConsensus request not decreased in allocation failure

* fix log level

* remove irrelevant codes from 2.0

* Remove a table test

* Interrupt wal-delete thread when WALManager is closed (#15442)

---------

Co-authored-by: Xiangpeng Hu <[email protected]>
JackieTien97 pushed a commit that referenced this pull request Dec 16, 2025
…lure (#16169)

* fix IoTConsensus memory management

* Fix ref count of IoTConsensus request not decreased in allocation failure

* fix log level

(cherry picked from commit a0f31fe)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants