Skip to content

Convert streaming api to the TSDB#2647

Merged
jmthomas merged 15 commits intorelease/v7.0.0from
streaming_api
Jan 13, 2026
Merged

Convert streaming api to the TSDB#2647
jmthomas merged 15 commits intorelease/v7.0.0from
streaming_api

Conversation

@jmthomas
Copy link
Copy Markdown
Member

@jmthomas jmthomas commented Dec 17, 2025

No description provided.

@jmthomas jmthomas requested a review from ryanmelt December 17, 2025 16:28
@codecov
Copy link
Copy Markdown

codecov bot commented Dec 17, 2025

Codecov Report

❌ Patch coverage is 80.32787% with 48 lines in your changes missing coverage. Please review.
✅ Project coverage is 78.30%. Comparing base (ed681fd) to head (7ebd069).
⚠️ Report is 66 commits behind head on release/v7.0.0.

Files with missing lines Patch % Lines
...-cmd-tlm-api/app/models/logged_streaming_thread.rb 79.66% 48 Missing ⚠️
Additional details and impacted files
@@                Coverage Diff                 @@
##           release/v7.0.0    #2647      +/-   ##
==================================================
- Coverage           78.33%   78.30%   -0.03%     
==================================================
  Files                 473      473              
  Lines               34179    34393     +214     
  Branches              736      736              
==================================================
+ Hits                26774    26933     +159     
- Misses               7325     7380      +55     
  Partials               80       80              
Flag Coverage Δ
python 96.03% <ø> (ø)
ruby-api 84.14% <79.74%> (-0.60%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link
Copy Markdown
Member

@ryanmelt ryanmelt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You deleted log file playback which is still necessary for raw buffer playback.

Copy link
Copy Markdown
Member

@ryanmelt ryanmelt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Streaming whole decom packets should still use the TSDB, not the files which will no longer exist.

Also does the TSDB ever need to switch to Redis mode?

jmthomas and others added 2 commits January 12, 2026 16:25
Split packet streaming by mode: DECOM packets now query QuestDB (TSDB)
for historical data while RAW packets continue streaming from binary
log files. This change reflects that decom log files will no longer
exist, but raw packet files remain.

Changes:
- Refactor stream_packets() to route by stream_mode
- Add stream_decom_packets_from_tsdb() to query QuestDB for all packet
  columns and map values based on value_type (RAW/CONVERTED/FORMATTED)
- Rename original file-based streaming to stream_raw_packets_from_files()
- Add build_packet_entry() to convert TSDB rows to packet format
- Update tests to mock PG::Connection for DECOM packet streaming

Co-Authored-By: Claude Opus 4.5 <[email protected]>
@jmthomas jmthomas merged commit 3a5d34f into release/v7.0.0 Jan 13, 2026
43 of 47 checks passed
@jmthomas jmthomas deleted the streaming_api branch January 13, 2026 02:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants