Skip to content

fix(logs): use channel-based aggregator#879

Merged
shreyamalpani merged 12 commits into
mainfrom
shreya.malpani/remove-lock-on-logs
Oct 1, 2025
Merged

fix(logs): use channel-based aggregator#879
shreyamalpani merged 12 commits into
mainfrom
shreya.malpani/remove-lock-on-logs

Conversation

@shreyamalpani

@shreyamalpani shreyamalpani commented Sep 30, 2025

Copy link
Copy Markdown
Contributor

Use a channel-based aggregator for logs to avoid locking on aggregation. Adds an aggregator service which receives incoming commands on a channel. Commands can be flush requests, inserts, or shutdowns.

Follows a similar pattern as DataDog/serverless-components#32

Tested that dual shipping still works as well.

SVLS-7646

@shreyamalpani
shreyamalpani marked this pull request as ready for review October 1, 2025 15:03
@shreyamalpani
shreyamalpani requested a review from a team as a code owner October 1, 2025 15:03
Comment thread bottlecap/src/bin/bottlecap/main.rs Outdated
Comment thread bottlecap/src/logs/aggregator_service.rs Outdated

@duncanista duncanista left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM – left some comments, and we also talked about some other improvements which I expect to be there before merging, so this can unblock you :shipit:

@shreyamalpani
shreyamalpani merged commit 924bb09 into main Oct 1, 2025
46 checks passed
@shreyamalpani
shreyamalpani deleted the shreya.malpani/remove-lock-on-logs branch October 1, 2025 19:25
shreyamalpani added a commit that referenced this pull request Oct 28, 2025
Use a channel-based aggregator for traces to avoid locking on
aggregation. Adds an aggregator service which receives incoming commands
on a channel. Commands can be to insert payloads, get batches, and
shutdown.

Follows a similar pattern as #879. Tested with self-monitoring and
tested that dual shipping still works as well.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants