feat(telemetry): add PostHog exception tracking for consecutive mistake errors #10193
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ke errors Add structured exception tracking via PostHog for 'Roo is having trouble' events: - Add ConsecutiveMistakeError class with reason field (no_tools_used, tool_repetition, unknown) - Add type guard isConsecutiveMistakeError() and property extractor - Update PostHogTelemetryClient.captureException() to auto-extract properties - Track consecutive mistake limit reached in Task.ts with 'no_tools_used' reason - Track tool repetition limit in presentAssistantMessage.ts with 'tool_repetition' reason - Add comprehensive tests (69 tests pass)
dosubot
bot
added
the
size:L
Contributor
Review completed. No new issues found. The changes add Mention @roomote in a comment to request specific changes to this pull request or fix all unresolved issues. |
![roomote[bot]](https://avatars.githubusercontent.com/in/1546624?s=60&v=4){kind=small}
hannesrudolph
added
the
Issue/PR - Triage
mrubens
reviewed
Dec 18, 2025
- Add ConsecutiveMistakeError class with provider and modelId tracking - Add type guard and property extraction for ConsecutiveMistakeError - Update PostHogTelemetryClient to handle ConsecutiveMistakeError - Track 'Roo is having trouble' events via captureException in Task.ts and presentAssistantMessage.ts - Include both telemetry event (captureConsecutiveMistakeError) and exception tracking - Add comprehensive tests for new error tracking functionality
cte
approved these changes
Dec 18, 2025
github-project-automation
bot
moved this from PR [Needs Review]
to Done
in Roo Code Roadmap
Merged
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Add structured exception tracking via PostHog for 'Roo is having trouble' events (consecutive mistake limit reached).
Changes
New Types (
packages/types/src/telemetry.ts)ConsecutiveMistakeReasontype:"no_tools_used" | "tool_repetition" | "unknown"ConsecutiveMistakeErrorclass with properties:taskId,consecutiveMistakeCount,consecutiveMistakeLimit,reasonisConsecutiveMistakeError()type guardextractConsecutiveMistakeErrorProperties()property extractorPostHog Integration (
packages/telemetry/src/PostHogTelemetryClient.ts)captureException()to detectConsecutiveMistakeErrorand auto-extract propertiesTracking Points
no_tools_used)tool_repetition)PostHog Event Data
When a consecutive mistake event fires, PostHog receives:
taskIdconsecutiveMistakeCountconsecutiveMistakeLimitreasonmessageappVersion,apiProvider,modelId, etc.Testing
Important
Introduces
ConsecutiveMistakeErrorfor tracking consecutive mistake errors via PostHog, with updates to telemetry handling and comprehensive tests.ConsecutiveMistakeErrorclass intelemetry.tsfor tracking consecutive mistake errors.captureException()inPostHogTelemetryClient.tsto handleConsecutiveMistakeError.Task.tswhen no tools are used and inpresentAssistantMessage.tsfor tool repetition.ConsecutiveMistakeReasontype andisConsecutiveMistakeError()type guard intelemetry.ts.extractConsecutiveMistakeErrorProperties()intelemetry.ts.ConsecutiveMistakeErrorand related utilities intelemetry.test.ts.This description was created by
for 2ab2df5. You can customize this summary. It will automatically update as commits are pushed.