Skip to content

fix(session): remove unused LLM call for message title generation - #10751

Closed
felipemadero wants to merge 1 commit into
anomalyco:devfrom
felipemadero:fix/remove-unused-summary-title
Closed

felipemadero wants to merge 1 commit into
anomalyco:devfrom
felipemadero:fix/remove-unused-summary-title

Conversation

@felipemadero

Copy link
Copy Markdown

Fixes #10749

Removes the LLM call in summarizeMessage that generated summary.title, which was never displayed.

Tested by verifying typecheck passes and tracing the code to confirm summary.title has no consumers.

@github-actions

Copy link
Copy Markdown
Contributor

The following comment was made by an LLM, it may be inaccurate:

No duplicate PRs found

The `summarizeMessage` function was making an LLM call to generate
a `summary.title` for each user message, but this title was never
displayed anywhere in the UI. The only consumer (MessageNav component)
always uses a `getLabel` prop that overrides the title fallback.

This removes one unnecessary LLM call per user message, which is
especially impactful for local models where inference is slow.

The schema fields (title, body) are left unchanged for backwards
compatibility with existing session data.
@github-actions

Copy link
Copy Markdown
Contributor

Closing this pull request because it has had no updates for more than 60 days. If you plan to continue working on it, feel free to reopen or open a new PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Unnecessary LLM call for unused message summary title

1 participant