Skip to content

feat(plugin): add request-scoped chat.model hook - #30457

Closed
JGuck wants to merge 4 commits into
anomalyco:devfrom
JGuck:feature/implementChatModel
Closed

JGuck wants to merge 4 commits into
anomalyco:devfrom
JGuck:feature/implementChatModel

Conversation

@JGuck

@JGuck JGuck commented Jun 2, 2026 •

Copy link
Copy Markdown

Issue for this PR

Closes:

Addresses / partially addresses:

Type of change

  • Bug fix
  • New feature
  • Refactor / code improvement
  • Documentation

What does this PR do?

This adds a request-scoped chat.model plugin hook that runs before provider/model/auth resolution. A plugin can use it to replace the selected { providerID, modelID } for the current LLM request.

The selected session model is not mutated. Later request hooks, including chat.params and chat.headers, receive the routed model. If a plugin routes to an unknown model, the existing provider lookup fails before sending the LLM request.

The hook also receives the current user message { id, text }, so routing plugins can make a simple decision from the prompt without requiring full conversation history.

This intentionally does not update the model picker, persist routed models across turns, or change subagent inheritance behavior.

How did you verify your code works?

  • bun typecheck in packages/plugin
  • bun typecheck in packages/opencode
  • bun test test\session\llm.test.ts --timeout 30000 in packages/opencode

Screenshots / recordings

Not a UI change.

Checklist

  • I have tested my changes locally
  • I have not included unrelated changes in this PR

JGuck added 3 commits June 2, 2026 20:42
Introduce a plugin-based model routing step (plugin trigger "chat.model") that can override the target provider/model for LLM streams. Import ProviderV2 and resolve the routed model and corresponding user.model, then use that model throughout logging, provider/auth lookups, runtime selection, providerOptions, and message transforms. Emit routedFrom/reason metadata when routing occurs. Also add helpers (currentUserMessageText, partText) to extract the current user's message text for routing.
Expose a new "chat.model" plugin hook in the plugin interface to allow routing of the model used for an LLM request (returns an optional routed model and reason). Add tests in packages/opencode/test/session/llm.test.ts that cover routing behavior: preserving the original model when no route, failing when routed to an unknown model, passing routed model to chat.headers and chat.params, and an end-to-end routing plugin file written to disk (routing-plugin.ts + opencode.json). Also add test helpers (pluginLayer, llmLayerWithPlugin), import pathToFileURL, and wire up request/response assertions for the routed model and modified params/headers.
@github-actions

github-actions Bot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

Automated PR Cleanup

Thank you for contributing to opencode.

Due to the high volume of PRs from users and AI agents, we periodically close older PRs using automated criteria so maintainers can focus review time on the most active and community-supported contributions.

This PR was closed because it matched the following cleanup criteria:

  • The PR was created more than 1 month ago
  • The PR had fewer than 2 positive reactions
  • Positive reactions are counted as thumbs-up, heart, celebration, or rocket reactions on the PR

PRs created within the last month are not affected by this cleanup.

If you believe this PR was closed incorrectly, or if you are still actively working on it, please leave a comment explaining why it should be reopened. A maintainer can review and reopen it if appropriate.

Thanks again for taking the time to contribute.

@lexasub

lexasub commented Jul 25, 2026

Copy link
Copy Markdown

@JGuck , do you have another pr?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants