Skip to content

Can't get custom small_model to work for title generation #2640

Closed

Description

@hd-o

I can't get title generation working with any small_model, only without (using default claude-3.5-haiku). Help, please 🙏

Logs

https://gist.github.com/hd-o/b066b3358213107ed81b14d91b00e02c

Config

{
  "$schema": "https://opencode.ai/config.json",
  "model": "openrouter/openai/gpt-5-nano",
  "small_model": "openrouter/openai/gpt-5-nano"
}

Screenshot

Image

Activity

  1. github-actions commented on Sep 16, 2025

    @github-actions
    Contributor

    This issue might be a duplicate of existing issues. Please check:

    Feel free to ignore if none of these address your specific case.

  2. rekram1-node commented on Sep 16, 2025

    @rekram1-node
    Collaborator

    I will take a look

  3. self-assigned this
    on Sep 16, 2025
  4. rekram1-node commented on Sep 17, 2025

    @rekram1-node
    Collaborator

    You can get around this temporarily by using a non reasoning openai model, I will adjust the title gen logic to set reasoningEffort to low even for all gpt-5 models when generating titles

  5. rekram1-node commented on Sep 17, 2025

    @rekram1-node
    Collaborator

    in next release we will set reasoning effort to minimal for all gpt-5 model variations when generating title and that should resolve issue for you

  6. listenerri commented on Mar 18, 2026

    @listenerri

    @rekram1-node

    The small_model configuration still does not work for the title generation.

    opencode v1.2.27

    Are title generation and the main conversation concurrent requests?

    Originally, I set model and small_model as two local models. However, due to the VRAM limitation, only one model could be run at a time. When I changed small_model to another model, the title generation function worked well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions