Skip to content

[Refactor] remove the internal talk_to_user tool #97

Open

Description

@sonleoracle

Back when not all LLMs support native tool calling, we use this tool as the in-context learning way to make the LLM generate more consistent tool calls. Modern LLMs, even local ones such as GPT-OSS, have been mid-trained and post-trained to generate accurate tool calls in conjunction with generating free-form text replies to the user (in addition to reasoning content), so the talk_to_user tool would actually goes against its original purpose by confusing the models.

Let's remove the internal talk_to_user tool.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions