Skip to content

Test: text-to-speech in Chat #213355

@bpasero

Description

@bpasero

Refs #196261

Complexity: 4

Create Issue


Setup:

  • latest pre-release version of GitHub Copilot Chat
  • latest pre-release version of VS Code Speech

Testing:

  • test in various locations that offer Copilot chat including panel chat, quick open chat, inline chat, terminal chat
  • from a chat response verify you can click on the 🔈 icon and get the response read out aloud in english
  • click the animated pulse icon in the chat input or the 🔈 icon again to stop playback anytime
  • use the 🎤 action to use voice for a chat request and verify the response is read out aloud automatically while streaming in
  • verify that automated reading does not occur when you configure accessibility.voice.autoSynthesize: false
  • change accessibility.voice.speechLanguage to a language of choice, have a response of that language and verify its being read out aloud properly in that language (you are getting asked to install a language extension if needed)
  • play around with various responses (with / without code, references, etc.) and ensure the synthesis is making sense to you [1]

[1] Note: synthesis may jump over certain parts of the output, for example file references are not read out and source code is not treated any specially and may skip over some characters. We want to explore using Speech Markup Language for this in the future but are a bit limited in what the local model allows to do.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions