Skip to content

AssemblyAI Dictation as a cloud transcription option #1697

Open

Description

@dan-ince-aai

What are you trying to do?

Get text that's ready to send from a cloud model in one step. Today the cloud option (ElevenLabs) returns the words as spoken, filler and self-corrections included.

What would help?

AssemblyAI's Dictation API as a cloud option:

  • One request: POST https://dictation.assemblyai.com/v1/transcribe with the recording as a multipart audio part (WAV, raw PCM, MP3, M4A, Ogg/Opus, FLAC, WebM; 80 ms to 20 minutes) and an Authorization: <api key> header. Raw PCM needs sample_rate and channels in the config.
  • The response has text (verbatim) and llm_response (filler words removed, punctuation, capitalization and self-corrections fixed). Use llm_response, falling back to text when it's empty.
  • An optional JSON config part takes keyterms_prompt (names and jargon to spell right) and language_codes. It covers 32 languages.
  • It isn't OpenAI-compatible, so it needs its own small request rather than the OpenAI-compatible path.

Disclosure: I work at AssemblyAI. If you have questions or want a hand with anything on our side, comment here or reach me on X at @dan_aai.

Activity

  1. thdxr commented on Nov 11, 2026

    @thdxr
    Member

    hex doesn't have a cloud transcription option right now. everything is transcribed on your device, and once the speech model is downloaded your audio never leaves the machine.

    for cleaned-up, ready-to-send text today, a mode with rewriting turned on does that: it transcribes locally, then rewrites the result to drop filler words and fix self-corrections before it's pasted.

    sending audio to a cloud service at all is a bigger call we haven't made yet, so it's the same decision as #765 and #603.

    • would you want cloud as an opt-in per mode, or a global switch?
    • is the main draw the cleanup, or accuracy on names and jargon?

    — from 𝕺𝖕𝖊𝖓𝕮𝖔𝖉𝖊

  2. added
    needs-designNeeds a closer look or a product decision before we build it
    on Nov 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-designNeeds a closer look or a product decision before we build it

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions