1b763a5524aca2d7ecf1eea38f845ad1ffed5c1b37e85e62f6a7902a3ee0f920 config-baseline.plugin.json

realtime: {

provider: "openai",

model: "gpt-realtime-2",

},

},

},

Notes:

- `voice.mode` controls the conversation path. The default is `agent-proxy`: a realtime voice front end handles turn timing, interruption, and playback, delegates substantive work to the routed OpenClaw agent through `openclaw_agent_consult`, and treats the result like a typed Discord prompt from that speaker. `stt-tts` keeps the older batch STT plus TTS flow. `bidi` lets the realtime model converse directly while exposing `openclaw_agent_consult` for the OpenClaw brain.

- `voice.agentSession` controls which OpenClaw conversation receives voice turns. Leave it unset for the voice channel's own session, or set `{ mode: "target", target: "channel:<text-channel-id>" }` to make the voice channel act as the microphone/speaker extension of an existing Discord text channel session such as `#maintainers`.

- `voice.model` overrides the OpenClaw agent brain for Discord voice responses and realtime consults. Leave it unset to inherit the routed agent model. It is separate from `voice.realtime.model`.

- `voice.followUsers` lets the bot join, move, and leave Discord voice with selected users. See [Follow users in voice](#follow-users-in-voice) for behavior rules and examples.

- `agent-proxy` routes speech through `discord-voice`, which preserves normal owner/tool authorization for the speaker and target session but hides the agent `tts` tool because Discord voice owns playback. By default, `agent-proxy` gives the consult full owner-equivalent tool access for owner speakers (`voice.realtime.toolPolicy: "owner"`) and strongly prefers consulting the OpenClaw agent before substantive answers (`voice.realtime.consultPolicy: "always"`). In that default `always` mode, the realtime layer does not auto-speak filler before the consult answer; it captures and transcribes speech, then speaks the routed OpenClaw answer. If multiple forced consult answers finish while Discord is still playing the first answer, later exact-speech answers are queued until playback idles instead of replacing speech mid-sentence.

- In `stt-tts` mode, STT uses `tools.media.audio`; `voice.model` does not affect transcription.

- Realtime voice modes include small `IDENTITY.md`, `USER.md`, and `SOUL.md` profile files in the realtime provider instructions by default so fast direct turns keep the same identity, user grounding, and persona as the routed OpenClaw agent. Set `voice.realtime.bootstrapContextFiles` to a subset to customize this, or `[]` to disable it. The supported realtime bootstrap files are limited to those profile files; `AGENTS.md` stays in the normal agent context. The injected profile context does not replace `openclaw_agent_consult` for workspace work, current facts, memory lookup, or tool-backed actions.

- In OpenAI `agent-proxy` realtime mode, set `voice.realtime.requireWakeName: true` to keep Discord realtime voice silent until a transcript starts or ends with a wake name. Configured wake names must be one or two words. If `voice.realtime.wakeNames` is unset, OpenClaw uses the routed agent `name` plus `OpenClaw`, falling back to the agent id plus `OpenClaw`. Wake-name gating disables realtime provider auto-response, routes accepted turns through the OpenClaw agent consult path, and gives a short spoken acknowledgement when a leading wake name is recognized from partial transcription before the final transcript arrives.

- The OpenAI realtime provider accepts current Realtime 2 event names and legacy Codex-compatible aliases for output audio and transcript events, so compatible provider snapshots can drift without dropping assistant audio.

- `voice.realtime.bargeIn` controls whether Discord speaker-start events interrupt active realtime playback. If unset, it follows the realtime provider's input-audio interruption setting.

- `voice.realtime.minBargeInAudioEndMs` controls the minimum assistant playback duration before an OpenAI realtime barge-in truncates audio. Default: `250`. Set `0` for immediate interruption in low-echo rooms, or raise it for echo-heavy speaker setups.

- Per-channel Discord `systemPrompt` overrides apply to voice transcript turns for that voice channel.

- Voice transcript turns derive owner status from Discord `allowFrom` (or `dm.allowFrom`) for owner-gated commands and channel actions. Agent tool visibility follows the configured tool policy for the routed session.

- Discord voice is opt-in for text-only configs; set `channels.discord.voice.enabled=true` (or keep an existing `channels.discord.voice` block) to enable `/vc` commands, the voice runtime, and the `GuildVoiceStates` gateway intent.

realtime: {

provider: "openai",

model: "gpt-realtime-2",

},

},

},

model: "openai/gpt-5.4-mini",

tts: {

provider: "openai",

},

},

},

realtime: {

provider: "openai",

model: "gpt-realtime-2",

toolPolicy: "safe-read-only",

consultPolicy: "always",

},

realtime: {

provider: "openai",

model: "gpt-realtime-2",

},

},

},

realtime: {

provider: "openai",

model: "gpt-realtime-2",

bargeIn: true,

minBargeInAudioEndMs: 500,

consultPolicy: "always",

params: { cacheRetention: "none" }, // overrides matching defaults.models params by key

tts: {

providers: {

},

},

skills: ["docs-search"], // replaces agents.defaults.skills when set

elevenlabs: {

apiKey: "elevenlabs_api_key",

baseUrl: "https://api.elevenlabs.io",

modelId: "eleven_multilingual_v2",

seed: 42,

applyTextNormalization: "auto",

},

},

microsoft: {

lang: "en-US",

outputFormat: "audio-24khz-48kbitrate-mono-mp3",

},

openai: {

apiKey: "openai_api_key",

baseUrl: "https://api.openai.com/v1",

model: "gpt-4o-mini-tts",

},

},

},

provider: "elevenlabs",

providers: {

elevenlabs: {

voiceAliases: {

Clawd: "EXAVITQu4vr4xnSDxMaL",

Roger: "CwhRBWXzGAHq8TQ4Fs17",

providers: {

openai: {

model: "gpt-realtime-2",

},

},

instructions: "Speak warmly and keep answers brief.",

- `routing.transcribeAudio` → `tools.media.audio.models`

- `messages.tts.<provider>` (`openai`/`elevenlabs`/`microsoft`/`edge`) → `messages.tts.providers.<provider>`

- `messages.tts.provider: "edge"` and `messages.tts.providers.edge` → `messages.tts.provider: "microsoft"` and `messages.tts.providers.microsoft`

- `channels.discord.voice.tts.<provider>` (`openai`/`elevenlabs`/`microsoft`/`edge`) → `channels.discord.voice.tts.providers.<provider>`

- `channels.discord.accounts.<id>.voice.tts.<provider>` (`openai`/`elevenlabs`/`microsoft`/`edge`) → `channels.discord.accounts.<id>.voice.tts.providers.<provider>`

- `plugins.entries.voice-call.config.tts.<provider>` (`openai`/`elevenlabs`/`microsoft`/`edge`) → `plugins.entries.voice-call.config.tts.providers.<provider>`

introMessage: "Say exactly: I'm here.",

providers: {

google: {

},

},

},

providers: {

elevenlabs: {

modelId: "eleven_v3",

},

},

},

The persistent Meet voice comes from

overrides are enabled, but config is the deterministic default for meetings.

On join, the logs should show `transcriptionProvider=elevenlabs` and each

Twilio-only config:

responseSystemPrompt: "You are a concise baseball card specialist.",

tts: {

providers: {

},

},

},

google: {

apiKey: "${GEMINI_API_KEY}",

model: "gemini-2.5-flash-native-audio-preview-12-2025",

silenceDurationMs: 500,

startSensitivity: "high",

},

provider: "elevenlabs",

providers: {

elevenlabs: {

modelId: "eleven_multilingual_v2",

},

},

tts: {

provider: "openai",

providers: {

},

},

},

providers: {

elevenlabs: {

apiKey: "elevenlabs_key",

modelId: "eleven_multilingual_v2",

},

},

providers: {

openai: {

model: "gpt-4o-mini-tts",

},

},

},

tts: {

provider: "openai",

providers: {

},

},

numbers: {

responseSystemPrompt: "You are a concise baseball card specialist.",

tts: {

providers: {

},

},

},

provider: "azure-speech",

providers: {

"azure-speech": {

lang: "en-US",

},

},

| `region` | `messages.tts.providers.azure-speech.region` | Azure Speech resource region. Falls back to `AZURE_SPEECH_REGION` or `SPEECH_REGION`. |

| `endpoint` | `messages.tts.providers.azure-speech.endpoint` | Optional Azure Speech endpoint/base URL override. |

| `baseUrl` | `messages.tts.providers.azure-speech.baseUrl` | Optional Azure Speech base URL override. |

| `lang` | `messages.tts.providers.azure-speech.lang` | SSML language code (default `en-US`). |

| `outputFormat` | `messages.tts.providers.azure-speech.outputFormat` | Audio-file output format (default `audio-24khz-48kbitrate-mono-mp3`). |

| `voiceNoteOutputFormat` | `messages.tts.providers.azure-speech.voiceNoteOutputFormat` | Voice-note output format (default `ogg-24khz-16bit-mono-opus`). |

providers: {

elevenlabs: {

apiKey: "${ELEVENLABS_API_KEY}",

modelId: "eleven_multilingual_v2",

},

},

providers: {

google: {

model: "gemini-3.1-flash-tts-preview",

audioProfile: "Speak professionally with a calm tone.",

},

},

providers: {

google: {

model: "gemini-2.5-flash-native-audio-preview-12-2025",

activityHandling: "start-of-activity-interrupts",

turnCoverage: "only-activity",

},