You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/concepts/model-providers.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -337,7 +337,7 @@ See [/providers/kilocode](/providers/kilocode) for setup details.
337
337
Model ids use a `nvidia/<vendor>/<model>` namespace (for example `nvidia/nvidia/nemotron-...` alongside `nvidia/moonshotai/kimi-k2.5`); pickers preserve the literal `<provider>/<model-id>` composition while the canonical key sent to the API stays single-prefixed.
338
338
</Accordion>
339
339
<Accordiontitle="xAI">
340
-
Uses the xAI Responses path. The recommended path is SuperGrok/X Premium OAuth; API keys still work via `XAI_API_KEY` or plugin config, and Grok `web_search` reuses the same auth profile before API-key fallback. `grok-4.3` is the bundled public API default chat model, while `grok-composer-2.5-fast` and `grok-build-0.1` are selectable for Grok OAuth / Grok Build coding workloads. `/fast` or `params.fastMode: true` rewrites `grok-3`, `grok-3-mini`, `grok-4`, and `grok-4-0709` to their `*-fast` variants. `tool_stream` defaults on; disable via `agents.defaults.models["xai/<model>"].params.tool_stream=false`.
340
+
Uses the xAI Responses path. The recommended path is SuperGrok/X Premium OAuth; API keys still work via `XAI_API_KEY` or plugin config, and Grok `web_search` reuses the same auth profile before API-key fallback. `grok-4.3` is the bundled default chat model, and `grok-build-0.1` is selectable for build/coding-focused work. `/fast` or `params.fastMode: true` rewrites `grok-3`, `grok-3-mini`, `grok-4`, and `grok-4-0709` to their `*-fast` variants. `tool_stream` defaults on; disable via `agents.defaults.models["xai/<model>"].params.tool_stream=false`.
341
341
</Accordion>
342
342
<Accordiontitle="Cerebras">
343
343
Ships as the bundled `cerebras` provider plugin. GLM uses `zai-glm-4.7`; OpenAI-compatible base URL is `https://api.cerebras.ai/v1`.
Copy file name to clipboardExpand all lines: docs/nodes/talk.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -116,13 +116,13 @@ Defaults:
116
116
-`providers.elevenlabs.apiKey`: falls back to `ELEVENLABS_API_KEY` (or gateway shell profile if available).
117
117
-`consultThinkingLevel`: optional thinking level override for the full OpenClaw agent run behind realtime `openclaw_agent_consult` calls.
118
118
-`consultFastMode`: optional fast-mode override for realtime `openclaw_agent_consult` calls.
119
-
-`realtime.provider`: selects the active browser/server realtime voice provider. Use `openai` for WebRTC, `google` for provider WebSocket, `xai` for Grok Voice through provider WebSocket or Gateway relay, or another bridge-only provider through Gateway relay.
119
+
-`realtime.provider`: selects the active browser/server realtime voice provider. Use `openai` for WebRTC, `google` for provider WebSocket, `xai` for Grok Voice through Gateway relay, or another bridge-only provider through Gateway relay.
120
120
-`realtime.providers.<provider>` stores provider-owned realtime config. The browser receives only ephemeral or constrained session credentials, never a standard API key.
121
121
-`realtime.providers.openai.voice`: built-in OpenAI Realtime voice id. Current `gpt-realtime-2` voices are `alloy`, `ash`, `ballad`, `coral`, `echo`, `sage`, `shimmer`, `verse`, `marin`, and `cedar`; `marin` and `cedar` are recommended for best quality.
122
122
-`realtime.providers.xai.voice` / `speakerVoice` / `voiceId` / `speakerVoiceId`: xAI Grok Voice id. Built-in xAI voices include `eve`, `ara`, `rex`, `sal`, and `leo`; default is `leo`.
123
123
-`realtime.transport`: `webrtc` and `provider-websocket` are browser realtime transports. Android uses realtime relay only when this is `gateway-relay`; otherwise Android Talk uses its native STT/TTS loop.
124
-
-`realtime.providers.xai.vadThreshold`, `silenceDurationMs`, and `prefixPaddingMs`: forwarded to xAI server VAD for provider WebSocket and Gateway relay sessions.
125
-
-`realtime.providers.xai.baseUrl`: custom xAI-compatible Realtime base URL for `gateway-relay` only. Browser-owned xAI `provider-websocket` sessions require the native `https://api.x.ai/v1` endpoint.
124
+
-`realtime.providers.xai.vadThreshold`, `silenceDurationMs`, and `prefixPaddingMs`: forwarded to xAI server VAD for Gateway relay sessions.
125
+
-`realtime.providers.xai.baseUrl`: custom xAI-compatible Realtime base URL for `gateway-relay`.
126
126
-`realtime.brain`: `agent-consult` routes realtime tool calls through Gateway policy; `direct-tools` is legacy direct-tool compatibility behavior; `none` is for transcription or external orchestration.
127
127
-`realtime.consultRouting`: `provider-direct` preserves the provider's direct reply when it skips `openclaw_agent_consult`; `force-agent-consult` makes Gateway relay route finalized user transcripts through OpenClaw instead.
128
128
-`realtime.instructions`: appends provider-facing system instructions to OpenClaw's built-in realtime prompt. Use it for voice style and tone; OpenClaw keeps the default `openclaw_agent_consult` guidance.
Copy file name to clipboardExpand all lines: docs/web/control-ui.md
+1-3Lines changed: 1 addition & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -201,12 +201,10 @@ Activity entries keep only sanitized summaries and redacted, truncated output pr
201
201
202
202
</Accordion>
203
203
<Accordiontitle="Talk mode (browser realtime)">
204
-
Talk mode uses a registered realtime voice provider. Configure OpenAI with `talk.realtime.provider: "openai"` plus an `openai` API-key auth profile, `talk.realtime.providers.openai.apiKey`, or `OPENAI_API_KEY`; OpenAI OAuth profiles do not configure Realtime voice. Configure Google with `talk.realtime.provider: "google"` plus `talk.realtime.providers.google.apiKey`. Configure xAI Grok Voice with `talk.realtime.provider: "xai"` plus either `talk.realtime.providers.xai.apiKey`, `XAI_API_KEY`, or an xAI auth profile. The browser never receives a standard provider API key. OpenAI receives an ephemeral Realtime client secret for WebRTC. Google Live receives a one-use constrained Live API auth token for a browser WebSocket session, with instructions and tool declarations locked into the token by the Gateway. xAI receives an ephemeral Realtime client secret from `/v1/realtime/client_secrets` and connects to the Grok Voice WebSocket with the `xai-client-secret.<token>` subprotocol. Browser-owned xAI sessions require the native `https://api.x.ai/v1` endpoint; use Gateway relay for custom xAI `baseUrl` or proxy endpoints. Providers that only expose a backend realtime bridge run through the Gateway relay transport, so credentials and vendor sockets stay server-side while browser audio moves through authenticated Gateway RPCs. The Realtime session prompt is assembled by the Gateway; `talk.client.create` does not accept caller-provided instruction overrides.
204
+
Talk mode uses a registered realtime voice provider. Configure OpenAI with `talk.realtime.provider: "openai"` plus an `openai` API-key auth profile, `talk.realtime.providers.openai.apiKey`, or `OPENAI_API_KEY`; OpenAI OAuth profiles do not configure Realtime voice. Configure Google with `talk.realtime.provider: "google"` plus `talk.realtime.providers.google.apiKey`. The browser never receives a standard provider API key. OpenAI receives an ephemeral Realtime client secret for WebRTC. Google Live receives a one-use constrained Live API auth token for a browser WebSocket session, with instructions and tool declarations locked into the token by the Gateway. Providers that only expose a backend realtime bridge run through the Gateway relay transport, so credentials and vendor sockets stay server-side while browser audio moves through authenticated Gateway RPCs. The Realtime session prompt is assembled by the Gateway; `talk.client.create` does not accept caller-provided instruction overrides.
205
205
206
206
The Chat composer includes a Talk options button next to the Talk start/stop button. The options apply to the next Talk session and can override provider, transport, model, voice, reasoning effort, VAD threshold, silence duration, and prefix padding. When an option is blank, the Gateway uses configured defaults where available or the provider default. Selecting Gateway relay forces the backend relay path; selecting WebRTC keeps the session client-owned and fails instead of silently falling back to relay if the provider cannot create a browser session.
207
207
208
-
Provider WebSocket and Gateway relay providers can emit inbound transcript updates while audio is still streaming. For xAI, the bridge maps the cumulative `conversation.item.input_audio_transcription.updated` event to user transcript updates so Talk and meeting transcription surfaces can consume live inbound speech content.
209
-
210
208
In the Chat composer, the Talk control is the waves button next to the microphone dictation button. When Talk starts, the composer status row shows `Connecting Talk...`, then `Talk live` while audio is connected, or `Asking OpenClaw...` while a realtime tool call is consulting the configured larger model through `talk.client.toolCall`.
211
209
212
210
Maintainer live smoke: `OPENAI_API_KEY=... GEMINI_API_KEY=... node --import tsx scripts/dev/realtime-talk-live-smoke.ts` verifies the OpenAI backend WebSocket bridge, OpenAI browser WebRTC SDP exchange, Google Live constrained-token browser WebSocket setup, and the Gateway relay browser adapter with fake microphone media. The command prints provider status only and does not log secrets.
0 commit comments