-Cold-start note: the router loads models on first request. GLM in particular can block up to roughly 60 seconds before the first byte arrives — this is expected, not a hang. `options.headerTimeout` is set to 900000ms (15m) and `options.timeout` to `false` so that cold load doesn't trip the request-level timeout. `options.chunkTimeout` is set to 120000ms (2m) separately: once headers arrive, a stalled generation (no SSE chunk for 2 minutes) still aborts instead of hanging forever, since `timeout: false` alone does not bound the time between streamed chunks. All three models return `reasoning_content` (surfaced via each model's `interleaved: "reasoning_content"` declaration), structured `tool_calls`, and SSE streaming. Context window is 65536 tokens, max output 16384 tokens.
0 commit comments