You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/concepts/qa-e2e-automation.md
+17-5Lines changed: 17 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -178,10 +178,21 @@ QA Lab, so package Docker release lanes do not run `qa` commands. Use
178
178
`pnpm qa:observability:smoke` from a built source checkout when changing
179
179
diagnostics instrumentation.
180
180
181
-
For a transport-real Matrix smoke lane, run:
181
+
For a transport-real Matrix smoke lane that does not require model-provider
182
+
credentials, run the fast profile with the deterministic mock OpenAI provider:
182
183
183
184
```bash
184
-
pnpm openclaw qa matrix --profile fast --fail-fast
185
+
OPENCLAW_QA_MATRIX_NO_REPLY_WINDOW_MS=3000 \
186
+
pnpm openclaw qa matrix --provider-mode mock-openai --profile fast --fail-fast
187
+
```
188
+
189
+
For the live-frontier provider lane, supply OpenAI-compatible credentials
190
+
explicitly:
191
+
192
+
```bash
193
+
OPENCLAW_LIVE_OPENAI_KEY="${OPENAI_API_KEY}" \
194
+
OPENCLAW_QA_MATRIX_NO_REPLY_WINDOW_MS=3000 \
195
+
pnpm openclaw qa matrix --provider-mode live-frontier --profile fast --fail-fast
185
196
```
186
197
187
198
The full CLI reference, profile/scenario catalog, env vars, and artifact layout for this lane live in [Matrix QA](/concepts/qa-matrix). At a glance: it provisions a disposable Tuwunel homeserver in Docker, registers temporary driver/SUT/observer users, runs the real Matrix plugin inside a child QA gateway scoped to that transport (no `qa-channel`), then writes a Markdown report, JSON summary, observed-events artifact, and combined output log under `.artifacts/qa-e2e/matrix-<timestamp>/`.
@@ -201,9 +212,10 @@ environment. That viewer profile is only for visual capture; the pass/fail
201
212
decision still comes from the Discord REST oracle.
202
213
203
214
CI uses the same command surface in `.github/workflows/qa-live-transports-convex.yml`.
204
-
Scheduled and default manual runs execute the fast Matrix profile with live
205
-
frontier credentials, `--fast`, and `OPENCLAW_QA_MATRIX_NO_REPLY_WINDOW_MS=3000`.
206
-
Manual `matrix_profile=all` fans out into the five profile shards.
215
+
Scheduled and default manual runs execute the fast Matrix profile with
216
+
QA-provided live-frontier credentials, `--fast`, and
0 commit comments