You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 09ddede
Browse filesBrowse the repository at this point in the historyBrowse files
|`inputModalities` includes `image`| The synthetic-image procedure for that model: an exact-token read, repeated over several independently generated images, and a text-only control (explicit `["text"]`), repeated on the same images, that never returns the token. A single run is not enough. |
156
156
|`inputModalities` includes `audio`, `video`, or `pdf`| Its own probe, with a known-content input of that type that cannot be answered from text or the model id, repeated samples, and a text-only control. An image probe says nothing about these. No such probe exists yet, so these values are not published. |
157
157
|`inputModalities: ["text"]` (known text-only) | A negative result is also a claim. Record the failed attempts and the exact rejection or error, so a transient outage is not published as "unsupported". |
158
-
|`reasoning: true` or `false`| No procedure can currently substantiate it on OpenCode 2.0.30 or the USAi gateway: OpenCode drops the field, and the gateway exposes no reasoning signal or working control. See [`reasoning-validation.md`](../../acq-kits/opencode/docs/reasoning-validation.md). **Decision rule: no value is published and the field stays absent for every model.** Revisit only if a future OpenCode or gateway exposes an observable control, meaning a consumer that reads the field and changes behavior with it, or a gateway signal (a reasoning stream field or `reasoning_tokens`) plus a documented switch that demonstrably changes it. An image probe says nothing about this. |
158
+
|`reasoning: true` or `false`| No procedure can currently substantiate it on OpenCode 2.0.30 or the USAi gateway: OpenCode drops the field, and the gateway exposes no reasoning signal or working control. See [`reasoning-validation.md`](../../acq-kits/opencode/docs/reasoning-validation.md). **Decision rule: no value is published and the field stays absent for every model.** Revisit only if a future OpenCode or gateway exposes an observable control, meaning a consumer that reads the field and changes behavior with it, or a gateway signal (a reasoning stream field or `reasoning_tokens`) plus a documented switch that demonstrably changes it**on the target model** (for `true`), or an explicit gateway or vendor statement for the target model (for `false`). A null observation, or a control that works only on another model, leaves the model indeterminate and the field absent. An image probe says nothing about this. |
159
159
160
160
### Evidence record
161
161
@@ -276,8 +276,9 @@ kept as written.
276
276
277
277
The owner of the epic accepted keeping `reasoning`**absent for every model**.
278
278
No `reasoning: true` or `false` value is published, and none will be unless a
279
-
future OpenCode or gateway exposes an observable control (see the evidence
280
-
table).
279
+
future OpenCode or gateway exposes an observable control, or the gateway or
280
+
vendor states explicitly that a given model does not support reasoning (see the
281
+
evidence table).
281
282
282
283
### Evidence
283
284
@@ -297,7 +298,16 @@ USAi gateway; full method and limits are in
297
298
the stand-in gateway only.
298
299
- The gateway returned no reasoning stream field and no `reasoning_tokens` for
299
300
the four models examined, and the effort and disable switches tried had no
300
-
observable effect, so there is no usable negative control.
301
+
observable effect, so there is no usable positive or negative control on
302
+
any model. Every model is therefore *Indeterminate*: a null observation
303
+
(no signal, wrong answers, low token counts) is not evidence that a model
304
+
does not reason, and a control working on another model cannot establish a
305
+
value for the target. `true` needs target-specific positive evidence (a signal plus that
306
+
model's own switch changing it). `false` (known-unsupported) needs an explicit
307
+
target-specific statement from the gateway or vendor that the model does
308
+
not support reasoning; an OFF/ON run with no difference is not enough,
309
+
because an ignored switch looks the same. The
310
+
gateway's reporting telemetry does not establish internal reasoning.
301
311
302
312
The samples are small (four gateway models in depth, single-digit runs, one
303
313
date). This is evidence for the decision, not proof.
@@ -324,6 +334,9 @@ per the kit README) was **not tested**.
324
334
- The `reasoning` field and its type stay in the neutral and USAi schemas as
325
335
optional. Absent means unknown.
326
336
- Consumers MUST treat absent `reasoning` as unknown, not as "does not reason".
337
+
- Unsuccessful or unobserved reasoning (no signal, failed task, or a positive
338
+
control that exists only on another model) stays *Indeterminate* and the
339
+
field stays absent. `false` is never concluded from a null observation.
327
340
- Producers should not supply `reasoning` for OpenCode 2.0.30 consumers unless
328
341
the behavior is re-verified. The renderer does not enforce this today; it
0 commit comments