You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit b5f0322
Browse filesBrowse the repository at this point in the historyBrowse files
fix(opencode): own the scratch dir, honor --samples, skip unavailable models
Address review of the image-verification script:
- Create a unique owned scratch dir only after preflight and remove only it,
so a pre-existing <output-dir>/.work survives --dry-run, preflight stops,
and complete runs.
- Pass the requested sample count into candidate decisions so a model only
qualifies when every configuration has all requested samples.
- Classify text-control failures: a message naming the single model
(blocked, unknown, no tool-use streaming) is reported as SKIPPED
(unavailable), does not count toward the consecutive-failure stop, and
does not change the exit status; 401s, bare 4xx, timeouts and connection
errors stay run-level, and a run where no model passes still stops.
Co-authored-by: OpenCode Agent <[email protected]>
Paste back the `RESULT` line and the contents of `evidence.md` (it holds
@@ -194,9 +194,17 @@ a provider `baseURL` that is not `https://api.gsa.usai.gov`; a reply that is
194
194
longer than 500 characters (unset and explicit `["text","image"]` runs, where
195
195
only a six-character token is expected) or carries credential-shaped data; an
196
196
explicit `["text"]` run that
197
-
returns the token; three consecutive models failing the text control; and an
197
+
returns the token; three consecutive models failing the text control for auth, routing, timeout or
198
+
connection reasons (or no model passing it at all); and an
198
199
OpenCode that cannot be run. A model whose own text control fails is recorded
199
-
and skipped (auth or routing, not an image result). In the explicit
200
+
and skipped (not an image result). When the gateway message names that one model (`model_blocked_globally`,
201
+
an unknown or nonexistent model, or "doesn't support tool use") it is reported
202
+
as `SKIPPED (unavailable)`, does not count toward the three-in-a-row stop, and
203
+
does not change the exit status; a complete run with such models exits 0 and
204
+
lists them as `skipped=N(model,...)` in the `RESULT` line. A plain 401 or 403, a
205
+
bare 4xx with no model-specific text, a timeout, or a connection error stays a
206
+
run-level failure, and if no model at all passes its text control the run stops
207
+
(a run cannot succeed with every model "unavailable"). In the explicit
200
208
`["text"]` negative control a long, harmless refusal is the expected outcome, so
201
209
that run's length cap is 8000 characters instead (credential-shaped content
202
210
still stops the run); stored replies are truncated to 500 characters after
0 commit comments