Skip to content

Capability-gate host receipts round 2 at main eb5ca78a (supersede the first recording; GPT-6 review agree) + dashboard gate row - #442

Merged
seathatflowsinourveins merged 3 commits into
mainfrom
claude/capability-gate-receipts-r2-20260927
Sep 28, 2026
Merged

seathatflowsinourveins merged 3 commits into
mainfrom
claude/capability-gate-receipts-r2-20260927

Conversation

@seathatflowsinourveins

Copy link
Copy Markdown
Collaborator

Scope

SOTA sources

Evidence-class table

Claim Evidence class Command / receipt
jcodemunch gate. run_gate.py jcodemunch exited 0 and printed capability-gate jcodemunch: PASS | gate 6/6 pass; ctrl-disabled 2/2 fail as predicted; ctrl-prompt 2/2 fail as predicted | 10 rows as expected, 10 distinct sessions | loki 10/10 rows match (8 MCP tool results), results 047b20eb…. native_proven (host receipt, recorded at eb5ca78a) evidence/hosts/nativestack-5975wx-20260925/nativestack-5975wx-20260925--jcodemunch-mcp--use--20260927-2.json; run 2026-09-27T23:32:30Z
ai-memory gate (F7). run_gate.py ai-memory exited 0 and printed capability-gate ai-memory: PASS | gate 6/6 pass; ctrl-disabled 2/2 fail as predicted; ctrl-prompt 2/2 fail as predicted | 10 rows as expected, 10 distinct sessions | loki 10/10 rows match (8 MCP tool results), results 956bfa9b…. native_proven (host receipt) …--ai-memory--use--20260927-2.json; run 2026-09-27T23:28:15Z
M13 gate. run_gate.py m13 exited 0 and printed capability-gate m13: PASS | gate 40/40 pass; ctrl-disabled 6/6 fail as predicted; ctrl-wrongroot 6/6 fail as predicted | 52 rows as expected, 52 distinct sessions | loki 52/52 rows match (236 MCP tool results), results 13ee190c…. native_proven (host receipt) …--context-mode--use--20260927-2.json; run 2026-09-27T23:28:18Z
Retained results re-check. Each retained results file's sha256 equals its verdict line's results field. Re-applying tools/capability-gate/assertions.js at eb5ca78a to each file reproduced 260 of 260 (M13), 10 of 10 (ai-memory) and 10 of 10 (jcodemunch) component verdicts. All 52 M13 rows carry their own vars.sentinel. local check over host-private retained results (counts only) coordinator re-score; the reviewer's own re-check is below
Model and effort. All 72 conversations in the recording window (52 + 10 + 10) started as model gpt-6-astra at reasoning effort max on codex-cli 0.157.1. native_proven (live Loki query, counts only) codex.conversation_starts in {service_name="codex_sdk_ts"}, 23:28:00Z–23:44:30Z
Tool-result counts. The same window holds 323 functions results and these MCP results: context_mode 184, serena 52, ai_memory 8, jcodemunch 8, socraticode 0. The MCP totals equal the receipts' 236 + 8 + 8. native_proven (live Loki query, counts only) codex.tool_result in the same service and window
Dashboard row. The codex-capability-gate row meets progress.py's token and evidence-ref rules. local check python3 -m unittest tests.test_grand_dashboard

Each receipt claim quotes only that recording's own verdict line. The recording script kept a receipt only if its result was pass, its excerpt started with the quoted line, and the line carried a 64-hex results field. All three were kept.

Each receipt's limitations state what PASS means in the harness at eb5ca78a:

  • the argument fields actually checked;
  • the directory-change forms, a syntactic list;
  • sentinel retention;
  • shell visibility and Loki reconciliation;
  • for M13: top-level-only scope, overlap, wrong-root indexing and the Serena build;
  • for ai-memory: the pin mismatch and the empty-hit boundary;
  • for jcodemunch: route left unqualified.

Local commands run

$ python3 scripts/host_receipts.py record ... --supersedes <first receipt id>   (x3, from detached worktrees at eb5ca78a)
KEEP m13 pass | KEEP ai-memory pass | KEEP jcodemunch pass   (recording 23:28:10Z-23:43:34Z)
$ node <re-score> tools/capability-gate/assertions.js <retained results.json>   (x3, counts only)
m13 260/260 identical; ai-memory 10/10; jcodemunch 10/10; m13 rows with own sentinel 52/52
$ python3 -m unittest tests.test_grand_dashboard
OK
$ python3 scripts/component_matrix.py --write
{"flip_rule_violations": 0, "rows": 32, "status": "written"}
$ python3 scripts/new_host_grand_list.py --write
{"status": "written", "layers": 32, "winners": 66}
$ python3 scripts/validate.py
{"components": 69, "hashed_files": 7373, "profiles": 4, "receipts": 159, "status": "passed"}
$ GIT_NO_LAZY_FETCH=1 python3 scripts/host_receipts.py validate
{"receipts": 182, "status": "passed"}
$ git diff --check origin/main...HEAD   # clean; pre-push registry gate: Ran 3 tests OK

Independent review

  • Who reviewed. The reviewer is the one whose needs_changes the first receipts carry: gpt-6-astra at effort max, read-only codex exec, its own thread resumed.
  • What it checked. It reviewed each -2 receipt at eb5ca78a:
    • the claim quotes only the recording's own verdict line;
    • the result, supersession and date are consistent;
    • the limitations match the harness;
    • it re-applied assertions.js to the retained results itself, as an independent replay.
  • Replay results. 260/260, 10/10 and 10/10 component verdicts, with the gate, disabled and prompt/wrong-root tallies all matching. Retained hashes matched 3/3, and M13 sentinels are bound in 52/52 rows with 52 unique values.
  • Findings. No P0–P3 findings.
  • Recorded verdicts. It then recorded codex_lane agree on each receipt itself, with scripts/host_receipts.py review under its own identity, which differs from the recorder's.
  • Coordinator-supplied inputs. The Loki, model and installed-Serena observations were supplied by the coordinator. The reviewer counted MCP calls independently from the retained results and matched the supplied totals.
  • Round 1. The first receipts keep their needs_changes reviews (Capability gate: retain scored results, enforce tool identity and directory-change forms (GPT-6 review repair); first host receipts with that review #440). Superseded at the same version, they support no status.

Host evidence

  • Where recorded: host executions on nativestack-5975wx-20260925 (linux-wsl2-x86_64) at eb5ca78a, from 2026-09-27T23:28:10Z to 23:43:34Z. Historical receipts; they do not certify another host.
  • Run conditions:
    • Main checkout. The jcodemunch sessions run in the main checkout, as the harness requires. It stayed at c8362c02, and the two fixture files (scripts/host_receipts.py, tools/sota-convergence/landscape-sweep/build_args.py) do not differ between c8362c02 and eb5ca78a.
    • Codex home config. It was last modified at 2026-09-27T21:42:49Z, before the window. The round-1 SocratiCode switch did not recur, and SocratiCode shows 0 tool results.
    • Retained results. They stay host-private: files 0600, directories 0700, never overwritten. They are not published.

🤖 Generated with Claude Code

Scout and others added 3 commits September 27, 2026 19:59
…the first recording, with GPT-6 review agree

The three gates re-ran live through host_receipts.py record --supersedes at the published
repair (#440). Each receipt quotes only its own verdict line, which carries the retained
results' sha256. The GPT-6 cross-family reviewer independently re-applied assertions.js to
the retained results (260/260, 10/10, 10/10 component verdicts; hashes 3/3; M13 sentinels
52/52) and recorded codex_lane agree on each receipt itself. The grand-dashboard gets the
codex-capability-gate row.

Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
…files)

docs/lanes.md hot-file protocol after merging origin/main at b26add9 (#439): main's
manifests/evidence.json with the three -2 receipts and observability/grand-dashboard/state.json
registered, and the component evidence matrix regenerated (flip-rule violations 0).

Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
@seathatflowsinourveins seathatflowsinourveins added the lane:foundation Foundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers label Sep 28, 2026
@seathatflowsinourveins
seathatflowsinourveins merged commit 37739d3 into main Sep 28, 2026
24 checks passed
@seathatflowsinourveins
seathatflowsinourveins deleted the claude/capability-gate-receipts-r2-20260927 branch September 28, 2026 00:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lane:foundation Foundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant