Repository navigation
Crosswalk the gap-resolution receipts onto the 380 current open gaps (92bb279) - #85
Merged
Merged
Conversation
…2bb279) - tools/sota-convergence/gap_crosswalk.py: TypeSafe screen (jev-1.13.0, question revision gap-crosswalk-questions-v1), eval scoring, and an offline build that joins the retained judgments with the retained Opus review. - Preregistered threshold rule; eval on the 315 reviewed bdd04ca gaps selected T=0.3 (27/29 addressed gaps caught). TypeSafe blocker categories agreed 46% (below the 0.60 bar), so categories come from the reviewers. - Review: 9 semantic-evidence-reviewer groups (Opus/high) decided all 109 queued pairs and categorized all 380 gaps; 8 evidence-reviewer checks (Opus/high) verified the 30 positive decisions (25 agree, 5 corrected). - Result: 3 gaps settled and 22 advanced by existing receipts, 355 open; 258 executable_now gaps listed with a next check and an owner per the agreed layer split. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
…pt drift and off-rule candidates The repo ignores *.jsonl, so the retained judgments were never committed (Codex blocker). The build now recomputes each judged state from the current receipts and gap text and compares state_sha256, and requires the judged candidates to equal the ledger's candidate rule; tests cover both guards. eval-score.json reproduces from the retained eval judgments. Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
Co-Authored-By: Claude Opus 5.5 (1M context) <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Maps the 40 gap-resolution receipts (#81) onto every
open_gapsentry of the 32 landscape rows at92bb279, which #79 rewrote. Each gap also gets a blocker category, a next check where one is executable, and an owner for the next evidence wave. No verdict changes.Method
jev-1.13.0, question revisiongap-crosswalk-questions-v1, viatools/sota-convergence/gap_crosswalk.py. The threshold rule was preregistered inevidence/artifacts/gap-crosswalk-92bb279/PREREGISTRATION.mdbefore any call.bdd04cagaps, the rule selected T = 0.3, which caught 27 of 29 addressed gaps.semantic-evidence-reviewergroups decided every queued pair and categorized every gap. Independent Opusevidence-reviewers re-checked all 30 positive decisions: they agreed with 25 and corrected 5 (3 up to settles, 2 down to not addressed). TypeSafe never sets a status.Result
executable_nowgaps have a next check, split by the owners agreed between the two sessions:gap-resolution: 69 gaps in 8 foundation layers;agent-lab-17: 189 gaps in 12 us-equities and 12 foundation layers.catalogs/landscape/gap-crosswalk-92bb279.jsonand the pagedocs/gap-crosswalk-92bb279.md. The retained judgments and review results are hash-checked bytests/test_gap_crosswalk.py.Verification
gap_crosswalk.py build --checkreports up to date.python3 -m unittest: 2,134 tests OK (324 environment skips).validate.py,validate_catalogs.py,validate_foundation.py,validate_convergence.py,landscape.py,build_verdicts.py --check,trading_gates.py --check,build_ecosystem.py --check.Limits
92bb279. The convergence refresh planned for today will re-record the rows and needs a new crosswalk.🤖 Generated with Claude Code