Repository navigation
Commit 7961993
authored
Record upstream evaluation rule and context read-back waiver (#802)
### Scope
Record the owner's 2026-10-06 foundation-selection rule: use upstream evidence for component choices, maintain clean installations, and verify our wiring with smoke checks and organic native counters. The decision names all six superseded gate groups, the 13-row #723 cohort, retained checks, re-scoped S4, alternatives and the upstream-change comparison that reopens a choice. Four current policy guides gain a pointer to this rule; instruction-file changes remain a CC handoff.
B3's read-back ruling is an appended, dated "Amendment 2026-10-06" section in the October5 context-budget decision:23 lines inserted,0 removed. NativeStack's part is waived until retirement; the recorded NativeStack2604 pass and Skills row remain historical observations, and the co-op owns the remaining bounded SDK read-back. The CC's clarified preservation rule permits this addendum form. No existing historical or DECIDED line is edited.
- Base commit: `d9eb68750311d5f888adec140723da174f9fe10c`.
- Lane: `lane:foundation` (sole label).
- Owned source paths: NEW `docs/decisions/2026-10-06-upstream-evidence-over-local-evaluation.md`, the appended B3 section in `docs/decisions/2026-10-05-harness-context-budget.md`, `docs/acceptance-evidence-policy.md`, `docs/convergence-architecture.md`, `docs/harness-defaults.md`, `docs/token-practice.md`, and `catalogs/foundation/upstream-surface-dispositions.json`.
- The October5 record's existing text remains unchanged. Its append-only form is byte-identical to reviewed58dff931's file, SHA256 `dd3df75f9a7c2d736c476f6df07ffdb4e83e960ccfad79ba3f1826810986cbef`. Existing receipts and measured observations retain their history.
- `manifests/evidence.json` registrations are in the final registry-only commit. The two active `context_management` disposition citations point to line134 after the current policy pointer.
## SOTA sources
- [affaan-m/ECC](https://github.com/affaan-m/ECC/blob/2b6e839771e53096d8451a213d40dc64ec8acac0/skills/search-first/SKILL.md), commit `2b6e839771e53096d8451a213d40dc64ec8acac0`, Workflow and Decision Matrix: source-backed discovery and reuse.
- [modelcontextprotocol/modelcontextprotocol](https://github.com/modelcontextprotocol/modelcontextprotocol/blob/38c84e9f93ad191d9eb26d92b945d17bd0efcaf3/docs/specification/2025-11-25/basic/lifecycle.mdx), commit `38c84e9f93ad191d9eb26d92b945d17bd0efcaf3` / protocol tag `2025-11-25`, Initialization and Operation: client/server negotiation and native operation underlying wiring checks.
- [promptfoo/promptfoo](https://github.com/promptfoo/promptfoo/blob/0.123.1/README.md), tag `0.123.1`, README: upstream application-evaluation tooling retains its appropriate integration scope.
- [anthropics/claude-code](https://github.com/anthropics/claude-code/blob/v2.1.289/CHANGELOG.md), tag `v2.1.289`, changelog, and [Claude memory documentation](https://code.claude.com/docs/en/memory), reviewed2026-10-06: native context surfaces underlying the preserved context-budget record.
- Policy authority: CC interpretation `ITEM-ns2604-coop-20261006T190307Z.md`, SHA256 `425a46312a9dae9a2234e2ec64951f802b389bbb0c11cf744ac120dcce2f4734`; B3 item `task-ns2604-coop-20261006T203515Z`, section5; final preservation scope item `task-ns2604-coop-20261006T230116Z`; FormA item `task-ns2604-coop-20261006T230854Z`. The records paraphrase the policy and contain no verbatim owner quotation.
### Evidence-class table
| Claim | Evidence class | Command / receipt |
| --- | --- | --- |
| Five rules, six superseded gate groups, retained checks and S4 match the CC interpretation | source_review | Canonical item190307Z and independent GPT read; named sources are linked in the new decision |
| The #723 cohort contains exactly13 named rows | source_review | `foundation-eta-rerun-wf_91416191-566.json#/result/units/0/result/items`; indices6,10,11,13,14,18,46,48,49,50,51,64,70 independently checked |
| B3 records its waiver, measured observation and deferred SDK check without a new host run | source_review | `session-d91d55ad-20261006/IMPROVEMENT-MANIFEST.md` B3, SHA256 `38b27a5646c65d6a5afdb1478f5312c411b038a13b12c576e636e138b5d7284d`; item203515Z section5/B3, SHA256 `fd44de4938cc96e9efcb29f8b7a17077275427b746455a275ca9db5a75f64966` |
| B3 is an append-only dated amendment; reviewed58dff source content survives a pure main rebase | source_review | Four source commits are patch-equivalent, append-only diff and dd3df75f... hash; independent rebase/registry critic |
| Registry, references and active disposition citations pass locally | local_integration | Fresh native validate and upstream_surface_watch module below; returned streams retained privately |
### Local commands run
```text
rtk proxy nice -n 19 ionice -c3 python3 scripts/validate.py
exit0:69components,10383hashedfiles,4profiles,223receipts
rtk proxy nice -n 19 ionice -c3 python3 -m unittest tests.test_upstream_surface_watch
exit0:114tests,6skips
rtk proxy git diff --check
exit0
```
These are structural and local integration checks. The B3 Skills figure describes its retained `/context` row; it establishes no provider-token saving or comparative benchmark. Native streams and earlier failed/reviewed attempts remain durable. FormA preserves reviewed58dff's content with only a rebase and registry regeneration; the withdrawn separate-record move is retained privately and is absent from this PR.
### Decision record
`docs/decisions/2026-10-06-upstream-evidence-over-local-evaluation.md` contains the selection/evidence rule and CC instruction handoff. The dated B3 amendment in `docs/decisions/2026-10-05-harness-context-budget.md` carries its alternative and overturn comparison beside the original gate. The new decision's B3 link targets that amendment.
### Handoff to the CC
The decision lists the instruction sentences in `AGENTS.md`, `examples/claude-native/CLAUDE.md`, `adoption/templates/codex.AGENTS.template.md` and `adoption/scaffold/AGENTS.md` whose selection/evaluation scope needs to follow the rule, including AGENTS.md:9's foundation-selection reference. Those files and deployed configuration are outside this PR. FormA retains the earlier content acknowledgement; the co-op checks the pure range-diff and new-head CI before5f lands.
### Host evidence
No `evidence/hosts/` files or live client configuration change. B3 reports existing observations; the SDK kit owner performs the deferred bounded-job check.
### Checklist
- [x] Third-party action pin requirements retained; no workflow change.
- [x] Workflow permission requirements retained; no workflow change.
- [x] No secrets printed or committed; no new required secret.
- [x] No paid hosting, subscription or billing surface added.
- [x] Peer-owned instruction, install-plan, evidence and decision files preserved.1 parent b593372 commit 7961993
8 files changed
Lines changed: 257 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2614 | 2614 | | |
2615 | 2615 | | |
2616 | 2616 | | |
2617 | | - | |
2618 | | - | |
| 2617 | + | |
| 2618 | + | |
2619 | 2619 | | |
2620 | 2620 | | |
2621 | 2621 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
464 | 464 | | |
465 | 465 | | |
466 | 466 | | |
| 467 | + | |
| 468 | + | |
| 469 | + | |
| 470 | + | |
| 471 | + | |
| 472 | + | |
| 473 | + | |
| 474 | + | |
| 475 | + | |
| 476 | + | |
| 477 | + | |
| 478 | + | |
| 479 | + | |
| 480 | + | |
| 481 | + | |
| 482 | + | |
| 483 | + | |
| 484 | + | |
| 485 | + | |
| 486 | + | |
| 487 | + | |
| 488 | + | |
| 489 | + | |
467 | 490 | | |
468 | 491 | | |
469 | 492 | | |
| |||
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
16528 | 16528 | | |
16529 | 16529 | | |
16530 | 16530 | | |
16531 | | - | |
| 16531 | + | |
16532 | 16532 | | |
16533 | 16533 | | |
16534 | 16534 | | |
| |||
17003 | 17003 | | |
17004 | 17004 | | |
17005 | 17005 | | |
17006 | | - | |
17007 | | - | |
| 17006 | + | |
| 17007 | + | |
17008 | 17008 | | |
17009 | 17009 | | |
17010 | 17010 | | |
| |||
17098 | 17098 | | |
17099 | 17099 | | |
17100 | 17100 | | |
17101 | | - | |
17102 | | - | |
| 17101 | + | |
| 17102 | + | |
17103 | 17103 | | |
17104 | 17104 | | |
17105 | 17105 | | |
| |||
17583 | 17583 | | |
17584 | 17584 | | |
17585 | 17585 | | |
17586 | | - | |
17587 | | - | |
| 17586 | + | |
| 17587 | + | |
17588 | 17588 | | |
17589 | 17589 | | |
17590 | 17590 | | |
| |||
17666 | 17666 | | |
17667 | 17667 | | |
17668 | 17668 | | |
| 17669 | + | |
| 17670 | + | |
| 17671 | + | |
| 17672 | + | |
| 17673 | + | |
17669 | 17674 | | |
17670 | 17675 | | |
17671 | 17676 | | |
| |||
17798 | 17803 | | |
17799 | 17804 | | |
17800 | 17805 | | |
17801 | | - | |
17802 | | - | |
| 17806 | + | |
| 17807 | + | |
17803 | 17808 | | |
17804 | 17809 | | |
17805 | 17810 | | |
| |||
18043 | 18048 | | |
18044 | 18049 | | |
18045 | 18050 | | |
18046 | | - | |
18047 | | - | |
| 18051 | + | |
| 18052 | + | |
18048 | 18053 | | |
18049 | 18054 | | |
18050 | 18055 | | |
| |||
0 commit comments