Repository navigation
Description
[P3] Comparison adapters: finish official-toolchain admission for the supported language set
Scope and reviewed baseline
Remaining work from #284 (R03). Review date: 29 September 2026.
Branch: wavect/v070, PR #314, source commit 1ae35afe83f62f405b979f57ac90772cfec9daca.
Classification: Remaining provenance and supported-scope decision.
This ticket replaces only the unresolved portion of its predecessor. Migration of the old ticket is not a claim that its whole original scope was completed. A missing hosted CI receipt is not a blocker when the required implementation and substantive local execution are complete.
Already delivered: do not rebuild
The v1/v2 local runnable adapters and 13-task inventory exist. The PR reports the corrected official TypeScript v3 lane passing 54 local checks. Do not redo that lane or treat its older documentation status header as evidence that the correction is absent.
Remaining gap
The pinned v3 contract admits only official Node/TypeScript and explicitly says other actually available lanes still need their own official provenance. A local-fixture lane is not automatically an independently admitted comparison environment.
Work to finish
- Name the exact additional language/toolchain lanes intended to be supported in this comparison. Either admit their official toolchains under the existing provenance/authority model or explicitly exclude them from the supported runnable set.
- For each newly supported lane, bind independent origin metadata, exact artifact bytes, source/task inventory, sandbox authority and actual public/hidden scorer execution. Reuse the existing v1/v2/v3 acquisition and scoring boundaries.
- Keep all 182 task/adapter inventory rows (13 tasks × 14 adapters), including explicit unavailable reasons. Preserve the completed official TypeScript lane and predecessor wire profiles. Do not raise archive bounds merely to turn an unavailable lane into an admitted one.
Acceptance
- Every lane advertised as independently runnable has an actual official-toolchain execution and negative provenance/authority controls, or is explicitly not supported.
- Task denominators and unavailable reasons are complete. Local sandboxed execution qualifies; no hosted receipt is required. Model performance comparisons remain owned by the pilot tickets, not this adapter ticket.
Boundaries
Use the existing mechanisms and frozen profiles. Do not silently weaken resource, source-authority, ownership, oracle or refusal requirements. This ticket does not authorize paid model/training calls, credentials, external deployment, signing, publication or a support-policy change. Obtain those authorities only where the remaining work actually needs them. Do not reopen excluded deferred work.
Evidence and entry points
- Official TypeScript scope and remaining official provenance
- PR: corrected TypeScript v3 integrated; local 54/54
Review basis: source/document inspection plus retained repository/issue test reports, not a new execution of the Semaprax test suite. Evidence remains bound to the revision and host on which it was actually produced. Confidence: High for scope gap; reported tests not rerun.
Activity
refs #322
wsdt commentedon Sep 30, 2026
Resolved on wavect/v070 at 6a7a341.
Scope decision confirmed: retain the existing official TypeScript v3 profile as the sole supported independently runnable comparison lane. The other 13 adapters are explicitly excluded from official comparison support; their local fixtures remain unchanged.
All 182 task/adapter rows are preserved: 13 supported TypeScript slots and 169 explicitly unsupported slots, with reasons retained. Existing provenance, authority, scorer and resource boundaries remain unchanged.
Both acceptance criteria are satisfied through the explicit-exclusion option. No additional hosted receipt is required. This closure does not claim additional official toolchains, new model-performance evidence, a merge to main or full release acceptance.