Repository navigation
pi trial record: pi v0.99.1 behind OmniRoute with the token-save practice (S1, S2, R1 observed, decision trial) - #524
Closed
seathatflowsinourveins wants to merge 3 commits into
Closed
seathatflowsinourveins wants to merge 3 commits into
seathatflowsinourveins wants to merge 3 commits into
Conversation
seathatflowsinourveins
force-pushed
the
claude/pi-omni-trial-20260929
branch
from
September 30, 2026 04:01
f260d4b to
3443ee3
Compare
…tice (S1, S2, R1 observed, decision trial) Kit, four-arm S2 (24 runs), S1 wiring smoke (3 runs) and R1 kill-and-resume on sharedgw/gpt-6.1-sol via 20129 after the gateway owner's corrected token-save configuration; sanitized per-run evidence, gateway read-backs and pool readings; an independent review's findings applied. Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
…tra max via OmniRoute) Kit: label aggregation, --tag selection, null-safe shares, missing-row and truncation flags, R1 export guard, mutant self-test tally, run exit statuses; evidence regenerated from the same call logs (totals unchanged). Record: wording scoped to what the fixtures support, shared MCP tool state and lite whitespace folding disclosed, provenance of the kit files stated. Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
…on (hot-file step, base b4056a3) Co-Authored-By: Claude Sonnet 5.5 <[email protected]>
seathatflowsinourveins
force-pushed
the
claude/pi-omni-trial-20260929
branch
from
September 30, 2026 06:01
3443ee3 to
5302387
Compare
Collaborator
Author
|
Takeover notice from Claude session native-agent-stack-0c, objection window until 2026-10-03T06:36Z. A verified triage (Sonnet facts plus an Opus judge, re-read against main
To keep or land it yourself, comment here before 2026-10-03T06:36Z. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
blueprints/convergence-practice/pi-omni-trial-20260929/: README,experiment.json, the local kit, sanitized per-run evidence, two gateway read-backs and pool readings) and registers its 28 files and the record inmanifests/evidence.json. pi v0.99.1 ran 28 real tasks onsharedgw/gpt-6.1-solthrough the 20129 lane (S1 wiring smoke 3, S2 24 = 3 tasks x 4 arms x 2 attempts, R1 one run killed at its second response and resumed); all passed their fixture checks. On these small fixtures the token-save stack used more tokens than plain pi (about 4.9x the uncached input), the gateway lane removed 192 of 413,153 input tokens, and its effect on uncached input is unresolved. Decision staystrial; nothing is adopted, and no verdict row, catalog, pin, client setting or gateway setting changes.b4056a355580f079560cb612cf03a0a2568c3af7(rebased onto main after OpenHands recipe lock: PyJWT 2.14.0 relock closes ten advisories (unblocks the required osv-scanner check) #525, the PyJWT relock, and OmniRoute rebuild 2026-09-30: decision record, evidence artifacts, owner-record script, unit templates (records what runs; compression on 20128 not applied) #530, the OmniRoute rebuild record it cites)lane:foundationblueprints/convergence-practice/pi-omni-trial-20260929/**;manifests/evidence.json(shared hot file: last commit, taken frommainand re-registered after the rebase, per docs/lanes.md; the re-registered manifest is byte-identical to the auto-merged one).SOTA sources
v0.99.1(d86654abb8862e201933517d6f1fce9f88dd117f):docs/mcp.md,docs/cli.md(tool_search),packages/aiopenai-responses.ts:327-337;packages/ai/src/api/anthropic-messages.ts(why the Anthropic OAuth path is excluded).rtk init --agent pi. context-mode: https://github.com/mksglu/context-mode 1.0.169, README "Pi Coding Agent" andsrc/adapters/pi/extension.ts:740-753.2f42a9ac19d1a247ec9ce5473b790843724b3061(tree equal to upstream mainc1e30b76):open-sse/services/compression/{lossyRequestPolicy.ts:29-71,deriveDefaultPlan.ts,strategySelector.ts:143-173,engineCatalog.ts:200-206,types.ts:421-443},docs/compression/COMPRESSION_GUIDE.md:233-239,src/app/api/usage/provider-limits/route.ts(POST = manual quota-cache refresh).v0.23.0,src/harbor/agents/installed/pi.pylines 88-100, 115-178, 222-235 (why S1/S2 use a local runner and S3 needs a subclass).Evidence-class table
sharedgw/gpt-6.1-solvia 20129 (S1 3, S2 24, R1 1)native_proven(this host, 2026-09-30)evidence/{s1-runs,s2-runs,r1}.json,experiment.jsonobservationssynthetic(three small fixtures, n=2 per cell)evidence/s2-runs.json,evidence/s2-summary.txtpi --continuefinished and passed, no descendant survivednative_proven(one run)evidence/r1.jsonnative_provenread-backevidence/gateway-readback-20260930T0159Z.json(first apply:...T0009Z-first-apply.json)source_review2f42a9ac1files abovelocal_integrationkit/probes.py,kit/stage.py --checkLocal commands run
Independent reviews, two families, one repair round each: (1) an Opus evidence-reviewer (read-only): no blocker, 9 should-fix, all applied (the "upstream-default" label corrected to "upstream's documented safe lane plus ccr", cache-warmth confound disclosed, unarchived figures removed or labelled, the 14:12Z run's role and compression note corrected, read-back extended to the full key set). (2) A GPT-6 astra review at max through OmniRoute (20129 to 20128, compression off, read-only sandbox): no blocker, every recomputed number confirmed (S2 table, request-2 shares, paired differences, R1 sums, all 29 usage objects, 47 hashes); about 11 should-fix and 10 minor findings, applied in the second commit: analysis scripts (summarizer merged the gateway-off control into
stack, no stage selection, null usage read as zero, silent row truncation, R1 export overwrite, run exit statuses masked), the mutant self-test dropped verdicts from the probe tally ("of 98" is now "of 100"), wording scoped to what n=2 fixtures support, and two undisclosed confounds now disclosed (stack and stack-ext shared Serena/jCodeMunch state directories; the header-less arms passed through the gateway'slitewhitespace fold). Not changed, by design: the runners and templates that produced the evidence (their hashes must match the runs); their findings (inheritedPI_CODING_AGENT_DIR, PID-by-PID kill) are disclosed in the record. Residuals: no live re-run of R1 with the hardened kill; provenance of the executedrun_s2.shpredecessor.Decision record
The record's own decision is
trial(experiment.json); itsnext_decision_changing_testis a large-output fixture (S2b) with the same four arms.Host evidence
No files under
evidence/hosts/change.Checklist
permissions: contents: read(no workflow changes).🤖 Generated with Claude Code