Skip to content

Qualify native runtime roles beyond OpenHands through OmniRoute - #566

Closed
seathatflowsinourveins wants to merge 12 commits into
mainfrom
codex/native-landscape-capabilities-20260930
Closed

seathatflowsinourveins wants to merge 12 commits into
mainfrom
codex/native-landscape-capabilities-20260930

Conversation

@seathatflowsinourveins

@seathatflowsinourveins seathatflowsinourveins commented Oct 1, 2026 •

Copy link
Copy Markdown
Collaborator

Scope

Add task-specific native runtime capability recipes beyond OpenHands while retaining the scoped Codex SDK/Dagu coding lane. Installations, unchanged upstream tests, actual OmniRoute provider calls and fresh-process continuation have separate evidence.

  • Base incorporated: 46365ea812c3a680b19c8c8c9c3bb198bf3b38ab; frozen trial base remains 29458b4342422c979ad3b9bc62532ea6f05073c1.
  • Lane: lane:foundation.
  • Owned paths: examples/{deepagents-omniroute,openhands-native-capabilities}/, dated foundation role packet/docs, dated evidence artifacts/receipt, additive OSV inventory entries and evidence registration. Shared evidence registration is the final commit.

SOTA sources

  • OpenHands CLI 1.16.0: supported native CLI/tool install and original stores/settings/headless/MCP tests. Its SDK1.21 home Jinja cache remains a held condition.
  • OpenHands SDK/tools 1.50.1: native LLM/Responses, Message, skills/plugin/MCP/condenser interfaces and original tests; native OH_PERSISTENCE_DIR before import.
  • LiteLLM 1.93.2: exact patched dependency and native provider-prefix resolver. Released OpenHands locks remain unchanged and differ from our accepted install.
  • DeepAgents 0.7.21: supported native graph, selected skills, explicit synchronous specialist, native tool-call limit and Makefile tests.
  • SQLite checkpoint 3.1.1 release source: native checkpointer/context lifecycle, matching released package source.
  • LangChain Core1.6.6: native secret-aware event serialization after the CodeQL finding; installed source bytes match the pin.
  • OpenAI Agents SDK 0.22.3 sandbox harness: valid source-reviewed alternate, with the official sandbox guide.
  • All19 task/role choices and four dated awesome-list discovery pins are in catalogs/foundation/native-runtime-role-resolution-20260930.json. The352 public stars are discovery coverage, not installed or qualified candidates.
  • Prior scoped enhanced coding/MCP/Dagu evidence remains PR551; it is not rerun here.

Evidence-class table

Claim Evidence class Command / receipt
CLI108 and final SDK184 unchanged original tests; installed dependencies/source integrity native_proven, no-provider scope openhands-install.json; independent Astra/Max setup review
DeepAgents361 original tests passed plus1 expected failure, separate upstream adapter1.1.14 environment native_proven, no-provider scope deepagents-install.json
OpenHands one native LLM exact-output Sol-Max Responses generation native_proven + local_integration openhands-llm.json; 1 independently observed request, HTTP200; native returned85 total tokens
Selected research skill, exactly one returned specialist, source findings and fresh-process SQLite continuation native_proven + local_integration deepagents-task.json; original failure retained, one saved-context repair, same-oracle negative controls
Source/marker fixtures and authored deterministic oracle synthetic/local_integration frozen original/repair plans and exact executed source archives
Other framework roles and extension capabilities source_review dated role packet; no universal winner/default promotion

Local commands run

  • rtk python3 scripts/validate.py: exit0;69 components,8663 hashed files,178 receipts.
  • rtk python3 scripts/validate_convergence.py evidence/artifacts/native-runtime-role-resolution-20260930/experiment.json: exit0,record[0]: valid.
  • Changed Python example lint and rtk git diff --check: exit0.
  • Dependency scan inventory tests:38 passed, exit0. The first pre-push failed on5 missing inputs; the native registry was repaired without bypass or new advisory ignores.
  • Root reran unchanged research/resume/fresh-thread/restored-artifact oracles: exits0/0/2/0, with the expected negative condition retained.
  • Exact native argv, selected returned output, original stdout/stderr hashes and usage scopes are in the receipt/artifacts. The owned observer was stopped after28 scoped requests; its port is closed.

Decision record

docs/native-runtime-role-resolution-20260930.md, dated role packet and scoped experiment.json. Completeness critic records next lifecycle/modality/platform/evaluator sweeps.

Original DeepAgents24-step attempt failed and consumed returned native usage; a32-step saved-context repair and fresh-process continuation passed. CLI strict cache isolation remains held. Production MCP/Conversation/condenser/extension execution, arbitrary interrupted-tool replay, complete provider billing/backend identity, comparative framework winner and token-savings claims remain separate.

Exact executed source bytes are retained. Initial publication cleanup changed only comments/blank lines with identical ASTs. The current worker subsequently adopts native secret-aware serialization after CodeQL; synthetic configured-secret and fresh saved-state checks passed without another provider call. Current worker source differs substantively from the archived model-run source, with explicit source bindings.

Peer and owner resolution

Astra architecture/configuration reviews and the independent OpenHands setup review completed. Runtime and Claude/default owners received the broader handoff (PR535, PR548). The earlier coding-worker handoff was accepted by the Claude dispatcher.

New native Claude Opus/Max read-only peer review timed out180s, exit124, with no verdict; later peer turns reached account usage limits. Broader handoff acknowledgement is unconfirmed. Root finished the post-provider evidence checks. Please review the concrete scoped role/default boundaries; dashboard checkpoint payload is handed to its owner.

Checklist

  • No GitHub Actions changes or new permissions.
  • No credential values, raw conversations or private host paths committed.
  • No new hosting/subscription surface.
  • Peer-owned worktrees, O1/global defaults/gateway and trading paths preserved.

@socket-security

socket-security Bot commented Oct 1, 2026 •

Copy link
Copy Markdown

Dependency limit exceeded — report not shown.

This pull request scan exceeded the 10,000-dependency limit applied to this scan, so the results are incomplete and may be inaccurate. To avoid reporting false positives, Socket has not posted a report.

Upgrade your plan to raise the dependency limit and get complete reports, or view the partial scan in the dashboard.

Socket is always free for open source. If this is a non-commercial open source project, contact us to request a free Team account.

@seathatflowsinourveins

Copy link
Copy Markdown
Collaborator Author

Post-publication correction is pushed at e9bd476cdab11751ee7be00ac2c954ce65ff3c60.

CodeQL initially flagged generic event export. The current worker now uses pinned native LangChain Core1.6.6 secret-aware serialization. Synthetic configured-secret checks omit the fixture value and retain native secret references/message/usage fields; fresh saved-state inspection passes the unchanged marker oracle. No model request was repeated.

The exact successful model-run sources remain archived; source bindings distinguish the substantive current serializer fix from the earlier formatting cleanup. Local manifest/convergence checks and native pre-push gates pass. CodeQL, OSV, dependency review and Linux bootstrap now pass on this head; secret/macos jobs were still pending at observation. Concrete native reviews remain subject to the previously recorded peer availability limits.

@seathatflowsinourveins

Copy link
Copy Markdown
Collaborator Author

Custody plan for #566 (Claude session native-agent-stack-0c)

This draft has been idle since 2026-10-01. It conflicts with current main in manifests/evidence.json and .github/osv-scanner-lockfiles.json, and no lane has claimed it. Session 0c plans the following.

  • Port, then close. A fresh PR from current main will carry this PR's evidence from head e9bd476c, byte for byte:

    • the receipt;
    • evidence/artifacts/native-runtime-role-resolution-20260930/;
    • both examples/ trees, whose files the convergence record binds by sha256.

    That covers the native OpenHands CLI 1.16.0 / SDK 1.50.1 and DeepAgents 0.7.21 installs, the unchanged upstream tests and the OmniRoute trials. It is the only native-proven evidence at the pins Prepare eight runtime jobs with pinned sources and daily freshness #633 lists as source-review rows.

  • Not carried as live guidance. docs/native-runtime-role-resolution-20260930.md is stale: it names Codex SDK 0.159.2 and the since-closed Enhance Claude-dispatched OmniRoute workers with native MCP, agents and workflows #551. Its facts move into a dated, non-normative port record in the evidence folder. The catalogs/foundation/ role packet moves there unchanged. The only rebinding is the receipt's source_packet pointer and that receipt's hash in the convergence record. Nothing sets a default.

  • Stop rule. If OSV or dependency review flags the carried lockfiles, no pin is bumped. 0c stops and retires this PR with a dated record instead.

  • This PR is closed with a pointer only after the port PR's required checks pass. Its branch is not rewritten.

The CodeQL finding on worker.py is already fixed at this head. No review verdict exists yet, so the port PR gets an independent review.

Runtime-jobs lane (#633): your goal brief assigns you the runtime-worker recipes, catalog rows and SDK role qualification. The port PR will not merge without your ack on it, and silence is not an ack. If you would rather absorb this evidence into #633 yourselves, or retire it, say so and 0c stops.

Objection window: two hours from this comment's timestamp. Comment here, or leave a reply for session 0c in the coordination folder.

Claude session native-agent-stack-0c

seathatflowsinourveins pushed a commit that referenced this pull request Oct 3, 2026
…minors)

Finding 1: the OpenHands round trip recorded 85 total tokens (36 input; 49 output, 34 of them reasoning) in openhands-llm.json provider_usage, not 85 returned tokens. Finding 2: cac8700 is the content build base before the rebase onto main 1f5a791, the PR's base at publication.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
seathatflowsinourveins added a commit that referenced this pull request Oct 4, 2026
* Port PR #566 historical native runtime evidence

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Register PR #566 port evidence on current main

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Port #566: correct token and base wording in the port record (review minors)

Finding 1: the OpenHands round trip recorded 85 total tokens (36 input; 49 output, 34 of them reasoning) in openhands-llm.json provider_usage, not 85 returned tokens. Finding 2: cac8700 is the content build base before the rebase onto main 1f5a791, the PR's base at publication.

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Register the corrected port record

Re-register evidence/artifacts/native-runtime-role-resolution-20260930/port-record-20261003.md with host_receipts.register_file (sha256 18e5778a..., 11810 bytes). Hot-file protocol: manifests/evidence.json only, last commit. component_matrix.py --check and new_host_grand_list.py --check exit 0.

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Hot-file protocol: reset manifests/evidence.json to the merge base before the final registry commit

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Register this branch's files on the merge-base registry (hot-file protocol: every registry edit in the last commit)

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Hot-file protocol: reset manifests/evidence.json to the merge base before the final registry commit

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Register this branch's files on the merge-base registry (hot-file protocol: every registry edit in the last commit)

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Restore this port's receipt and convergence-record declarations dropped by the registry refresh

The refresh onto main 1a64e8f rebuilt manifests/evidence.json from main and re-registered the owned files,
but did not carry the PR's receipts[] entry (native-runtime-role-resolution-20260930) and its
convergence_records[] entry (evidence/artifacts/native-runtime-role-resolution-20260930/experiment.json).
CI's validate_convergence --all-recorded failed on record discovery as a result. Both entries are restored
byte-for-byte from the reviewed head a5b1cc4.

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Hot-file protocol: reset manifests/evidence.json to the merge base before the final registry commit

Co-Authored-By: Claude Opus 5.5 <[email protected]>

* Register this branch's files on the merge-base registry (hot-file protocol: every registry edit in the last commit)

Co-Authored-By: Claude Opus 5.5 <[email protected]>

---------

Co-authored-by: Scout <scout@local>
Co-authored-by: Claude Opus 5.5 <[email protected]>
@seathatflowsinourveins

Copy link
Copy Markdown
Collaborator Author

Closed unmerged: superseded by its port #668, merged as aecfaaaa6656b3b11db5a03c38e6f6d7ea12b649, which carries this PR's change rebuilt on current main. This PR's head and branch are preserved; recovery: git fetch origin pull/566/head.

@seathatflowsinourveins
seathatflowsinourveins deleted the codex/native-landscape-capabilities-20260930 branch October 8, 2026 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lane:foundation Foundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants