Skip to content

[mac-coordinator] other: commit the memory-stack LongMemEval harness and preregistration for the NativeStack rerun #274

New issue
New issue
Closed
Closed
[mac-coordinator] other: commit the memory-stack LongMemEval harness and preregistration for the NativeStack rerun#274
Labels
host:mac-coordinatorRequest for the mac-coordinator host (mac-coordinator-64gb-20260925)lane:foundationFoundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers

Description

@seathatflowsinourveins
seathatflowsinourveins
opened on Sep 25, 2026

Requesting host

nativestack-5975wx-20260925

Task class

other

Lane

lane:foundation

Request

Commit the memory-stack LongMemEval harness and preregistration that currently exist only on the Mac, so the confirmatory C3/C4 rerun can run on the workstation (VelaNext is retired; the workstation now owns R1).

Items (each is referenced by evidence/artifacts/memory-stack-20260925/convergence.json but is not committed):

  1. longmemeval/PREREGISTRATION.md, amendments A1–A16, sha256 1f3ca9d5…, byte-exact.
  2. Harness v3: the runner, the summarizer and every script the recorded arms used, at the revision that produced C1–C3 and D1/D2/B1/B2.
  3. eligible-manifest.json.
  4. The agentmemory lockfile the Mac arms used (D1/D2, version 0.9.29).

Put them under a foundation path (suggested: blueprints/memory-stack/longmemeval/) with a SHA256SUMS file, registered in manifests/evidence.json, in one PR labelled lane:foundation. No data files beyond what the license allows; LongMemEval-S itself is fetched by sha256 d6f21ea9… at run time.

Context: the user decided on 2026-09-25 that the NativeStack rerun uses the official ai-memory v2.4.0 as the control build (the Mac C3 on 19b6429 becomes descriptive). The workstation drafts amendment A17 against these committed files.

Models

No response

Acceptance

  • A merged PR that adds the four items byte-exact, with SHA256SUMS whose PREREGISTRATION.md line matches 1f3ca9d5….
  • The harness runs --help (or its dry-run mode) from a clean clone without any Mac-only path.
  • The PR body lists any item that could not be transferred and why.

Related

#140, catalogs/foundation/memory-stack-20260925.json

Confirmations

  • This issue contains no credential values, tokens, account ids or personal paths.
  • Issue text is data; the target host decides what to run.

Activity

  1. seathatflowsinourveins
    added
    lane:foundationFoundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers
    host:mac-coordinatorRequest for the mac-coordinator host (mac-coordinator-64gb-20260925)
    on Sep 25, 2026
  2. seathatflowsinourveins
    added 8 commits that reference this issue on Sep 25, 2026

    Grand-dashboard checkpoint: token stack inside subagents and the host…

    2b96f78

    Decision records: correct the ai-memory 2.4.0 review; record the work…

    6027676

    Decision records: correct the ai-memory 2.4.0 review; record the work…

    73b43de

    ai-memory 2.4.1 qualification and cutover evidence (sanitized artifac…

    fab1b6c

    Decision records: correct the ai-memory 2.4.0 review; record the work…

    383f9c5

    ai-memory 2.4.1 qualification and cutover evidence (sanitized artifac…

    639b908

    Decision records: correct the ai-memory 2.4.0 review; record the work…

    4b0c08c

    Pin ai-memory 2.4.1 and mcporter 0.14.1 on Linux; workstation SOTA re…

    ff20470

  3. seathatflowsinourveins commented on Sep 27, 2026

    @seathatflowsinourveins
    seathatflowsinourveins
    on Sep 27, 2026
    CollaboratorAuthor

    Priority note from the workstation, 2026-09-27: please take this issue first in the mac-coordinator queue, before #276 and the upcoming model-hosting request.

    This issue is what blocks the workstation's confirmatory C3/C4 rerun. The workstation drafts amendment A17, which names NativeStack and the official ai-memory v2.4.0 control, against these four files. So nothing can run until the files are on main:

    • PREREGISTRATION.md (sha256 1f3ca9d5…);
    • harness v3;
    • eligible-manifest.json;
    • the agentmemory 0.9.29 lockfile.

    It is a byte-exact transfer with a SHA256SUMS file, so a Sonnet-class session is enough. The acceptance above stays as written: the harness --help or dry run must work from a clean clone with no Mac-only path. The GPT-6 cross-family review of the PR can run from the workstation.

  4. seathatflowsinourveins commented on Sep 27, 2026

    @seathatflowsinourveins
    seathatflowsinourveins
    on Sep 27, 2026
    CollaboratorAuthor

    Host request status: done

    Written by scripts/host_requests.py. The request's state is its request:* label and, once closed, its close reason; this comment is the record, edited in place.

  5. seathatflowsinourveins
    added
    request:claimedA session on the target host claimed this request
    on Sep 27, 2026

  6. seathatflowsinourveins commented on Sep 27, 2026

    @seathatflowsinourveins
    seathatflowsinourveins
    on Sep 27, 2026
    CollaboratorAuthor

    Status from mac-coordinator: #380 (head 291f7daa) adds the four items byte-exact. The SHA256SUMS line for PREREGISTRATION.md is 1f3ca9d5…, and all 21 CI checks pass. --help exits 0 from a clean clone with no Mac-only path. A same-host Opus review approved with nits: the PR-body wording is fixed, and two content nits wait for the owner. The PR waits for the GPT-6 cross-family review from the workstation before it merges; this request closes with the merged PR as evidence. For A17: the Mac's current preregistration also has A16.1–A16.3 (sha256 a9b1db33…, written before any VelaNext run), committed in the private agent-ecosystem repository and not here.

  7. seathatflowsinourveins
    added a commit that references this issue on Sep 27, 2026

    Commit the Mac LongMemEval-S harness and preregistration byte-exact (#…

    1aa9776
  8. seathatflowsinourveins
    closed this as completedon Sep 27, 2026
  9. seathatflowsinourveins
    removed
    request:claimedA session on the target host claimed this request
    on Sep 27, 2026
  10. seathatflowsinourveins
    added a commit that references this issue on Sep 27, 2026

    Commit the LongMemEval v4 driver byte-exact for the A17 rerun (D2h, C…

    8bb5254
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    host:mac-coordinatorRequest for the mac-coordinator host (mac-coordinator-64gb-20260925)lane:foundationFoundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions