Skip to content

catalog: finalize memory and RAG upstream stack recommendations - #828

Merged
seathatflowsinourveins merged 4 commits into
mainfrom
codex/memory-rag-final-stacks-20261007
Oct 7, 2026
Merged

seathatflowsinourveins merged 4 commits into
mainfrom
codex/memory-rag-final-stacks-20261007

Conversation

@seathatflowsinourveins

@seathatflowsinourveins seathatflowsinourveins commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

Scope

The foundation catalog lacked a final, use-case-specific memory/RAG architecture recommendation backed by current upstream engineering evidence. Add five recommended stacks, an 18-repository source review, and generated decision-index entries. The modular default is Hindsight + Docling + Haystack + Qdrant + Opik; separate choices cover coding continuity, application personalization, packaged document RAG, and workplace knowledge.

These are bounded source-review recommendations. The record retains observed CI failures, benchmark limitations, mutable-source limits, unspecified model/package locks and the unexecuted complete pipeline. Selection follows the merged October 6 upstream-evidence rule; installation/client-smoke/organic-use evidence remains separate. Deployment pins, services and historical trial artifacts are unchanged.

  • Base commit: 79619936926576576e5d011eec19e3790e55f457.
  • Lane: lane:foundation
  • Owned paths: catalogs/foundation/README.md, catalogs/foundation/memory-rag-stacks-20261007.json, docs/decisions/2026-10-07-memory-rag-source-stacks.md, evidence/artifacts/memory-rag-stacks-20261007/review.json, catalogs/us-equities/decision-index.json, and only this contribution's registrations in manifests/evidence.json.
  • Initial payload and evidence registrations are separate commits; subsequent main integrations rebuild the shared registry through the repository protocol. Coordination with the final-catalog synthesis owner: Consolidate catalog evidence, organic controls and foundation records #820 (comment). Shared-registry integration handoff: Record upstream evaluation rule and context read-back waiver #802 (comment). This does not claim completion of the separate catalog synthesis.

SOTA sources

All 18 inspected commits, release tags, workflow observations and source locators are recorded in evidence/artifacts/memory-rag-stacks-20261007/review.json and linked from the structured catalog. Representative primary sources:

Evidence-class table

Claim Evidence class Command / receipt
Five architecture recommendations and 18 upstream-quality assessments source_review evidence/artifacts/memory-rag-stacks-20261007/review.json; inspected commits, workflow runs, release metadata and limitations
Catalog/index/manifest integration and hashes pass local_integration Commands below; 10,423 hashes, 875 repository identities, 2,072 typed references
Existing relevant catalog behavior passes local_integration 33 catalog tests

Independent bounded review checked all 18 release records/provenance joins, 28 pinned GitHub source locators, in-memory index regeneration and payload hashes. Its broken Haystack links were corrected to the official unversioned URLs, and the mutable PageIndex benchmark locator is explicitly disclosed.

The shared-registry integrations took main's evidence registry, re-registered this contribution's files and regenerated the component matrix/new-host list through the repository's protocol. The final policy alignment was independently reviewed at 6b2a9dd452d2b1da8a7e1eb93585b23d079c1d58. Deterministic comparisons confirm that all five stack choices and all 18 upstream audit records remain unchanged; only policy references and scope wording changed. Catalog/index/hash validation and the 33 relevant tests were repeated on the combined revision and passed.

Local commands run

python3 scripts/catalog_decisions.py --check
exit 0; 875 repositories, 2072 references
python3 scripts/evidence_manifest.py --check
exit 0; 10423 files
python3 scripts/validate.py
exit 0; 69 components, 10423 hashed files, 4 profiles, 224 receipts
python3 scripts/validate_catalogs.py
exit 0
python3 scripts/validate_foundation.py --root . --json
exit 0; errors []
python3 scripts/build_ecosystem.py --check
exit 0; 19 pre-existing architecture-pin drift rows retained
python3 -m unittest tests.test_foundation_catalog tests.test_catalog_decisions
exit 0; 33 tests, OK
git diff --check
exit 0
python3 scripts/component_matrix.py --write
exit 0; 32 rows, zero flip-rule violations
python3 scripts/new_host_grand_list.py --write
exit 0; 32 layers, 66 winners

The current authenticated star inventory contains 366 repositories. The existing decision index deliberately retains its older dated 357-star snapshot; this contribution does not refresh unrelated inventory.

Decision record

docs/decisions/2026-10-07-memory-rag-source-stacks.md names the recommendations, alternatives, evidence limits, unresolved specifications and criteria for revisiting each choice. Complete-stack runtime acceptance and matched comparative superiority remain unestablished.

Host evidence

No host receipt or platform status changes.

Checklist

  • No workflow or dependency changes.
  • No secrets or new required secret.
  • No new paid service or billing surface.
  • Peer-owned files and worktrees preserved.

@seathatflowsinourveins seathatflowsinourveins added the lane:foundation Foundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers label Oct 7, 2026
@seathatflowsinourveins
seathatflowsinourveins merged commit 18150f1 into main Oct 7, 2026
25 checks passed
@seathatflowsinourveins
seathatflowsinourveins deleted the codex/memory-rag-final-stacks-20261007 branch October 7, 2026 08:23
seathatflowsinourveins added a commit that referenced this pull request Oct 7, 2026
### Scope

Qualifies #828's current memory/RAG catalog as proposed source-review input and adds a dated provenance amendment. The original review observations, decided text, eighteen repository pins/dispositions and five profile memberships are preserved.

- Base commit: `c9e3597b176c247585392aa22cc23dbb748a3441`
- Head: `663702741d8019cc9b091735f2ff7fbfccb7c706`
- Lane: `lane:foundation`
- Owned paths: the memory/RAG catalog, catalog README, appended decision amendment, two new qualification artifacts and their evidence-registry bindings.
- Landing path: co-op exact-head read of findings F1–F3 → command-center ACK with CI at that head → the command center's queue, landed by 5f. This is the explicitly assigned #828 follow-up, exempt from the lane's two-unit cap; it stays draft until that read.

Exactly three findings addressed:

1. **F1 (P2):** explicit proposed status, recommendation-only responsibilities, no host memory-owner selection and no preselected memory-h2h winner. The current carriers are edited; the old decision is qualified by an appended dated amendment.
2. **F2 (P2):** the historical PageIndex benchmark revision remains unrecovered. A new dated check pins the separate benchmark README, labels its counts and exclusions as vendor descriptions and makes all eighteen inspected component locators direct in the amendment.
3. **F3 (P3):** installation and client smoke are explicitly not performed in this review; organic use is not observed. “Tested” evaluation wording names the upstream CI actor.

### SOTA sources

- [Original source review and catalog at the landed #828 commit](https://github.com/seathatflowsinourveins/native-agent-stack/tree/18150f10b061ca3fb74a63cdb783dbaaf31c4057/evidence/artifacts/memory-rag-stacks-20261007), including its eighteen immutable primary-source locators. This follow-up preserves that record and its failure observations.
- [VectifyAI/PageIndex-OSS-Benchmark@ad4c0b9:README.md](https://github.com/VectifyAI/PageIndex-OSS-Benchmark/blob/ad4c0b92970a6f4801f09ff2e647389e8f5874fa/README.md#L6-L15), with [the count inventory](https://github.com/VectifyAI/PageIndex-OSS-Benchmark/blob/ad4c0b92970a6f4801f09ff2e647389e8f5874fa/README.md#L22-L23). This new check is not a recovered historical pin or an executed benchmark.
- [Repository evidence policy@c9e3597b176c247585392aa22cc23dbb748a3441:docs/acceptance-evidence-policy.md](https://github.com/seathatflowsinourveins/native-agent-stack/blob/c9e3597b176c247585392aa22cc23dbb748a3441/docs/acceptance-evidence-policy.md#L24-L40) and [hot-file protocol](https://github.com/seathatflowsinourveins/native-agent-stack/blob/c9e3597b176c247585392aa22cc23dbb748a3441/docs/lanes.md#L94-L141): source review, native acceptance and structural validation remain separate; registry committed last.

### Evidence-class table

| Claim | Evidence class | Command / receipt |
| --- | --- | --- |
| Proposed-status and actor qualifications | source_review | Current catalog plus appended decision amendment |
| Newly pinned PageIndex benchmark description | source_review; vendor claim | New `source-qualification.json`; pinned README above |
| Historical bytes, eighteen pins/dispositions and five memberships preserved | structural_validation | Exact base/head byte and parsed-signature comparisons |
| Typed index and registered file consistency | structural_validation | `catalog_decisions.py --write`, `validate.py` |
| Catalog parser contracts | synthetic fixture; structural_validation | Existing `tests.test_catalog_decisions`: 14 tests, exit 0 |
| Installation, native-client smoke, organic use and model/benchmark runs | not performed in this review | Explicit qualification states |

### Local commands run

```
python3 scripts/catalog_decisions.py --write
exit 0; identity union and typed pointers validated; generated index unchanged

python3 -c 'import sys; from pathlib import Path; sys.path.insert(0, "scripts"); import host_receipts
for p in sys.argv[1:]: host_receipts.register_file(Path("."), p)' <five owned files>
exit 0

python3 -m unittest tests.test_catalog_decisions
exit 0; 14 tests passed

python3 scripts/validate.py
exit 0; status passed, 10,490 hashed files

git diff --check
exit 0
```

Commands ran with nice 19 and idle I/O; test scratch and logs are durable private lane state. The registry is the last commit. No rebase was performed.

### Decision record

`docs/decisions/2026-10-07-memory-rag-source-stacks.md`, appended **Amendment (2026-10-07)**. The separately owned memory-h2h result is added as an explicit possible overturn source; this PR makes no new selection.

### Host evidence

No host receipt or deployed configuration is changed.

### Checklist

- [x] No workflows, dependency locks or installation commands changed.
- [x] No credentials, raw conversations or private host paths committed.
- [x] No new paid hosting or billing surface introduced.
- [x] Peer-owned worktrees and untracked files preserved.
- [x] Exactly F1, F2 and F3 addressed; source review is not promoted into adoption.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lane:foundation Foundation lane: Claude/Codex setup, hosts, memory, RAG, research, workers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant