You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit e9b0077
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: README.md
+14-2Lines changed: 14 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -292,7 +292,18 @@ from it.
292
292
| Recall@10 |**98.2%**|**97.8%**|
293
293
| MRR |**0.9167**|**0.905**|
294
294
295
-
Both are single runs: n=500, clean database, consolidation disabled, retrieval only.
295
+
Both are single runs: n=500, consolidation disabled, retrieval only. Both describe the
296
+
**PostgreSQL** store with the cross-encoder reranker: the harness (`benchmarks/lib/bench_db.py`)
297
+
always builds a `PgMemoryStore` and calls `core.pg_recall`, and both artifacts record
298
+
`"reranker_state": "loaded"`. The v4.20.0 run used a clean database in the ephemeral
299
+
`pgvector/pgvector:pg16` container of `benchmarks/reproduce.sh` (its manifest records that
300
+
`pg_image`); the v4.14.1 run did not use that container and ran against the live PostgreSQL
301
+
store (CHANGELOG 4.14.1, "Verified").
302
+
The default SQLite store has no comparable run yet (n=500, reranker loaded;
303
+
[#708](https://github.com/cdeust/Cortex/issues/708)), so these figures do not describe it.
304
+
The best SQLite LongMemEval-S result is a bounded run without the reranker (n=50,
| Published retrieval quality | n=50 without reranker only ([#708](https://github.com/cdeust/Cortex/issues/708)) | LongMemEval-S n=500 above |
337
349
| Fusion | in-process | server-side PL/pgSQL |
338
350
| ANN index | none | pgvector HNSW |
339
351
| Cross-agent team decisions, preemptive context, pipeline heat bumps | no-op | active |
0 commit comments