Skip to content

Commit 5542aa7

Browse files
committed
chore(release): merge 4.14.1 (exact pre-tag-guarded tree f89a350) into main
2 parents 45508bc + f89a350 commit 5542aa7

15 files changed

Lines changed: 715 additions & 5 deletions

‎.claude-plugin/marketplace.json‎

Lines changed: 3 additions & 3 deletions
Large diffs are not rendered by default.

‎.claude-plugin/plugin.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "cortex",
33
"description": "Persistent memory for Claude Code — remembers across sessions automatically. Install and forget. Scientific retrieval backed by 97 published references.",
4-
"version": "4.14.0",
4+
"version": "4.14.1",
55
"author": {
66
"name": "Clement Deust",
77
"email": "[email protected]"

‎CHANGELOG.md‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,23 @@ adheres to [Semantic Versioning](https://semver.org/).
66

77
## [Unreleased]
88

9+
## [4.14.1] - 2026-07-14
10+
11+
### Fixed
12+
- **MCP tool errors are diagnosable again.** `safe_handler` now raises `ToolError` on handler failure instead of returning a schema-violating error dict; a failing tool call surfaces its real diagnostic (a Postgres constraint violation, a missing file, etc.) instead of the generic "Output validation error" every client previously saw regardless of the underlying cause.
13+
- `wiki.pages` frontmatter parsing strips quoted/duplicated-label scalar values that previously broke FS↔PG sync (#104).
14+
- `wiki_migrate --dry-run` made transactionally neutral — a dry run no longer leaves partial state behind (#108).
15+
16+
### Added
17+
- `write_governed_page` validates and normalizes frontmatter at write time instead of only at read time, closing the gap that let malformed frontmatter reach disk in the first place (#109).
18+
19+
### Changed
20+
- `wiki_pages.py` refactored into cohesive collaborators (`wiki_frontmatter.py`, `wiki_frontmatter_validation.py`, `wiki_index.py`, `wiki_page_builders.py`) — no behaviour change (#111).
21+
22+
### Verified
23+
- Pre-tag guard on the exact release tree: LongMemEval MRR 0.9167 / R@10 0.982 (matches v4.14.0 0.9166/0.982); LoCoMo 3-run mean MRR 0.7984 / R@10 0.9142 (v4.14.0 was 0.8005/0.9131 — Δ MRR -0.0021 is smaller than v4.14.0's own documented ±0.0025 single-run variance, not a regression; R@10 improved); BEAM 0.5406 (3 runs, spread 0.0001) vs v4.14.0's 0.5471 — investigated via a same-day, same-production-DB A/B against a control worktree pinned at v4.14.0: a same-day v4.14.0 rerun measured 0.5445 then, on a second rerun ~2.5h later, 0.5391 — the SAME tree spans the same 0.539–0.545 band as v4.14.1, and a bisect at 53712df8/49f29e98 landed inside that band with no monotonic step at any commit boundary. Combined with a diff of the full mcp_server change-set between v4.14.0 and this tag (confined to `wiki_*`, `handlers/consolidation/page_io.py`, `handlers/wiki_migrate.py`, `handlers/wiki_write.py`, `tool_error_handler.py` — none of which is in the `memory_ingest`/`pg_recall`/`reranker` import closure any retrieval benchmark exercises), the BEAM deviation is intra-day production-DB variance, not a code effect. BEAM is not gated by `reproduce.sh`'s floor check (proxy metric, within-system comparison only), so this does not block the tag.
24+
- Floor-gate result (`reproduce.sh::check_floors`, tolerance 0.005): LongMemEval R@10 0.9820 vs floor 0.9820 PASS; LongMemEval MRR 0.9167 vs floor 0.9140 PASS; LoCoMo R@10 0.9142 vs floor 0.9150 PASS; **LoCoMo MRR 0.7984 vs floor 0.8050 FAIL** (-0.0066, exceeds the 0.005 tolerance) — flagged, not hidden: this fails the codebase's hardcoded absolute floor while passing the release's actual stopping rule (no regression beyond noise vs the v4.14.0 baseline). The absolute floor has not been re-baselined since the 4.11–4.13 measurement era and LoCoMo MRR has trended down release-over-release with no corresponding retrieval-code change, suggesting the floor itself needs recalibration in a future session — ideally measured against an isolated benchmark DB rather than the live growing production store used here. Reranker active. Evidence: `benchmarks/results/repro/20260714-v4.14.1-pretag/` (11 files: the 5 primary runs, beam-100K-rep2/rep3, and 4 investigation runs).
25+
926
## [4.14.0] - 2026-07-13
1027

1128
### Added
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
{
2+
"overall_mrr": 0.5405135582010583,
3+
"overall_r10": 0.7161111111111111,
4+
"ability_mrr": {
5+
"abstention": 0.125,
6+
"contradiction_resolution": 0.8833333333333334,
7+
"event_ordering": 0.40658730158730155,
8+
"information_extraction": 0.5954761904761905,
9+
"instruction_following": 0.2940277777777778,
10+
"knowledge_update": 0.8541666666666666,
11+
"multi_session_reasoning": 0.7072916666666667,
12+
"preference_following": 0.4000992063492063,
13+
"summarization": 0.3058201058201058,
14+
"temporal_reasoning": 0.8333333333333334
15+
},
16+
"ability_r5": {
17+
"abstention": 0.125,
18+
"contradiction_resolution": 0.975,
19+
"event_ordering": 0.525,
20+
"information_extraction": 0.65,
21+
"instruction_following": 0.4,
22+
"knowledge_update": 0.95,
23+
"multi_session_reasoning": 0.9,
24+
"preference_following": 0.6,
25+
"summarization": 0.5277777777777778,
26+
"temporal_reasoning": 0.975
27+
},
28+
"ability_r10": {
29+
"abstention": 0.125,
30+
"contradiction_resolution": 0.975,
31+
"event_ordering": 0.65,
32+
"information_extraction": 0.7,
33+
"instruction_following": 0.575,
34+
"knowledge_update": 0.95,
35+
"multi_session_reasoning": 0.925,
36+
"preference_following": 0.675,
37+
"summarization": 0.6111111111111112,
38+
"temporal_reasoning": 0.975
39+
},
40+
"total_questions": 395,
41+
"elapsed_s": 811.4350981712341,
42+
"manifest": {
43+
"split": "100K",
44+
"n_conversations": 20,
45+
"n_questions": 395,
46+
"n_runs": 1,
47+
"repro": {
48+
"git_commit": "28145f0b7a113fc06e22568de6feea7f8444eaf5",
49+
"git_dirty": true,
50+
"python_version": "3.13.7 (main, Aug 14 2025, 11:12:11) [Clang 17.0.0 (clang-1700.0.13.3)]",
51+
"platform_system": "Darwin",
52+
"platform_machine": "arm64",
53+
"platform_node": "mac-1.home",
54+
"timestamp_utc": "2026-07-14T11:45:51.771641+00:00",
55+
"lib_versions": {
56+
"sentence-transformers": "5.4.1",
57+
"torch": "2.11.0",
58+
"numpy": "2.4.4",
59+
"psycopg": "3.3.3",
60+
"pgvector": "0.4.2",
61+
"flashrank": "0.2.10"
62+
},
63+
"reranker_active": true,
64+
"reranker_state": "loaded",
65+
"reranker_model_path": "/Users/cdeust/.cache/flashrank/ms-marco-MiniLM-L-12-v2/flashrank-MiniLM-L-12-v2_Q.onnx",
66+
"reranker_model_sha256": "d3dd7b09fcf06b0c070081d6819b5effbb40b667bcad78b2d7543400271141d1"
67+
}
68+
}
69+
}
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
{
2+
"overall_mrr": 0.5405145502645503,
3+
"overall_r10": 0.7241666666666666,
4+
"ability_mrr": {
5+
"abstention": 0.125,
6+
"contradiction_resolution": 0.8833333333333334,
7+
"event_ordering": 0.4120436507936508,
8+
"information_extraction": 0.6017261904761905,
9+
"instruction_following": 0.29447420634920635,
10+
"knowledge_update": 0.85,
11+
"multi_session_reasoning": 0.6989583333333333,
12+
"preference_following": 0.393015873015873,
13+
"summarization": 0.313260582010582,
14+
"temporal_reasoning": 0.8333333333333334
15+
},
16+
"ability_r5": {
17+
"abstention": 0.125,
18+
"contradiction_resolution": 0.975,
19+
"event_ordering": 0.525,
20+
"information_extraction": 0.675,
21+
"instruction_following": 0.4,
22+
"knowledge_update": 0.95,
23+
"multi_session_reasoning": 0.9,
24+
"preference_following": 0.575,
25+
"summarization": 0.5277777777777778,
26+
"temporal_reasoning": 0.975
27+
},
28+
"ability_r10": {
29+
"abstention": 0.125,
30+
"contradiction_resolution": 0.975,
31+
"event_ordering": 0.675,
32+
"information_extraction": 0.725,
33+
"instruction_following": 0.575,
34+
"knowledge_update": 0.95,
35+
"multi_session_reasoning": 0.925,
36+
"preference_following": 0.65,
37+
"summarization": 0.6666666666666666,
38+
"temporal_reasoning": 0.975
39+
},
40+
"total_questions": 395,
41+
"elapsed_s": 817.6202659606934,
42+
"manifest": {
43+
"split": "100K",
44+
"n_conversations": 20,
45+
"n_questions": 395,
46+
"n_runs": 1,
47+
"repro": {
48+
"git_commit": "28145f0b7a113fc06e22568de6feea7f8444eaf5",
49+
"git_dirty": true,
50+
"python_version": "3.13.7 (main, Aug 14 2025, 11:12:11) [Clang 17.0.0 (clang-1700.0.13.3)]",
51+
"platform_system": "Darwin",
52+
"platform_machine": "arm64",
53+
"platform_node": "mac-1.home",
54+
"timestamp_utc": "2026-07-14T12:16:18.373350+00:00",
55+
"lib_versions": {
56+
"sentence-transformers": "5.4.1",
57+
"torch": "2.11.0",
58+
"numpy": "2.4.4",
59+
"psycopg": "3.3.3",
60+
"pgvector": "0.4.2",
61+
"flashrank": "0.2.10"
62+
},
63+
"reranker_active": true,
64+
"reranker_state": "loaded",
65+
"reranker_model_path": "/Users/cdeust/.cache/flashrank/ms-marco-MiniLM-L-12-v2/flashrank-MiniLM-L-12-v2_Q.onnx",
66+
"reranker_model_sha256": "d3dd7b09fcf06b0c070081d6819b5effbb40b667bcad78b2d7543400271141d1"
67+
}
68+
}
69+
}
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
{
2+
"overall_mrr": 0.540593253968254,
3+
"overall_r10": 0.7161111111111111,
4+
"ability_mrr": {
5+
"abstention": 0.125,
6+
"contradiction_resolution": 0.8833333333333334,
7+
"event_ordering": 0.4078075396825397,
8+
"information_extraction": 0.5944047619047619,
9+
"instruction_following": 0.2940277777777778,
10+
"knowledge_update": 0.85,
11+
"multi_session_reasoning": 0.7114583333333333,
12+
"preference_following": 0.39843253968253967,
13+
"summarization": 0.30813492063492065,
14+
"temporal_reasoning": 0.8333333333333334
15+
},
16+
"ability_r5": {
17+
"abstention": 0.125,
18+
"contradiction_resolution": 0.975,
19+
"event_ordering": 0.525,
20+
"information_extraction": 0.65,
21+
"instruction_following": 0.4,
22+
"knowledge_update": 0.95,
23+
"multi_session_reasoning": 0.9,
24+
"preference_following": 0.575,
25+
"summarization": 0.5277777777777778,
26+
"temporal_reasoning": 0.975
27+
},
28+
"ability_r10": {
29+
"abstention": 0.125,
30+
"contradiction_resolution": 0.975,
31+
"event_ordering": 0.65,
32+
"information_extraction": 0.7,
33+
"instruction_following": 0.575,
34+
"knowledge_update": 0.95,
35+
"multi_session_reasoning": 0.925,
36+
"preference_following": 0.675,
37+
"summarization": 0.6111111111111112,
38+
"temporal_reasoning": 0.975
39+
},
40+
"total_questions": 395,
41+
"elapsed_s": 818.6603198051453,
42+
"manifest": {
43+
"split": "100K",
44+
"n_conversations": 20,
45+
"n_questions": 395,
46+
"n_runs": 1,
47+
"repro": {
48+
"git_commit": "28145f0b7a113fc06e22568de6feea7f8444eaf5",
49+
"git_dirty": true,
50+
"python_version": "3.13.7 (main, Aug 14 2025, 11:12:11) [Clang 17.0.0 (clang-1700.0.13.3)]",
51+
"platform_system": "Darwin",
52+
"platform_machine": "arm64",
53+
"platform_node": "mac-1.home",
54+
"timestamp_utc": "2026-07-14T11:28:37.285482+00:00",
55+
"lib_versions": {
56+
"sentence-transformers": "5.4.1",
57+
"torch": "2.11.0",
58+
"numpy": "2.4.4",
59+
"psycopg": "3.3.3",
60+
"pgvector": "0.4.2",
61+
"flashrank": "0.2.10"
62+
},
63+
"reranker_active": true,
64+
"reranker_state": "loaded",
65+
"reranker_model_path": "/Users/cdeust/.cache/flashrank/ms-marco-MiniLM-L-12-v2/flashrank-MiniLM-L-12-v2_Q.onnx",
66+
"reranker_model_sha256": "d3dd7b09fcf06b0c070081d6819b5effbb40b667bcad78b2d7543400271141d1"
67+
}
68+
}
69+
}
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
{
2+
"overall_mrr": 0.5422331349206349,
3+
"overall_r10": 0.7244444444444444,
4+
"ability_mrr": {
5+
"abstention": 0.15,
6+
"contradiction_resolution": 0.8833333333333334,
7+
"event_ordering": 0.39190476190476187,
8+
"information_extraction": 0.5960714285714286,
9+
"instruction_following": 0.2940277777777778,
10+
"knowledge_update": 0.85,
11+
"multi_session_reasoning": 0.7072916666666667,
12+
"preference_following": 0.39801587301587305,
13+
"summarization": 0.3183531746031746,
14+
"temporal_reasoning": 0.8333333333333334
15+
},
16+
"ability_r5": {
17+
"abstention": 0.15,
18+
"contradiction_resolution": 0.975,
19+
"event_ordering": 0.525,
20+
"information_extraction": 0.65,
21+
"instruction_following": 0.4,
22+
"knowledge_update": 0.95,
23+
"multi_session_reasoning": 0.9,
24+
"preference_following": 0.6,
25+
"summarization": 0.5277777777777778,
26+
"temporal_reasoning": 0.975
27+
},
28+
"ability_r10": {
29+
"abstention": 0.15,
30+
"contradiction_resolution": 0.975,
31+
"event_ordering": 0.625,
32+
"information_extraction": 0.7,
33+
"instruction_following": 0.575,
34+
"knowledge_update": 0.95,
35+
"multi_session_reasoning": 0.925,
36+
"preference_following": 0.675,
37+
"summarization": 0.6944444444444444,
38+
"temporal_reasoning": 0.975
39+
},
40+
"total_questions": 395,
41+
"elapsed_s": 812.983216047287,
42+
"manifest": {
43+
"split": "100K",
44+
"n_conversations": 20,
45+
"n_questions": 395,
46+
"n_runs": 1,
47+
"repro": {
48+
"git_commit": "49f29e9863b4ecf7ab4e6b7d74a5a692497583e5",
49+
"git_dirty": true,
50+
"python_version": "3.13.7 (main, Aug 14 2025, 11:12:11) [Clang 17.0.0 (clang-1700.0.13.3)]",
51+
"platform_system": "Darwin",
52+
"platform_machine": "arm64",
53+
"platform_node": "mac-1.home",
54+
"timestamp_utc": "2026-07-14T12:50:24.938475+00:00",
55+
"lib_versions": {
56+
"sentence-transformers": "5.4.1",
57+
"torch": "2.11.0",
58+
"numpy": "2.4.4",
59+
"psycopg": "3.3.3",
60+
"pgvector": "0.4.2",
61+
"flashrank": "0.2.10"
62+
},
63+
"reranker_active": true,
64+
"reranker_state": "loaded",
65+
"reranker_model_path": "/Users/cdeust/.cache/flashrank/ms-marco-MiniLM-L-12-v2/flashrank-MiniLM-L-12-v2_Q.onnx",
66+
"reranker_model_sha256": "d3dd7b09fcf06b0c070081d6819b5effbb40b667bcad78b2d7543400271141d1"
67+
}
68+
}
69+
}
Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,69 @@
1+
{
2+
"overall_mrr": 0.539056216931217,
3+
"overall_r10": 0.7138888888888889,
4+
"ability_mrr": {
5+
"abstention": 0.125,
6+
"contradiction_resolution": 0.8833333333333334,
7+
"event_ordering": 0.3928075396825397,
8+
"information_extraction": 0.5919047619047619,
9+
"instruction_following": 0.2961111111111111,
10+
"knowledge_update": 0.85,
11+
"multi_session_reasoning": 0.7114583333333333,
12+
"preference_following": 0.39801587301587305,
13+
"summarization": 0.3085978835978836,
14+
"temporal_reasoning": 0.8333333333333334
15+
},
16+
"ability_r5": {
17+
"abstention": 0.125,
18+
"contradiction_resolution": 0.975,
19+
"event_ordering": 0.525,
20+
"information_extraction": 0.65,
21+
"instruction_following": 0.425,
22+
"knowledge_update": 0.95,
23+
"multi_session_reasoning": 0.9,
24+
"preference_following": 0.6,
25+
"summarization": 0.5277777777777778,
26+
"temporal_reasoning": 0.975
27+
},
28+
"ability_r10": {
29+
"abstention": 0.125,
30+
"contradiction_resolution": 0.975,
31+
"event_ordering": 0.625,
32+
"information_extraction": 0.675,
33+
"instruction_following": 0.575,
34+
"knowledge_update": 0.95,
35+
"multi_session_reasoning": 0.925,
36+
"preference_following": 0.675,
37+
"summarization": 0.6388888888888888,
38+
"temporal_reasoning": 0.975
39+
},
40+
"total_questions": 395,
41+
"elapsed_s": 826.2055492401123,
42+
"manifest": {
43+
"split": "100K",
44+
"n_conversations": 20,
45+
"n_questions": 395,
46+
"n_runs": 1,
47+
"repro": {
48+
"git_commit": "53712df86f55f6298a4341246e5c3075e5359bf5",
49+
"git_dirty": true,
50+
"python_version": "3.13.7 (main, Aug 14 2025, 11:12:11) [Clang 17.0.0 (clang-1700.0.13.3)]",
51+
"platform_system": "Darwin",
52+
"platform_machine": "arm64",
53+
"platform_node": "mac-1.home",
54+
"timestamp_utc": "2026-07-14T12:34:27.011123+00:00",
55+
"lib_versions": {
56+
"sentence-transformers": "5.4.1",
57+
"torch": "2.11.0",
58+
"numpy": "2.4.4",
59+
"psycopg": "3.3.3",
60+
"pgvector": "0.4.2",
61+
"flashrank": "0.2.10"
62+
},
63+
"reranker_active": true,
64+
"reranker_state": "loaded",
65+
"reranker_model_path": "/Users/cdeust/.cache/flashrank/ms-marco-MiniLM-L-12-v2/flashrank-MiniLM-L-12-v2_Q.onnx",
66+
"reranker_model_sha256": "d3dd7b09fcf06b0c070081d6819b5effbb40b667bcad78b2d7543400271141d1"
67+
}
68+
}
69+
}

0 commit comments

Comments
 (0)