-
Notifications
You must be signed in to change notification settings - Fork 2
research: episodic-to-semantic memory promotion for long-term knowledge retention #1608
Copy link
Copy link
Closed
Labels
enhancementNew feature or requestNew feature or requestmemoryzeph-memory crate (SQLite)zeph-memory crate (SQLite)researchResearch-driven improvementResearch-driven improvement
Description
Research Finding
Source: arxiv:2501.11739 (Jan 2025), arxiv:2512.13564
Applicability: High | Complexity: Moderate
Problem
Zeph stores all memory entries uniformly with no distinction between ephemeral episodic events and stable semantic facts. Over time, the memory grows unbounded and retrieval precision degrades as similar-but-stale entries compete with current ones. Ebbinghaus eviction handles decay but has no promotion complement.
Proposed Approach
A background consolidation job (similar to the existing autosave/snapshot loop) that:
- Clusters recent embeddings weekly using cosine similarity threshold (e.g. 0.92)
- Promotes stable clusters to a
semantic_memorytier in SQLite by stripping episodic metadata (timestamp, session_id) and merging near-duplicate entries via LLM - Soft-deletes episodic originals after promotion (preserving searchability with decay boost)
The promotion signal: a fact appears in N+ sessions without contradiction → stable semantic knowledge.
Memory Tier Design
| Tier | Table | Retention | Retrieval weight |
|---|---|---|---|
| Episodic | messages |
decays (Ebbinghaus) | temporal boost |
| Working | summaries |
session-scoped | context priority |
| Semantic | semantic_facts (new) |
permanent | high weight |
Integration Points
crates/zeph-memory: newpromote_to_semantic()background job[memory.semantic]config:promotion_threshold(min sessions),similarity_threshold- CLI:
/memory promoteto trigger manual promotion - TUI: semantic fact count in memory panel
Reference
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestmemoryzeph-memory crate (SQLite)zeph-memory crate (SQLite)researchResearch-driven improvementResearch-driven improvement