arXiv:cs.CL· Zhiyun Shi·· 4 小时前AI 评分47
Madeleine:从模拟人生中学习对话记忆的非自主回忆
Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives
AI 导读
针对长期对话助手难以在恰当时机召回正确记忆的问题,Madeleine 提出将联想视为可学习相关性,用 LLM 人生模拟器离线生成模拟人生,以线索-触发对训练查询编码器在冻结相似度之上学习残差联想。
正文
Abstract:A long-term conversational assistant must recall the right memory at the right moment, yet the memory that matters most is often not similar to what the user says now. Current systems recover such associations by letting an LLM reason at write or read time, at a cost of hundreds to over a thousand LLM calls per memory bank and up to several thousand context tokens per query. We argue that association is a learnable relevance: the pointwise mutual information of memories under how human lives unfold. We introduce Madeleine, which learns amortized association: offline, an LLM life simulator writes simulated lives, whose cue-trigger pairs teach a query encoder a residual association on top of frozen similarity; online, it calls no LLM and plugs into any vector memory by replacing only the query encoder. On LoCoMo-Plus under the official protocol, Madeleine (I) reaches 66.6 when plugged into HyperMem, the highest among all systems evaluated under this protocol; (II) used alone, reaches the score of HyperMem as released (52.4 vs. 52.9) with zero LLM calls and about 1/21 of its answer context; and (III) lifts T-Mem by 26.2 points, significantly outperforms the same untrained backbone inside both systems, and leaves ordinary QA intact on the 4B backbone.
| Comments: | 18 pages, 4 figures. v2: adds three-seed results for the HyperMem plug-in and an evaluation with human-written triggers (Appendix D) |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR) |
| Cite as: | arXiv:2610.01118 [cs.CL] |
| (or arXiv:2610.01118v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.01118 arXiv-issued DOI via DataCite |
Submission history
From: Zhiyun Shi [view email]
[v1]
Thu, 1 Oct 2026 05:59:23 UTC (1,037 KB)
[v2]
Wed, 7 Oct 2026 12:42:40 UTC (1,029 KB)
来源:arXiv:cs.CL · arxiv.org