arXiv:cs.AI· Yi Wen, Derong Xu, Pengyue Jia, Yichao Wang, Yingyi Zhang, Maolin Wang, Junyi Li, Wenlin Zhang, Xiaopeng Li, Yong Liu, Xiangyu Zhao·· 3 小时前
MemoType:用多样化策略让 LLM 智能体实现按记忆类型区分的长期记忆
Memory Type Varies: Empowering LLM Agents for Long-Term Memory with Diverse Strategies
AI 导读
针对现有基于检索的记忆方法对所有记忆采用统一策略的问题,研究者提出记忆多分类数据集 TriMEM 与记忆框架 MemoType,通过学习的 router 模型自适应识别记忆和查询类型并设计定制化检索策略。
正文
Authors:Yi Wen, Derong Xu, Pengyue Jia, Yichao Wang, Yingyi Zhang, Maolin Wang, Junyi Li, Wenlin Zhang, Xiaopeng Li, Yong Liu, Xiangyu Zhao
Abstract:The memory capabilities of Large Language Models (LLMs) have garnered increasing attention recently. Despite great success achieved, existing retrieval-based memory approaches typically overlook the differences between memories and employ a unified strategy to process all memories, leading to suboptimal performance. Thus, an intuitive question arises: can we categorize memory into different types and select appropriate strategies? However, given the topic-rich, scenario-complex, and boundary-blurred nature of memory scenarios, achieving precise classification of memories is not easy. To address this challenge, we propose a memory multi-class dataset in this paper, termed TriMEM, which provides precise annotations for memory types across diverse scenarios. Building upon this foundation, we propose a novel memory framework, named MemoType, which can adaptively recognize each memory and query type with the learned router model. With the memory and query routing, MemoType can retrieve the memory with corresponding query types and design tailored retrieval strategies, thereby enhancing the retrieval performance. Moreover, we theoretically prove that any single retrieval strategy is subject to a fundamental upper bound on its expected retrieval precision in multi-class corpora, leading to systematic precision degradation. Extensive experiments on three datasets demonstrate that MemoType consistently outperforms existing methods, achieving up to 16.18% improvement in Recall@1.
| Comments: | NeurIPS 2026 Accept Paper |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.11573 [cs.AI] |
| (or arXiv:2610.11573v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.11573 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yi Wen [view email]
[v1]
Thu, 8 Oct 2026 09:28:31 UTC (4,342 KB)
来源:arXiv:cs.AI · arxiv.org