arXiv:cs.AI· Jianghong Zhou, Hao Rong, Chen Lin, Daoan Zhang·· 18 小时前
多步并一步:LLM 智能体的推理收缩与安全记忆复用边界
Many Steps into One: Reasoning Contraction and the Limits of Safe Memory Reuse for LLM Agents
AI 导读
研究提出「推理收缩」概念,指出将多步推理压缩为记忆可节省步骤,但事实变化后记忆会悄然出错。在五个 LLM 的多跳问答上,ExpeL 和 ACE 式计数器给出的过时答案比经认证的记忆多 7.0-13.5 倍,在带精确验证器的代码任务上多 35-73 倍。研究给出按似然比加权失败、对活跃推理认证效用并在事实变化时重启证书的方法,认证负载决定安全记忆可跳过多少推理。
正文
Abstract:Thought templates, skill libraries, agent memories and caches turn many reasoning steps into one. We call this reasoning contraction. A contracted memory saves reasoning steps and errors until its facts change, then quietly answers wrong. Most systems trust memories by counting successes and failures. We prove that such counters are badly tuned change detectors: a symmetric counter notices a partial change only after a power of its false-alarm horizon, and an unclipped one may never notice it. On five LLMs answering multi-hop questions over edited facts, ExpeL- and ACE-style counters serve 7.0-13.5x more stale answers than certified memories given the same information, and on code tasks with an exact verifier 35-73x more. Safety also has a price. When facts change and each memory is judged only by its own verified outcomes, one number, the certification load, sets how much reasoning any safe memory can skip, and under Zipf demand it yields a scaling law. Our recipe weighs each memory's failures by its own likelihood ratio, certifies its utility against live reasoning, and restarts the certificate when facts change, with the likelihood-ratio detector as the safety net for unannounced changes; for large edits it also invalidates the memory.
| Comments: | 57 pages |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.17544 [cs.CL] |
| (or arXiv:2610.17544v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.17544 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Jianghong Zhou [view email]
[v1]
Tue, 13 Oct 2026 01:16:37 UTC (444 KB)
来源:arXiv:cs.AI · arxiv.org