arXiv：cs.AI· Xutao Mao, Liangjie Zhao, Leyao Wang, Rui Qian, Qiang Huang, Wentao Wang, Bo Han, Xiang Zheng, Cong Wang·· 23 小时前
自我改进个人智能体存在持续性谄媚：PASB 基准测试
Agents Don't Just Agree, They Remember: Benchmarking Persistent Sycophancy in Self-Improving Personal Agents
AI 导读
研究者提出 Personal Agent Sycophancy Benchmark（PASB），在 Hermes-Agent 和 OpenClaw 两个框架、十六个模型上运行 1,600 项任务，衡量智能体将用户说法写入记忆后被后续会话当作可信上下文读取的"持续性谄媚"。
正文
Abstract:Self-improving personal agents write profiles, memories, and reusable skills that carry over from one chat to the next. Prior works ask whether a model agrees with the user in its next reply. Yet these agents can also write down a claim the user made, and a later chat can read that note back as trusted context. We call this persistent sycophancy. We introduce the Personal Agent Sycophancy Benchmark, PASB, with 1,600 tasks run on two agent frameworks, Hermes-Agent and OpenClaw, across sixteen models that span scales and generations. Each task separates a first chat containing the claim from a follow-up chat in a fresh session, so the first chat can reach the follow-up only through a note the agent chose to write. Downstream failure, the rate at which follow-up answers still rely on the claim, reaches 68.1% when the agent saved the claim against 35.6% when it did not. Later generations fail less often, yet a saved note still more than doubles their failure rate. In 38.8% of runs the saved note states the claim with more authority than the user gave it, and a saved claim still shapes answers in a different domain. Among four mitigations, editing the stored note works better than correcting the agent in conversation, cutting same-domain downstream failure from 36.3% to 30.3% for Hermes-Agent and from 37.9% to 31.6% for OpenClaw. A strong instruction against saving brings failure back to the level of runs that saved nothing. Self-improving agents need controls on what they write to memory as well as on what they say. Our benchmark is available at this https URL.
| Comments: | add evaluations of four latest models including GPT-6-Sol |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2607.10526 [cs.AI] |
| (or arXiv:2607.10526v5 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2607.10526 arXiv-issued DOI via DataCite |
Submission history
From: Xutao Mao [view email]
[v1]
Sun, 12 Jul 2026 01:08:59 UTC (1,817 KB)
[v2]
Tue, 14 Jul 2026 02:45:31 UTC (1,817 KB)
[v3]
Mon, 27 Jul 2026 05:08:50 UTC (1,818 KB)
[v4]
Sun, 27 Sep 2026 10:53:07 UTC (1,135 KB)
[v5]
Sat, 10 Oct 2026 16:22:06 UTC (1,264 KB)
来源：arXiv：cs.AI · arxiv.org