arXiv：cs.AI· Benjamin Lange·· 6 小时前
AI 对齐与信义义务：开发者对用户负有的四项义务如何生成对齐标准
AI Alignment and Fiduciary Obligation
AI 导读
论文提出将信义义务理论应用于扩展型 AI 助手部署，认为用户-AI 交互始终由开发者中介，开发者对系统行为、记忆和参与参数拥有自由裁量控制权。作者将忠诚、谨慎、诚信、坦诚四项经典信义义务映射为开发者-用户关系的对齐标准，并对应四类用户侧风险提出机构性措施。该框架将对齐标准建立在开发者对用户的义务之上，而非用户-AI 交互应促进的价值观，且这些义务的成立不依赖于用户是否已受实际损害。
正文
Abstract:Advanced AI assistants engage users in extended interactions across a widening range of roles, including advice, decision support, collaboration, learning, emotional support, and companionship among others. Current alignment efforts consider what alignment criteria should govern these relationships, drawing on moral traditions developed for human relationships such as bioethics, virtue ethics, care ethics, and relationship science. This paper considers AI alignment criteria in the user-AI-developer triad, since every user-AI interaction is mediated by a developer who exercises discretionary control over a system's behaviour, memory, and engagement parameters. Drawing on business ethics and legal scholarship, I argue that fiduciary theory applies to extended AI assistant deployment. On this basis, the four canonical fiduciary duties of loyalty, care, good faith, and candour can generate alignment criteria for the developer-user relationship. I map four user-side risks of extended AI assistant deployment to the four duties and specify institutional measures that follow from discharging each duty. The discussion complements existing approaches by grounding alignment criteria in obligations the developer owes the user, rather than in values the user-AI interaction should promote, and by showing that those obligations hold independently of any de facto harm to users.
| Comments: | 10 pages, 1 table. Published in the Proceedings of the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026) |
| Subjects: | Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC) |
| Cite as: | arXiv:2608.02660 [cs.CY] |
| (or arXiv:2608.02660v3 [cs.CY] for this version) | |
| https://doi.org/10.48550/arXiv.2608.02660 arXiv-issued DOI via DataCite |
|
| Journal reference: | Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society 9(3), 1603-1615 (2026) |
| Related DOI: | https://doi.org/10.1609/aies.v9i3.43251
DOI(s) linking to related resources |
Submission history
From: Benjamin Lange [view email]
[v1]
Sat, 1 Aug 2026 14:18:36 UTC (38 KB)
[v2]
Sat, 22 Aug 2026 07:45:11 UTC (38 KB)
[v3]
Mon, 12 Oct 2026 05:57:29 UTC (38 KB)
来源：arXiv：cs.AI · arxiv.org