arXiv:cs.LG· Jie Zhu, Ronik Bhaskar, Heather Zheng, Ben Y. Zhao, Kexin Pei·· 16 小时前
自然代码变换可迷惑 AI 智能体,扰乱漏洞分析
Natural Code Transformation Confuses Agents in Vulnerability Analysis
AI 导读
研究发现,智能体在功能与漏洞完全相同、但经过自然代码变换的真实代码提交上,漏洞分析结果差异显著。研究者从真实代码提交中挖掘开发模式,构建自然变换语料,即使单一变换形式也能有效"迷惑"前沿智能体,如搭载 GPT-6 Sol 的 Codex,降低其漏洞发现成功率。研究还考察了智能体的不同失败模式、变换组合能否提供更强防护,以及自适应攻击者能否逆向变换。
正文
Abstract:Having demonstrated a strong potential for automating vulnerability discovery, AI agents can also be used to attack software systems at scale. Today's software systems need mechanisms to level the playing field by slowing down potential attacks, giving them time to patch vulnerabilities and strengthen software. Along this line, our study of agent trajectories in vulnerability analysis shows a surprising finding: agents produce dramatically different results across real-world code commits that carry the same functionality and the same vulnerability. This phenomenon appears consistently in multiple code domains and vulnerability categories.
It motivates us to study natural and functionality-preserving code transformations derived from real-world software development, and their potential as a defense against attacker agents. We build a corpus of natural transformations by mining recurring development patterns from real-world code commits, and apply them to evaluate impact on agentic vulnerability analysis. Our results show that even a single form of transformation can effectively "confuse" frontier agents, e.g., Codex with GPT-6 Sol, reducing successes in vulnerability discovery. We also study different agent failures, whether transformations can be composed to provide stronger protection, and adaptive attackers who seek to reverse them. Overall, our study of natural code transformation significantly expands the research space of using code transformations to defend against malicious agents.
| Subjects: | Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.14350 [cs.CR] |
| (or arXiv:2610.14350v2 [cs.CR] for this version) | |
| https://doi.org/10.48550/arXiv.2610.14350 arXiv-issued DOI via DataCite |
Submission history
From: Jie Zhu [view email]
[v1]
Fri, 9 Oct 2026 21:55:41 UTC (186 KB)
[v2]
Wed, 14 Oct 2026 13:20:51 UTC (187 KB)
来源:arXiv:cs.LG · arxiv.org