arXiv：cs.AI· Zian Yuan, Wei Li·· 18 小时前
PrivacyGuard：面向云端 GUI 智能体的源关联脱敏与本地可解析 PII 引用
PrivacyGuard: Source-Linked Sanitization and Locally Resolvable PII References for Cloud GUI Agents
AI 导读
PrivacyGuard 通过源关联脱敏（SAN）与结构化引用生命周期（REF），解决云端 GUI 智能体上传指令和截图时的 PII 泄露问题。在五轮会话测试中，它将审计到的源值泄露较最接近的既有全流程系统降低 33.55%--82.60%，REF 将严格跨形式连续性从 0.04 提升至 0.81。
正文
Abstract:Cloud graphical user interface (GUI) agents send instructions and screenshots to remote planners, exposing personally identifiable information (PII). Existing placeholder defenses mask detected spans and reuse exact strings. Fragmented or changed forms can expose PII or break entity continuity across turns. PrivacyGuard addresses this private reference problem with source-linked sanitization (SAN) and a structured reference lifecycle (REF). SAN reconstructs fragmented or overlapping evidence and rewrites the complete source extent. REF links changed appearances to session entities and supports locally resolvable references without returning raw values to the upload path. In five-turn sessions scored against common gold, PrivacyGuard reduces audited source-value leakage by 33.55\%--82.60\% relative to the closest prior full-pipeline system in all four reader--language combinations. REF raises strict cross-form continuity from 0.04 under exact-value reuse to 0.81. In reference-required Android tasks, verified completion rises from 8/30 and 7/30 to 17/30 and 20/30. On AndroidLab, PrivacyGuard achieves the highest or tied-highest task-success point estimate among protection pipelines for all four planners. On PrivScreen, it reduces fixed-reader field exposure by 62.72\%--62.84\% relative to the same baseline. PrivacyGuard lowers upload exposure while preserving a locally resolvable task path.
| Subjects: | Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC) |
| Cite as: | arXiv:2610.16778 [cs.CR] |
| (or arXiv:2610.16778v1 [cs.CR] for this version) | |
| https://doi.org/10.48550/arXiv.2610.16778 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Zian Yuan [view email]
[v1]
Mon, 12 Oct 2026 13:34:52 UTC (4,540 KB)
来源：arXiv：cs.AI · arxiv.org