arXiv:cs.CL· Thanh Dong, An Ngo, Minh Dau, Rajesh Kumar·· 5 小时前AI 评分36
通过击键检测 LLM 辅助越南语写作:行为操纵下的鲁棒性研究
Detecting LLM-Assisted Vietnamese Writing via Keystrokes under Behavioral Manipulation
AI 导读
研究团队构建越南语击键数据集,涵盖真实写作、转录与改写三种模式,并设计用户刻意改变打字模式的行为操纵威胁模型。在用户无关与上下文无关设定下评测时序、节奏特征及 1D-CNN、TypeNet 序列建模,结果显示序列模型多数情况下优于特征方法,转录可被可靠识别,但改写与对抗操纵样本常被误判为真实写作。引入行为操纵数据的对抗训练可显著提升可分性与鲁棒性,表明击键检测效果关键依赖对多样写作行为的覆盖。
正文
Abstract:We study the robustness of keystroke dynamics for detecting large language model (LLM)-assisted writing. We introduce a Vietnamese keystroke dataset capturing realistic writing modes, including bona fide composition, transcription, and paraphrasing. We also define a behaviorally grounded threat model in which users deliberately alter typing patterns. To implement the threat model, we create behaviorally manipulated variants of the data designed to evade keystroke-based detection. We evaluate four keystroke modeling approaches: temporal and rhythmic representations, and sequential representations modeled with a one-dimensional convolutional neural network (1D-CNN) and TypeNet, under user-independent and context-independent settings. The results show that sequential models outperform feature-based approaches in most cases and that keystroke signals encode discriminative information about the writing process. However, detection is not uniformly robust: transcription is reliably identified, while paraphrasing and adversarially manipulated samples are frequently misclassified as bona fide when not explicitly modeled. To address this, we incorporate adversarial training using behaviorally manipulated data, which substantially improves separability and robustness. These results suggest that keystroke-based detection depends critically on exposure to diverse writing behaviors, and that strong performance under limited conditions does not generalize to realistic or adversarial settings without targeted modeling.
| Comments: | 9 pages, 2 figures. Thanh Dong and An Ngo contributted equally. Accepted at the 2026 IEEE International Conference on Tools with Artificial Intelligence (ICTAI 2026) |
| Subjects: | Computation and Language (cs.CL); Computers and Society (cs.CY) |
| ACM classes: | I.2.7 |
| Cite as: | arXiv:2610.07700 [cs.CL] |
| (or arXiv:2610.07700v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.07700 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Rajesh Kumar [view email]
[v1]
Tue, 6 Oct 2026 03:45:12 UTC (102 KB)
来源:arXiv:cs.CL · arxiv.org