arXiv:cs.AI· Luk\'a\v{s} Proke\v{s}, Vojt\v{e}ch Stan\v{e}k, Anton Firc, Kamil Malinka·· 23 小时前
无监督数据漂移监测用于已部署的 Deepfake 语音检测器
Unsupervised Data Drift Monitoring for Deployed Deepfake Speech Detectors
AI 导读
针对已部署 Deepfake 语音检测器在运行中无法获取标签、难以判断是否仍处于熟悉条件的问题,研究者提出一种无监督漂移监测器,基于检测器内部嵌入向量,用正则化 Mahalanobis 距离对比真实与伪造参考样本,划分可信、模糊与新颖区域,将陌生输入转交人工复核。
正文
Abstract:Deepfake speech detectors are typically evaluated as binary classifiers on fixed benchmarks, but deployed systems face evolving attacks, codecs, speakers, and recording conditions, with labels unavailable during operation. This makes it difficult to know when a detector operates in familiar conditions and can be relied on. We propose an unsupervised drift monitor that operates on the internal embeddings of a deployed detector. The monitor compares each input against bona fide and spoof references using regularized Mahalanobis distances. These distances define trusted, ambiguous, and novel regions of the detector embedding space, allowing unfamiliar inputs to be routed for review. We evaluate the monitor on four modern detectors on three datasets. The monitor raises alerts for dataset mismatches and substantially reduces the security-critical case of accepting deepfakes at the cost of reduced automatic coverage. The results also show that drift affects both classes: bona fide recordings can move away from the training reference, increasing alert rates even in in-domain settings. Our findings suggest that deployed deepfake speech detectors should be treated not only as a binary classification, but also as a reliability problem.
| Comments: | Accepted at IEEE International Workshop on Information Forensics and Security (WIFS) 2026 |
| Subjects: | Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.16826 [cs.SD] |
| (or arXiv:2610.16826v1 [cs.SD] for this version) | |
| https://doi.org/10.48550/arXiv.2610.16826 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Vojtěch Staněk [view email]
[v1]
Mon, 12 Oct 2026 14:08:25 UTC (314 KB)
来源:arXiv:cs.AI · arxiv.org