arXiv：cs.CL· Hanlu He, Harald Vilhelm Skat-R{\o}rdam, Ingvi \"Orn\'olfsson, Ivana Konvalinka·· 4 小时前AI 评分29
自动流水线实现自发对话中标准化语音单元标注
An automated pipeline for standardised speech-unit annotation in spontaneous dialogue
AI 导读
研究者提出一套自动流水线，从双通道自发对话录音中提取话轮和反馈信号（backchannel），结合语音活动检测、通道能量过滤、时间合并、自动语音识别和上下文后处理。
正文
Abstract:Quantifying conversational dynamics requires reliable identification of interactional units and their temporal boundaries, but speech activity alone does not distinguish conversational turns from listener feedback or within-turn pauses. We present an automated pipeline for extracting turns and backchannels from separate-channel recordings of spontaneous dyadic conversation, designed to provide a consistent first-pass annotation for subsequent human review. The pipeline combines voice activity detection, channel-energy filtering, temporal merging, automatic speech recognition, and context-based post-processing. We evaluated the pipeline on 99 ten-minute Danish conversations from 33 dyads using segment-level detection reliability and temporal boundary error. Conversations were recorded under both normal and asymmetric listening conditions. In the latter, speech-shaped noise was delivered to one participant through bone-conduction headphones. Overall detection reliability was F1=0.621, with similar performance for turns F1=0.624 and backchannels F1=0.618. For successfully matched segments, median absolute onset and offset errors were 0.150 and 0.160s for turns and 0.130 and 0.180s for backchannels, respectively. Mean errors were substantially larger for turn boundaries, indicating a smaller number of large boundary mismatches. Performance did not differ significantly across the two experimental listening conditions. In a four-conversation case study, pipeline-human agreement was lower and more variable than human inter-annotator agreement and varied across parameter settings. These results support the pipeline as an automated first pass within a semi-automated annotation workflow, providing a consistent basis for more standardised and reproducible annotation of conversational dynamics.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.03078 [cs.CL] |
| (or arXiv:2610.03078v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.03078 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hanlu He [view email]
[v1]
Fri, 2 Oct 2026 10:00:14 UTC (168 KB)
来源：arXiv：cs.CL · arxiv.org