跳到正文
arXiv:cs.LG· Ali Alavi, Donald S. Williamson·· 2 天前AI 评分37

NEUROTOKEN:基于条件流匹配的联合源与方向听觉注意力解码

NEUROTOKEN: Joint Source and Directional AAD with Envelope Decoding via Conditional Flow Matching

AI 导读

NEUROTOKEN 用单一网络共享 EEG 前端,通过条件流匹配头 ATTUNEFLOW 以积分速度残差似然比对候选声流打分,在 KU Leuven、DTU、NJU 三个数据集 5 s 窗口下将逐段源-AAD 提升 9%-16%,跨被试方差缩小约 3 倍。

正文

View PDF HTML (experimental)

Abstract:Identifying which speaker a listener is attending to in a noisy room -- the cocktail-party problem -- is the missing ingredient for next-generation hearing aids and brain-computer interfaces: it tells the device whose voice to amplify. Auditory attention decoding (AAD) reads this answer from EEG, but the literature splits into disconnected pieces: directional-AAD classifies side but does not map side to stream; regression-based source-AAD ranks candidate streams by a single Pearson correlation that is intrinsically noisy at the 1-5 s windows real devices need; and envelope reconstruction has no native AAD rule. We argue the right object is not any single statistic but the conditional likelihood of the attended envelope given EEG, and we make this practical with NEUROTOKEN: a single network whose three heads share one EEG front-end, with a conditional flow-matching head (ATTUNEFLOW) that scores candidates by an integrated velocity-residual likelihood ratio. Two inference-time ensembles -- QUADTRACK (four complementary statistics) and ENV-FLOW (z-normalised QUADTRACK+ATTUNEFLOW) -- absorb per-statistic failure modes for free. On KU Leuven, DTU, and NJU at 5 s, ATTUNEFLOW lifts per-segment source-AAD by 9%-16% over the strongest non-generative baseline and shrinks across-subject variance by ~3x; trial-level fusion exceeds 93% on two of three datasets. In parallel reproductions we show that canonical 95-97% direction-AAD numbers collapse by 17%-45% under a strict trial-disjoint protocol, clarifying both the true ceiling and why a likelihood-based formulation is needed.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2610.00397 [cs.LG]
  (or arXiv:2610.00397v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.00397

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Seyed Ali Alavi Bajestan [view email]
[v1] Wed, 30 Sep 2026 11:55:25 UTC (132 KB)

来源:arXiv:cs.LG · arxiv.org