arXiv cs.CL· Yuxuan Chen, Yang Xiao, Jack Sun, Chak Sun, Brick Li, Sam·· 12 小时前AI 评分31
超越双轨：面向全双工对话的说话人锚定恢复方法
Beyond Two Tracks: Speaker-Anchored Full-Duplex Dialogue Recovery
AI 导读
研究者提出一种说话人锚定路由模块，在扩散生成前将分离器的粗粒度语音流匹配到固定注册身份并排序，无需重训生成器即可修正音轨归属漂移。该模块仅 1.84M 参数，在 25 分钟远程对话上将错误音轨时间从 43.9% 降至 4.1%，固定音轨活跃度 F1 从 0.46 提升至 0.84，且逐块重建质量不变。
正文 · 原文
Abstract:Spoken interaction is moving from alternating turns to full-duplex conversation, where an agent listens while speaking. Learning this coordination requires natural dialogue with persistent speaker-resolved tracks, a data requirement that remains difficult to satisfy at scale. Generative recovery offers a route from ordinary recordings, but recovering two voices is not enough: their track assignments can drift as the conversation unfolds. We address this missing link with speaker-anchored routing before diffusion: a 1.84M-parameter module matches the separator's coarse streams to fixed enrollment identities and orders them before a frozen generator reconstructs the speech, without retraining the generator or altering the reconstructed audio. On 25-minute remote conversations, routing cuts wrong-track time from 43.9% to 4.1%, below the 6.2% of matched-enrollment waveform re-identification, with its largest advantage when one participant holds the floor (17.8% versus 28.6%), and raises fixed-track activity F1 from 0.46 to 0.84 while per-chunk reconstruction quality is unchanged. The same router transfers to unseen face-to-face and telephone recordings, and a margin-gated verification step brings their wrong-track time to 0.9-1.7% while embedding 20-36% of the output, where full re-identification embeds all of it. Recovered voices thus become the participant-consistent tracks that full-duplex dialogue modeling needs. Audio examples: this https URL
| Comments: | 5 pages, 3 figures, 2 tables. Submitted to ICASSP 2027. Audio examples: this https URL |
| Subjects: | Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS) |
| Cite as: | arXiv:2610.27109 [cs.SD] |
| (or arXiv:2610.27109v1 [cs.SD] for this version) | |
| https://doi.org/10.48550/arXiv.2610.27109 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yuxuan Chen [view email]
[v1]
Mon, 19 Oct 2026 18:09:47 UTC (1,747 KB)
来源：arXiv cs.CL · arxiv.org