跳到正文
arXiv cs.CL· Bernd J. Kr\"oger·· 9 小时前AI 评分18

基于脉冲神经模型的音节表征到手势生成与发音研究

From syllable representation via gesture generation to articulation: A spiking neural model

AI 导读

一项基于神经工程框架与语义指针架构的脉冲神经感觉运动模型,实现了从音节表征到声道手势生成再到发音的转换。每个音节由神经振荡器相位协调手势并触发下一音节,相位依赖指令分别招募元音、口腔收缩、腭咽与声门动作的神经元群体,斜坡积分器塑造手势激活的升降。在两组各60次运行的配对仿真中,调整手势指令幅度后成功实现数从57/60提升至60/60。

正文 · 原文

View PDF HTML (experimental)

Abstract:Speech production requires a transformation from phonological representations into coordinated vocal-tract movements. This paper presents a spiking neural sensorimotor model within the Neural Engineering Framework and Semantic Pointer Architecture. Each syllable occurrence has a neural oscillator whose evolving phase coordinates its gestures and initiates the next syllable. Phase-dependent commands recruit separate neural populations for vocalic, oral-constriction, velopharyngeal, and glottal actions (gestures). Neural ramp integrators shape the rise and fall of gesture activation. Together with articulatory targets, these trajectories determine the extent and time course of articulatory movements. Opponent neural populations provide control signals to a geometric articulatory model.
Thirty reference recordings cover an input corpus of eight lexical words, an alternative realization of one word, a syllable sequence, and isolated syllables. Two additional paired simulation subcorpora of sixty runs each, covering two words and one syllable sequence, assess activation reliability across neural realizations. Adjusting gesture command amplitudes increased successful realizations from 57/60 to 60/60 under the specified criteria, with ramp rate factors held constant.
The model demonstrates how neural oscillator and ramp dynamics generate articulatory timing under specified phasing rules. It complements a preceding mental-lexicon model through an ordered syllable interface. Continuous online execution across all components and connection to the acoustic extension remain further integration steps. Accessible code and synchronized visualization support inspection of the neural activation trajectories and resulting vocal-tract movements.
Comments: 47 pages, 9 figures. Submitted to the Journal of Neurolinguistics on 8 November 2026
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2611.22499 [cs.CL]
  (or arXiv:2611.22499v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2611.22499

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Bernd-Joachim Kröger [view email]
[v1] Tue, 17 Nov 2026 09:53:29 UTC (291 KB)

来源:arXiv cs.CL · arxiv.org