arXiv cs.CL· Leonardo Araujo·· 10 小时前AI 评分31
LipSpell:结合区别特征编辑距离、键盘几何与语料频率的语言无关拼写纠错音韵评分框架
LipSpell: A Language-Independent Phonetic Scoring Framework for Spelling Correction Combining Distinctive-Feature Edit Distance, Keyboard Geometry, and Corpus Frequency
AI 导读
LipSpell 是一个语言无关的音韵评分引擎,搭配可替换的语言特定 G2P 前端、键盘映射与词库,融合基于 IPA 区别特征的音素距离矩阵、物理键盘几何与语料 unigram 频率先验。
正文 · 原文
Abstract:Automatic spelling correction must handle both keyboard typographical slips and cognitive or phonetic misspellings where writers approximate a word's pronunciation. Conventional spell checkers rely either on orthographic edit distance and keyboard proximity--which struggle when phonetic errors diverge by multiple characters--or on English-centric phonetic hashes such as Soundex and Metaphone. We present LipSpell, a unified, language-independent phonetic scoring engine paired with swappable language-specific G2P frontends, keyboard maps, and lexicons integrating: (1) a precomputed |P|x|P| phone-distance matrix from universal IPA distinctive features, (2) physical keyboard geometry, and (3) corpus unigram frequency priors, accelerated by a two-stage symmetric-delete and seven-class phonetic-code index. Across six English benchmarks (including 1,000 L2 errors from TOEFL-Spell), LipSpell outperforms Norvig and Hunspell on every dataset and beats Aspell on Norvig1 (78.52% vs. 75.56%), Holbrook (32.00% vs. 26.67%), and TOEFL-Spell (77.30% vs. 72.80%). Evaluated across six languages spanning five branches (Germanic, Romance, Slavic, Semitic, Turkic), three families (Indo-European, Afro-Asiatic, Turkic), and three scripts, LipSpell achieves strong fixed-weight transfer on Brazilian Portuguese (73.00% Top-1 on n=500 Wikipedia without NFD tolerance and 75.80% with NFD vs. 66.40% Norvig, 64.20% Hunspell, 64.00% Aspell) and Russian Cyrillic (85.67% vs. 78.50% Norvig). On 50/50 clean non-word splits with lexicon cleaning and weak-character indels, tuning yields strong gains over Norvig in Portuguese (86.97% vs. 76.75%), Turkish (81.67% vs. 79.05%), Hebrew Abjad (74.59% vs. 62.30%), and French (74.53% vs. 67.92%), while fixed weights remain optimal for English (80.37%) and Russian (85.67%).
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.24285 [cs.CL] |
| (or arXiv:2611.24285v2 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.24285 arXiv-issued DOI via DataCite |
Submission history
From: Leonardo Araujo [view email]
[v1]
Wed, 18 Nov 2026 11:59:47 UTC (55 KB)
[v2]
Thu, 19 Nov 2026 18:18:27 UTC (55 KB)
来源:arXiv cs.CL · arxiv.org