arXiv cs.CL· Atnafu Lambebo Tonja, Tadesse Destaw Belay, Jesujoba Oluwadara Alabi, Israel Abebe Azime, Benjamin Rosman, Ehsan Shareghi, Thamar Solorio, Pontus Stenetorp, Monojit Choudhury·· 13 小时前AI 评分31
研究测量低资源语言的研究进展与语言包容性
Measuring Research Progress and Linguistic Inclusion in Low-Resource Languages
AI 导读
一项分析 2020 至 2025 年间 1,158 篇同行评审开放获取论文的研究提出语言包容性框架(LIF),从研究增长、代表性扩展、代表性连续性和分布公平四个维度衡量语言包容性。
正文 · 原文
Abstract:Large Language Models (LLMs) have accelerated research on low-resource and multilingual NLP, but their effectiveness in creating an equitable landscape remains unmapped. We analyze 1,158 peer-reviewed open-access papers published between 2020 and 2025, examining research attention to low-resource languages (LRLs) and representation across language and speaker populations. To assess linguistic inclusion beyond publication counts, we introduce the Linguistic Inclusion Framework (LIF), a multidimensional framework that measures linguistic inclusion in four dimensions: research growth, representation expansion, representation continuity, and distributional equity. While annual publications grew from 52 to 415, a 5.4X increase in their ACL Anthology publication share, this growth largely concentrated on represented languages rather than expanding coverage of underrepresented languages. Further analysis shows that languages spoken in Asia account for 64.1% of speakers across LRLs we analyze but receive only 46.7% of the language representation share (0.7X their proportional share), while European languages receive 5.3X their proportional share. At the country level, linguistically diverse regions such as sub-Saharan Africa and Southeast Asia show the lowest language coverage ratios. Applying the framework at the continental level, we find that no region scores well on all four dimensions, showing that research growth alone is not a reliable metric of progress toward equitable and inclusive language technology\footnote{We will release all collected and annotated data for research purposes}.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.30296 [cs.CL] |
| (or arXiv:2610.30296v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.30296 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Atnafu Lambebo Tonja [view email]
[v1]
Wed, 21 Oct 2026 18:11:51 UTC (5,287 KB)
来源:arXiv cs.CL · arxiv.org