arXiv cs.CL· Hedwig Oldenhof, Laura Rosseel, Anna Wegmann, Dong Nguyen·· 9 小时前AI 评分19
人类与 LLM 对荷兰多民族语 Straattaal 的内隐与外显语言态度对比
Comparing Implicit and Explicit Language Attitudes toward the Dutch multiethnolect Straattaal in Humans and Large Language Models
AI 导读
研究用匹配设计对比人类与 LLM 对荷兰多民族语 Straattaal 的语言态度:人类在 IAT 和外显评分任务中均强烈将 Straattaal 与有移民背景者关联。
正文 · 原文
Abstract:While language attitudes have been extensively studied in humans, the extent to which large language models (LLMs) encode similar associations between language varieties and social attributes remains unclear. Contemporary sociolinguistic research distinguishes between explicit attitudes, which stem from deliberative processing, and implicit attitudes, which arise from automatic processing. This study investigates whether LLMs exhibit human-like implicit and explicit language attitudes toward the Dutch multiethnolect Straattaal, particularly its association with migrant communities. We use closely matched designs to assess attitudes in humans and LLMs. For humans, we use an Implicit Association Test (IAT) and an explicit rating task. For LLMs, we use the LLM Word Association Test (LLM WAT) and the same explicit rating task. Human participants strongly associate Straattaal with individuals with a migration background at both implicit and explicit levels. In the LLM WAT, Straattaal is consistently associated with individuals with a migration background, with stronger associations observed in larger and newer models. When presented with the same explicit rating task as human participants, LLMs produce comparable response patterns. Overall, the findings suggest that many LLMs encode language attitudes resembling those observed in humans, however we also highlight important questions about how concepts and measures developed to study human attitudes should be interpreted in LLMs. This highlights the relevance of incorporating sociolinguistic perspectives and language variation into NLP research to better identify and mitigate socially and linguistically embedded biases.
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.22335 [cs.CL] |
| (or arXiv:2611.22335v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22335 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Hedwig Oldenhof [view email]
[v1]
Tue, 17 Nov 2026 07:36:09 UTC (115 KB)
来源:arXiv cs.CL · arxiv.org