研究发现大语言模型存在亲 AI 偏向

View PDF HTML (experimental)

Abstract:Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We ask whether these models favor artificial intelligence (AI) itself. We examine this question through three experiments. First, in open-ended advice across investment, study, career, and startup domains, AI is prominent in most recommendation lists and is usually ranked first when it appears. Second, in salary estimations, models overestimate AI-related jobs more than they do for closely matched non-AI jobs. In a controlled follow-up, changing only the job title from the matched non-AI title to the AI-related title raises predicted salary by 10%, while all other supplied job details remain fixed. Finally, we show that the number of degrees and other credentials awarded by AI programs were 28% more overestimated than corresponding awards for matched computing programs. Overall, we show that AI is not only prominent in everyday LLM advice, but also receives systematically inflated quantitative estimates compared to non-AI cases, even against its closest disciplinary neighbors, raising concerns for high-stakes decision support.

Comments:	21 pages, 4 figures. Reproducibility code included as ancillary files
Subjects:	Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)
ACM classes:	I.2.7; K.4.1
Cite as:	arXiv:2601.13749 [cs.CL]
	(or arXiv:2601.13749v2 [cs.CL] for this version)
	https://doi.org/10.48550/arXiv.2601.13749 arXiv-issued DOI via DataCite

Submission history

From: Benaya Trabelsi [view email]
[v1] Tue, 20 Jan 2026 09:03:57 UTC (694 KB)
[v2] Fri, 16 Oct 2026 09:34:15 UTC (1,522 KB)