arXiv cs.CL· Manthan Gadhia, Alexander Hoyle, Karolina Sta\'nczak·· 12 小时前AI 评分31
分析 OLMo 3 训练全流程中的职业性别偏见
Analyzing Occupational Gender Bias across the LLM Training Lifecycle
AI 导读
研究追踪了全开放模型家族 OLMo 3 各后训练阶段 checkpoint 的职业性别偏见：当性别被明确给出时，后训练提升了男性编码画像的语义多样性，而女性编码画像在 SFT 后提升较小、在 DPO 和 RLVR 后不显著。
正文 · 原文
Abstract:Post-training is widely assumed to reduce the social biases language models inherit from pretraining, yet direct evidence for this assumption remains mixed. In this paper, we examine how gender disparities evolve across the language modeling pipeline. In particular, we study occupational gender bias in OLMo 3, a fully open language model family, across its post-training stages by prompting each checkpoint to generate open-ended narratives about synthetic personas given their occupation and education. We consider two settings, a gender-given setting in which the profile states the persona's gender explicitly and a gender-assumed setting in which it must be inferred by the model. We find that when gender is stated, post-training increases semantic diversity for male-coded profiles, whereas for female-coded profiles the increase is smaller after SFT and not significant after DPO and RLVR. When gender is assumed by the model, post-training affects narratives about female and male personas similarly. The model's own gender assumptions, however, show a consistent female-preferential skew relative to United States labor-force demographics, except for heavily male-dominated occupations. Every successive post-training stage monotonically increases the odds of attributing a female label over the base model. A provenance analysis of the supervised fine-tuning corpus finds only a modest 7.7% female-token surplus, too small to explain the size of these downstream effects. The project code is available under: this https URL.
| Comments: | Submitted to 7th Workshop on Gender Bias in Natural Language Processing @AACL-IJCNLP 2026 |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.23587 [cs.CL] |
| (or arXiv:2610.23587v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.23587 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Manthan Gadhia [view email]
[v1]
Fri, 16 Oct 2026 15:07:02 UTC (1,414 KB)
来源：arXiv cs.CL · arxiv.org