arXiv cs.CL· Suryansh Talukdar (Purdue University Fort Wayne), Taha Sarwat (Purdue University Fort Wayne), Jonathan Rusert (Purdue University Fort Wayne)·· 12 小时前AI 评分19
通过理由正则化缓解解释与人类对齐中的群体差异
Mitigating Demographic Disparities in Explanation-Human Alignment via Rationale Regularization
AI 导读
研究提出 Plausibility-EFG 指标,用 HateXplain 数据集衡量不同人口群体间解释合理性的最大差距,并对比 BERT、RoBERTa 与对抗训练的 ADV-RoBERTa。
正文 · 原文
Abstract:We study explanation fairness in hate speech detection. High classification performance does not always mean that a model produces equally plausible explanations for different demographic groups. Using the HateXplain dataset, we introduce Plausibility-EFG, a metric that measures the largest difference in explanation plausibility across demographic groups by comparing model-generated token attributions with human-annotated rationales. We evaluate BERT, RoBERTa, and ADV-RoBERTa, an adversarially trained model, using Integrated Gradients and SHAP. Our results show that ADV-RoBERTa improves classification performance and alignment between explanations and human rationales while reducing explanation disparities across demographic groups. These improvements are observed with both attribution methods and remain consistent across training, validation, and test splits. We also show that reducing prediction-level bias alone does not eliminate disparities in explanations, suggesting that predictive fairness and explanation fairness are related but distinct objectives. Finally, our fairness-performance analysis shows that stronger adversarial regularization can further reduce Plausibility-EFG, although it may cause a small decrease in macro-F1. Overall, this work presents explanation fairness as an important objective in hate speech moderation and introduces Fair-REF, a framework designed to reduce disparities in model explanations across demographic groups.
| Comments: | 19 pages, 10 figures, 10 tables |
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| ACM classes: | I.2.7 |
| Cite as: | arXiv:2610.22586 [cs.CL] |
| (or arXiv:2610.22586v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.22586 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Suryansh Talukdar [view email]
[v1]
Thu, 15 Oct 2026 19:36:39 UTC (1,958 KB)
来源:arXiv cs.CL · arxiv.org