arXiv cs.AI· Gabriella Bollici, Stefano De Giorgis, Wouter Van Atteveldt, Filip Ilievski·· 12 小时前AI 评分20
IRON-Meme:在线模因叙事中身份与角色结构化理解基准
IRON-Meme: A Benchmark for Structured Understanding of Identities and Roles in Online Meme Narratives
AI 导读
研究者提出 IRON-Meme,一个包含 1,110 张政治模因、覆盖模板数量远超现有基准的人工标注基准,用于结构化理解模因中的社会身份、内群体/外群体视角与叙事角色。分析显示多数模因赋予贬损性角色,且身份、角色与模板系统性关联;九个视觉语言模型的评测中,前沿规模与推理模型表现最佳,低频标签上的社会身份与叙事角色准确率下降,引入模板背景知识并未提升叙事角色分类。IRON-Meme 与代码已公开。
正文
Abstract:As polarization grows on social media, understanding how political memes shape online narratives has become increasingly important. Previous research has relied on either qualitative frameworks that are hard to scale or computational methods that lack theoretical grounding. Both approaches treat narrative categories in isolation and focus exclusively on moral portrayals of identity. To address these limitations, we introduce a framework grounded in social science theories, encompassing three categories: social identities (such as gender, politics, and ethnicity), viewpoints (ingroup and outgroup perspectives), and narrative roles (moral character, intelligence, status, and power). Building on this framework, we present IRON-Meme, a human-annotated benchmark comprising 1,110 political memes across substantially more templates than existing benchmarks. Our analysis of IRON-Meme shows that most memes assign derogatory roles and that identities, roles, and templates are systematically interconnected. Evaluation of nine vision-language models indicates that frontier-scale and reasoning models achieve the highest performance, while accuracy on social identities and narrative roles decreases for less frequent labels. Incorporating template background knowledge does not enhance narrative role classification, suggesting that meme interpretation relies on how memes are adapted for specific communicative purposes. We make IRON-Meme and our code publicly available.
| Comments: | Submitted to ARR |
| Subjects: | Artificial Intelligence (cs.AI) |
| MSC classes: | 68T07 |
| Cite as: | arXiv:2610.33097 [cs.AI] |
| (or arXiv:2610.33097v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.33097 arXiv-issued DOI via DataCite |
Submission history
From: Gabriella Bollici [view email]
[v1]
Thu, 22 Oct 2026 10:51:07 UTC (7,882 KB)
来源:arXiv cs.AI · arxiv.org