arXiv cs.CL· Linjuan Wu, Dingming Li, Yiwen Qiu, Xinze Lyu, Ye Guo, Daoxin Zhang, Zhe Xu, Weiming Lu·· 11 小时前AI 评分31
CULTURE-CMT：面向情境化社交媒体翻译的中英基准测试
CULTURE-CMT: Benchmarking Contextualized Social Media Translation
AI 导读
CULTURE-CMT 是一个中英社交媒体评论情境化翻译基准，包含 572 个经人工核验的样本，分为 Slang、Context 和 Both 三类，用于诊断翻译难点的不同来源。
正文 · 原文
Abstract:Social-media comments are interactions, yet they are often translated and evaluated as isolated text. This mismatch is especially problematic when meaning depends on surrounding discussion, community-specific slang, or culturally situated expressions. We introduce CULTURE-CMT, a Chinese-English benchmark for contextualized social-media comment translation that restores the post and conversational context naturally available to users. Its 572 manually verified examples are organized into Slang, Context, and Both, enabling diagnostic analysis of distinct and interacting sources of translation difficulty. To support scalable evaluation, we further develop a retrieval-augmented cultural-effectiveness Judger that combines a calibrated scoring model with dynamically retrieved cultural knowledge. CULTURE-CMT reveals several non-trivial patterns. Providing interaction context improves most model configurations, but does not eliminate culturally ineffective translations. Examples requiring both contextual grounding and culturally situated language remain substantially more difficult than either source of difficulty alone. Moreover, larger models are not consistently better, and thinking produces highly model-dependent gains, including occasional degradation. In contrast, a 27B model adapted on benchmark-disjoint social-media data achieves the lowest observed invalidity rate among the evaluated configurations under thinking inference with context. Together, these results suggest that realistic social-media translation is not simply a matter of scaling models or reasoning longer, but of learning to translate meaning as it is constructed within evolving online interactions.
| Comments: | 24 pages. Preprint |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.02018 [cs.CL] |
| (or arXiv:2611.02018v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2611.02018 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Linjuan Wu [view email]
[v1]
Sun, 1 Nov 2026 16:06:50 UTC (1,579 KB)
来源：arXiv cs.CL · arxiv.org