arXiv cs.CL· Shifali Agrahari, Sujit Kumar, Sanasam Ranbir Singh·· 11 小时前AI 评分27
TRIDENT 与 SHAKTI:面向印地语的 AI 文本检测框架与基准
TRIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection
AI 导读
研究团队发布印地语 AI 生成文本检测基准 SHAKTI,覆盖 4 种文体、8 个 LLM 系列及多种提示策略与对抗变换,并提出基于往返翻译的检测框架 TRIDENT,含静态阈值 TRIDENT-S、动态阈值 TRIDENT-D 和逻辑回归版 TRIDENT-C 三个变体。
正文 · 原文
Abstract:As Large Language Models (LLMs) become increasingly multilingual, distinguishing human-written from AI-generated text is essential for maintaining information integrity. However, research remains English-centric, with limited benchmarks for low-resource languages such as Hindi. To address this gap, we introduce SHAKTI, a large-scale Hindi benchmark covering four genres, eight LLM families, multiple prompting strategies, and adversarial transformations. We evaluate its quality through human annotation and analyze linguistic, grammatical, and sentiment-based differences between human- and AI-generated texts. Building on these findings, we propose TRIDENT, a round-trip translation-based detection framework with three variants: TRIDENT-S (static threshold), TRIDENT-D (dynamic threshold), and TRIDENT-C (logistic regression using multi-distance RTT features). TRIDENT leverages semantic consistency between original and round-trip translated texts to identify AI-generated content. Extensive experiments show that TRIDENT outperforms conventional and supervised baselines, with TRIDENT-S achieving the best overall performance. Further evaluations across seven languages, adversarial settings, and unseen LLMs demonstrate its multilingual applicability and robustness, while highlighting sensitivity to the translation model.
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.41232 [cs.AI] |
| (or arXiv:2610.41232v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.41232 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Shifali Agrahari [view email]
[v1]
Fri, 30 Oct 2026 04:13:20 UTC (4,178 KB)
来源:arXiv cs.CL · arxiv.org