arXiv cs.AI· Haq Nawaz Malik, Nahfid Nissar, Faizan Iqbal·· 3 天前AI 评分23
BharatSetu：面向印度语言翻译的 1M x 22 桥接数据集
bharatSetu: a 1M x 22 bridge for indic translation
AI 导读
BharatSetu 22-Indic 1M 发布，这是一个行对齐表格，包含 984,764 条英文句子及全部 22 种印度表列语言的机器翻译（共 21,664,808 个 Indic 单元），由 sarvamai/sarvam-translate 模型族生成。
正文 · 原文
Abstract:India's Eighth Schedule recognises 22 languages, yet parallel data is uneven across them, and many language pairs, especially among lower-resource languages such as Bodo, Dogri, Santali and Kashmiri, lack direct bitext. We present BharatSetu 22-Indic 1M, a row-aligned table of 984,764 English sentences, each paired with machine translations into all 22 scheduled languages (21,664,808 Indic cells), generated with the sarvamai/sarvam-translate model family. Because every Indic cell in a row translates the same English sentence, any two columns form a translation pair: 462 directed Indic-to-Indic pairs, or 506 including English, without direct bitext. We call these pivot-derived pairs and propose a confidence layer that lets users choose how strictly each pair is connected. The corpus is machine-generated and not human-verified; quality is expected to vary by language, domain and sentence style, and pivot-derived pairs can inherit errors from both sides. We therefore release BharatSetu as a machine layer and propose a human-correction layer keyed to the same row identifiers, so that each corrected column upgrades every pair that uses it, together with an evaluation protocol. We report no translation-quality results.
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.15705 [cs.CL] |
| (or arXiv:2610.15705v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.15705 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Haq Nawaz Malik Mr. [view email]
[v1]
Sun, 11 Oct 2026 15:39:19 UTC (28 KB)
来源：arXiv cs.AI · arxiv.org