跳到正文
arXiv cs.CL· Ali Khairallah, Arkaitz Zubiaga·· 11 小时前AI 评分18

AK_QMUL 在 ArGuard 共享任务:单一微调 JAIS 用于阿拉伯语有害提示检测

AK_QMUL at ArGuard Shared Tasks: A Single Fine-Tuned JAIS for Arabic Harmful-Prompt Detection

AI 导读

AK_QMUL 在 ArGuard-2026 阿拉伯语有害提示检测两项共享任务中均排名第一,两个提交共用同一骨干 JAIS-6.7B,采用 4-bit QLoRA 微调并在末位 token 表示上接线性分类头。

正文 · 原文

View PDF HTML (experimental)

Abstract:We present AK_QMUL's submissions to the ArGuard-2026 shared tasks on Arabic harmful-prompt detection: a binary safe/unsafe task (B1) and a seven-way harm-domain task (B2). Both submissions use one backbone -- JAIS-6.7B fine-tuned with 4-bit QLoRA and a linear classification head over its last-token representation. For B1 we train a four-way head that factors the label by dialect register {safe, unsafe} x {MSA, other}, we augment the training fold with MSA prompts from AraSafe, and decode with a plain argmax to score safe/unsafe. For B2 we fine-tune the same backbone as a seven-way classifier and average the softmax outputs of five random seeds. Both submissions ranked first on their track, with macro-F1 0.984 on B1 and 0.790 on B2. We report results by dialect and by class: on B1 the model is accurate across all six dialects (93.6--99.8%) and its predicted unsafe rate tracks the true rate closely; on B2 six of the seven classes reach F1 between 0.73 and 0.98, with the residual error concentrated in the Bully class, which overlaps semantically with harassment and harm-to-others.
Comments: Published at ArabicNLP 2026 (Shared Tasks), co-located with EMNLP 2026. ACL Anthology: this https URL
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2610.36360 [cs.CL]
  (or arXiv:2610.36360v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.36360

arXiv-issued DOI via DataCite (pending registration)

Journal reference: Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 347-351 (2026)

Submission history

From: Ali Khairallah [view email]
[v1] Mon, 26 Oct 2026 22:25:18 UTC (25 KB)

来源:arXiv cs.CL · arxiv.org