跳到正文
arXiv cs.AI· Simon Freitter, David Fischinger, Silvia Poletti, Marcel Hasenbalg, Martin Boyer·· 2 天前AI 评分22

DINO-FIL:多层 Transformer 融合用于生成式图像修复伪造定位

DINO-FIL: Multi-Layer Transformer Fusion for Generative Inpainting Forgery Localization

AI 导读

DINO-FIL 是一个基于 Transformer 的框架,用于像素级定位生成式图像伪造,它结合预训练 DINOv3 ViT-H+/16 编码器的多层表示与轻量融合解码器,捕捉语义结构和编辑引入的细粒度纹理不一致。

正文 · 原文

View PDF HTML (experimental)

Abstract:We propose DINO-FIL, a transformer-based framework for pixel-level localization of generative image forgeries. The method leverages multi-layer representations from a pretrained DINOv3 ViT-H+/16 encoder combined with a lightweight fusion decoder to capture both semantic structure and fine-grained texture inconsistencies introduced by image editing. By aggregating intermediate transformer features across depths, the model improves sensitivity to subtle, spatially localized artifacts that are often missed by standard single-layer approaches. We evaluate DINO-FIL in a cross-dataset setting, training on B-Free and testing on Beyond the Brush, CocoGlide, TGIF, and SAGI-D. The model achieves strong generalization, outperforming existing baselines on average and on four of five evaluated datasets, while maintaining a high true negative rate on pristine images.
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as: arXiv:2610.21780 [cs.CV]
  (or arXiv:2610.21780v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2610.21780

arXiv-issued DOI via DataCite (pending registration)

Journal reference: ECCV Workshop AI4MFDD2026 - 2026 Workshop on AI for Multimedia Forensics & Disinformation Detection

Submission history

From: Silvia Poletti [view email]
[v1] Thu, 15 Oct 2026 12:36:53 UTC (34 KB)

来源:arXiv cs.AI · arxiv.org