arXiv cs.AI· Ruikang Li, Zixuan Chen, Jiarui Wu, Mingde Yao, Yiyuan Zhang, Yujin Wang, Hanming Deng, Lewei Lu, Tianfan Xue·· 11 小时前AI 评分34
TailSteer:面向抗漂移多轮图像编辑的轨迹尾部引导框架
TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing
AI 导读
TailSteer 是一个末阶段训练框架,通过让早期去噪动态贴近基座模型、把保真修正集中在轨迹尾部,抑制多轮编辑中的累积视觉漂移。修正信号来自编辑器自身的 on-policy 去噪 rollout,以未改动的源内容为保真参照,无需人工标注的编辑配对数据。
正文 · 原文
Abstract:Strong single-turn editing performance does not guarantee reliable multi-turn interaction: as edited outputs are repeatedly reused, small unintended changes can accumulate into severe visual drift. This long-term drift is often mitigated through training on multi-turn data or cross-turn rollouts, potentially altering pretrained priors, or through specialized inference-time mechanisms that are difficult to scale to foundation models. We introduce TailSteer, a final-stage training framework that improves multi-turn robustness while retaining the generative and editing capabilities acquired through earlier training. TailSteer follows a simple principle: keep early denoising dynamics close to those of the base model and concentrate preservation corrections near the trajectory tail, where fine-grained deviations can be suppressed. These corrections are learned from the editor's own on-policy denoising rollouts, using unchanged source content as a preservation reference without requiring curated ground-truth editing pairs. Experiments across the FLUX, SenseNova, and Qwen families show that TailSteer substantially reduces cumulative drift over 15-20 editing turns while largely preserving base-model performance on extensive text-to-image and single-image editing benchmarks. These results demonstrate that long-horizon editing robustness can be unlocked in foundation models after TailSteer, rather than by relearning their existing capabilities.
| Comments: | 16 pages, 9 figures. Project page: this https URL |
| Subjects: | Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2611.06741 [cs.CV] |
| (or arXiv:2611.06741v1 [cs.CV] for this version) | |
| https://doi.org/10.48550/arXiv.2611.06741 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Ruikang Li [view email]
[v1]
Wed, 4 Nov 2026 16:23:24 UTC (45,313 KB)
来源:arXiv cs.AI · arxiv.org