跳到正文
arXiv cs.AI· Sophia Zalewski, Mustafa Munir, Enting Liu, Anjul Patney, David Dynerman·· 4 小时前AI 评分35

PromptPack:无需训练的扩散编辑器增强,实现意图对齐的空间与语义控制

PromptPack: Training-Free Augmentation of Diffusion Editors for Intent-Aligned Spatial and Semantic Control

AI 导读

PromptPack 通过两种显式“Edit Guides”——将像素标注为 Keep/Permit/Modify 的编辑角色分区,以及把空间区域映射到文本提示的区域提示分配——为扩散编辑器提供意图对齐控制,无需重新训练。

正文 · 原文

View PDF HTML (experimental)

Abstract:Many image-editing tasks require confining changes to intended spatial regions while exactly preserving user-designated source content. Instruction-driven editing pipelines often leave such user-intent underspecified, while inpainting editors condition generation on explicitly defined edit support but not on the spatial assignment of individual edit concepts. PromptPack addresses both limitations by equipping diffusion editors with two explicit 'Edit Guides': an edit-role partition that labels each pixel as 'Keep,' 'Permit,' or 'Modify' to specify where edits may occur, and a regional-prompt assignment that maps spatial regions to text prompts to specify which concepts apply where. These guides may be manually specified or, for source-object edits, automatically derived from a text-grounded SAM 3 mask. Without retraining, PromptPack injects independently embedded regional prompts into the editor's fixed-length text sequence and uses the Edit Guides to spatially mask attention, gate flow updates, and restore protected source pixels. We integrate PromptPack into FlowEdit FLUX, FlowEdit SD3, and FLUX Kontext and demonstrate improved requested-concept placement and protected-content preservation across all three integrations on PIE-Bench++. In a pairwise user study, PromptPack achieves an 87% preference rate over FlowEdit FLUX, establishing PromptPack as a practical, training-free interface for intent-aligned diffusion editing.
Comments: 32 pages, 21 figures, including supplementary material
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2611.21865 [cs.LG]
  (or arXiv:2611.21865v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2611.21865

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Sophia Zalewski [view email]
[v1] Mon, 16 Nov 2026 20:30:53 UTC (44,798 KB)

来源:arXiv cs.AI · arxiv.org