跳到正文
arXiv cs.AI· Saptarshi Roy, Alessandro Rinaldo, Purnamrita Sarkar·· 10 小时前AI 评分32

Rectified Flow 如何自动适应目标分布的低维结构:扩散与随机局部化视角

Low-Dimensional Adaptation of Rectified Flow: A Diffusion and Stochastic Localization Perspective

AI 导读

研究证明,Rectified Flow 采样器在精心设计的端点自适应时间离散方案下,迭代复杂度可达 O(k/ε),其中 k 为目标分布的内在维度。论文还建立了 DDPM 与随机局部化之间的新联系,证明 DDPM 等价于随机版本的 RF,并据此设计了同样适应低维结构的随机 RF 采样器,在合成数据与文生图实验中验证了新时间离散方案的效果。

正文 · 原文

View PDF HTML (experimental)

Abstract:In recent years, Rectified flow (RF) has gained considerable popularity largely due to its generation efficiency and state-of-the-art performance. In this paper, we investigate how well RF automatically adapts to the intrinsic low dimensionality of the support of the target distribution to accelerate sampling. We show that, using a carefully designed end-point adapted time-discretization scheme and with sufficiently accurate drift estimates, the RF sampler enjoys an iteration complexity of order $O(k/\varepsilon)$ (up to log factors), where $\varepsilon$ is the precision in total variation distance and $k$ is the intrinsic dimension of the target distribution. In addition, we show that the denoising diffusion probabilistic model (DDPM) procedure is equivalent to a stochastic version of RF by establishing a novel connection between these processes and stochastic localization. Building on this connection, we further design a stochastic RF sampler that also adapts to the low-dimensionality of the target distribution under mild requirements on the accuracy of the drift estimates, and also with a specific time schedule. We illustrate the efficacy of newly designed time-discretization schedules with simulations on the synthetic data and text-to-image (T2I) data experiments.
Comments: 48 pages, 7 figures
Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)
Cite as: arXiv:2601.15500 [stat.ML]
  (or arXiv:2601.15500v5 [stat.ML] for this version)
  https://doi.org/10.48550/arXiv.2601.15500

arXiv-issued DOI via DataCite

Submission history

From: Saptarshi Roy [view email]
[v1] Wed, 21 Jan 2026 22:09:27 UTC (7,148 KB)
[v2] Tue, 3 Feb 2026 19:21:19 UTC (7,424 KB)
[v3] Fri, 20 Feb 2026 22:57:16 UTC (7,424 KB)
[v4] Sun, 1 Nov 2026 12:54:11 UTC (11,416 KB)
[v5] Wed, 18 Nov 2026 18:32:58 UTC (11,408 KB)

来源:arXiv cs.AI · arxiv.org