跳到正文
arXiv:cs.LG· Alessio Spagnoletti, Abdul-Lateef Haji-Ali, Andr\'es Almansa, Alain Oliviero Durmus, Eric Moulines, Marcelo Pereyra·· 4 小时前AI 评分42

一致性模型的多步采样理论:稳定性、误差界与噪声调度

Iterating Consistency Models: Stability, Error Bounds and Noise Schedules

AI 导读

研究将多步一致性模型(CM)采样建模为加噪与近似去噪算子的复合,在显式可验证的稳定性假设下推导出非渐近误差界,将初始化误差的收缩与近似误差的累积分离。该误差界为噪声调度赋予不同角色:早期大噪声水平驱动收缩,后期小噪声水平控制残余偏差,并给出强对数凹与半对数凹目标的显式常数。实验表明误差界中的收缩与近似曲线可被可靠测量,且与预测的函数形式高度吻合。

正文

View PDF HTML (experimental)

Abstract:Consistency models (CMs) have become a leading approach for generating high-quality samples in few steps. However, adding steps can improve or degrade sample quality in ways that are highly sensitive to the schedule and that existing theory does not fully explain. To provide accuracy guarantees and guide CM sampler design, we analyze multistep CM sampling as a composition of noising and approximate denoising operators. Under explicit, verifiable stability assumptions, we derive a non-asymptotic error bound that separates contraction of the initialization error from accumulation of approximation error. The bound assigns distinct roles to the schedule: large early noise levels drive contraction, while small late noise levels control the residual bias. As a corollary, we obtain explicit constants for strongly log-concave and semi-log-concave targets. We further establish a complementary guarantee whose assumptions, one-step accuracy and stability, can be estimated for a given trained model. Experiments show that the contraction and approximation profiles entering our bounds can be reliably measured and closely match the predicted functional forms. Together, these results provide a meaningful convergence theory for multi-step CMs and a practical route to sampler design.
Comments: 27 pages, 6 figures
Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as: arXiv:2610.03414 [stat.ML]
  (or arXiv:2610.03414v1 [stat.ML] for this version)
  https://doi.org/10.48550/arXiv.2610.03414

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Alessio Spagnoletti [view email]
[v1] Fri, 2 Oct 2026 15:00:49 UTC (88 KB)

来源:arXiv:cs.LG · arxiv.org