arXiv:cs.LG· Liam Moroy, Jean-Fran\c{c}ois Giovannelli, Yoann Altmann, Steve McLaughlin, Fr\'ed\'eric Champagnat, Guillaume Bourmaud·· 3 小时前AI 评分41
扩散模型与流匹配后验采样中的引导权重如何调对
Getting Your Guidance Weights Right in diffusion and flow-matching posterior sampling
AI 导读
一种离线策略可自动调好扩散模型与流匹配模型后验采样中的引导权重,无需重训练或微调预训练生成模型,仅需一个 minibatch 的采样轨迹即可针对给定测量算子、噪声水平和采样器完成优化。
正文
Abstract:Training-free posterior sampling methods, also known as Plug-and-Play methods, leverage pretrained unconditional diffusion or flow-matching models to solve inverse problems. Most existing approaches rely on guidance weights to balance, at each time step, prior information from the unconditional score or velocity network with measurement consistency, yet the tuning of these weights is often not discussed and is largely left to heuristics. We introduce a simple and principled offline strategy for automatically tuning these guidance weights. Our key observation is that, at each time step, the conditional denoising score-matching objective for diffusion models, or the conditional flow-matching objective for flow-matching models, is a least-squares objective. Therefore, when the conditional prediction is expressed as a weighted sum of the unconditional network output and a measurement-guidance term, optimizing over these weights reduces to a two-dimensional linear least-squares problem. The resulting time-dependent guidance weights can be optimized offline for a given measurement operator, noise level and sampler at the cost of a single minibatch of sampling trajectories, without retraining or fine-tuning the pretrained generative model. Instantiated with the standard Tweedie-based measurement-consistency term, our approach improves posterior sampling and achieves state-of-the-art reconstruction performance across diffusion- and flow-matching-based methods. Moreover, the optimized guidance weights enable diffusion samplers to reduce the number of sampling steps from 1000 to 50 with no significant degradation in reconstruction quality. Code will be made available.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.03503 [cs.LG] |
| (or arXiv:2610.03503v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2610.03503 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Liam Moroy [view email]
[v1]
Fri, 2 Oct 2026 16:01:38 UTC (24,691 KB)
来源:arXiv:cs.LG · arxiv.org