Geometry-Correct Diffusion Posterior Sampling with Denoiser-Pullback Curvature Guidance and Manifold-Aligned Damping
- URL: http://arxiv.org/abs/2605.27990v1
- Date: Wed, 27 May 2026 05:29:35 GMT
- Title: Geometry-Correct Diffusion Posterior Sampling with Denoiser-Pullback Curvature Guidance and Manifold-Aligned Damping
- Abstract summary: We replace scalar guidance with a per-noise-level damped Gauss--Newton correction computed in diffusion-state coordinates.<n>It achieves competitive PSNR/SSIM/LPIPS while running markedly faster than most of the compared baselines.
- Score: 2.9985000712079426
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Diffusion posterior sampling conditions diffusion priors on measurements, but data-consistency updates are typically scaled by hand-tuned guidance weights and can destabilize sampling under stiff, operator-dependent curvature. We replace scalar guidance with a per-noise-level damped Gauss--Newton correction computed in diffusion-state coordinates. The correction pulls likelihood gradients back through the denoiser, uses a one-sided curvature model that avoids forward denoiser Jacobians, and applies diffusion-calibrated rank-one damping aligned with the denoiser residual. Each correction is solved with matrix-free GMRES using automatic differentiation, and sampling proceeds with a variance-preserving Langevin transition with a closed-form drift/noise split. On FFHQ and ImageNet across inverse problems, it achieves competitive PSNR/SSIM/LPIPS while running markedly faster than most of the compared baselines; on accelerated MRI reconstruction, it achieves the best PSNR/SSIM among the compared baselines.
Related papers
- Causal Discovery in Equal Variance Linear Gaussian DAGs via SURE-Tuned Ridge Regression [18.884190660925444]
SURE-Ridge is a non-iterative, closed-form estimator for equal variance linear Gaussian SEM.<n>It achieves the lowest structural Hamming distance in the small-sample regime and the lowest run time across all sample sizes tested.
arXiv Detail & Related papers (2026-08-17T21:07:06Z) - LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction [59.32834240526981]
Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE)<n>Existing GRPO methods for flow models replace the Euler-time ODE with aotropic differential equation (SDE) during training.<n>We introduce LC-GRPO, a flow-based GRPO framework with Langevin correction targeting the marginal distribution at the resulting timestep.
arXiv Detail & Related papers (2026-08-06T04:47:57Z) - Exact Posterior Score Estimation for Solving Linear Inverse Problems [32.51816945978934]
Diffusion and flow-based models learn powerful data priors by training a denoiser to reverse Gaussian corruption.<n>Existing methods either steer a fixed pretrained denoiser with approximate measurement-matching corrections, or train a conditional restoration model that abandons the denoising structure of the prior.<n>We turn this identity into Exact Posterior Score (EPS), a denoising training objective that preserves the input/output structure of standard pretraining.
arXiv Detail & Related papers (2026-06-15T17:58:22Z) - Coverage Analysis of Rydberg Atom Quantum Receiver Arrays: A Stochastic Geometry Approach [55.47164192369501]
Rydberg atomic quantum receivers (RAQRs) offer quantum-limited sensitivity and broadband tunability.<n>In dense deployments, aggregate interference can push atomic transducer out of its small-signal regime.<n>This paper addresses the question by embedding the RAQR front end into a geometry coverage analysis.
arXiv Detail & Related papers (2026-05-22T04:05:13Z) - Improving Diffusion Posterior Samplers with Lagged Temporal Corrections for Image Restoration [1.2891189282516038]
Diffusion-based posterior sampling (PS) is a leading framework for imaging inverse problems.<n>PS relies on instantaneous data-consistent estimates, which induce temporal variability in the reverse dynamics.<n>We propose LAMP, combining the second-order update with the residual correction characterizing a PS technique.
arXiv Detail & Related papers (2026-05-12T11:38:36Z) - Diffusion-Based Posterior Sampling: A Feynman-Kac Analysis of Bias and Stability [13.640937605089865]
Diffusion-based posterior samplers use pretrained diffusion priors to sample from measurement- or reward-conditioned posteriors.<n>This paper introduces a tractable surrogate path connecting the true posterior to a standard Gaussian and comparing it to the sampler's path.<n>A Feynman-Kac representation then expresses the Radon-Nikodym correction as an explicit path expectation, identifying which posterior regions are over- or under-sampled.
arXiv Detail & Related papers (2026-05-07T16:37:29Z) - Diffusion Controller: Framework, Algorithms and Parameterization [54.82539154511621]
We present a unified control-theoretic view that casts reverse diffusion sampling as state-only control within (generalized) linearly-solvable Markov Decision Processes.<n>Under this framework, control acts by reweighting the pretrained reverse-time transition kernels, balancing terminal objectives against an $f$-divergence cost.<n>Experiments on Stable Diffusion v1.4 show consistent gains in preference-alignment win rates and improved quality-efficiency trade-offs.
arXiv Detail & Related papers (2026-03-07T01:49:59Z) - FAST-DIPS: Adjoint-Free Analytic Steps and Hard-Constrained Likelihood Correction for Diffusion-Prior Inverse Problems [2.9506605740700107]
Training-free diffusion priors often rely on repeated derivatives or inner optimization/MCMC loops with conservative step sizes.<n>We propose a training-free solver that replaces these inner loops with a hard measurement-space feasibility constraint.<n>Experiments achieve competitive PSNR/SSIM/LPIPS with up to 19.5$times$ speedup, without hand-coded adjoints or inner MCMC.
arXiv Detail & Related papers (2026-03-02T08:17:26Z) - Plug-and-Play Diffusion Meets ADMM: Dual-Variable Coupling for Robust Medical Image Reconstruction [45.25461515976432]
Plug-and-Play diffusion prior (DP) frameworks have emerged as a powerful paradigm for imaging reconstruction.<n>We present a novel approach to resolving bias-hallucination trade-off, achieving state-of-the-art gradients with significantly accelerated convergence.
arXiv Detail & Related papers (2026-02-26T16:58:43Z) - Stability and Generalization of Push-Sum Based Decentralized Optimization over Directed Graphs [55.77845440440496]
Push-based decentralized communication enables optimization over communication networks, where information exchange may be asymmetric.<n>We develop a unified uniform-stability framework for the Gradient Push (SGP) algorithm.<n>A key technical ingredient is an imbalance-aware generalization bound through two quantities.
arXiv Detail & Related papers (2026-02-24T05:32:03Z) - Stabilizing Diffusion Posterior Sampling by Noise--Frequency Continuation [52.736416985173776]
At high noise, data-consistency gradients computed from inaccurate estimates can be geometrically incongruent with the posterior geometry.<n>We propose a noise--frequency Continuation framework that constructs a continuous family of intermediate posteriors whose likelihood enforces measurement consistency only within a noise-dependent frequency band.<n>Our method achieves state-of-the-art performance and improves motion deblurring PSNR by up to 5 dB over strong baselines.
arXiv Detail & Related papers (2026-01-30T03:14:01Z) - Solving Diffusion Inverse Problems with Restart Posterior Sampling [2.9527010146189556]
Inverse problems are fundamental to science and engineering, where the goal is to infer an underlying signal or state from noisy measurements.<n>Recent approaches employ diffusion models as powerful implicit priors for such problems, owing to their ability to capture complex data distributions.<n>We propose Restart for Posterior Sampling (RePS), a general and efficient framework for solving both linear and non-linear inverse problems.
arXiv Detail & Related papers (2025-11-24T20:42:33Z) - Closed-Form Last Layer Optimization [72.49151473937319]
Under a squared loss, the optimal solution to the linear last layer weights is known in closed-form.<n>We show this is equivalent to alternating between gradient descent steps on the backbone and closed-form updates on the last layer.
arXiv Detail & Related papers (2025-10-06T09:14:39Z) - EquiReg: Equivariance Regularized Diffusion for Inverse Problems [67.01847869495558]
We propose EquiReg diffusion, a framework for regularizing posterior sampling in diffusion-based inverse problem solvers.<n>When applied to a variety of solvers, EquiReg outperforms state-of-the-art diffusion models in both linear and nonlinear image restoration tasks.
arXiv Detail & Related papers (2025-05-29T01:25:43Z) - Gradient Normalization Provably Benefits Nonconvex SGD under Heavy-Tailed Noise [60.92029979853314]
We investigate the roles of gradient normalization and clipping in ensuring the convergence of Gradient Descent (SGD) under heavy-tailed noise.
Our work provides the first theoretical evidence demonstrating the benefits of gradient normalization in SGD under heavy-tailed noise.
We introduce an accelerated SGD variant incorporating gradient normalization and clipping, further enhancing convergence rates under heavy-tailed noise.
arXiv Detail & Related papers (2024-10-21T22:40:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.