Parallel Diffusion Models of Operator and Image for Blind Inverse Problems

• URL: http://arxiv.org/abs/2211.10656v1
• Date: Sat, 19 Nov 2022 10:36:32 GMT
• Title: Parallel Diffusion Models of Operator and Image for Blind Inverse Problems
• Authors: Hyungjin Chung, Jeongsol Kim, Sehui Kim, Jong Chul Ye
• Abstract summary: Diffusion model-based inverse problem solvers have demonstrated state-of-the-art performance in cases where the forward operator is known. We show that we can indeed solve a family of blind inverse problems by constructing another diffusion prior for the forward operator.
• Score: 34.280463095974795
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Diffusion model-based inverse problem solvers have demonstrated state-of-the-art performance in cases where the forward operator is known (i.e. non-blind). However, the applicability of the method to blind inverse problems has yet to be explored. In this work, we show that we can indeed solve a family of blind inverse problems by constructing another diffusion prior for the forward operator. Specifically, parallel reverse diffusion guided by gradients from the intermediate stages enables joint optimization of both the forward operator parameters as well as the image, such that both are jointly estimated at the end of the parallel reverse diffusion procedure. We show the efficacy of our method on two representative tasks -- blind deblurring, and imaging through turbulence -- and show that our method yields state-of-the-art performance, while also being flexible to be applicable to general blind inverse problems when we know the functional forms.

Related papers

• G2D2: Gradient-guided Discrete Diffusion for image inverse problem solving [55.185588994883226]
  This paper presents a novel method for addressing linear inverse problems by leveraging image-generation models based on discrete diffusion as priors. To the best of our knowledge, this is the first approach to use discrete diffusion model-based priors for solving image inverse problems.
  arXiv  Detail & Related papers  (2024-10-09T06:18:25Z)
• Gaussian is All You Need: A Unified Framework for Solving Inverse Problems via Diffusion Posterior Sampling [16.683393726483978]
  Diffusion models can generate a variety of high-quality images by modeling complex data distributions. Most of the existing diffusion-based methods integrate data consistency steps within the diffusion reverse sampling process. We show that the existing approximations are either insufficient or computationally inefficient.
  arXiv  Detail & Related papers  (2024-09-13T15:20:03Z)
• Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems [12.482127049881026]
  We propose a novel approach to solve inverse problems with a diffusion prior from an amortized variational inference perspective. Our amortized inference learns a function that directly maps measurements to the implicit posterior distributions of corresponding clean data, enabling a single-step posterior sampling even for unseen measurements.
  arXiv  Detail & Related papers  (2024-07-23T02:14:18Z)
• Prompt-tuning latent diffusion models for inverse problems [72.13952857287794]
  We propose a new method for solving imaging inverse problems using text-to-image latent diffusion models as general priors. Our method, called P2L, outperforms both image- and latent-diffusion model-based inverse problem solvers on a variety of tasks, such as super-resolution, deblurring, and inpainting.
  arXiv  Detail & Related papers  (2023-10-02T11:31:48Z)
• Source Condition Double Robust Inference on Functionals of Inverse Problems [71.42652863687117]
  We consider estimation of parameters defined as linear functionals of solutions to linear inverse problems. We provide the first source condition double robust inference method.
  arXiv  Detail & Related papers  (2023-07-25T19:54:46Z)
• A Variational Perspective on Solving Inverse Problems with Diffusion Models [101.831766524264]
  Inverse tasks can be formulated as inferring a posterior distribution over data. This is however challenging in diffusion models since the nonlinear and iterative nature of the diffusion process renders the posterior intractable. We propose a variational approach that by design seeks to approximate the true posterior distribution.
  arXiv  Detail & Related papers  (2023-05-07T23:00:47Z)
• Bayesian Inversion with Neural Operator (BINO) for Modeling Subdiffusion: Forward and Inverse Problems [6.114065706275863]
  We propose a Bayesian Inversion with Neural Operator (BINO) to overcome the difficulty in traditional numerical methods. We employ a deep operator network to learn the solution operators for the fractional diffusion equations. In addition, we integrate the deep operator network with a Bayesian inversion method for modelling a problem by subdiffusion process and solving inverse subdiffusion problems.
  arXiv  Detail & Related papers  (2022-11-22T03:32:48Z)
• Diffusion Posterior Sampling for General Noisy Inverse Problems [50.873313752797124]
  We extend diffusion solvers to handle noisy (non)linear inverse problems via approximation of the posterior sampling. Our method demonstrates that diffusion models can incorporate various measurement noise statistics.
  arXiv  Detail & Related papers  (2022-09-29T11:12:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.