Bayesian Inversion for Nonlinear Imaging Models using Deep Generative
Priors
- URL: http://arxiv.org/abs/2203.10078v3
- Date: Thu, 25 May 2023 10:34:17 GMT
- Title: Bayesian Inversion for Nonlinear Imaging Models using Deep Generative
Priors
- Authors: Pakshal Bohra, Thanh-an Pham, Jonathan Dong, Michael Unser
- Abstract summary: We develop a tractable posterior-sampling scheme based on the Metropolis-adjusted Langevin algorithm for the class of nonlinear inverse problems.
We illustrate the advantages of our framework by applying it to two nonlinear imaging modalities-phase retrieval and optical diffraction tomography.
- Score: 24.544313203472992
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Most modern imaging systems incorporate a computational pipeline to infer the
image of interest from acquired measurements. The Bayesian approach to solve
such ill-posed inverse problems involves the characterization of the posterior
distribution of the image. It depends on the model of the imaging system and on
prior knowledge on the image of interest. In this work, we present a Bayesian
reconstruction framework for nonlinear imaging models where we specify the
prior knowledge on the image through a deep generative model. We develop a
tractable posterior-sampling scheme based on the Metropolis-adjusted Langevin
algorithm for the class of nonlinear inverse problems where the forward model
has a neural-network-like structure. This class includes most practical imaging
modalities. We introduce the notion of augmented deep generative priors in
order to suitably handle the recovery of quantitative images.We illustrate the
advantages of our framework by applying it to two nonlinear imaging
modalities-phase retrieval and optical diffraction tomography.
Related papers
- Diffeomorphic Template Registration for Atmospheric Turbulence Mitigation [50.16004183320537]
We describe a method for recovering the irradiance underlying a collection of images corrupted by atmospheric turbulence.
We select one of the images as a reference, and model the deformation in this image by the aggregation of the optical flow from it to other images.
We achieve state-of-the-art performance despite its simplicity.
arXiv Detail & Related papers (2024-05-06T17:39:53Z) - CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model [17.26789842018146]
Diffusion posterior sampling has been used to produce high quality CT images given low-quality measurements.
Current methods rely on a linear model of x-ray CT physics to reconstruct or restore images.
We propose a new method that solves the inverse problem of nonlinear CT image reconstruction via diffusion posterior sampling.
arXiv Detail & Related papers (2023-12-03T17:20:11Z) - Stable Deep MRI Reconstruction using Generative Priors [13.400444194036101]
We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only.
The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods.
arXiv Detail & Related papers (2022-10-25T08:34:29Z) - DELAD: Deep Landweber-guided deconvolution with Hessian and sparse prior [0.22940141855172028]
We present a model for non-blind image deconvolution that incorporates the classic iterative method into a deep learning application.
We build our network based on the iterative Landweber deconvolution algorithm, which is integrated with trainable convolutional layers to enhance the recovered image structures and details.
arXiv Detail & Related papers (2022-09-30T11:15:03Z) - Ultrasound Signal Processing: From Models to Deep Learning [64.56774869055826]
Medical ultrasound imaging relies heavily on high-quality signal processing to provide reliable and interpretable image reconstructions.
Deep learning based methods, which are optimized in a data-driven fashion, have gained popularity.
A relatively new paradigm combines the power of the two: leveraging data-driven deep learning, as well as exploiting domain knowledge.
arXiv Detail & Related papers (2022-04-09T13:04:36Z) - Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms.
Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
arXiv Detail & Related papers (2021-11-27T12:12:57Z) - Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
Deep image prior was introduced as an effective prior for image reconstruction.
Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques.
We develop a two-stage learning paradigm to address the computational challenge.
arXiv Detail & Related papers (2021-11-23T15:08:26Z) - Using Deep Image Priors to Generate Counterfactual Explanations [38.62513524757573]
A deep image prior (DIP) can be used to obtain pre-images from latent representation encodings.
We propose a novel regularization strategy based on an auxiliary loss estimator jointly trained with the predictor.
arXiv Detail & Related papers (2020-10-22T20:40:44Z) - Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
Blind image restoration is a common yet challenging problem in computer vision.
We propose a novel blind image restoration method, aiming to integrate both the advantages of them.
Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
arXiv Detail & Related papers (2020-08-25T03:30:53Z) - Limited-angle tomographic reconstruction of dense layered objects by
dynamical machine learning [68.9515120904028]
Limited-angle tomography of strongly scattering quasi-transparent objects is a challenging, highly ill-posed problem.
Regularizing priors are necessary to reduce artifacts by improving the condition of such problems.
We devised a recurrent neural network (RNN) architecture with a novel split-convolutional gated recurrent unit (SC-GRU) as the building block.
arXiv Detail & Related papers (2020-07-21T11:48:22Z) - Class-Specific Blind Deconvolutional Phase Retrieval Under a Generative
Prior [8.712404218757733]
The problem arises in various imaging modalities such as Fourier ptychography, X-ray crystallography, and in visible light communication.
We propose to solve this inverse problem using alternating gradient descent algorithm under two pretrained deep generative networks as priors.
The proposed recovery algorithm strives to find a sharp image and a blur kernel in the range of the respective pre-generators that textitbest explain the forward measurement model.
arXiv Detail & Related papers (2020-02-28T07:36:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.