pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularization

• URL: http://arxiv.org/abs/2411.00605v1
• Date: Fri, 01 Nov 2024 14:09:28 GMT
• Title: pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularization
• Authors: Matthew C. Bendel, Rizwan Ahmad, Philip Schniter,
• Abstract summary: In ill-posed imaging inverse problems, there can exist many hypotheses that fit both the observed measurements and prior knowledge of the true image. We propose a fast and accurate posterior-sampling conditional generative adversarial network (cGAN) that, through a novel form of regularization, aims for correctness in the posterior mean.
• Score: 11.393603788068777
• License:
• Abstract: In ill-posed imaging inverse problems, there can exist many hypotheses that fit both the observed measurements and prior knowledge of the true image. Rather than returning just one hypothesis of that image, posterior samplers aim to explore the full solution space by generating many probable hypotheses, which can later be used to quantify uncertainty or construct recoveries that appropriately navigate the perception/distortion trade-off. In this work, we propose a fast and accurate posterior-sampling conditional generative adversarial network (cGAN) that, through a novel form of regularization, aims for correctness in the posterior mean as well as the trace and K principal components of the posterior covariance matrix. Numerical experiments demonstrate that our method outperforms contemporary cGANs and diffusion models in imaging inverse problems like denoising, large-scale inpainting, and accelerated MRI recovery. The code for our model can be found here: https://github.com/matt-bendel/pcaGAN.

Related papers

• Highly Accelerated MRI via Implicit Neural Representation Guided Posterior Sampling of Diffusion Models [2.5412006057370893]
  Implicit neural representation (INR) has emerged as a powerful paradigm for solving inverse problems. Our proposed framework can be a generalizable framework to solve inverse problems in other medical imaging tasks.
  arXiv  Detail & Related papers  (2024-07-03T01:37:56Z)
• Unsupervised Anomaly Detection via Masked Diffusion Posterior Sampling [8.887775968482208]
  diffusion models have shown promising applications for anomaly detection due to their powerful generative ability. This paper proposes a novel and highly-interpretable method named Masked Diffusion Posterior Sampling (MDPS) MDPS can achieve state-of-the-art performance in normal image reconstruction quality as well as anomaly detection and localization.
  arXiv  Detail & Related papers  (2024-04-27T13:13:27Z)
• Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models trained on Corrupted Data [56.81246107125692]
  Ambient Diffusion Posterior Sampling (A-DPS) is a generative model pre-trained on one type of corruption. We show that A-DPS can sometimes outperform models trained on clean data for several image restoration tasks in both speed and performance. We extend the Ambient Diffusion framework to train MRI models with access only to Fourier subsampled multi-coil MRI measurements.
  arXiv  Detail & Related papers  (2024-03-13T17:28:20Z)
• Deep Equilibrium Diffusion Restoration with Parallel Sampling [120.15039525209106]
  Diffusion model-based image restoration (IR) aims to use diffusion models to recover high-quality (HQ) images from degraded images, achieving promising performance. Most existing methods need long serial sampling chains to restore HQ images step-by-step, resulting in expensive sampling time and high computation costs. In this work, we aim to rethink the diffusion model-based IR models through a different perspective, i.e., a deep equilibrium (DEQ) fixed point system, called DeqIR.
  arXiv  Detail & Related papers  (2023-11-20T08:27:56Z)
• A Variational Perspective on Solving Inverse Problems with Diffusion Models [101.831766524264]
  Inverse tasks can be formulated as inferring a posterior distribution over data. This is however challenging in diffusion models since the nonlinear and iterative nature of the diffusion process renders the posterior intractable. We propose a variational approach that by design seeks to approximate the true posterior distribution.
  arXiv  Detail & Related papers  (2023-05-07T23:00:47Z)
• Posterior samples of source galaxies in strong gravitational lenses with score-based priors [107.52670032376555]
  We use a score-based model to encode the prior for the inference of undistorted images of background galaxies. We show how the balance between the likelihood and the prior meet our expectations in an experiment with out-of-distribution data.
  arXiv  Detail & Related papers  (2022-11-07T19:00:42Z)
• Stable Deep MRI Reconstruction using Generative Priors [13.400444194036101]
  We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only. The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods.
  arXiv  Detail & Related papers  (2022-10-25T08:34:29Z)
• A Regularized Conditional GAN for Posterior Sampling in Image Recovery Problems [11.393603788068777]
  In image recovery problems, one seeks to infer an image from distorted, incomplete, and/or noise-corrupted measurements. We propose a regularized conditional Wasserstein GAN that generates dozens of high-quality posterior samples per second. Our method produces state-of-the-art posterior samples in both multicoil MRI and large-scale inpainting applications.
  arXiv  Detail & Related papers  (2022-10-24T16:43:00Z)
• Improving Diffusion Models for Inverse Problems using Manifold Constraints [55.91148172752894]
  We show that current solvers throw the sample path off the data manifold, and hence the error accumulates. To address this, we propose an additional correction term inspired by the manifold constraint. We show that our method is superior to the previous methods both theoretically and empirically.
  arXiv  Detail & Related papers  (2022-06-02T09:06:10Z)
• Denoising Diffusion Restoration Models [110.1244240726802]
  Denoising Diffusion Restoration Models (DDRM) is an efficient, unsupervised posterior sampling method. We demonstrate DDRM's versatility on several image datasets for super-resolution, deblurring, inpainting, and colorization.
  arXiv  Detail & Related papers  (2022-01-27T20:19:07Z)
• Unsupervised Lesion Detection via Image Restoration with a Normative Prior [6.495883501989547]
  We propose a probabilistic model that uses a network-based prior as the normative distribution and detect lesions pixel-wise using MAP estimation. Experiments with gliomas and stroke lesions in brain MRI show that the proposed approach outperforms the state-of-the-art unsupervised methods by a substantial margin.
  arXiv  Detail & Related papers  (2020-04-30T18:03:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.