An Adversarial Learning Based Approach for Unknown View Tomographic Reconstruction

• URL: http://arxiv.org/abs/2108.09873v1
• Date: Mon, 23 Aug 2021 00:28:47 GMT
• Title: An Adversarial Learning Based Approach for Unknown View Tomographic Reconstruction
• Authors: Mona Zehni, Zhizhen Zhao
• Abstract summary: It is often presumed that projection angles associated with the projection lines are known in advance. Under certain situations, however, these angles are known only approximately or are completely unknown. We propose an adversarial learning based approach to recover the image and the projection angle distribution.
• Score: 27.661868972910742
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The goal of 2D tomographic reconstruction is to recover an image given its projection lines from various views. It is often presumed that projection angles associated with the projection lines are known in advance. Under certain situations, however, these angles are known only approximately or are completely unknown. It becomes more challenging to reconstruct the image from a collection of random projection lines. We propose an adversarial learning based approach to recover the image and the projection angle distribution by matching the empirical distribution of the measurements with the generated data. Fitting the distributions is achieved through solving a min-max game between a generator and a critic based on Wasserstein generative adversarial network structure. To accommodate the update of the projection angle distribution through gradient back propagation, we approximate the loss using the Gumbel-Softmax reparameterization of samples from discrete distributions. Our theoretical analysis verifies the unique recovery of the image and the projection distribution up to a rotation and reflection upon convergence. Our extensive numerical experiments showcase the potential of our method to accurately recover the image and the projection angle distribution under noise contamination.

Related papers

• Integrating Generative and Physics-Based Models for Ptychographic Imaging with Uncertainty Quantification [0.0]
  Ptychography is a scanning coherent diffractive imaging technique that enables imaging nanometer-scale features in extended samples. This paper proposes a Bayesian inversion method for ptychography that performs effectively even with less overlap between neighboring scan locations.
  arXiv  Detail & Related papers  (2024-12-14T16:16:37Z)
• Learning Gaussian Representation for Eye Fixation Prediction [54.88001757991433]
  Existing eye fixation prediction methods perform the mapping from input images to the corresponding dense fixation maps generated from raw fixation points. We introduce Gaussian Representation for eye fixation modeling. We design our framework upon some lightweight backbones to achieve real-time fixation prediction.
  arXiv  Detail & Related papers  (2024-03-21T20:28:22Z)
• Cameras as Rays: Pose Estimation via Ray Diffusion [54.098613859015856]
  Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views. We propose a distributed representation of camera pose that treats a camera as a bundle of rays. Our proposed methods, both regression- and diffusion-based, demonstrate state-of-the-art performance on camera pose estimation on CO3D.
  arXiv  Detail & Related papers  (2024-02-22T18:59:56Z)
• APRF: Anti-Aliasing Projection Representation Field for Inverse Problem in Imaging [74.9262846410559]
  Sparse-view Computed Tomography (SVCT) reconstruction is an ill-posed inverse problem in imaging. Recent works use Implicit Neural Representations (INRs) to build the coordinate-based mapping between sinograms and CT images. We propose a self-supervised SVCT reconstruction method -- Anti-Aliasing Projection Representation Field (APRF) APRF can build the continuous representation between adjacent projection views via the spatial constraints.
  arXiv  Detail & Related papers  (2023-07-11T14:04:12Z)
• Generative Modeling in Sinogram Domain for Sparse-view CT Reconstruction [12.932897771104825]
  radiation dose in computed tomography (CT) examinations can be significantly reduced by intuitively decreasing the number of projection views. Previous deep learning techniques with sparse-view data require sparse-view/full-view CT image pairs to train the network with supervised manners. We present a fully unsupervised score-based generative model in sinogram domain for sparse-view CT reconstruction.
  arXiv  Detail & Related papers  (2022-11-25T06:49:18Z)
• Conditional Variational Autoencoder for Learned Image Reconstruction [5.487951901731039]
  We develop a novel framework that approximates the posterior distribution of the unknown image at each query observation. It handles implicit noise models and priors, it incorporates the data formation process (i.e., the forward operator), and the learned reconstructive properties are transferable between different datasets.
  arXiv  Detail & Related papers  (2021-10-22T10:02:48Z)
• Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers [68.9065881270224]
  We introduce the Wellington Posterior, which is the distribution of outcomes that would have been obtained in response to data that could have been generated by the same scene. We explore the use of data augmentation, dropout, ensembling, single-view reconstruction, and model linearization to compute a Wellington Posterior. Additional methods include the use of conditional generative models such as generative adversarial networks, neural radiance fields, and conditional prior networks.
  arXiv  Detail & Related papers  (2021-06-25T20:10:00Z)
• UVTomo-GAN: An adversarial learning based approach for unknown view X-ray tomographic reconstruction [27.661868972910742]
  Tomographic reconstruction recovers an unknown image given its projections from different angles. Here, we tackle a more challenging setting: 1) the projection angles are unknown, 2) they are drawn from an unknown probability distribution. In this set-up our goal is to recover the image and the projection angle distribution using an unsupervised adversarial learning approach.
  arXiv  Detail & Related papers  (2021-02-09T00:51:25Z)
• Deep Variational Network Toward Blind Image Restoration [60.45350399661175]
  Blind image restoration is a common yet challenging problem in computer vision. We propose a novel blind image restoration method, aiming to integrate both the advantages of them. Experiments on two typical blind IR tasks, namely image denoising and super-resolution, demonstrate that the proposed method achieves superior performance over current state-of-the-arts.
  arXiv  Detail & Related papers  (2020-08-25T03:30:53Z)
• Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images [59.906948203578544]
  We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object. We first estimate per-view depth maps using a deep multi-view stereo network. These depth maps are used to coarsely align the different views. We propose a novel multi-view reflectance estimation network architecture.
  arXiv  Detail & Related papers  (2020-03-27T21:28:54Z)
• Class-Specific Blind Deconvolutional Phase Retrieval Under a Generative Prior [8.712404218757733]
  The problem arises in various imaging modalities such as Fourier ptychography, X-ray crystallography, and in visible light communication. We propose to solve this inverse problem using alternating gradient descent algorithm under two pretrained deep generative networks as priors. The proposed recovery algorithm strives to find a sharp image and a blur kernel in the range of the respective pre-generators that textitbest explain the forward measurement model.
  arXiv  Detail & Related papers  (2020-02-28T07:36:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.