On hallucinations in tomographic image reconstruction

• URL: http://arxiv.org/abs/2012.00646v2
• Date: Thu, 1 Apr 2021 16:44:18 GMT
• Title: On hallucinations in tomographic image reconstruction
• Authors: Sayantan Bhadra, Varun A. Kelkar, Frank J. Brooks and Mark A. Anastasio
• Abstract summary: An inaccurate prior might lead to false structures being hallucinated in the reconstructed image. Deep neural networks have been actively investigated for regularizing image reconstruction problems.
• Score: 3.486901561986149
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tomographic image reconstruction is generally an ill-posed linear inverse problem. Such ill-posed inverse problems are typically regularized using prior knowledge of the sought-after object property. Recently, deep neural networks have been actively investigated for regularizing image reconstruction problems by learning a prior for the object properties from training images. However, an analysis of the prior information learned by these deep networks and their ability to generalize to data that may lie outside the training distribution is still being explored. An inaccurate prior might lead to false structures being hallucinated in the reconstructed image and that is a cause for serious concern in medical imaging. In this work, we propose to illustrate the effect of the prior imposed by a reconstruction method by decomposing the image estimate into generalized measurement and null components. The concept of a hallucination map is introduced for the general purpose of understanding the effect of the prior in regularized reconstruction methods. Numerical studies are conducted corresponding to a stylized tomographic imaging modality. The behavior of different reconstruction methods under the proposed formalism is discussed with the help of the numerical studies.

Related papers

• Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction [13.277067849874756]
  We study how DIP recovers information from undersampled imaging measurements. We introduce a self-driven reconstruction process that concurrently optimize both the network weights and the input. Our method incorporates a novel denoiser regularization term which enables robust and stable joint estimation of both the network input and reconstructed image.
  arXiv  Detail & Related papers  (2024-02-06T15:52:23Z)
• Prior image-based medical image reconstruction using a style-based generative adversarial network [15.757204774959366]
  This work proposes to use a style-based generative adversarial network (StyleGAN) to constrain an image reconstruction problem. An optimization problem is formulated in the intermediate latent-space of a StyleGAN, that is disentangled with respect to meaningful image attributes. A stylized numerical study inspired by MR imaging is designed, where the sought-after and the prior image are structurally similar.
  arXiv  Detail & Related papers  (2022-02-17T23:28:10Z)
• Learning Discriminative Shrinkage Deep Networks for Image Deconvolution [122.79108159874426]
  We propose an effective non-blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms. Experimental results show that the proposed method performs favorably against the state-of-the-art ones in terms of efficiency and accuracy.
  arXiv  Detail & Related papers  (2021-11-27T12:12:57Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Proxy-bridged Image Reconstruction Network for Anomaly Detection in Medical Images [59.700111685673846]
  Anomaly detection in medical images refers to the identification of abnormal images with only normal images in the training set. We propose a novel Proxy-bridged Image Reconstruction Network ( ProxyAno) for anomaly detection in medical images.
  arXiv  Detail & Related papers  (2021-10-05T00:40:43Z)
• Evaluation of Complexity Measures for Deep Learning Generalization in Medical Image Analysis [77.34726150561087]
  PAC-Bayes flatness-based and path norm-based measures produce the most consistent explanation for the combination of models and data. We also investigate the use of multi-task classification and segmentation approach for breast images.
  arXiv  Detail & Related papers  (2021-03-04T20:58:22Z)
• NAS-DIP: Learning Deep Image Prior with Neural Architecture Search [65.79109790446257]
  Recent work has shown that the structure of deep convolutional neural networks can be used as a structured image prior. We propose to search for neural architectures that capture stronger image priors. We search for an improved network by leveraging an existing neural architecture search algorithm.
  arXiv  Detail & Related papers  (2020-08-26T17:59:36Z)
• Encoding Structure-Texture Relation with P-Net for Anomaly Detection in Retinal Images [42.700275429734205]
  Anomaly detection in retinal image refers to the identification of abnormality caused by various retinal diseases/lesions. We propose to leverage the relation between the image texture and structure to design a deep neural network for anomaly detection.
  arXiv  Detail & Related papers  (2020-08-09T02:59:33Z)
• Data Consistent CT Reconstruction from Insufficient Data with Learned Prior Images [70.13735569016752]
  We investigate the robustness of deep learning in CT image reconstruction by showing false negative and false positive lesion cases. We propose a data consistent reconstruction (DCR) method to improve their image quality, which combines the advantages of compressed sensing and deep learning. The efficacy of the proposed method is demonstrated in cone-beam CT with truncated data, limited-angle data and sparse-view data, respectively.
  arXiv  Detail & Related papers  (2020-05-20T13:30:49Z)
• Medical image reconstruction with image-adaptive priors learned by use of generative adversarial networks [12.288269320420486]
  We apply an image-adaptive GAN-based reconstruction method to reconstruct high fidelity images from incomplete medical imaging data. It is observed that the IAGAN method can potentially recover fine structures in the object that are relevant for medical diagnosis but may be oversmoothed in reconstructions with traditional sparsity-promoting regularization.
  arXiv  Detail & Related papers  (2020-01-27T23:39:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.