Stabilizing Deep Tomographic Reconstruction

• URL: http://arxiv.org/abs/2008.01846v5
• Date: Mon, 13 Sep 2021 16:25:34 GMT
• Title: Stabilizing Deep Tomographic Reconstruction
• Authors: Weiwen Wu, Dianlin Hu, Wenxiang Cong, Hongming Shan, Shaoyu Wang, Chuang Niu, Pingkun Yan, Hengyong Yu, Varut Vardhanabhuti, Ge Wang
• Abstract summary: We propose an Analytic Compressed Iterative Deep (ACID) framework to address this challenge. ACID synergizes a deep reconstruction network trained on big data, kernel awareness from CS-inspired processing, and iterative refinement. Our study demonstrates that the deep reconstruction using ACID is accurate and stable, and sheds light on the converging mechanism of the ACID iteration.
• Score: 25.179542326326896
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tomographic image reconstruction with deep learning is an emerging field, but a recent landmark study reveals that several deep reconstruction networks are unstable for computed tomography (CT) and magnetic resonance imaging (MRI). Specifically, three kinds of instabilities were reported: (1) strong image artefacts from tiny perturbations, (2) small features missing in a deeply reconstructed image, and (3) decreased imaging performance with increased input data. On the other hand, compressed sensing (CS) inspired reconstruction methods do not suffer from these instabilities because of their built-in kernel awareness. For deep reconstruction to realize its full potential and become a mainstream approach for tomographic imaging, it is thus critically important to meet this challenge by stabilizing deep reconstruction networks. Here we propose an Analytic Compressed Iterative Deep (ACID) framework to address this challenge. ACID synergizes a deep reconstruction network trained on big data, kernel awareness from CS-inspired processing, and iterative refinement to minimize the data residual relative to real measurement. Our study demonstrates that the deep reconstruction using ACID is accurate and stable, and sheds light on the converging mechanism of the ACID iteration under a Bounded Relative Error Norm (BREN) condition. In particular, the study shows that ACID-based reconstruction is resilient against adversarial attacks, superior to classic sparsity-regularized reconstruction alone, and eliminates the three kinds of instabilities. We anticipate that this integrative data-driven approach will help promote development and translation of deep tomographic image reconstruction networks into clinical applications.

Related papers

• 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning [79.60829508459753]
  Current commercial Digital Subtraction Angiography (DSA) systems typically demand hundreds of scanning views to perform reconstruction. The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task. We propose to use a time-agnostic vessel probability field to solve this problem effectively.
  arXiv  Detail & Related papers  (2024-05-17T11:23:33Z)
• Implicit Neural Representations for Robust Joint Sparse-View CT Reconstruction [12.381526863294061]
  Implicit Neural Representations (INRs) have shown promise in addressing sparse-view CT reconstruction. We propose a novel approach to improve reconstruction quality through joint reconstruction of multiple objects using INRs.
  arXiv  Detail & Related papers  (2024-05-03T22:50:59Z)
• Analysis of Deep Image Prior and Exploiting Self-Guidance for Image Reconstruction [13.277067849874756]
  We study how DIP recovers information from undersampled imaging measurements. We introduce a self-driven reconstruction process that concurrently optimize both the network weights and the input. Our method incorporates a novel denoiser regularization term which enables robust and stable joint estimation of both the network input and reconstructed image.
  arXiv  Detail & Related papers  (2024-02-06T15:52:23Z)
• Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction [0.0]
  State-of-the-art reconstruction methods have been developed based on recent advances in deep learning. For such approaches to be used in safety-critical domains such as medical imaging, the network reconstruction should not only provide the user with a reconstructed image, but also with some level of confidence in the reconstruction. This work is the first approach to solving inverse problems that additionally models data-dependent uncertainty by estimating an input-dependent scale map.
  arXiv  Detail & Related papers  (2023-04-14T06:58:44Z)
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction [68.80715727288514]
  We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix. In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
  arXiv  Detail & Related papers  (2022-09-15T03:58:30Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Over-and-Under Complete Convolutional RNN for MRI Reconstruction [57.95363471940937]
  Recent deep learning-based methods for MR image reconstruction usually leverage a generic auto-encoder architecture. We propose an Over-and-Under Complete Convolu?tional Recurrent Neural Network (OUCR), which consists of an overcomplete and an undercomplete Convolutional Recurrent Neural Network(CRNN) The proposed method achieves significant improvements over the compressed sensing and popular deep learning-based methods with less number of trainable parameters.
  arXiv  Detail & Related papers  (2021-06-16T15:56:34Z)
• Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation [60.663499381212425]
  We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
  arXiv  Detail & Related papers  (2021-04-05T13:05:22Z)
• Adversarial Robust Training of Deep Learning MRI Reconstruction Models [0.0]
  We employ adversarial attacks to generate small synthetic perturbations, which are difficult to reconstruct for a trained Deep Learning reconstruction network. We then use robust training to increase the network's sensitivity to these small features and encourage their reconstruction. Experimental results show that by introducing robust training to a reconstruction network, the rate of false negative features can be reduced.
  arXiv  Detail & Related papers  (2020-10-30T19:26:14Z)
• Limited View Tomographic Reconstruction Using a Deep Recurrent Framework with Residual Dense Spatial-Channel Attention Network and Sinogram Consistency [25.16002539710169]
  We propose a novel recurrent reconstruction framework that stacks the same block multiple times. We develop a sinogram consistency layer interleaved in our recurrent framework to ensure that the sampled sinogram is consistent with the sinogram of the intermediate outputs of the recurrent blocks. Our algorithm achieves a consistent and significant improvement over the existing state-of-the-art neural methods on both limited angle reconstruction and sparse view reconstruction.
  arXiv  Detail & Related papers  (2020-09-03T16:39:48Z)
• Limited-angle tomographic reconstruction of dense layered objects by dynamical machine learning [68.9515120904028]
  Limited-angle tomography of strongly scattering quasi-transparent objects is a challenging, highly ill-posed problem. Regularizing priors are necessary to reduce artifacts by improving the condition of such problems. We devised a recurrent neural network (RNN) architecture with a novel split-convolutional gated recurrent unit (SC-GRU) as the building block.
  arXiv  Detail & Related papers  (2020-07-21T11:48:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.