MetaInv-Net: Meta Inversion Network for Sparse View CT Image Reconstruction

• URL: http://arxiv.org/abs/2006.00171v3
• Date: Fri, 18 Sep 2020 01:17:18 GMT
• Title: MetaInv-Net: Meta Inversion Network for Sparse View CT Image Reconstruction
• Authors: Haimiao Zhang, Baodong Liu, Hengyong Yu, Bin Dong
• Abstract summary: We propose a new deep learning based model for CT image reconstruction with the backbone network architecture built by unrolling an iterative algorithm. We call the proposed model the meta-inversion network (MetaInv-Net) The proposed MetaInv-Net can be designed with much less trainable parameters while still preserves its superior image reconstruction performance.
• Score: 15.090133305839595
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: X-ray Computed Tomography (CT) is widely used in clinical applications such as diagnosis and image-guided interventions. In this paper, we propose a new deep learning based model for CT image reconstruction with the backbone network architecture built by unrolling an iterative algorithm. However, unlike the existing strategy to include as many data-adaptive components in the unrolled dynamics model as possible, we find that it is enough to only learn the parts where traditional designs mostly rely on intuitions and experience. More specifically, we propose to learn an initializer for the conjugate gradient (CG) algorithm that involved in one of the subproblems of the backbone model. Other components, such as image priors and hyperparameters, are kept as the original design. Since a hypernetwork is introduced to inference on the initialization of the CG module, it makes the proposed model a certain meta-learning model. Therefore, we shall call the proposed model the meta-inversion network (MetaInv-Net). The proposed MetaInv-Net can be designed with much less trainable parameters while still preserves its superior image reconstruction performance than some state-of-the-art deep models in CT imaging. In simulated and real data experiments, MetaInv-Net performs very well and can be generalized beyond the training setting, i.e., to other scanning settings, noise levels, and data sets.

Related papers

• Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning [13.17680480211064]
  We propose a hybrid supervised-unsupervised learning framework for X-ray computed tomography (CT) image reconstruction. Each proposed trained block consists of a deterministic MBIR solver and a neural network. We demonstrate the efficacy of this learned hybrid model for low-dose CT image reconstruction with limited training data.
  arXiv  Detail & Related papers  (2023-11-19T20:23:59Z)
• MEPNet: A Model-Driven Equivariant Proximal Network for Joint Sparse-View Reconstruction and Metal Artifact Reduction in CT Images [29.458632068296854]
  We propose a model-driven equivariant proximal network, called MEPNet. MEPNet is optimization-inspired and has a clear working mechanism. We will release the code at urlhttps://github.com/hongwang01/MEPNet.
  arXiv  Detail & Related papers  (2023-06-25T15:50:11Z)
• Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generation [78.13793505707952]
  Existing autoregressive models follow the two-stage generation paradigm that first learns a codebook in the latent space for image reconstruction and then completes the image generation autoregressively based on the learned codebook. We propose a novel two-stage framework, which consists of Masked Quantization VAE (MQ-VAE) Stack model from modeling redundancy.
  arXiv  Detail & Related papers  (2023-05-23T02:15:53Z)
• Deep Learning for Material Decomposition in Photon-Counting CT [0.5801044612920815]
  We present a novel deep-learning solution for material decomposition in PCCT, based on an unrolled/unfolded iterative network. Our approach outperforms a maximum likelihood estimation, a variational method, as well as a fully-learned network.
  arXiv  Detail & Related papers  (2022-08-05T19:05:16Z)
• Adaptive Convolutional Dictionary Network for CT Metal Artifact Reduction [62.691996239590125]
  We propose an adaptive convolutional dictionary network (ACDNet) for metal artifact reduction. Our ACDNet can automatically learn the prior for artifact-free CT images via training data and adaptively adjust the representation kernels for each input CT image. Our method inherits the clear interpretability of model-based methods and maintains the powerful representation ability of learning-based methods.
  arXiv  Detail & Related papers  (2022-05-16T06:49:36Z)
• Unsupervised Deep Learning Meets Chan-Vese Model [77.24463525356566]
  We propose an unsupervised image segmentation approach that integrates the Chan-Vese (CV) model with deep neural networks. Our basic idea is to apply a deep neural network that maps the image into a latent space to alleviate the violation of the piecewise constant assumption in image space.
  arXiv  Detail & Related papers  (2022-04-14T13:23:57Z)
• InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal Artifact Reduction in CT Images [53.4351366246531]
  We construct a novel interpretable dual domain network, termed InDuDoNet+, into which CT imaging process is finely embedded. We analyze the CT values among different tissues, and merge the prior observations into a prior network for our InDuDoNet+, which significantly improve its generalization performance.
  arXiv  Detail & Related papers  (2021-12-23T15:52:37Z)
• Is Deep Image Prior in Need of a Good Education? [57.3399060347311]
  Deep image prior was introduced as an effective prior for image reconstruction. Despite its impressive reconstructive properties, the approach is slow when compared to learned or traditional reconstruction techniques. We develop a two-stage learning paradigm to address the computational challenge.
  arXiv  Detail & Related papers  (2021-11-23T15:08:26Z)
• Meta Internal Learning [88.68276505511922]
  Internal learning for single-image generation is a framework, where a generator is trained to produce novel images based on a single image. We propose a meta-learning approach that enables training over a collection of images, in order to model the internal statistics of the sample image more effectively. Our results show that the models obtained are as suitable as single-image GANs for many common image applications.
  arXiv  Detail & Related papers  (2021-10-06T16:27:38Z)
• Multi-layer Residual Sparsifying Transform (MARS) Model for Low-dose CT Image Reconstruction [12.37556184089774]
  We develop a new image reconstruction approach based on a novel multi-layer model learned in an unsupervised manner. The proposed framework extends the classical sparsifying transform model for images to a Multi-lAyer Residual Sparsifying transform (MARS) model. We derive an efficient block coordinate descent algorithm to learn the transforms across layers, in an unsupervised manner from limited regular-dose images.
  arXiv  Detail & Related papers  (2020-10-10T09:04:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.