Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRI

• URL: http://arxiv.org/abs/2405.14327v4
• Date: Mon, 07 Oct 2024 15:10:03 GMT
• Title: Autoregressive Image Diffusion: Generation of Image Sequence and Application in MRI
• Authors: Guanxiong Luo, Shoujin Huang, Martin Uecker,
• Abstract summary: Generative models learn image distributions and can be used to reconstruct high-quality images from undersampled k-space data. We present the autoregressive image diffusion (AID) model for image sequences and use it to sample the posterior for accelerated MRI reconstruction. The results show that the AID model can robustly generate sequentially coherent image sequences.
• Score: 2.0318411357438086
• License:
• Abstract: Magnetic resonance imaging (MRI) is a widely used non-invasive imaging modality. However, a persistent challenge lies in balancing image quality with imaging speed. This trade-off is primarily constrained by k-space measurements, which traverse specific trajectories in the spatial Fourier domain (k-space). These measurements are often undersampled to shorten acquisition times, resulting in image artifacts and compromised quality. Generative models learn image distributions and can be used to reconstruct high-quality images from undersampled k-space data. In this work, we present the autoregressive image diffusion (AID) model for image sequences and use it to sample the posterior for accelerated MRI reconstruction. The algorithm incorporates both undersampled k-space and pre-existing information. Models trained with fastMRI dataset are evaluated comprehensively. The results show that the AID model can robustly generate sequentially coherent image sequences. In MRI applications, the AID can outperform the standard diffusion model and reduce hallucinations, due to the learned inter-image dependencies. The project code is available at https://github.com/mrirecon/aid.

Related papers

• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• CMRxRecon: An open cardiac MRI dataset for the competition of accelerated image reconstruction [62.61209705638161]
  There has been growing interest in deep learning-based CMR imaging algorithms. Deep learning methods require large training datasets. This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
  arXiv  Detail & Related papers  (2023-09-19T15:14:42Z)
• Generalized Implicit Neural Representation for Efficient MRI Parallel Imaging Reconstruction [16.63720411275398]
  This study presents a generalized implicit neural representation (INR)-based framework for MRI PI reconstruction. The framework's INR model treats fully sampled MR images as a continuous function of spatial coordinates and prior voxel-specific features. Experiments on publicly available MRI datasets demonstrate the superior performance of the proposed method in reconstructing images at multiple acceleration factors.
  arXiv  Detail & Related papers  (2023-09-12T09:07:03Z)
• Global k-Space Interpolation for Dynamic MRI Reconstruction using Masked Image Modeling [10.74920257710449]
  In dynamic Magnetic Imaging (MRI), k-space is typically undersampled due to limited scan time. We propose a novel Transformer-based k-space Global Interpolation Network, termed k-GIN. Our k-GIN learns global dependencies among low- and high-frequency components of 2D+t k-space and uses it to interpolate unsampled data.
  arXiv  Detail & Related papers  (2023-07-24T10:20:14Z)
• On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
  Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input. DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases. We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
  arXiv  Detail & Related papers  (2023-06-23T03:09:03Z)
• A Deep Learning Approach Using Masked Image Modeling for Reconstruction of Undersampled K-spaces [7.227671880690971]
  This study makes use of 11161 reconstructed MRI and k spaces of knee MRI images from Facebook's fastmri dataset. The model was evaluated through L1 loss, gradient normalization, and structural similarity values. The reconstructed k spaces yielded structural similarity values of over 99% for both training and validation with the fully sampled k spaces.
  arXiv  Detail & Related papers  (2022-08-24T12:27:54Z)
• Multi-Modal MRI Reconstruction with Spatial Alignment Network [51.74078260367654]
  In clinical practice, magnetic resonance imaging (MRI) with multiple contrasts is usually acquired in a single study. Recent researches demonstrate that, considering the redundancy between different contrasts or modalities, a target MRI modality under-sampled in the k-space can be better reconstructed with the helps from a fully-sampled sequence. In this paper, we integrate the spatial alignment network with reconstruction, to improve the quality of the reconstructed target modality.
  arXiv  Detail & Related papers  (2021-08-12T08:46:35Z)
• Generative Adversarial Networks (GAN) Powered Fast Magnetic Resonance Imaging -- Mini Review, Comparison and Perspectives [5.3148259096171175]
  One drawback of MRI is its comparatively slow scanning and reconstruction compared to other image modalities. Deep Neural Networks (DNNs) have been used in sparse MRI reconstruction models to recreate relatively high-quality images. Generative Adversarial Networks (GAN) based methods are proposed to solve fast MRI with enhanced image perceptual quality.
  arXiv  Detail & Related papers  (2021-05-04T23:59:00Z)
• Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion Encoding (SIDE) [50.65891535040752]
  We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion. SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients. We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
  arXiv  Detail & Related papers  (2020-02-25T14:48:17Z)
• Deep Residual Dense U-Net for Resolution Enhancement in Accelerated MRI Acquisition [19.422926534305837]
  We propose a deep-learning approach, aiming at reconstructing high-quality images from accelerated MRI acquisition. Specifically, we use Convolutional Neural Network (CNN) to learn the differences between the aliased images and the original images. Considering the peculiarity of the down-sampled k-space data, we introduce a new term to the loss function in learning, which effectively employs the given k-space data.
  arXiv  Detail & Related papers  (2020-01-13T19:01:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.