Reference-based Magnetic Resonance Image Reconstruction Using Texture Transforme

• URL: http://arxiv.org/abs/2111.09492v1
• Date: Thu, 18 Nov 2021 03:06:25 GMT
• Title: Reference-based Magnetic Resonance Image Reconstruction Using Texture Transforme
• Authors: Pengfei Guo, Vishal M. Patel
• Abstract summary: We propose a novel Texture Transformer Module (TTM) for accelerated MRI reconstruction. We formulate the under-sampled data and reference data as queries and keys in a transformer. The proposed TTM can be stacked on prior MRI reconstruction approaches to further improve their performance.
• Score: 86.6394254676369
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep Learning (DL) based methods for magnetic resonance (MR) image reconstruction have been shown to produce superior performance in recent years. However, these methods either only leverage under-sampled data or require a paired fully-sampled auxiliary modality to perform multi-modal reconstruction. Consequently, existing approaches neglect to explore attention mechanisms that can transfer textures from reference fully-sampled data to under-sampled data within a single modality, which limits these approaches in challenging cases. In this paper, we propose a novel Texture Transformer Module (TTM) for accelerated MRI reconstruction, in which we formulate the under-sampled data and reference data as queries and keys in a transformer. The TTM facilitates joint feature learning across under-sampled and reference data, so the feature correspondences can be discovered by attention and accurate texture features can be leveraged during reconstruction. Notably, the proposed TTM can be stacked on prior MRI reconstruction approaches to further improve their performance. Extensive experiments show that TTM can significantly improve the performance of several popular DL-based MRI reconstruction methods.

Related papers

• Correlated and Multi-frequency Diffusion Modeling for Highly Under-sampled MRI Reconstruction [14.687337090732036]
  Most existing MRI reconstruction methods perform tar-geted reconstruction of the entire MR image without considering specific tissue regions. This may fail to emphasize the reconstruction accuracy on im-portant tissues for diagnosis. In this study, leveraging a combination of the properties of k-space data and the diffusion process, our novel scheme focuses on mining the multi-frequency prior.
  arXiv  Detail & Related papers  (2023-09-02T07:51:27Z)
• Self-Supervised MRI Reconstruction with Unrolled Diffusion Models [27.143473617162304]
  We propose a novel self-supervised deep reconstruction model, named Self-Supervised Diffusion Reconstruction (SSDiffRecon) SSDiffRecon expresses a conditional diffusion process that interleaves cross-attention transformers for reverse diffusion steps with data-consistency blocks for physics-driven processing. Experiments on public brain MR datasets demonstrate the superiority of SSDiffRecon against state-of-the-art supervised, and self-supervised baselines in terms of reconstruction speed and quality.
  arXiv  Detail & Related papers  (2023-06-29T03:31:46Z)
• Dual-Domain Self-Supervised Learning for Accelerated Non-Cartesian MRI Reconstruction [14.754843942604472]
  We present a fully self-supervised approach for accelerated non-Cartesian MRI reconstruction. In training, the undersampled data are split into disjoint k-space domain partitions. For the image-level self-supervision, we enforce appearance consistency obtained from the original undersampled data.
  arXiv  Detail & Related papers  (2023-02-18T06:11:49Z)
• Towards performant and reliable undersampled MR reconstruction via diffusion model sampling [67.73698021297022]
  DiffuseRecon is a novel diffusion model-based MR reconstruction method. It guides the generation process based on the observed signals. It does not require additional training on specific acceleration factors.
  arXiv  Detail & Related papers  (2022-03-08T02:25:38Z)
• ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer [60.27951773998535]
  We propose a recurrent transformer model, namely textbfReconFormer, for MRI reconstruction. It can iteratively reconstruct high fertility magnetic resonance images from highly under-sampled k-space data. We show that it achieves significant improvements over the state-of-the-art methods with better parameter efficiency.
  arXiv  Detail & Related papers  (2022-01-23T21:58:19Z)
• Fast T2w/FLAIR MRI Acquisition by Optimal Sampling of Information Complementary to Pre-acquired T1w MRI [52.656075914042155]
  We propose an iterative framework to optimize the under-sampling pattern for MRI acquisition of another modality. We have demonstrated superior performance of our learned under-sampling patterns on a public dataset.
  arXiv  Detail & Related papers  (2021-11-11T04:04:48Z)
• Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation [60.663499381212425]
  We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
  arXiv  Detail & Related papers  (2021-04-05T13:05:22Z)
• Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learning [62.17532253489087]
  Deep learning methods have been shown to produce superior performance on MR image reconstruction. These methods require large amounts of data which is difficult to collect and share due to the high cost of acquisition and medical data privacy regulations. We propose a federated learning (FL) based solution in which we take advantage of the MR data available at different institutions while preserving patients' privacy.
  arXiv  Detail & Related papers  (2021-03-03T03:04:40Z)
• Joint reconstruction and bias field correction for undersampled MR imaging [7.409376558513677]
  Undersampling the k-space in MRI allows saving precious acquisition time, yet results in an ill-posed inversion problem. Deep learning schemes are susceptible to differences between the training data and the image to be reconstructed at test time. In this work, we address the sensitivity of the reconstruction problem to the bias field and propose to model it explicitly in the reconstruction.
  arXiv  Detail & Related papers  (2020-07-26T12:58:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.