Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis

• URL: http://arxiv.org/abs/2007.01441v4
• Date: Sat, 18 Jun 2022 02:22:11 GMT
• Title: Joint Frequency and Image Space Learning for MRI Reconstruction and Analysis
• Authors: Nalini M. Singh, Juan Eugenio Iglesias, Elfar Adalsteinsson, Adrian V. Dalca, Polina Golland
• Abstract summary: We show that neural network layers that explicitly combine frequency and image feature representations can be used as a versatile building block for reconstruction from frequency space data. The proposed joint learning schemes enable both correction of artifacts native to the frequency space and manipulation of image space representations to reconstruct coherent image structures at every layer of the network.
• Score: 7.821429746599738
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the challenges arising in MRI acquisition where the signal is a corrupted Fourier transform of the desired image. The proposed joint learning schemes enable both correction of artifacts native to the frequency space and manipulation of image space representations to reconstruct coherent image structures at every layer of the network. This is in contrast to most current deep learning approaches for image reconstruction that treat frequency and image space features separately and often operate exclusively in one of the two spaces. We demonstrate the advantages of joint convolutional learning for a variety of tasks, including motion correction, denoising, reconstruction from undersampled acquisitions, and combined undersampling and motion correction on simulated and real world multicoil MRI data. The joint models produce consistently high quality output images across all tasks and datasets. When integrated into a state of the art unrolled optimization network with physics-inspired data consistency constraints for undersampled reconstruction, the proposed architectures significantly improve the optimization landscape, which yields an order of magnitude reduction of training time. This result suggests that joint representations are particularly well suited for MRI signals in deep learning networks. Our code and pretrained models are publicly available at https://github.com/nalinimsingh/interlacer.

Related papers

• Attention Hybrid Variational Net for Accelerated MRI Reconstruction [7.046523233290946]
  The application of compressed sensing (CS)-enabled data reconstruction for accelerating magnetic resonance imaging (MRI) remains a challenging problem. This is due to the fact that the information lost in k-space from the acceleration mask makes it difficult to reconstruct an image similar to the quality of a fully sampled image. We propose a deep learning-based attention hybrid variational network that performs learning in both the k-space and image domain.
  arXiv  Detail & Related papers  (2023-06-21T16:19:07Z)
• Single-pass Object-adaptive Data Undersampling and Reconstruction for MRI [6.599344783327054]
  We propose a data-driven sampler using a convolutional neural network, MNet, to provide object-specific sampling patterns adaptive to each scanned object. The network observes very limited low-frequency k-space data for each object and rapidly predicts the desired undersampling pattern. Experimental results on the fastMRI knee dataset demonstrate the ability of the proposed learned undersampling network to generate object-specific masks at fourfold and eightfold acceleration.
  arXiv  Detail & Related papers  (2021-11-17T16:06:06Z)
• Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
  We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality. In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network. Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
  arXiv  Detail & Related papers  (2021-10-15T13:16:59Z)
• Multi-Modal MRI Reconstruction with Spatial Alignment Network [51.74078260367654]
  In clinical practice, magnetic resonance imaging (MRI) with multiple contrasts is usually acquired in a single study. Recent researches demonstrate that, considering the redundancy between different contrasts or modalities, a target MRI modality under-sampled in the k-space can be better reconstructed with the helps from a fully-sampled sequence. In this paper, we integrate the spatial alignment network with reconstruction, to improve the quality of the reconstructed target modality.
  arXiv  Detail & Related papers  (2021-08-12T08:46:35Z)
• IREM: High-Resolution Magnetic Resonance (MR) Image Reconstruction via Implicit Neural Representation [33.55719364798433]
  We propose a novel image reconstruction network named IREM, which is trained on multiple low-resolution (LR) MR images. IREM reduces scan time and achieves high-resolution MR imaging in terms of SNR and local image detail.
  arXiv  Detail & Related papers  (2021-06-29T05:25:43Z)
• Over-and-Under Complete Convolutional RNN for MRI Reconstruction [57.95363471940937]
  Recent deep learning-based methods for MR image reconstruction usually leverage a generic auto-encoder architecture. We propose an Over-and-Under Complete Convolu?tional Recurrent Neural Network (OUCR), which consists of an overcomplete and an undercomplete Convolutional Recurrent Neural Network(CRNN) The proposed method achieves significant improvements over the compressed sensing and popular deep learning-based methods with less number of trainable parameters.
  arXiv  Detail & Related papers  (2021-06-16T15:56:34Z)
• Joint Calibrationless Reconstruction and Segmentation of Parallel MRI [21.227526213206545]
  We introduce a novel image domain deep-learning framework for calibrationless parallel MRI reconstruction. The combination of the proposed image domain deep calibrationless approach with the segmentation algorithm offers improved image quality. The proposed few-shot training strategy requires only 10% of segmented datasets to offer good performance.
  arXiv  Detail & Related papers  (2021-05-19T16:04:20Z)
• Dual-Octave Convolution for Accelerated Parallel MR Image Reconstruction [75.35200719645283]
  We propose the Dual-Octave Convolution (Dual-OctConv), which is capable of learning multi-scale spatial-frequency features from both real and imaginary components. By reformulating the complex operations using octave convolutions, our model shows a strong ability to capture richer representations of MR images.
  arXiv  Detail & Related papers  (2021-04-12T10:51:05Z)
• Adaptive Gradient Balancing for UndersampledMRI Reconstruction and Image-to-Image Translation [60.663499381212425]
  We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
  arXiv  Detail & Related papers  (2021-04-05T13:05:22Z)
• Learning Enriched Features for Real Image Restoration and Enhancement [166.17296369600774]
  convolutional neural networks (CNNs) have achieved dramatic improvements over conventional approaches for image restoration task. We present a novel architecture with the collective goals of maintaining spatially-precise high-resolution representations through the entire network. Our approach learns an enriched set of features that combines contextual information from multiple scales, while simultaneously preserving the high-resolution spatial details.
  arXiv  Detail & Related papers  (2020-03-15T11:04:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.