Memory-efficient Learning for High-Dimensional MRI Reconstruction

• URL: http://arxiv.org/abs/2103.04003v1
• Date: Sat, 6 Mar 2021 01:36:25 GMT
• Title: Memory-efficient Learning for High-Dimensional MRI Reconstruction
• Authors: Ke Wang, Michael Kellman, Christopher M. Sandino, Kevin Zhang, Shreyas S. Vasanawala, Jonathan I. Tamir, Stella X. Yu, Michael Lustig
• Abstract summary: We show improved image reconstruction performance for in-vivo 3D MRI and 2D+time cardiac cine MRI using memory-efficient learning framework (MEL) MEL uses far less GPU memory while marginally increasing the training time, which enables new applications of DL to high-dimensional MRI.
• Score: 20.81538631727325
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI). Similar to compressed sensing, DL can leverage high-dimensional data (e.g. 3D, 2D+time, 3D+time) to further improve performance. However, network size and depth are currently limited by the GPU memory required for backpropagation. Here we use a memory-efficient learning (MEL) framework which favorably trades off storage with a manageable increase in computation during training. Using MEL with multi-dimensional data, we demonstrate improved image reconstruction performance for in-vivo 3D MRI and 2D+time cardiac cine MRI. MEL uses far less GPU memory while marginally increasing the training time, which enables new applications of DL to high-dimensional MRI.

Related papers

• Lightplane: Highly-Scalable Components for Neural 3D Fields [54.59244949629677]
  Lightplane Render and Splatter significantly reduce memory usage in 2D-3D mapping. These innovations enable the processing of vastly more and higher resolution images with small memory and computational costs.
  arXiv  Detail & Related papers  (2024-04-30T17:59:51Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• Video4MRI: An Empirical Study on Brain Magnetic Resonance Image Analytics with CNN-based Video Classification Frameworks [60.42012344842292]
  3D CNN-based models dominate the field of magnetic resonance image (MRI) analytics. In this paper, four datasets of Alzheimer's and Parkinson's disease recognition are utilized in experiments. In terms of efficiency, the video framework performs better than 3D-CNN models by 5% - 11% with 50% - 66% less trainable parameters.
  arXiv  Detail & Related papers  (2023-02-24T15:26:31Z)
• Computationally Efficient 3D MRI Reconstruction with Adaptive MLP [12.796051051794024]
  Current methods are mainly based on convolutional neural networks (CNN) with small kernels, which are difficult to scale up to have sufficient fitting power for 3D MRI reconstruction. We propose Recon3DMLP, a hybrid of CNN modules with small kernels for low-frequency reconstruction and GPU (MLP) modules with large kernels to boost the high-frequency reconstruction.
  arXiv  Detail & Related papers  (2023-01-21T02:58:51Z)
• Attentive Symmetric Autoencoder for Brain MRI Segmentation [56.02577247523737]
  We propose a novel Attentive Symmetric Auto-encoder based on Vision Transformer (ViT) for 3D brain MRI segmentation tasks. In the pre-training stage, the proposed auto-encoder pays more attention to reconstruct the informative patches according to the gradient metrics. Experimental results show that our proposed attentive symmetric auto-encoder outperforms the state-of-the-art self-supervised learning methods and medical image segmentation models.
  arXiv  Detail & Related papers  (2022-09-19T09:43:19Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI [19.942978606567547]
  Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI) Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution. We present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized.
  arXiv  Detail & Related papers  (2021-12-09T06:39:55Z)
• 3-Dimensional Deep Learning with Spatial Erasing for Unsupervised Anomaly Segmentation in Brain MRI [55.97060983868787]
  We investigate whether using increased spatial context by using MRI volumes combined with spatial erasing leads to improved unsupervised anomaly segmentation performance. We compare 2D variational autoencoder (VAE) to their 3D counterpart, propose 3D input erasing, and systemically study the impact of the data set size on the performance. Our best performing 3D VAE with input erasing leads to an average DICE score of 31.40% compared to 25.76% for the 2D VAE.
  arXiv  Detail & Related papers  (2021-09-14T09:17:27Z)
• Improved Simultaneous Multi-Slice Functional MRI Using Self-supervised Deep Learning [0.487576911714538]
  We extend self-supervised DL reconstruction to simultaneous multi-slice (SMS) imaging. Our results show that self-supervised DL reduces reconstruction noise and suppresses residual artifacts. Subsequent fMRI analysis remains unaltered by DL processing, while the improved temporal signal-to-noise ratio produces higher coherence estimates between task runs.
  arXiv  Detail & Related papers  (2021-05-10T17:36:27Z)
• KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow [1.2599533416395765]
  We propose a knowledge distillation (KD) framework for the image to image problems in the MRI workflow. We conduct experiments using Cardiac, Brain, and Knee MRI datasets for 4x, 5x and 8x accelerations. For the Knee dataset, the student network achieves $65%$ parameter reduction, 2x faster CPU running time, and 1.5x faster GPU running time compared to the teacher.
  arXiv  Detail & Related papers  (2020-04-11T06:21:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.