INFusion: Diffusion Regularized Implicit Neural Representations for 2D and 3D accelerated MRI reconstruction

• URL: http://arxiv.org/abs/2406.13895v1
• Date: Wed, 19 Jun 2024 23:51:26 GMT
• Title: INFusion: Diffusion Regularized Implicit Neural Representations for 2D and 3D accelerated MRI reconstruction
• Authors: Yamin Arefeen, Brett Levac, Zach Stoebner, Jonathan Tamir,
• Abstract summary: Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions. This work proposes INFusion, a technique that regularizes the optimization of INRs from under-sampled MR measurements. We also propose a hybrid 3D approach with our diffusion regularization that enables INR application on large-scale 3D MR datasets.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Implicit Neural Representations (INRs) are a learning-based approach to accelerate Magnetic Resonance Imaging (MRI) acquisitions, particularly in scan-specific settings when only data from the under-sampled scan itself are available. Previous work demonstrates that INRs improve rapid MRI through inherent regularization imposed by neural network architectures. Typically parameterized by fully-connected neural networks, INRs support continuous image representations by taking a physical coordinate location as input and outputting the intensity at that coordinate. Previous work has applied unlearned regularization priors during INR training and have been limited to 2D or low-resolution 3D acquisitions. Meanwhile, diffusion based generative models have received recent attention as they learn powerful image priors decoupled from the measurement model. This work proposes INFusion, a technique that regularizes the optimization of INRs from under-sampled MR measurements with pre-trained diffusion models for improved image reconstruction. In addition, we propose a hybrid 3D approach with our diffusion regularization that enables INR application on large-scale 3D MR datasets. 2D experiments demonstrate improved INR training with our proposed diffusion regularization, and 3D experiments demonstrate feasibility of INR training with diffusion regularization on 3D matrix sizes of 256 by 256 by 80.

Related papers

• Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
  Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements. Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements. We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Highly Accelerated MRI via Implicit Neural Representation Guided Posterior Sampling of Diffusion Models [2.5412006057370893]
  Implicit neural representation (INR) has emerged as a powerful paradigm for solving inverse problems. Our proposed framework can be a generalizable framework to solve inverse problems in other medical imaging tasks.
  arXiv  Detail & Related papers  (2024-07-03T01:37:56Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• Optimizing Sampling Patterns for Compressed Sensing MRI with Diffusion Generative Models [75.52575380824051]
  We present a learning method to optimize sub-sampling patterns for compressed sensing multi-coil MRI. We use a single-step reconstruction based on the posterior mean estimate given by the diffusion model and the MRI measurement process. Our method requires as few as five training images to learn effective sampling patterns.
  arXiv  Detail & Related papers  (2023-06-05T22:09:06Z)
• Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction [11.661657147506519]
  Implicit Neuraltruth (INR) has appeared as powerful DL-based tool for solving the inverse problem. In this work, we proposed an INR-based method to improve dynamic MRI reconstruction from highly undersampled k-space data. The proposed INR represents the dynamic MRI images as an implicit function and encodes them into neural networks.
  arXiv  Detail & Related papers  (2022-12-31T05:43:21Z)
• A scan-specific unsupervised method for parallel MRI reconstruction via implicit neural representation [9.388253054229155]
  implicit neural representation (INR) has emerged as a new deep learning paradigm for learning the internal continuity of an object. The proposed method outperforms existing methods by suppressing the aliasing artifacts and noise. The high-quality results and scanning specificity make the proposed method hold the potential for further accelerating the data acquisition of parallel MRI.
  arXiv  Detail & Related papers  (2022-10-19T10:16:03Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• Scale-Equivariant Unrolled Neural Networks for Data-Efficient Accelerated MRI Reconstruction [33.82162420709648]
  We propose modeling the proximal operators of unrolled neural networks with scale-equivariant convolutional neural networks. Our approach demonstrates strong improvements over the state-of-the-art unrolled neural networks under the same memory constraints.
  arXiv  Detail & Related papers  (2022-04-21T23:29:52Z)
• A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction [50.1787181309337]
  We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
  arXiv  Detail & Related papers  (2022-03-28T14:03:45Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• MRI Super-Resolution with GAN and 3D Multi-Level DenseNet: Smaller, Faster, and Better [16.65044022241517]
  High-resolution (HR) magnetic resonance imaging (MRI) provides detailed anatomical information critical for diagnosis in the clinical application. HR MRI typically comes at the cost of long scan time, small spatial coverage, and low signal-to-noise ratio (SNR) Recent studies showed that with a deep convolutional neural network (CNN), HR generic images could be recovered from low-resolution (LR) inputs via single image super-resolution (SISR) approaches.
  arXiv  Detail & Related papers  (2020-03-02T22:07:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.