Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI

• URL: http://arxiv.org/abs/2312.03102v2
• Date: Wed, 28 Feb 2024 15:58:28 GMT
• Title: Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI
• Authors: Sean I. Young, Ya\"el Balbastre, Bruce Fischl, Polina Golland, Juan Eugenio Iglesias
• Abstract summary: In magnetic resonance imaging (MRI), slice-to-volume reconstruction (SVR) refers to computational reconstruction of an unknown 3D magnetic resonance volume from stacks of 2D slices corrupted by motion. Here, we propose a SVR method that overcomes the shortcomings of previous work and produces state-of-the-art reconstructions in the presence of extreme inter-slice motion. Experiments on the SVR of adult and fetal brains demonstrate that our fully convolutional method is twice as accurate as previous SVR methods.
• Score: 9.512063866033126
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In magnetic resonance imaging (MRI), slice-to-volume reconstruction (SVR) refers to computational reconstruction of an unknown 3D magnetic resonance volume from stacks of 2D slices corrupted by motion. While promising, current SVR methods require multiple slice stacks for accurate 3D reconstruction, leading to long scans and limiting their use in time-sensitive applications such as fetal fMRI. Here, we propose a SVR method that overcomes the shortcomings of previous work and produces state-of-the-art reconstructions in the presence of extreme inter-slice motion. Inspired by the recent success of single-view depth estimation methods, we formulate SVR as a single-stack motion estimation task and train a fully convolutional network to predict a motion stack for a given slice stack, producing a 3D reconstruction as a byproduct of the predicted motion. Extensive experiments on the SVR of adult and fetal brains demonstrate that our fully convolutional method is twice as accurate as previous SVR methods. Our code is available at github.com/seannz/svr.

Related papers

• From Coarse to Continuous: Progressive Refinement Implicit Neural Representation for Motion-Robust Anisotropic MRI Reconstruction [15.340881123379567]
  In MRI, slice-to-volume reconstruction is critical for recovering consistent 3D brain volumes from 2D slices.<n>We propose a progressive refinement implicit neural representation framework (PR-INR)<n>Our PR-INR unifies motion correction, structural refinement, and volumetric synthesis within a geometry-aware coordinate space.
  arXiv  Detail & Related papers  (2025-06-19T10:58:43Z)
• SUFFICIENT: A scan-specific unsupervised deep learning framework for high-resolution 3D isotropic fetal brain MRI reconstruction [7.268308489093152]
  We propose an unsupervised iterative SVR-SRR framework for isotropic HR volume reconstruction.<n>A decoding network embedded within a deep image prior framework is incorporated with a comprehensive image degradation model to produce the high-resolution (HR) volume.<n>Experiments conducted on large-magnitude motion-corrupted simulation data and clinical data demonstrate the superior performance of the proposed framework.
  arXiv  Detail & Related papers  (2025-05-23T04:53:59Z)
• Meta-learning Slice-to-Volume Reconstruction in Fetal Brain MRI using Implicit Neural Representations [9.749932662063992]
  High-resolution slice-to-volume reconstruction (SVR) from multiple motion-corrupted low-resolution 2D slices constitutes a critical step in image-based diagnostics of moving subjects.<n>Existing solutions struggle with image artifacts and severe subject motion or require slice pre-alignment to achieve satisfying reconstruction performance.<n>We propose a novel SVR method to enable fast and accurate MRI reconstruction even in cases of severe image and motion corruption.
  arXiv  Detail & Related papers  (2025-05-14T17:07:37Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data. Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging. We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRI [24.048132427816704]
  We propose a deep learning-based test-time-training method for accurate motion estimation. We show that our method can provably reconstruct motion parameters for a simple signal and neural network model.
  arXiv  Detail & Related papers  (2024-09-14T08:51:33Z)
• A self-attention model for robust rigid slice-to-volume registration of functional MRI [4.615338063719135]
  Head motion during fMRI scans can result in distortion, biased analyses, and increased costs. We introduce an end-to-end SVR model for aligning 2D fMRI slices with a 3D reference volume. Our model achieves competitive performance in terms of alignment accuracy compared to state-of-the-art deep learning-based methods.
  arXiv  Detail & Related papers  (2024-04-06T08:02:18Z)
• RoHM: Robust Human Motion Reconstruction via Diffusion [58.63706638272891]
  RoHM is an approach for robust 3D human motion reconstruction from monocular RGB(-D) videos. It conditioned on noisy and occluded input data, reconstructs complete, plausible motions in consistent global coordinates. Our method outperforms state-of-the-art approaches qualitatively and quantitatively, while being faster at test time.
  arXiv  Detail & Related papers  (2024-01-16T18:57:50Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• REGAS: REspiratory-GAted Synthesis of Views for Multi-Phase CBCT Reconstruction from a single 3D CBCT Acquisition [75.64791080418162]
  REGAS proposes a self-supervised method to synthesize the undersampled tomographic views and mitigate aliasing artifacts in reconstructed images. To address the large memory cost of deep neural networks on high resolution 4D data, REGAS introduces a novel Ray Path Transformation (RPT) that allows for distributed, differentiable forward projections.
  arXiv  Detail & Related papers  (2022-08-17T03:42:19Z)
• GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction [50.248694764703714]
  Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. We propose Greedy LEarning for Accelerated MRI reconstruction, an efficient training strategy for high-dimensional imaging settings.
  arXiv  Detail & Related papers  (2022-07-18T06:01:29Z)
• SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI [5.023544755441559]
  We propose a novel slice-to-volume registration method using Transformers trained on synthetically transformed data. Our model automatically detects the relevance between slices and predicts the transformation of one slice using information from other slices. Experiments with real-world MRI data are also performed to demonstrate the ability of the proposed model to improve the quality of 3D reconstruction under severe fetal motion.
  arXiv  Detail & Related papers  (2022-06-22T01:55:42Z)
• ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer [60.27951773998535]
  We propose a recurrent transformer model, namely textbfReconFormer, for MRI reconstruction. It can iteratively reconstruct high fertility magnetic resonance images from highly under-sampled k-space data. We show that it achieves significant improvements over the state-of-the-art methods with better parameter efficiency.
  arXiv  Detail & Related papers  (2022-01-23T21:58:19Z)
• One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI [19.942978606567547]
  Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI) Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution. We present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized.
  arXiv  Detail & Related papers  (2021-12-09T06:39:55Z)
• A Novel Approach for Correcting Multiple Discrete Rigid In-Plane Motions Artefacts in MRI Scans [63.28835187934139]
  We propose a novel method for removing motion artefacts using a deep neural network with two input branches. The proposed method can be applied to artefacts generated by multiple movements of the patient.
  arXiv  Detail & Related papers  (2020-06-24T15:25:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.