SISMIK for brain MRI: Deep-learning-based motion estimation and model-based motion correction in k-space
- URL: http://arxiv.org/abs/2312.13220v3
- Date: Sun, 03 Nov 2024 16:09:04 GMT
- Title: SISMIK for brain MRI: Deep-learning-based motion estimation and model-based motion correction in k-space
- Authors: Oscar Dabrowski, Jean-Luc Falcone, Antoine Klauser, Julien Songeon, Michel Kocher, Bastien Chopard, François Lazeyras, Sébastien Courvoisier,
- Abstract summary: We propose a retrospective method for motion estimation and correction for 2D Spin-Echo scans of the brain.
The method leverages the power of deep neural networks to estimate motion parameters in k-space.
It uses a model-based approach to restore degraded images to avoid ''hallucinations''
- Score: 0.0
- License:
- Abstract: MRI, a widespread non-invasive medical imaging modality, is highly sensitive to patient motion. Despite many attempts over the years, motion correction remains a difficult problem and there is no general method applicable to all situations. We propose a retrospective method for motion estimation and correction to tackle the problem of in-plane rigid-body motion, apt for classical 2D Spin-Echo scans of the brain, which are regularly used in clinical practice. Due to the sequential acquisition of k-space, motion artifacts are well localized. The method leverages the power of deep neural networks to estimate motion parameters in k-space and uses a model-based approach to restore degraded images to avoid ''hallucinations''. Notable advantages are its ability to estimate motion occurring in high spatial frequencies without the need of a motion-free reference. The proposed method operates on the whole k-space dynamic range and is moderately affected by the lower SNR of higher harmonics. As a proof of concept, we provide models trained using supervised learning on 600k motion simulations based on motion-free scans of 43 different subjects. Generalization performance was tested with simulations as well as in-vivo. Qualitative and quantitative evaluations are presented for motion parameter estimations and image reconstruction. Experimental results show that our approach is able to obtain good generalization performance on simulated data and in-vivo acquisitions. We provide a Python implementation at https://gitlab.unige.ch/Oscar.Dabrowski/sismik_mri/.
Related papers
- Highly efficient non-rigid registration in k-space with application to cardiac Magnetic Resonance Imaging [10.618048010632728]
We propose a novel self-supervised deep learning-based framework, dubbed the Local-All Pass Attention Network (LAPANet) for non-rigid motion estimation.
LAPANet was evaluated on cardiac motion estimation across various sampling trajectories and acceleration rates.
The achieved high temporal resolution (less than 5 ms) for non-rigid motion opens new avenues for motion detection, tracking and correction in dynamic and real-time MRI applications.
arXiv Detail & Related papers (2024-10-24T15:19:59Z) - A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements.
Our model is based on neural operators, a discretization-agnostic architecture.
Our inference speed is also 1,400x faster than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRI [24.048132427816704]
We propose a deep learning-based test-time-training method for accurate motion estimation.
We show that our method can provably reconstruct motion parameters for a simple signal and neural network model.
arXiv Detail & Related papers (2024-09-14T08:51:33Z) - On the Influence of Smoothness Constraints in Computed Tomography Motion Compensation [3.5475653746630056]
This study analyzes the influence of a spline-based motion model within an existing rigid motion compensation algorithm for cone-beam CT.
Results demonstrate that the choice of motion model crucially influences recoverable frequencies.
Ultimately, the optimal motion model is dependent on the imaged anatomy, clinical use case, and scanning protocol.
arXiv Detail & Related papers (2024-05-29T13:36:16Z) - MotionHint: Self-Supervised Monocular Visual Odometry with Motion
Constraints [70.76761166614511]
We present a novel self-supervised algorithm named MotionHint for monocular visual odometry (VO)
Our MotionHint algorithm can be easily applied to existing open-sourced state-of-the-art SSM-VO systems.
arXiv Detail & Related papers (2021-09-14T15:35:08Z) - Dynamic Mode Decomposition in Adaptive Mesh Refinement and Coarsening
Simulations [58.720142291102135]
Dynamic Mode Decomposition (DMD) is a powerful data-driven method used to extract coherent schemes.
This paper proposes a strategy to enable DMD to extract from observations with different mesh topologies and dimensions.
arXiv Detail & Related papers (2021-04-28T22:14:25Z) - Rigid and non-rigid motion compensation in weight-bearing cone-beam CT
of the knee using (noisy) inertial measurements [4.4889330164039025]
Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee.
We propose to use inertial measurement units (IMUs) attached to the leg for motion estimation.
Three IMU-based correction approaches are evaluated, namely rigid motion correction, non-rigid 2D projection deformation and non-rigid 3D dynamic reconstruction.
arXiv Detail & Related papers (2021-02-24T17:19:32Z) - Inertial Measurements for Motion Compensation in Weight-bearing
Cone-beam CT of the Knee [6.7461735822055715]
Involuntary motion during CT scans of the knee causes artifacts in the reconstructed volumes making them unusable for clinical diagnosis.
We propose to attach an inertial measurement unit (IMU) to the leg of the subject in order to measure the motion during the scan and correct for it.
arXiv Detail & Related papers (2020-07-09T09:26:27Z) - Motion Pyramid Networks for Accurate and Efficient Cardiac Motion
Estimation [51.72616167073565]
We propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation.
We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field.
We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance.
arXiv Detail & Related papers (2020-06-28T21:03:19Z) - A Novel Approach for Correcting Multiple Discrete Rigid In-Plane Motions
Artefacts in MRI Scans [63.28835187934139]
We propose a novel method for removing motion artefacts using a deep neural network with two input branches.
The proposed method can be applied to artefacts generated by multiple movements of the patient.
arXiv Detail & Related papers (2020-06-24T15:25:11Z) - Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT
Image Data [63.73263986460191]
Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions.
We investigate whether using a temporal stream of OCT image volumes can improve deep learning-based motion estimation performance.
Using 4D information for the model input improves performance while maintaining reasonable inference times.
arXiv Detail & Related papers (2020-04-21T15:43:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.