Dynamic imaging using Motion-Compensated SmooThness Regularization on Manifolds (MoCo-SToRM)

• URL: http://arxiv.org/abs/2112.03380v1
• Date: Mon, 6 Dec 2021 22:04:57 GMT
• Title: Dynamic imaging using Motion-Compensated SmooThness Regularization on Manifolds (MoCo-SToRM)
• Authors: Qing Zou, Luis A. Torres, Sean B. Fain, Nara S. Higano, Alister J. Bates, Mathews Jacob
• Abstract summary: We introduce an unsupervised motion-compensated reconstruction scheme for high-resolution free-breathing pulmonary MRI. We model the image frames in the time series as the deformed version of the 3D template image volume. We assume the deformation maps to be points on a smooth manifold in high-dimensional space.
• Score: 19.70386996879205
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce an unsupervised motion-compensated reconstruction scheme for high-resolution free-breathing pulmonary MRI. We model the image frames in the time series as the deformed version of the 3D template image volume. We assume the deformation maps to be points on a smooth manifold in high-dimensional space. Specifically, we model the deformation map at each time instant as the output of a CNN-based generator that has the same weight for all time-frames, driven by a low-dimensional latent vector. The time series of latent vectors account for the dynamics in the dataset, including respiratory motion and bulk motion. The template image volume, the parameters of the generator, and the latent vectors are learned directly from the k-t space data in an unsupervised fashion. Our experimental results show improved reconstructions compared to state-of-the-art methods, especially in the context of bulk motion during the scans.

Related papers

• MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion [118.74385965694694]
  We present Motion DUSt3R (MonST3R), a novel geometry-first approach that directly estimates per-timestep geometry from dynamic scenes. By simply estimating a pointmap for each timestep, we can effectively adapt DUST3R's representation, previously only used for static scenes, to dynamic scenes. We show that by posing the problem as a fine-tuning task, identifying several suitable datasets, and strategically training the model on this limited data, we can surprisingly enable the model to handle dynamics.
  arXiv  Detail & Related papers  (2024-10-04T18:00:07Z)
• Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction [89.53963284958037]
  We propose a novel motion-aware enhancement framework for dynamic scene reconstruction. Specifically, we first establish a correspondence between 3D Gaussian movements and pixel-level flow. For the prevalent deformation-based paradigm that presents a harder optimization problem, a transient-aware deformation auxiliary module is proposed.
  arXiv  Detail & Related papers  (2024-03-18T03:46:26Z)
• Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Tracking [52.393359791978035]
  Motion2VecSets is a 4D diffusion model for dynamic surface reconstruction from point cloud sequences. We parameterize 4D dynamics with latent sets instead of using global latent codes. For more temporally-coherent object tracking, we synchronously denoise deformation latent sets and exchange information across multiple frames.
  arXiv  Detail & Related papers  (2024-01-12T15:05:08Z)
• Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion Modeling [83.76377808476039]
  We propose a new modeling method for human pose deformations and design an accompanying diffusion-based motion prior. Inspired by the field of non-rigid structure-from-motion, we divide the task of reconstructing 3D human skeletons in motion into the estimation of a 3D reference skeleton. A mixed spatial-temporal NRSfMformer is used to simultaneously estimate the 3D reference skeleton and the skeleton deformation of each frame from 2D observations sequence.
  arXiv  Detail & Related papers  (2023-08-18T16:41:57Z)
• SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes [75.9110646062442]
  We propose SceNeRFlow to reconstruct a general, non-rigid scene in a time-consistent manner. Our method takes multi-view RGB videos and background images from static cameras with known camera parameters as input. We show experimentally that, unlike prior work that only handles small motion, our method enables the reconstruction of studio-scale motions.
  arXiv  Detail & Related papers  (2023-08-16T09:50:35Z)
• MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta, Shooting, and Correction [12.281250177881445]
  We introduce a novel framework for Lagrangian motion estimation in the presence of repetitive patterns and large motion. The results on a 2D synthetic dataset and a real 3D tMRI dataset demonstrate our method's efficiency.
  arXiv  Detail & Related papers  (2023-08-05T20:32:30Z)
• {\phi}-SfT: Shape-from-Template with a Physics-Based Deformation Model [69.27632025495512]
  Shape-from-Template (SfT) methods estimate 3D surface deformations from a single monocular RGB camera. This paper proposes a new SfT approach explaining 2D observations through physical simulations.
  arXiv  Detail & Related papers  (2022-03-22T17:59:57Z)
• Dynamic imaging using motion-compensated smoothness regularization on manifolds (MoCo-SToRM) [23.093076134206513]
  We introduce an unsupervised deep manifold learning algorithm for motion-compensated dynamic MRI. The utility of the algorithm is demonstrated in the context of motion-compensated high-resolution lung MRI.
  arXiv  Detail & Related papers  (2021-11-21T19:52:01Z)
• Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion [15.359134407309726]
  Our model decomposes highly correlated skeleton data into a set of few spatial basis of switching temporal processes. This results in a dynamical deep generative latent model that parses the meaningful intrinsic states in the dynamics of 3D pose data.
  arXiv  Detail & Related papers  (2021-06-18T23:58:49Z)
• Learning a Generative Motion Model from Image Sequences based on a Latent Motion Matrix [8.774604259603302]
  We learn a probabilistic motion model from simulating temporal-temporal registration in a sequence of images. We show improved registration accuracy-temporally smoother consistencys compared to three state-of-the-art registration algorithms. We also demonstrate the model's applicability for motion analysis, simulation and super-resolution by an improved motion reconstruction from sequences with missing frames.
  arXiv  Detail & Related papers  (2020-11-03T14:44:09Z)
• A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image [18.670134909724723]
  We introduce a volumetric motion network (VINS) designed for 4D dynamic medical images. Experimental results demonstrated that our SVIN outperformed state-of-the-art temporal medical methods and natural video methods.
  arXiv  Detail & Related papers  (2020-02-28T12:40:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.