MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta,
Shooting, and Correction
- URL: http://arxiv.org/abs/2308.02949v1
- Date: Sat, 5 Aug 2023 20:32:30 GMT
- Title: MomentaMorph: Unsupervised Spatial-Temporal Registration with Momenta,
Shooting, and Correction
- Authors: Zhangxing Bian, Shuwen Wei, Yihao Liu, Junyu Chen, Jiachen Zhuo,
Fangxu Xing, Jonghye Woo, Aaron Carass, Jerry L. Prince
- Abstract summary: We introduce a novel framework for Lagrangian motion estimation in the presence of repetitive patterns and large motion.
The results on a 2D synthetic dataset and a real 3D tMRI dataset demonstrate our method's efficiency.
- Score: 12.281250177881445
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Tagged magnetic resonance imaging (tMRI) has been employed for decades to
measure the motion of tissue undergoing deformation. However,
registration-based motion estimation from tMRI is difficult due to the periodic
patterns in these images, particularly when the motion is large. With a larger
motion the registration approach gets trapped in a local optima, leading to
motion estimation errors. We introduce a novel "momenta, shooting, and
correction" framework for Lagrangian motion estimation in the presence of
repetitive patterns and large motion. This framework, grounded in Lie algebra
and Lie group principles, accumulates momenta in the tangent vector space and
employs exponential mapping in the diffeomorphic space for rapid approximation
towards true optima, circumventing local optima. A subsequent correction step
ensures convergence to true optima. The results on a 2D synthetic dataset and a
real 3D tMRI dataset demonstrate our method's efficiency in estimating
accurate, dense, and diffeomorphic 2D/3D motion fields amidst large motion and
repetitive patterns.
Related papers
- MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements [59.70107451308687]
We show for the first time that using 3D Gaussians for map representation with unposed camera images and inertial measurements can enable accurate SLAM.
Our method, MM3DGS, addresses the limitations of prior rendering by enabling faster scale awareness, and improved trajectory tracking.
We also release a multi-modal dataset, UT-MM, collected from a mobile robot equipped with a camera and an inertial measurement unit.
arXiv Detail & Related papers (2024-04-01T04:57:41Z) - Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstruction [89.53963284958037]
We propose a novel motion-aware enhancement framework for dynamic scene reconstruction.
Specifically, we first establish a correspondence between 3D Gaussian movements and pixel-level flow.
For the prevalent deformation-based paradigm that presents a harder optimization problem, a transient-aware deformation auxiliary module is proposed.
arXiv Detail & Related papers (2024-03-18T03:46:26Z) - RoHM: Robust Human Motion Reconstruction via Diffusion [58.63706638272891]
RoHM is an approach for robust 3D human motion reconstruction from monocular RGB(-D) videos.
It conditioned on noisy and occluded input data, reconstructs complete, plausible motions in consistent global coordinates.
Our method outperforms state-of-the-art approaches qualitatively and quantitatively, while being faster at test time.
arXiv Detail & Related papers (2024-01-16T18:57:50Z) - Unsupervised 3D Pose Estimation with Non-Rigid Structure-from-Motion
Modeling [83.76377808476039]
We propose a new modeling method for human pose deformations and design an accompanying diffusion-based motion prior.
Inspired by the field of non-rigid structure-from-motion, we divide the task of reconstructing 3D human skeletons in motion into the estimation of a 3D reference skeleton.
A mixed spatial-temporal NRSfMformer is used to simultaneously estimate the 3D reference skeleton and the skeleton deformation of each frame from 2D observations sequence.
arXiv Detail & Related papers (2023-08-18T16:41:57Z) - SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes [75.9110646062442]
We propose SceNeRFlow to reconstruct a general, non-rigid scene in a time-consistent manner.
Our method takes multi-view RGB videos and background images from static cameras with known camera parameters as input.
We show experimentally that, unlike prior work that only handles small motion, our method enables the reconstruction of studio-scale motions.
arXiv Detail & Related papers (2023-08-16T09:50:35Z) - Orthogonal Matrix Retrieval with Spatial Consensus for 3D Unknown-View
Tomography [58.60249163402822]
Unknown-view tomography (UVT) reconstructs a 3D density map from its 2D projections at unknown, random orientations.
The proposed OMR is more robust and performs significantly better than the previous state-of-the-art OMR approach.
arXiv Detail & Related papers (2022-07-06T21:40:59Z) - Neural Computed Tomography [1.7188280334580197]
Motion during acquisition of a set of projections can lead to significant motion artifacts in computed tomography reconstructions.
We propose a novel reconstruction framework, NeuralCT, to generate time-resolved images free from motion artifacts.
arXiv Detail & Related papers (2022-01-17T18:50:58Z) - Dynamic imaging using Motion-Compensated SmooThness Regularization on
Manifolds (MoCo-SToRM) [19.70386996879205]
We introduce an unsupervised motion-compensated reconstruction scheme for high-resolution free-breathing pulmonary MRI.
We model the image frames in the time series as the deformed version of the 3D template image volume.
We assume the deformation maps to be points on a smooth manifold in high-dimensional space.
arXiv Detail & Related papers (2021-12-06T22:04:57Z) - Dynamic imaging using motion-compensated smoothness regularization on
manifolds (MoCo-SToRM) [23.093076134206513]
We introduce an unsupervised deep manifold learning algorithm for motion-compensated dynamic MRI.
The utility of the algorithm is demonstrated in the context of motion-compensated high-resolution lung MRI.
arXiv Detail & Related papers (2021-11-21T19:52:01Z) - LAPNet: Non-rigid Registration derived in k-space for Magnetic Resonance
Imaging [28.404584219735074]
Motion correction techniques have been proposed to compensate for these types of motion during thoracic scans.
A particular interest and challenge lie in the derivation of reliable non-rigid motion fields from the undersampled motion-resolved data.
We propose a deep-learning based approach to perform fast and accurate non-rigid registration from the undersampled k-space data.
arXiv Detail & Related papers (2021-07-19T15:39:23Z) - Learning a Generative Motion Model from Image Sequences based on a
Latent Motion Matrix [8.774604259603302]
We learn a probabilistic motion model from simulating temporal-temporal registration in a sequence of images.
We show improved registration accuracy-temporally smoother consistencys compared to three state-of-the-art registration algorithms.
We also demonstrate the model's applicability for motion analysis, simulation and super-resolution by an improved motion reconstruction from sequences with missing frames.
arXiv Detail & Related papers (2020-11-03T14:44:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.