4D Atlas: Statistical Analysis of the Spatiotemporal Variability in
Longitudinal 3D Shape Data
- URL: http://arxiv.org/abs/2101.09403v1
- Date: Sat, 23 Jan 2021 02:59:55 GMT
- Title: 4D Atlas: Statistical Analysis of the Spatiotemporal Variability in
Longitudinal 3D Shape Data
- Authors: Hamid Laga, Marcel Padilla, Ian H. Jermyn, Sebastian Kurtek, Mohammed
Bennamoun, Anuj Srivastava
- Abstract summary: We propose a framework to learn a novel variability in 3D shape data sets, which contain observations of that subjects and deform over time.
We treat a 3D surface as a point in a shape space equipped with an elastic metric that measures amount of bending and stretching that surfaces undergo.
A 4D surface can then be seen as a trajectory in this space.
- Score: 34.21760947722201
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose a novel framework to learn the spatiotemporal variability in
longitudinal 3D shape data sets, which contain observations of subjects that
evolve and deform over time. This problem is challenging since surfaces come
with arbitrary spatial and temporal parameterizations. Thus, they need to be
spatially registered and temporally aligned onto each other. We solve this
spatiotemporal registration problem using a Riemannian approach. We treat a 3D
surface as a point in a shape space equipped with an elastic metric that
measures the amount of bending and stretching that the surfaces undergo. A 4D
surface can then be seen as a trajectory in this space. With this formulation,
the statistical analysis of 4D surfaces becomes the problem of analyzing
trajectories embedded in a nonlinear Riemannian manifold. However, computing
spatiotemporal registration and statistics on nonlinear spaces relies on
complex nonlinear optimizations. Our core contribution is the mapping of the
surfaces to the space of Square-Root Normal Fields (SRNF) where the L2 metric
is equivalent to the partial elastic metric in the space of surfaces. By
solving the spatial registration in the SRNF space, analyzing 4D surfaces
becomes the problem of analyzing trajectories embedded in the SRNF space, which
is Euclidean. Here, we develop the building blocks that enable such analysis.
These include the spatiotemporal registration of arbitrarily parameterized 4D
surfaces even in the presence of large elastic deformations and large
variations in their execution rates, the computation of geodesics between 4D
surfaces, the computation of statistical summaries, such as means and modes of
variation, and the synthesis of random 4D surfaces. We demonstrate the
performance of the proposed framework using 4D facial surfaces and 4D human
body shapes.
Related papers
- NeuroGauss4D-PCI: 4D Neural Fields and Gaussian Deformation Fields for Point Cloud Interpolation [19.28734823769732]
Interpolation confronts challenges from point sparsity, complextemporal dynamics, and the difficulty of deriving complete 3D point clouds from sparse temporal information.
This paper presents NeuroGauss4D-corrupt, which excels at modeling complex non-rigid deformations across varied dynamic scenes.
NeuroGauss4D-corrupt delivers leading performance on both object-level tasks and large-scale autonomous driving datasets.
arXiv Detail & Related papers (2024-05-23T07:21:01Z) - Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation [50.376243444909136]
We present a unified framework to predict both point-wise correspondences and shape between 3D shapes.
We combine the deep functional map framework with classical surface deformation models to map shapes in both spectral and spatial domains.
arXiv Detail & Related papers (2024-02-29T07:26:23Z) - Measuring the Discrepancy between 3D Geometric Models using Directional
Distance Fields [98.15456815880911]
We propose DirDist, an efficient, effective, robust, and differentiable distance metric for 3D geometry data.
As a generic distance metric, DirDist has the potential to advance the field of 3D geometric modeling.
arXiv Detail & Related papers (2024-01-18T05:31:53Z) - LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human
Modeling [69.56581851211841]
We propose a novel Local 4D implicit Representation for Dynamic clothed human, named LoRD.
Our key insight is to encourage the network to learn the latent codes of local part-level representation.
LoRD has strong capability for representing 4D human, and outperforms state-of-the-art methods on practical applications.
arXiv Detail & Related papers (2022-08-18T03:49:44Z) - Elastic shape analysis of surfaces with second-order Sobolev metrics: a
comprehensive numerical framework [11.523323270411959]
This paper introduces a set of numerical methods for shape analysis of 3D surfaces.
We address the computation of geodesics and geodesic distances between parametrized or unparametrized surfaces represented as 3D meshes.
arXiv Detail & Related papers (2022-04-08T18:19:05Z) - {\phi}-SfT: Shape-from-Template with a Physics-Based Deformation Model [69.27632025495512]
Shape-from-Template (SfT) methods estimate 3D surface deformations from a single monocular RGB camera.
This paper proposes a new SfT approach explaining 2D observations through physical simulations.
arXiv Detail & Related papers (2022-03-22T17:59:57Z) - Averaging Spatio-temporal Signals using Optimal Transport and Soft
Alignments [110.79706180350507]
We show that our proposed loss can be used to define temporal-temporal baryechecenters as Fr'teche means duality.
Experiments on handwritten letters and brain imaging data confirm our theoretical findings.
arXiv Detail & Related papers (2022-03-11T09:46:22Z) - 4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface [7.637832293935966]
We introduce 4DComplete, a novel data-driven approach that estimates the non-rigid motion for the unobserved geometry.
For network training, we constructed a large-scale synthetic dataset called DeformingThings4D.
arXiv Detail & Related papers (2021-05-05T07:39:12Z) - Characterization of surface motion patterns in highly deformable soft
tissue organs from dynamic MRI: An application to assess 4D bladder motion [0.0]
The objective of this study is to go towards 3D dense velocity measurements to fully cover the entire surface.
We present a pipeline for characterization of bladder surface dynamics during deep respiratory movements.
arXiv Detail & Related papers (2020-10-05T08:38:08Z) - A new geodesic-based feature for characterization of 3D shapes:
application to soft tissue organ temporal deformations [0.0]
We show a direct application on a study of organ temporal deformations.
We characterize the behavior of a bladder during a forced respiratory motion with a reduced number of 3D surface points.
We demonstrate the robustness of our feature on both synthetic 3D shapes and realistic dynamic MRI data.
arXiv Detail & Related papers (2020-03-18T16:56:41Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.