4D Atlas: Statistical Analysis of the Spatiotemporal Variability in Longitudinal 3D Shape Data

• URL: http://arxiv.org/abs/2101.09403v1
• Date: Sat, 23 Jan 2021 02:59:55 GMT
• Title: 4D Atlas: Statistical Analysis of the Spatiotemporal Variability in Longitudinal 3D Shape Data
• Authors: Hamid Laga, Marcel Padilla, Ian H. Jermyn, Sebastian Kurtek, Mohammed Bennamoun, Anuj Srivastava
• Abstract summary: We propose a framework to learn a novel variability in 3D shape data sets, which contain observations of that subjects and deform over time. We treat a 3D surface as a point in a shape space equipped with an elastic metric that measures amount of bending and stretching that surfaces undergo. A 4D surface can then be seen as a trajectory in this space.
• Score: 34.21760947722201
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose a novel framework to learn the spatiotemporal variability in longitudinal 3D shape data sets, which contain observations of subjects that evolve and deform over time. This problem is challenging since surfaces come with arbitrary spatial and temporal parameterizations. Thus, they need to be spatially registered and temporally aligned onto each other. We solve this spatiotemporal registration problem using a Riemannian approach. We treat a 3D surface as a point in a shape space equipped with an elastic metric that measures the amount of bending and stretching that the surfaces undergo. A 4D surface can then be seen as a trajectory in this space. With this formulation, the statistical analysis of 4D surfaces becomes the problem of analyzing trajectories embedded in a nonlinear Riemannian manifold. However, computing spatiotemporal registration and statistics on nonlinear spaces relies on complex nonlinear optimizations. Our core contribution is the mapping of the surfaces to the space of Square-Root Normal Fields (SRNF) where the L2 metric is equivalent to the partial elastic metric in the space of surfaces. By solving the spatial registration in the SRNF space, analyzing 4D surfaces becomes the problem of analyzing trajectories embedded in the SRNF space, which is Euclidean. Here, we develop the building blocks that enable such analysis. These include the spatiotemporal registration of arbitrarily parameterized 4D surfaces even in the presence of large elastic deformations and large variations in their execution rates, the computation of geodesics between 4D surfaces, the computation of statistical summaries, such as means and modes of variation, and the synthesis of random 4D surfaces. We demonstrate the performance of the proposed framework using 4D facial surfaces and 4D human body shapes.

Related papers

• Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation [50.26314343851213]
  Inferring signed distance functions (SDFs) from sparse point clouds remains a challenge in surface reconstruction. We present a novel approach that learns a dynamic deformation network to predict SDFs in an end-to-end manner. Experimental results on synthetic and real scanned datasets demonstrate that our method significantly outperforms the current state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-31T02:27:02Z)
• Thin-Shell-SfT: Fine-Grained Monocular Non-rigid 3D Surface Tracking with Neural Deformation Fields [66.1612475655465]
  3D reconstruction of deformable surfaces from RGB videos is a challenging problem. Existing methods use deformation models with statistical, neural, or physical priors. We propose ThinShell-SfT, a new method for non-rigid 3D tracking meshes.
  arXiv  Detail & Related papers  (2025-03-25T18:00:46Z)
• DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generation [50.01520547454224]
  Current generative models struggle to synthesize 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS) We propose DiST-4D, which disentangles the problem into two diffusion processes: DiST-T, which predicts future metric depth and multi-view RGB sequences directly from past observations, and DiST-S, which enables spatial NVS by training only on existing viewpoints while enforcing cycle consistency. Experiments demonstrate that DiST-4D achieves state-of-the-art performance in both temporal prediction and NVS tasks, while also delivering competitive performance in planning-related evaluations.
  arXiv  Detail & Related papers  (2025-03-19T13:49:48Z)
• Dynamic Neural Surfaces for Elastic 4D Shape Representation and Analysis [36.228108480107906]
  We propose a framework for the statistical analysis of genus-zeroD surfaces that deform and evolve over time. We introduce Dynamic Spherical Neural Surfaces (D-SNS), an efficient continuoustemporal representation for genus-0 4D surfaces. We demonstrate the efficiency of the framework on 4D human and face datasets.
  arXiv  Detail & Related papers  (2025-03-05T03:02:59Z)
• Level-Set Parameters: Novel Representation for 3D Shape Analysis [70.23417107911567]
  Recent development of neural fields brings in level-set parameters from signed distance functions as a novel, continuous, and numerical representation of 3D shapes. We establish correlations across different shapes by formulating them as a pseudo-normal distribution, and learn the distribution prior to the respective dataset. We demonstrate the promise of the novel representations through applications in shape classification, retrieval, and 6D object pose estimation.
  arXiv  Detail & Related papers  (2024-12-18T04:50:19Z)
• Self Supervised Networks for Learning Latent Space Representations of Human Body Scans and Motions [6.165163123577484]
  This paper introduces self-supervised neural network models to tackle several fundamental problems in the field of 3D human body analysis and processing. We propose VariShaPE, a novel architecture for the retrieval of latent space representations of body shapes and poses. Second, we complement the estimation of latent codes with MoGeN, a framework that learns the geometry on the latent space itself.
  arXiv  Detail & Related papers  (2024-11-05T19:59:40Z)
• 3D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction [50.07071392673984]
  Existing methods learn 3D rotations parametrized in the spatial domain using angles or quaternions. We propose a frequency-domain approach that directly predicts Wigner-D coefficients for 3D rotation regression. Our method achieves state-of-the-art results on benchmarks such as ModelNet10-SO(3) and PASCAL3D+.
  arXiv  Detail & Related papers  (2024-11-01T12:50:38Z)
• Geometric Trajectory Diffusion Models [58.853975433383326]
  Generative models have shown great promise in generating 3D geometric systems. Existing approaches only operate on static structures, neglecting the fact that physical systems are always dynamic in nature. We propose geometric trajectory diffusion models (GeoTDM), the first diffusion model for modeling the temporal distribution of 3D geometric trajectories.
  arXiv  Detail & Related papers  (2024-10-16T20:36:41Z)
• A Riemannian Approach for Spatiotemporal Analysis and Generation of 4D Tree-shaped Structures [38.04447518666407]
  We present the first comprehensive approach for modeling and analyzingtemporal shape variability in tree-like 4D objects. Our key contribution is the representation of tree-like 3D shapes using Square Root Velocity Trees (SFT) This reduces the problem of modeling and analyzing 4D tree-like shapes to that of modeling and analyzing elastic trajectories in the SRVFT space.
  arXiv  Detail & Related papers  (2024-08-22T14:39:30Z)
• Spectral Meets Spatial: Harmonising 3D Shape Matching and Interpolation [50.376243444909136]
  We present a unified framework to predict both point-wise correspondences and shape between 3D shapes. We combine the deep functional map framework with classical surface deformation models to map shapes in both spectral and spatial domains.
  arXiv  Detail & Related papers  (2024-02-29T07:26:23Z)
• LoRD: Local 4D Implicit Representation for High-Fidelity Dynamic Human Modeling [69.56581851211841]
  We propose a novel Local 4D implicit Representation for Dynamic clothed human, named LoRD. Our key insight is to encourage the network to learn the latent codes of local part-level representation. LoRD has strong capability for representing 4D human, and outperforms state-of-the-art methods on practical applications.
  arXiv  Detail & Related papers  (2022-08-18T03:49:44Z)
• Elastic shape analysis of surfaces with second-order Sobolev metrics: a comprehensive numerical framework [11.523323270411959]
  This paper introduces a set of numerical methods for shape analysis of 3D surfaces. We address the computation of geodesics and geodesic distances between parametrized or unparametrized surfaces represented as 3D meshes.
  arXiv  Detail & Related papers  (2022-04-08T18:19:05Z)
• Averaging Spatio-temporal Signals using Optimal Transport and Soft Alignments [110.79706180350507]
  We show that our proposed loss can be used to define temporal-temporal baryechecenters as Fr'teche means duality. Experiments on handwritten letters and brain imaging data confirm our theoretical findings.
  arXiv  Detail & Related papers  (2022-03-11T09:46:22Z)
• 4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface [7.637832293935966]
  We introduce 4DComplete, a novel data-driven approach that estimates the non-rigid motion for the unobserved geometry. For network training, we constructed a large-scale synthetic dataset called DeformingThings4D.
  arXiv  Detail & Related papers  (2021-05-05T07:39:12Z)
• Characterization of surface motion patterns in highly deformable soft tissue organs from dynamic MRI: An application to assess 4D bladder motion [0.0]
  The objective of this study is to go towards 3D dense velocity measurements to fully cover the entire surface. We present a pipeline for characterization of bladder surface dynamics during deep respiratory movements.
  arXiv  Detail & Related papers  (2020-10-05T08:38:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.