GNPM: Geometric-Aware Neural Parametric Models
- URL: http://arxiv.org/abs/2209.10621v1
- Date: Wed, 21 Sep 2022 19:23:31 GMT
- Title: GNPM: Geometric-Aware Neural Parametric Models
- Authors: Mirgahney Mohamed, Lourdes Agapito
- Abstract summary: We propose a learned parametric model that takes into account the local structure of data to learn disentangled shape and pose latent spaces of 4D dynamics.
We evaluate GNPMs on various datasets of humans, and show that it achieves comparable performance to state-of-the-art methods that require dense correspondences during training.
- Score: 6.620111952225635
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose Geometric Neural Parametric Models (GNPM), a learned parametric
model that takes into account the local structure of data to learn disentangled
shape and pose latent spaces of 4D dynamics, using a geometric-aware
architecture on point clouds. Temporally consistent 3D deformations are
estimated without the need for dense correspondences at training time, by
exploiting cycle consistency. Besides its ability to learn dense
correspondences, GNPMs also enable latent-space manipulations such as
interpolation and shape/pose transfer. We evaluate GNPMs on various datasets of
clothed humans, and show that it achieves comparable performance to
state-of-the-art methods that require dense correspondences during training.
Related papers
- Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimation [32.30055363306321]
We propose a paradigm for seamlessly unifying different human pose and shape-related tasks and datasets.
Our formulation is centered on the ability - both at training and test time - to query any arbitrary point of the human volume.
We can naturally exploit differently annotated data sources including mesh, 2D/3D skeleton and dense pose, without having to convert between them.
arXiv Detail & Related papers (2024-07-10T10:44:18Z) - Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks [79.16635054977068]
We present a new class of equivariant neural networks, dubbed Lattice-Equivariant Neural Networks (LENNs)
Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators.
Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.
arXiv Detail & Related papers (2024-05-22T17:23:15Z) - Toward Mesh-Invariant 3D Generative Deep Learning with Geometric
Measures [2.167843405313757]
3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing.
Many generative learning algorithms require correspondence between each point when comparing the predicted shape and the target shape.
We propose an architecture able to cope with different parameterizations, even during the training phase.
arXiv Detail & Related papers (2023-06-27T19:27:15Z) - Automatic Parameterization for Aerodynamic Shape Optimization via Deep
Geometric Learning [60.69217130006758]
We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization.
Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric patterns.
We perform shape optimization experiments on 2D airfoils and discuss the applicable scenarios for the two models.
arXiv Detail & Related papers (2023-05-03T13:45:40Z) - Geometry-Contrastive Transformer for Generalized 3D Pose Transfer [95.56457218144983]
The intuition of this work is to perceive the geometric inconsistency between the given meshes with the powerful self-attention mechanism.
We propose a novel geometry-contrastive Transformer that has an efficient 3D structured perceiving ability to the global geometric inconsistencies.
We present a latent isometric regularization module together with a novel semi-synthesized dataset for the cross-dataset 3D pose transfer task.
arXiv Detail & Related papers (2021-12-14T13:14:24Z) - NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One
Go [109.88509362837475]
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes.
NeuroMorph produces smooth and point-to-point correspondences between them.
It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
arXiv Detail & Related papers (2021-06-17T12:25:44Z) - GeoMol: Torsional Geometric Generation of Molecular 3D Conformer
Ensembles [60.12186997181117]
Prediction of a molecule's 3D conformer ensemble from the molecular graph holds a key role in areas of cheminformatics and drug discovery.
Existing generative models have several drawbacks including lack of modeling important molecular geometry elements.
We propose GeoMol, an end-to-end, non-autoregressive and SE(3)-invariant machine learning approach to generate 3D conformers.
arXiv Detail & Related papers (2021-06-08T14:17:59Z) - NPMs: Neural Parametric Models for 3D Deformable Shapes [26.87200488085741]
We propose a novel, learned alternative to traditional, parametric 3D models.
In particular, we learn to disentangle 4D dynamics into latent-space representations of shape and pose.
We show that NPMs improve notably over both parametric and non-parametric state of the art in reconstruction and tracking of monocular depth sequences of humans and hands.
arXiv Detail & Related papers (2021-04-01T18:14:56Z) - Mix Dimension in Poincar\'{e} Geometry for 3D Skeleton-based Action
Recognition [57.98278794950759]
Graph Convolutional Networks (GCNs) have already demonstrated their powerful ability to model the irregular data.
We present a novel spatial-temporal GCN architecture which is defined via the Poincar'e geometry.
We evaluate our method on two current largest scale 3D datasets.
arXiv Detail & Related papers (2020-07-30T18:23:18Z) - LOCA: LOcal Conformal Autoencoder for standardized data coordinates [6.608924227377152]
We present a method for learning an embedding in $mathbbRd$ that is isometric to the latent variables of the manifold.
Our embedding is obtained using a LOcal Conformal Autoencoder (LOCA), an algorithm that constructs an embedding to rectify deformations.
We also apply LOCA to single-site Wi-Fi localization data, and to $3$-dimensional curved surface estimation.
arXiv Detail & Related papers (2020-04-15T17:49:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.