GNPM: Geometric-Aware Neural Parametric Models

• URL: http://arxiv.org/abs/2209.10621v1
• Date: Wed, 21 Sep 2022 19:23:31 GMT
• Title: GNPM: Geometric-Aware Neural Parametric Models
• Authors: Mirgahney Mohamed, Lourdes Agapito
• Abstract summary: We propose a learned parametric model that takes into account the local structure of data to learn disentangled shape and pose latent spaces of 4D dynamics. We evaluate GNPMs on various datasets of humans, and show that it achieves comparable performance to state-of-the-art methods that require dense correspondences during training.
• Score: 6.620111952225635
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We propose Geometric Neural Parametric Models (GNPM), a learned parametric model that takes into account the local structure of data to learn disentangled shape and pose latent spaces of 4D dynamics, using a geometric-aware architecture on point clouds. Temporally consistent 3D deformations are estimated without the need for dense correspondences at training time, by exploiting cycle consistency. Besides its ability to learn dense correspondences, GNPMs also enable latent-space manipulations such as interpolation and shape/pose transfer. We evaluate GNPMs on various datasets of clothed humans, and show that it achieves comparable performance to state-of-the-art methods that require dense correspondences during training.

Related papers

• Geometry Distributions [51.4061133324376]
  We propose a novel geometric data representation that models geometry as distributions. Our approach uses diffusion models with a novel network architecture to learn surface point distributions. We evaluate our representation qualitatively and quantitatively across various object types, demonstrating its effectiveness in achieving high geometric fidelity.
  arXiv  Detail & Related papers  (2024-11-25T04:06:48Z)
• STREAM: A Universal State-Space Model for Sparse Geometric Data [2.9483719973596303]
  Handling unstructured geometric data, such as point clouds or event-based vision, is a pressing challenge in the field of machine vision. We propose to encode geometric structure explicitly into the parameterization of a state-space model. Our model deploys the Mamba selective state-space model with a modified kernel to efficiently map sparse data to modern hardware.
  arXiv  Detail & Related papers  (2024-11-19T16:06:32Z)
• Self Supervised Networks for Learning Latent Space Representations of Human Body Scans and Motions [6.165163123577484]
  This paper introduces self-supervised neural network models to tackle several fundamental problems in the field of 3D human body analysis and processing. We propose VariShaPE, a novel architecture for the retrieval of latent space representations of body shapes and poses. Second, we complement the estimation of latent codes with MoGeN, a framework that learns the geometry on the latent space itself.
  arXiv  Detail & Related papers  (2024-11-05T19:59:40Z)
• Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks [79.16635054977068]
  We present a new class of equivariant neural networks, dubbed Lattice-Equivariant Neural Networks (LENNs) Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators. Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.
  arXiv  Detail & Related papers  (2024-05-22T17:23:15Z)
• Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures [2.167843405313757]
  3D generative modeling is accelerating as the technology allowing the capture of geometric data is developing. Many generative learning algorithms require correspondence between each point when comparing the predicted shape and the target shape. We propose an architecture able to cope with different parameterizations, even during the training phase.
  arXiv  Detail & Related papers  (2023-06-27T19:27:15Z)
• Automatic Parameterization for Aerodynamic Shape Optimization via Deep Geometric Learning [60.69217130006758]
  We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization. Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric patterns. We perform shape optimization experiments on 2D airfoils and discuss the applicable scenarios for the two models.
  arXiv  Detail & Related papers  (2023-05-03T13:45:40Z)
• Geometry-Contrastive Transformer for Generalized 3D Pose Transfer [95.56457218144983]
  The intuition of this work is to perceive the geometric inconsistency between the given meshes with the powerful self-attention mechanism. We propose a novel geometry-contrastive Transformer that has an efficient 3D structured perceiving ability to the global geometric inconsistencies. We present a latent isometric regularization module together with a novel semi-synthesized dataset for the cross-dataset 3D pose transfer task.
  arXiv  Detail & Related papers  (2021-12-14T13:14:24Z)
• NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go [109.88509362837475]
  We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes. NeuroMorph produces smooth and point-to-point correspondences between them. It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
  arXiv  Detail & Related papers  (2021-06-17T12:25:44Z)
• NPMs: Neural Parametric Models for 3D Deformable Shapes [26.87200488085741]
  We propose a novel, learned alternative to traditional, parametric 3D models. In particular, we learn to disentangle 4D dynamics into latent-space representations of shape and pose. We show that NPMs improve notably over both parametric and non-parametric state of the art in reconstruction and tracking of monocular depth sequences of humans and hands.
  arXiv  Detail & Related papers  (2021-04-01T18:14:56Z)
• Mix Dimension in Poincar\'{e} Geometry for 3D Skeleton-based Action Recognition [57.98278794950759]
  Graph Convolutional Networks (GCNs) have already demonstrated their powerful ability to model the irregular data. We present a novel spatial-temporal GCN architecture which is defined via the Poincar'e geometry. We evaluate our method on two current largest scale 3D datasets.
  arXiv  Detail & Related papers  (2020-07-30T18:23:18Z)
• LOCA: LOcal Conformal Autoencoder for standardized data coordinates [6.608924227377152]
  We present a method for learning an embedding in $mathbbRd$ that is isometric to the latent variables of the manifold. Our embedding is obtained using a LOcal Conformal Autoencoder (LOCA), an algorithm that constructs an embedding to rectify deformations. We also apply LOCA to single-site Wi-Fi localization data, and to $3$-dimensional curved surface estimation.
  arXiv  Detail & Related papers  (2020-04-15T17:49:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.