Deep Deformable Models: Learning 3D Shape Abstractions with Part
Consistency
- URL: http://arxiv.org/abs/2309.01035v1
- Date: Sat, 2 Sep 2023 23:18:28 GMT
- Title: Deep Deformable Models: Learning 3D Shape Abstractions with Part
Consistency
- Authors: Di Liu, Long Zhao, Qilong Zhangli, Yunhe Gao, Ting Liu, Dimitris N.
Metaxas
- Abstract summary: Recent methods learn to represent an object shape using a set of simple primitives to fit the target.
These primitives do not always correspond to real parts or lack geometric flexibility for semantic interpretation.
In this paper, we investigate salient and efficient primitive descriptors for accurate shape abstractions.
- Score: 37.28811220509584
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The task of shape abstraction with semantic part consistency is challenging
due to the complex geometries of natural objects. Recent methods learn to
represent an object shape using a set of simple primitives to fit the target.
\textcolor{black}{However, in these methods, the primitives used do not always
correspond to real parts or lack geometric flexibility for semantic
interpretation.} In this paper, we investigate salient and efficient primitive
descriptors for accurate shape abstractions, and propose \textit{Deep
Deformable Models (DDMs)}. DDM employs global deformations and diffeomorphic
local deformations. These properties enable DDM to abstract complex object
shapes with significantly fewer primitives that offer broader geometry coverage
and finer details. DDM is also capable of learning part-level semantic
correspondences due to the differentiable and invertible properties of our
primitive deformation. Moreover, DDM learning formulation is based on dynamic
and kinematic modeling, which enables joint regularization of each
sub-transformation during primitive fitting. Extensive experiments on
\textit{ShapeNet} demonstrate that DDM outperforms the state-of-the-art in
terms of reconstruction and part consistency by a notable margin.
Related papers
- Implicit Modeling of Non-rigid Objects with Cross-Category Signals [28.956412015920936]
MODIF is a multi-object deep implicit function that jointly learns the deformation fields and instance-specific latent codes for multiple objects at once.
We show that MODIF can proficiently learn the shape representation of each organ and their relations to others, to the point that shapes missing from unseen instances can be consistently recovered.
arXiv Detail & Related papers (2023-12-15T22:34:17Z) - DeFormer: Integrating Transformers with Deformable Models for 3D Shape
Abstraction from a Single Image [31.154786931081087]
We propose a novel bi-channel Transformer architecture, integrated with parameterized deformable models, to simultaneously estimate the global and local deformations of primitives.
DeFormer achieves better reconstruction accuracy over the state-of-the-art, and visualizes with consistent semantic correspondences for improved interpretability.
arXiv Detail & Related papers (2023-09-22T02:46:43Z) - DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via
Deformable Template Field [29.42222066097076]
Estimating 6D poses and reconstructing 3D shapes of objects in open-world scenes from RGB-depth image pairs is challenging.
We propose the DTF-Net, a novel framework for pose estimation and shape reconstruction based on implicit neural fields of object categories.
arXiv Detail & Related papers (2023-08-04T10:35:40Z) - SPAMs: Structured Implicit Parametric Models [30.19414242608965]
We learn Structured-implicit PArametric Models (SPAMs) as a deformable object representation that structurally decomposes non-rigid object motion into part-based disentangled representations of shape and pose.
Experiments demonstrate that our part-aware shape and pose understanding lead to state-of-the-art performance in reconstruction and tracking of depth sequences of complex deforming object motion.
arXiv Detail & Related papers (2022-01-20T12:33:46Z) - Frame Averaging for Equivariant Shape Space Learning [85.42901997467754]
A natural way to incorporate symmetries in shape space learning is to ask that the mapping to the shape space (encoder) and mapping from the shape space (decoder) are equivariant to the relevant symmetries.
We present a framework for incorporating equivariance in encoders and decoders by introducing two contributions.
arXiv Detail & Related papers (2021-12-03T06:41:19Z) - NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One
Go [109.88509362837475]
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes.
NeuroMorph produces smooth and point-to-point correspondences between them.
It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
arXiv Detail & Related papers (2021-06-17T12:25:44Z) - Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible
Neural Networks [118.20778308823779]
We present a novel 3D primitive representation that defines primitives using an Invertible Neural Network (INN)
Our model learns to parse 3D objects into semantically consistent part arrangements without any part-level supervision.
arXiv Detail & Related papers (2021-03-18T17:59:31Z) - Deep Implicit Templates for 3D Shape Representation [70.9789507686618]
We propose a new 3D shape representation that supports explicit correspondence reasoning in deep implicit representations.
Our key idea is to formulate DIFs as conditional deformations of a template implicit function.
We show that our method can not only learn a common implicit template for a collection of shapes, but also establish dense correspondences across all the shapes simultaneously without any supervision.
arXiv Detail & Related papers (2020-11-30T06:01:49Z) - Monocular Human Pose and Shape Reconstruction using Part Differentiable
Rendering [53.16864661460889]
Recent works succeed in regression-based methods which estimate parametric models directly through a deep neural network supervised by 3D ground truth.
In this paper, we introduce body segmentation as critical supervision.
To improve the reconstruction with part segmentation, we propose a part-level differentiable part that enables part-based models to be supervised by part segmentation.
arXiv Detail & Related papers (2020-03-24T14:25:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.