Hamiltonian Dynamics for Real-World Shape Interpolation
- URL: http://arxiv.org/abs/2004.05199v1
- Date: Fri, 10 Apr 2020 18:38:52 GMT
- Title: Hamiltonian Dynamics for Real-World Shape Interpolation
- Authors: Marvin Eisenberger, Daniel Cremers
- Abstract summary: We revisit the classical problem of 3D shape and propose a novel, physically plausible approach based on Hamiltonian dynamics.
Our method yields exactly volume preserving intermediate shapes, avoids self-intersections and is scalable to high resolution scans.
- Score: 66.47407593823208
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We revisit the classical problem of 3D shape interpolation and propose a
novel, physically plausible approach based on Hamiltonian dynamics. While most
prior work focuses on synthetic input shapes, our formulation is designed to be
applicable to real-world scans with imperfect input correspondences and various
types of noise. To that end, we use recent progress on dynamic thin shell
simulation and divergence-free shape deformation and combine them to address
the inverse problem of finding a plausible intermediate sequence for two input
shapes. In comparison to prior work that mainly focuses on small distortion of
consecutive frames, we explicitly model volume preservation and momentum
conservation, as well as an anisotropic local distortion model. We argue that,
in order to get a robust interpolation for imperfect inputs, we need to model
the input noise explicitly which results in an alignment based formulation.
Finally, we show a qualitative and quantitative improvement over prior work on
a broad range of synthetic and scanned data. Besides being more robust to noisy
inputs, our method yields exactly volume preserving intermediate shapes, avoids
self-intersections and is scalable to high resolution scans.
Related papers
- Robustifying Generalizable Implicit Shape Networks with a Tunable
Non-Parametric Model [10.316008740970037]
Generalizable models for implicit shape reconstruction from unoriented point cloud suffer from generalization issues.
We propose here an efficient mechanism to remedy some of these limitations at test time.
We demonstrate the improvement obtained through our method with respect to baselines and the state-of-the-art using synthetic and real data.
arXiv Detail & Related papers (2023-11-21T20:12:29Z) - Shuffled Autoregression For Motion Interpolation [53.61556200049156]
This work aims to provide a deep-learning solution for the motion task.
We propose a novel framework, referred to as emphShuffled AutoRegression, which expands the autoregression to generate in arbitrary (shuffled) order.
We also propose an approach to constructing a particular kind of dependency graph, with three stages assembled into an end-to-end spatial-temporal motion Transformer.
arXiv Detail & Related papers (2023-06-10T07:14:59Z) - OReX: Object Reconstruction from Planar Cross-sections Using Neural
Fields [10.862993171454685]
OReX is a method for 3D shape reconstruction from slices alone, featuring a Neural Field gradients as the prior.
A modest neural network is trained on the input planes to return an inside/outside estimate for a given 3D coordinate, yielding a powerful prior that induces smoothness and self-similarities.
We offer an iterative estimation architecture and a hierarchical input sampling scheme that encourage coarse-to-fine training, allowing the training process to focus on high frequencies at later stages.
arXiv Detail & Related papers (2022-11-23T11:44:35Z) - Scene Synthesis via Uncertainty-Driven Attribute Synchronization [52.31834816911887]
This paper introduces a novel neural scene synthesis approach that can capture diverse feature patterns of 3D scenes.
Our method combines the strength of both neural network-based and conventional scene synthesis approaches.
arXiv Detail & Related papers (2021-08-30T19:45:07Z) - Autoencoder-driven Spiral Representation Learning for Gravitational Wave
Surrogate Modelling [47.081318079190595]
We investigate the existence of underlying structures in the empirical coefficients using autoencoders.
We design a spiral module with learnable parameters, that is used as the first layer in a neural network, which learns to map the input space to the coefficients.
The spiral module is evaluated on multiple neural network architectures and consistently achieves better speed-accuracy trade-off than baseline models.
arXiv Detail & Related papers (2021-07-09T09:03:08Z) - NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One
Go [109.88509362837475]
We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes.
NeuroMorph produces smooth and point-to-point correspondences between them.
It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
arXiv Detail & Related papers (2021-06-17T12:25:44Z) - Deep Magnification-Flexible Upsampling over 3D Point Clouds [103.09504572409449]
We propose a novel end-to-end learning-based framework to generate dense point clouds.
We first formulate the problem explicitly, which boils down to determining the weights and high-order approximation errors.
Then, we design a lightweight neural network to adaptively learn unified and sorted weights as well as the high-order refinements.
arXiv Detail & Related papers (2020-11-25T14:00:18Z) - Dense Non-Rigid Structure from Motion: A Manifold Viewpoint [162.88686222340962]
Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geometry of a deforming object from its 2D feature correspondences across multiple frames.
We show that our approach significantly improves accuracy, scalability, and robustness against noise.
arXiv Detail & Related papers (2020-06-15T09:15:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.