MORPH-DSLAM: Model Order Reduction for PHysics-based Deformable SLAM
- URL: http://arxiv.org/abs/2009.00576v2
- Date: Wed, 6 Oct 2021 10:03:13 GMT
- Title: MORPH-DSLAM: Model Order Reduction for PHysics-based Deformable SLAM
- Authors: Alberto Badias, Iciar Alfaro, David Gonzalez, Francisco Chinesta and
Elias Cueto
- Abstract summary: We propose a new methodology to estimate the 3D displacement field of deformable objects from video sequences using standard monocular cameras.
We solve in real time the complete (possibly visco-elastic)hyperlinearity problem to properly describe the strain and stress fields that are consistent with the displacements captured by the images, constrained by real physics.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: We propose a new methodology to estimate the 3D displacement field of
deformable objects from video sequences using standard monocular cameras. We
solve in real time the complete (possibly visco-)hyperelasticity problem to
properly describe the strain and stress fields that are consistent with the
displacements captured by the images, constrained by real physics. We do not
impose any ad-hoc prior or energy minimization in the external surface, since
the real and complete mechanics problem is solved. This means that we can also
estimate the internal state of the objects, even in occluded areas, just by
observing the external surface and the knowledge of material properties and
geometry. Solving this problem in real time using a realistic constitutive law,
usually non-linear, is out of reach for current systems. To overcome this
difficulty, we solve off-line a parametrized problem that considers each source
of variability in the problem as a new parameter and, consequently, as a new
dimension in the formulation. Model Order Reduction methods allow us to reduce
the dimensionality of the problem, and therefore, its computational cost, while
preserving the visualization of the solution in the high-dimensionality space.
This allows an accurate estimation of the object deformations, improving also
the robustness in the 3D points estimation.
Related papers
- Motion and Structure from Event-based Normal Flow [26.513167481193225]
Neuromorphic event-based cameras place great demands on approaches that use raw event data as input to solve this fundamental problem.
Existing state-of-the-art solutions typically infer implicitly data association by iteratively reversing the event data generation process.
We show that the event-based normal flow can be used, via the proposed geometric error term, as an alternative to the full flow in solving a family of geometric problems.
arXiv Detail & Related papers (2024-07-17T01:11:20Z) - Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation [18.45850302604534]
We present a data-, mesh-, and grid-free solution for elastic simulation for any object in any geometric representation.
For each object, we fit a small implicit neural network encoding varying weights that act as a reduced deformation basis.
Our experiments demonstrate the versatility, accuracy, and speed of this approach on data including signed distance functions, point clouds, neural primitives, tomography scans, radiance fields, Gaussian splats, surface meshes, and volume meshes.
arXiv Detail & Related papers (2024-06-09T18:57:23Z) - {\phi}-SfT: Shape-from-Template with a Physics-Based Deformation Model [69.27632025495512]
Shape-from-Template (SfT) methods estimate 3D surface deformations from a single monocular RGB camera.
This paper proposes a new SfT approach explaining 2D observations through physical simulations.
arXiv Detail & Related papers (2022-03-22T17:59:57Z) - Message Passing Neural PDE Solvers [60.77761603258397]
We build a neural message passing solver, replacing allally designed components in the graph with backprop-optimized neural function approximators.
We show that neural message passing solvers representationally contain some classical methods, such as finite differences, finite volumes, and WENO schemes.
We validate our method on various fluid-like flow problems, demonstrating fast, stable, and accurate performance across different domain topologies, equation parameters, discretizations, etc., in 1D and 2D.
arXiv Detail & Related papers (2022-02-07T17:47:46Z) - A Bayesian Treatment of Real-to-Sim for Deformable Object Manipulation [59.29922697476789]
We propose a novel methodology for extracting state information from image sequences via a technique to represent the state of a deformable object as a distribution embedding.
Our experiments confirm that we can estimate posterior distributions of physical properties, such as elasticity, friction and scale of highly deformable objects, such as cloth and ropes.
arXiv Detail & Related papers (2021-12-09T17:50:54Z) - Model reduction for the material point method via learning the
deformation map and its spatial-temporal gradients [9.509644638212773]
The technique approximates the $textitkinematics$ by approximating the deformation map in a manner that restricts deformation trajectories to reside on a low-dimensional manifold.
The ability to generate material points also allows for adaptive quadrature rules for stress update.
arXiv Detail & Related papers (2021-09-25T15:45:14Z) - Localization and Tracking of User-Defined Points on Deformable Objects
for Robotic Manipulation [0.0]
This paper introduces an efficient procedure to localize user-defined points on the surface of deformable objects.
We propose a discretized deformation field, which is estimated during runtime using a multi-step non-linear solver pipeline.
Our approach is capable of solving the localization problem online in a data-parallel manner, making it ideally suitable for the perception of non-rigid objects in industrial manufacturing processes.
arXiv Detail & Related papers (2021-05-19T11:25:33Z) - gradSim: Differentiable simulation for system identification and
visuomotor control [66.37288629125996]
We present gradSim, a framework that overcomes the dependence on 3D supervision by leveraging differentiable multiphysics simulation and differentiable rendering.
Our unified graph enables learning in challenging visuomotor control tasks, without relying on state-based (3D) supervision.
arXiv Detail & Related papers (2021-04-06T16:32:01Z) - Scalable Differentiable Physics for Learning and Control [99.4302215142673]
Differentiable physics is a powerful approach to learning and control problems that involve physical objects and environments.
We develop a scalable framework for differentiable physics that can support a large number of objects and their interactions.
arXiv Detail & Related papers (2020-07-04T19:07:51Z) - Dense Non-Rigid Structure from Motion: A Manifold Viewpoint [162.88686222340962]
Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geometry of a deforming object from its 2D feature correspondences across multiple frames.
We show that our approach significantly improves accuracy, scalability, and robustness against noise.
arXiv Detail & Related papers (2020-06-15T09:15:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.