4Deform: Neural Surface Deformation for Robust Shape Interpolation

• URL: http://arxiv.org/abs/2502.20208v1
• Date: Thu, 27 Feb 2025 15:47:49 GMT
• Title: 4Deform: Neural Surface Deformation for Robust Shape Interpolation
• Authors: Lu Sang, Zehranaz Canfes, Dongliang Cao, Riccardo Marin, Florian Bernard, Daniel Cremers,
• Abstract summary: We develop a new approach to generate realistic intermediate shapes between non-rigidly deformed shapes in unstructured data.<n>Our method learns a continuous velocity field in Euclidean space and does not require intermediate-shape supervision during training.<n>For the first time, our method enables new applications like 4D Kinect sequence upsampling and real-world high-resolution mesh deformation.
• Score: 47.47045870313048
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Generating realistic intermediate shapes between non-rigidly deformed shapes is a challenging task in computer vision, especially with unstructured data (e.g., point clouds) where temporal consistency across frames is lacking, and topologies are changing. Most interpolation methods are designed for structured data (i.e., meshes) and do not apply to real-world point clouds. In contrast, our approach, 4Deform, leverages neural implicit representation (NIR) to enable free topology changing shape deformation. Unlike previous mesh-based methods that learn vertex-based deformation fields, our method learns a continuous velocity field in Euclidean space. Thus, it is suitable for less structured data such as point clouds. Additionally, our method does not require intermediate-shape supervision during training; instead, we incorporate physical and geometrical constraints to regularize the velocity field. We reconstruct intermediate surfaces using a modified level-set equation, directly linking our NIR with the velocity field. Experiments show that our method significantly outperforms previous NIR approaches across various scenarios (e.g., noisy, partial, topology-changing, non-isometric shapes) and, for the first time, enables new applications like 4D Kinect sequence upsampling and real-world high-resolution mesh deformation.

Related papers

• Learning Bijective Surface Parameterization for Inferring Signed Distance Functions from Sparse Point Clouds with Grid Deformation [50.26314343851213]
  Inferring signed distance functions (SDFs) from sparse point clouds remains a challenge in surface reconstruction. We present a novel approach that learns a dynamic deformation network to predict SDFs in an end-to-end manner. Experimental results on synthetic and real scanned datasets demonstrate that our method significantly outperforms the current state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-31T02:27:02Z)
• Implicit Neural Surface Deformation with Explicit Velocity Fields [47.610773635281085]
  We introduce the first unsupervised method that simultaneously predicts time-varying neural implicit surfaces and deformations between pairs of point clouds.<n>Our method is able to handle both rigid and non-rigid deformations without any intermediate shape supervision.
  arXiv  Detail & Related papers  (2025-01-23T19:11:53Z)
• CanFields: Consolidating 4D Dynamic Shapes from Raw Scans [12.221737707194261]
  We introduce Canonical Consolidation Fields (CanFields), a new method for reconstructing a time series of independently captured 3D scans into a single, coherent deforming shape.<n>CanFields effectively learns geometry and deformation in an unsupervised way by incorporating two geometric priors.<n>We validate the robustness and accuracy of CanFields on diverse raw scans, demonstrating its superior performance even with missing regions, sparse frames, and noise.
  arXiv  Detail & Related papers  (2024-06-05T17:07:55Z)
• Non-Rigid Shape Registration via Deep Functional Maps Prior [1.9249120068573227]
  We propose a learning-based framework for non-rigid shape registration without correspondence supervision. We deform source mesh towards the target point cloud, guided by correspondences induced by high-dimensional embeddings. Our pipeline achieves state-of-the-art results on several benchmarks of non-rigid point cloud matching.
  arXiv  Detail & Related papers  (2023-11-08T06:52:57Z)
• Neural Shape Deformation Priors [14.14047635248036]
  We present Neural Shape Deformation Priors, a novel method for shape manipulation. We learn the deformation behavior based on the underlying geometric properties of a shape. Our method can be applied to challenging deformations and generalizes well to unseen deformations.
  arXiv  Detail & Related papers  (2022-10-11T17:03:25Z)
• NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go [109.88509362837475]
  We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes. NeuroMorph produces smooth and point-to-point correspondences between them. It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
  arXiv  Detail & Related papers  (2021-06-17T12:25:44Z)
• SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes [117.76767853430243]
  We introduce SNARF, which combines the advantages of linear blend skinning for polygonal meshes with neural implicit surfaces. We propose a forward skinning model that finds all canonical correspondences of any deformed point using iterative root finding. Compared to state-of-the-art neural implicit representations, our approach generalizes better to unseen poses while preserving accuracy.
  arXiv  Detail & Related papers  (2021-04-08T17:54:59Z)
• A Point-Cloud Deep Learning Framework for Prediction of Fluid Flow Fields on Irregular Geometries [62.28265459308354]
  Network learns end-to-end mapping between spatial positions and CFD quantities. Incompress laminar steady flow past a cylinder with various shapes for its cross section is considered. Network predicts the flow fields hundreds of times faster than our conventional CFD.
  arXiv  Detail & Related papers  (2020-10-15T12:15:02Z)
• Dense Non-Rigid Structure from Motion: A Manifold Viewpoint [162.88686222340962]
  Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geometry of a deforming object from its 2D feature correspondences across multiple frames. We show that our approach significantly improves accuracy, scalability, and robustness against noise.
  arXiv  Detail & Related papers  (2020-06-15T09:15:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.