Implicit field supervision for robust non-rigid shape matching

• URL: http://arxiv.org/abs/2203.07694v2
• Date: Wed, 16 Mar 2022 14:01:00 GMT
• Title: Implicit field supervision for robust non-rigid shape matching
• Authors: Ramana Sundararaman, Gautam Pai, Maks Ovsjanikov
• Abstract summary: Establishing a correspondence between two non-rigidly deforming shapes is one of the most fundamental problems in visual computing. We introduce an approach based on auto-decoder framework, that learns a continuous shape-wise deformation field over a fixed template. Our method is remarkably robust in the presence of strong artefacts and can be generalised to arbitrary shape categories.
• Score: 29.7672368261038
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Establishing a correspondence between two non-rigidly deforming shapes is one of the most fundamental problems in visual computing. Existing methods often show weak resilience when presented with challenges innate to real-world data such as noise, outliers, self-occlusion etc. On the other hand, auto-decoders have demonstrated strong expressive power in learning geometrically meaningful latent embeddings. However, their use in shape analysis and especially in non-rigid shape correspondence has been limited. In this paper, we introduce an approach based on auto-decoder framework, that learns a continuous shape-wise deformation field over a fixed template. By supervising the deformation field for points on-surface and regularising for points off-surface through a novel Signed Distance Regularisation (SDR), we learn an alignment between the template and shape volumes. Unlike classical correspondence techniques, our method is remarkably robust in the presence of strong artefacts and can be generalised to arbitrary shape categories. Trained on clean water-tight meshes, without any data-augmentation, we demonstrate compelling performance on compromised data and real-world scans.

Related papers

• Canonical Consolidation Fields: Reconstructing Dynamic Shapes from Point Clouds [12.221737707194261]
  We present Canonical Consolidation Fields (CanFields) CanFields is a method for reconstructing a time series of independently-sampled point clouds into a single deforming coherent shape. We demonstrate the robustness and accuracy of our methods on a diverse benchmark of dynamic point clouds.
  arXiv  Detail & Related papers  (2024-06-05T17:07:55Z)
• DynoSurf: Neural Deformation-based Temporally Consistent Dynamic Surface Reconstruction [93.18586302123633]
  This paper explores the problem of reconstructing temporally consistent surfaces from a 3D point cloud sequence without correspondence. We propose DynoSurf, an unsupervised learning framework integrating a template surface representation with a learnable deformation field. Experimental results demonstrate the significant superiority of DynoSurf over current state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-03-18T08:58:48Z)
• Deformation-Guided Unsupervised Non-Rigid Shape Matching [7.327850781641328]
  We present an unsupervised data-driven approach for non-rigid shape matching. Our approach is particularly robust when matching digitized shapes using 3D scanners.
  arXiv  Detail & Related papers  (2023-11-27T09:55:55Z)
• Non-Rigid Shape Registration via Deep Functional Maps Prior [1.9249120068573227]
  We propose a learning-based framework for non-rigid shape registration without correspondence supervision. We deform source mesh towards the target point cloud, guided by correspondences induced by high-dimensional embeddings. Our pipeline achieves state-of-the-art results on several benchmarks of non-rigid point cloud matching.
  arXiv  Detail & Related papers  (2023-11-08T06:52:57Z)
• Semantic-Aware Implicit Template Learning via Part Deformation Consistency [18.63665468429503]
  We propose a semantic-aware implicit template learning framework to enable semantically plausible deformation. By leveraging semantic prior from a self-supervised feature extractor, we suggest local conditioning with novel semantic-aware deformation code. Our experiments demonstrate the superiority of the proposed method over baselines in various tasks.
  arXiv  Detail & Related papers  (2023-08-23T05:02:17Z)
• Self-Supervised Learning for Multimodal Non-Rigid 3D Shape Matching [15.050801537501462]
  We introduce a self-supervised multimodal learning strategy that combines mesh-based functional map regularisation with a contrastive loss that couples mesh and point cloud data. Our shape matching approach allows to obtain intramodal correspondences for triangle meshes, complete point clouds, and partially observed point clouds. We demonstrate that our method achieves state-of-the-art results on several challenging benchmark datasets.
  arXiv  Detail & Related papers  (2023-03-20T09:47:02Z)
• Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transport [80.64516377977183]
  Shape matching has been a long-studied problem for the computer graphics and vision community. We investigate a hierarchical learning design, to which we incorporate local patch-level information and global shape-level structures. We propose a novel optimal transport solver by recurrently updating features on non-confident nodes to learn globally consistent correspondences between the shapes.
  arXiv  Detail & Related papers  (2022-02-03T11:41:46Z)
• Frame Averaging for Equivariant Shape Space Learning [85.42901997467754]
  A natural way to incorporate symmetries in shape space learning is to ask that the mapping to the shape space (encoder) and mapping from the shape space (decoder) are equivariant to the relevant symmetries. We present a framework for incorporating equivariance in encoders and decoders by introducing two contributions.
  arXiv  Detail & Related papers  (2021-12-03T06:41:19Z)
• Augmenting Implicit Neural Shape Representations with Explicit Deformation Fields [95.39603371087921]
  Implicit neural representation is a recent approach to learn shape collections as zero level-sets of neural networks. We advocate deformation-aware regularization for implicit neural representations, aiming at producing plausible deformations as latent code changes.
  arXiv  Detail & Related papers  (2021-08-19T22:07:08Z)
• SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes [117.76767853430243]
  We introduce SNARF, which combines the advantages of linear blend skinning for polygonal meshes with neural implicit surfaces. We propose a forward skinning model that finds all canonical correspondences of any deformed point using iterative root finding. Compared to state-of-the-art neural implicit representations, our approach generalizes better to unseen poses while preserving accuracy.
  arXiv  Detail & Related papers  (2021-04-08T17:54:59Z)
• Hamiltonian Dynamics for Real-World Shape Interpolation [66.47407593823208]
  We revisit the classical problem of 3D shape and propose a novel, physically plausible approach based on Hamiltonian dynamics. Our method yields exactly volume preserving intermediate shapes, avoids self-intersections and is scalable to high resolution scans.
  arXiv  Detail & Related papers  (2020-04-10T18:38:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.