Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow

• URL: http://arxiv.org/abs/2203.08652v1
• Date: Wed, 16 Mar 2022 14:39:11 GMT
• Title: Topology-Preserving Shape Reconstruction and Registration via Neural Diffeomorphic Flow
• Authors: Shanlin Sun, Kun Han, Deying Kong, Hao Tang, Xiangyi Yan, Xiaohui Xie
• Abstract summary: Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. We propose a new model called Neural Diffeomorphic Flow (NDF) to learn deep implicit shape templates. NDF achieves consistently state-of-the-art organ shape reconstruction and registration results in both accuracy and quality.
• Score: 22.1959666473906
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences simultaneously, capturing semantic relationships across shapes of the same class by learning a DIFs-modeled shape template. These methods provide great flexibility and accuracy in reconstructing 3D shapes and inferring correspondences. However, the point correspondences built from these methods do not intrinsically preserve the topology of the shapes, unlike mesh-based template matching methods. This limits their applications on 3D geometries where underlying topological structures exist and matter, such as anatomical structures in medical images. In this paper, we propose a new model called Neural Diffeomorphic Flow (NDF) to learn deep implicit shape templates, representing shapes as conditional diffeomorphic deformations of templates, intrinsically preserving shape topologies. The diffeomorphic deformation is realized by an auto-decoder consisting of Neural Ordinary Differential Equation (NODE) blocks that progressively map shapes to implicit templates. We conduct extensive experiments on several medical image organ segmentation datasets to evaluate the effectiveness of NDF on reconstructing and aligning shapes. NDF achieves consistently state-of-the-art organ shape reconstruction and registration results in both accuracy and quality. The source code is publicly available at https://github.com/Siwensun/Neural_Diffeomorphic_Flow--NDF.

Related papers

• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• Hybrid Neural Diffeomorphic Flow for Shape Representation and Generation via Triplane [16.684276798449115]
  HNDF is a method that implicitly learns the underlying representation and decomposes intricate dense correspondences into explicitly axis-aligned triplane features. Unlike conventional approaches that directly generate new 3D shapes, we explore the idea of shape generation with deformed template shape via diffeomorphic flows.
  arXiv  Detail & Related papers  (2023-07-04T23:28:01Z)
• Landmark-free Statistical Shape Modeling via Neural Flow Deformations [0.5897108307012394]
  We present FlowSSM, a novel shape modeling approach that learns shape variability without requiring dense correspondence between training instances. Our model outperforms state-of-the-art methods in providing an expressive and robust shape prior for distal femur and liver.
  arXiv  Detail & Related papers  (2022-09-14T18:17:19Z)
• Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes [52.038346313823524]
  This paper introduces a novel framework called DTNet for 3D mesh reconstruction and generation via Disentangled Topology. Our method is able to produce high-quality meshes, particularly with diverse topologies, as compared with the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-06-10T08:32:57Z)
• Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networks [118.20778308823779]
  We present a novel 3D primitive representation that defines primitives using an Invertible Neural Network (INN) Our model learns to parse 3D objects into semantically consistent part arrangements without any part-level supervision.
  arXiv  Detail & Related papers  (2021-03-18T17:59:31Z)
• Deep Implicit Templates for 3D Shape Representation [70.9789507686618]
  We propose a new 3D shape representation that supports explicit correspondence reasoning in deep implicit representations. Our key idea is to formulate DIFs as conditional deformations of a template implicit function. We show that our method can not only learn a common implicit template for a collection of shapes, but also establish dense correspondences across all the shapes simultaneously without any supervision.
  arXiv  Detail & Related papers  (2020-11-30T06:01:49Z)
• Deformed Implicit Field: Modeling 3D Shapes with Learned Dense Correspondence [30.849927968528238]
  We propose a novel Deformed Implicit Field representation for modeling 3D shapes of a category. Our neural network, dubbed DIF-Net, jointly learns a shape latent space and these fields for 3D objects belonging to a category. Experiments show that DIF-Net not only produces high-fidelity 3D shapes but also builds high-quality dense correspondences across different shapes.
  arXiv  Detail & Related papers  (2020-11-27T10:45:26Z)
• Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flows [79.39092757515395]
  We propose Neural Mesh Flow (NMF) to generate two-manifold meshes for genus-0 shapes. NMF is a shape auto-encoder consisting of several Neural Ordinary Differential Equation (NODE) blocks that learn accurate mesh geometry by progressively deforming a spherical mesh. Our experiments demonstrate that NMF facilitates several applications such as single-view mesh reconstruction, global shape parameterization, texture mapping, shape deformation and correspondence.
  arXiv  Detail & Related papers  (2020-07-21T17:45:41Z)
• Dense Non-Rigid Structure from Motion: A Manifold Viewpoint [162.88686222340962]
  Non-Rigid Structure-from-Motion (NRSfM) problem aims to recover 3D geometry of a deforming object from its 2D feature correspondences across multiple frames. We show that our approach significantly improves accuracy, scalability, and robustness against noise.
  arXiv  Detail & Related papers  (2020-06-15T09:15:54Z)
• ShapeFlow: Learnable Deformations Among 3D Shapes [28.854946339507123]
  We present a flow-based model for learning a deformation space for entire classes of 3D shapes with large intra-class variations. ShapeFlow allows learning a multi-template deformation space that is agnostic to shape topology, yet preserves fine geometric details.
  arXiv  Detail & Related papers  (2020-06-14T19:03:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.