CorticalFlow: A Diffeomorphic Mesh Deformation Module for Cortical Surface Reconstruction

• URL: http://arxiv.org/abs/2206.02374v1
• Date: Mon, 6 Jun 2022 06:10:31 GMT
• Title: CorticalFlow: A Diffeomorphic Mesh Deformation Module for Cortical Surface Reconstruction
• Authors: L\'eo Lebrat, Rodrigo Santa Cruz, Fr\'ed\'eric de Gournay, Darren Fu, Pierrick Bourgeat, Jurgen Fripp, Clinton Fookes, Olivier Salvado
• Abstract summary: CorticalFlow is a new geometric deep-learning model that learns to deform a reference template towards a targeted object. We demonstrate its performance for the challenging task of brain cortical surface reconstruction.
• Score: 18.851541271793085
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper we introduce CorticalFlow, a new geometric deep-learning model that, given a 3-dimensional image, learns to deform a reference template towards a targeted object. To conserve the template mesh's topological properties, we train our model over a set of diffeomorphic transformations. This new implementation of a flow Ordinary Differential Equation (ODE) framework benefits from a small GPU memory footprint, allowing the generation of surfaces with several hundred thousand vertices. To reduce topological errors introduced by its discrete resolution, we derive numeric conditions which improve the manifoldness of the predicted triangle mesh. To exhibit the utility of CorticalFlow, we demonstrate its performance for the challenging task of brain cortical surface reconstruction. In contrast to current state-of-the-art, CorticalFlow produces superior surfaces while reducing the computation time from nine and a half minutes to one second. More significantly, CorticalFlow enforces the generation of anatomically plausible surfaces; the absence of which has been a major impediment restricting the clinical relevance of such surface reconstruction methods.

Related papers

• DynoSurf: Neural Deformation-based Temporally Consistent Dynamic Surface Reconstruction [93.18586302123633]
  This paper explores the problem of reconstructing temporally consistent surfaces from a 3D point cloud sequence without correspondence. We propose DynoSurf, an unsupervised learning framework integrating a template surface representation with a learnable deformation field. Experimental results demonstrate the significant superiority of DynoSurf over current state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-03-18T08:58:48Z)
• Neural deformation fields for template-based reconstruction of cortical surfaces from MRI [5.4173776411667935]
  We introduce Vox2Cortex-Flow, a deep mesh-deformation technique that learns a deformation field from a brain template to the cortical surfaces of an MRI scan. V2C-Flow is not only very fast, requiring less than two seconds to infer all four cortical surfaces. We show that V2C-Flow results in cortical surfaces that are state-of-the-art in terms of accuracy.
  arXiv  Detail & Related papers  (2024-01-23T17:50:58Z)
• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• Flexible Isosurface Extraction for Gradient-Based Mesh Optimization [65.76362454554754]
  This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field. We introduce FlexiCubes, an isosurface representation specifically designed for optimizing an unknown mesh with respect to geometric, visual, or even physical objectives.
  arXiv  Detail & Related papers  (2023-08-10T06:40:19Z)
• NeuralMeshing: Differentiable Meshing of Implicit Neural Representations [63.18340058854517]
  We propose a novel differentiable meshing algorithm for extracting surface meshes from neural implicit representations. Our method produces meshes with regular tessellation patterns and fewer triangle faces compared to existing methods.
  arXiv  Detail & Related papers  (2022-10-05T16:52:25Z)
• CorticalFlow$^{++}$: Boosting Cortical Surface Reconstruction Accuracy, Regularity, and Interoperability [19.79686539414599]
  Supervised deep learning approaches have been introduced to speed up this task cutting down the reconstruction time from hours to seconds. This paper proposes three modifications to improve its accuracy and interoperability with existing surface analysis tools. We demonstrate the proposed changes provide more geometric accuracy and surface regularity while keeping the reconstruction time and GPU memory requirements almost unchanged.
  arXiv  Detail & Related papers  (2022-06-14T05:23:23Z)
• Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes [52.038346313823524]
  This paper introduces a novel framework called DTNet for 3D mesh reconstruction and generation via Disentangled Topology. Our method is able to produce high-quality meshes, particularly with diverse topologies, as compared with the state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-06-10T08:32:57Z)
• CortexODE: Learning Cortical Surface Reconstruction by Neural ODEs [12.239318066719068]
  CortexODE is a deep learning framework for cortical surface reconstruction. It can be integrated to an automatic learning-based pipeline, which reconstructs surfaces efficiently in less than 6 seconds. Our experiments demonstrate that the CortexODE-based pipeline can achieve less than 0.2mm average geometric error.
  arXiv  Detail & Related papers  (2022-02-16T20:57:59Z)
• Bridge the Gap Between Model-based and Model-free Human Reconstruction [10.818838437018682]
  We present an end-to-end neural network that simultaneously predicts the pixel-aligned implicit surface and the explicit mesh model built by graph convolutional neural network. Experiments on DeepHuman dataset showed that our approach is effective.
  arXiv  Detail & Related papers  (2021-06-11T11:13:42Z)
• Learning Deformable Tetrahedral Meshes for 3D Reconstruction [78.0514377738632]
  3D shape representations that accommodate learning-based 3D reconstruction are an open problem in machine learning and computer graphics. Previous work on neural 3D reconstruction demonstrated benefits, but also limitations, of point cloud, voxel, surface mesh, and implicit function representations. We introduce Deformable Tetrahedral Meshes (DefTet) as a particular parameterization that utilizes volumetric tetrahedral meshes for the reconstruction problem.
  arXiv  Detail & Related papers  (2020-11-03T02:57:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.