Unsupervised Multimodal Surface Registration with Geometric Deep Learning

• URL: http://arxiv.org/abs/2311.13022v1
• Date: Tue, 21 Nov 2023 22:05:00 GMT
• Title: Unsupervised Multimodal Surface Registration with Geometric Deep Learning
• Authors: Mohamed A. Suliman, Logan Z. J. Williams, Abdulah Fawaz, and Emma C. Robinson
• Abstract summary: GeoMorph is a novel geometric deep-learning framework designed for image registration of cortical surfaces. We show that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Such versatility and robustness suggest strong potential for various neuroscience applications.
• Score: 3.3403308469369577
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: This paper introduces GeoMorph, a novel geometric deep-learning framework designed for image registration of cortical surfaces. The registration process consists of two main steps. First, independent feature extraction is performed on each input surface using graph convolutions, generating low-dimensional feature representations that capture important cortical surface characteristics. Subsequently, features are registered in a deep-discrete manner to optimize the overlap of common structures across surfaces by learning displacements of a set of control points. To ensure smooth and biologically plausible deformations, we implement regularization through a deep conditional random field implemented with a recurrent neural network. Experimental results demonstrate that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Furthermore, GeoMorph exhibits competitive performance compared to classical frameworks. Such versatility and robustness suggest strong potential for various neuroscience applications.

Related papers

• GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration [8.896542371748115]
  This paper constructs a deep learning model to study the technology of cortical surface image registration. An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed. A graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features.
  arXiv  Detail & Related papers  (2024-10-18T18:21:47Z)
• Flatten Anything: Unsupervised Neural Surface Parameterization [76.4422287292541]
  We introduce the Flatten Anything Model (FAM), an unsupervised neural architecture to achieve global free-boundary surface parameterization. Compared with previous methods, our FAM directly operates on discrete surface points without utilizing connectivity information. Our FAM is fully-automated without the need for pre-cutting and can deal with highly-complex topologies.
  arXiv  Detail & Related papers  (2024-05-23T14:39:52Z)
• Mesh Denoising Transformer [104.5404564075393]
  Mesh denoising is aimed at removing noise from input meshes while preserving their feature structures. SurfaceFormer is a pioneering Transformer-based mesh denoising framework. New representation known as Local Surface Descriptor captures local geometric intricacies. Denoising Transformer module receives the multimodal information and achieves efficient global feature aggregation.
  arXiv  Detail & Related papers  (2024-05-10T15:27:43Z)
• Flexible Isosurface Extraction for Gradient-Based Mesh Optimization [65.76362454554754]
  This work considers gradient-based mesh optimization, where we iteratively optimize for a 3D surface mesh by representing it as the isosurface of a scalar field. We introduce FlexiCubes, an isosurface representation specifically designed for optimizing an unknown mesh with respect to geometric, visual, or even physical objectives.
  arXiv  Detail & Related papers  (2023-08-10T06:40:19Z)
• Automatic Landmark Detection and Registration of Brain Cortical Surfaces via Quasi-Conformal Geometry and Convolutional Neural Networks [17.78250777571423]
  We propose a novel framework for the automatic landmark detection and registration of brain cortical surfaces. We first develop a landmark detection network (LD-Net) that allows for the automatic extraction of landmark curves. We then utilize the detected landmarks and quasi-conformal theory for achieving the surface registration.
  arXiv  Detail & Related papers  (2022-08-15T05:47:51Z)
• Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysis [8.20832544370228]
  We introduce a domain-agnostic architecture to study any surface data projected onto a spherical manifold. A vision transformer model encodes the sequence of patches via successive multi-head self-attention layers. Experiments show that the SiT generally outperforms surface CNNs, while performing comparably on registered and unregistered data.
  arXiv  Detail & Related papers  (2022-03-30T15:56:11Z)
• A Deep-Discrete Learning Framework for Spherical Surface Registration [4.7633236054762875]
  Cortical surface registration is a fundamental tool for neuroimaging analysis. We propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem. Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms.
  arXiv  Detail & Related papers  (2022-03-24T11:47:11Z)
• Localized Persistent Homologies for more Effective Deep Learning [60.78456721890412]
  We introduce an approach that relies on a new filtration function to account for location during network training. We demonstrate experimentally on 2D images of roads and 3D image stacks of neuronal processes that networks trained in this manner are better at recovering the topology of the curvilinear structures they extract.
  arXiv  Detail & Related papers  (2021-10-12T19:28:39Z)
• NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One Go [109.88509362837475]
  We present NeuroMorph, a new neural network architecture that takes as input two 3D shapes. NeuroMorph produces smooth and point-to-point correspondences between them. It works well for a large variety of input shapes, including non-isometric pairs from different object categories.
  arXiv  Detail & Related papers  (2021-06-17T12:25:44Z)
• Self-supervised Geometric Perception [96.89966337518854]
  Self-supervised geometric perception is a framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels. We show that SGP achieves state-of-the-art performance that is on-par or superior to the supervised oracles trained using ground-truth labels.
  arXiv  Detail & Related papers  (2021-03-04T15:34:43Z)
• Cortical surface registration using unsupervised learning [8.57142014602892]
  Non-rigid cortical registration is an important and challenging task due to the geometric complexity of the human cortex. Recent learning-based methods to surfaces yields poor results due to distortions introduced by projecting a sphere to a 2D plane. We present SphereMorph, a diffeomorphic registration framework for cortical surfaces using deep networks that addresses these issues.
  arXiv  Detail & Related papers  (2020-04-09T15:59:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.