Automatic Landmark Detection and Registration of Brain Cortical Surfaces via Quasi-Conformal Geometry and Convolutional Neural Networks

• URL: http://arxiv.org/abs/2208.07010v1
• Date: Mon, 15 Aug 2022 05:47:51 GMT
• Title: Automatic Landmark Detection and Registration of Brain Cortical Surfaces via Quasi-Conformal Geometry and Convolutional Neural Networks
• Authors: Yuchen Guo, Qiguang Chen, Gary P. T. Choi, Lok Ming Lui
• Abstract summary: We propose a novel framework for the automatic landmark detection and registration of brain cortical surfaces. We first develop a landmark detection network (LD-Net) that allows for the automatic extraction of landmark curves. We then utilize the detected landmarks and quasi-conformal theory for achieving the surface registration.
• Score: 17.78250777571423
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In medical imaging, surface registration is extensively used for performing systematic comparisons between anatomical structures, with a prime example being the highly convoluted brain cortical surfaces. To obtain a meaningful registration, a common approach is to identify prominent features on the surfaces and establish a low-distortion mapping between them with the feature correspondence encoded as landmark constraints. Prior registration works have primarily focused on using manually labeled landmarks and solving highly nonlinear optimization problems, which are time-consuming and hence hinder practical applications. In this work, we propose a novel framework for the automatic landmark detection and registration of brain cortical surfaces using quasi-conformal geometry and convolutional neural networks. We first develop a landmark detection network (LD-Net) that allows for the automatic extraction of landmark curves given two prescribed starting and ending points based on the surface geometry. We then utilize the detected landmarks and quasi-conformal theory for achieving the surface registration. Specifically, we develop a coefficient prediction network (CP-Net) for predicting the Beltrami coefficients associated with the desired landmark-based registration and a mapping network called the disk Beltrami solver network (DBS-Net) for generating quasi-conformal mappings from the predicted Beltrami coefficients, with the bijectivity guaranteed by quasi-conformal theory. Experimental results are presented to demonstrate the effectiveness of our proposed framework. Altogether, our work paves a new way for surface-based morphometry and medical shape analysis.

Related papers

• Deep Learning-Based Quasi-Conformal Surface Registration for Partial 3D Faces Applied to Facial Recognition [13.426313868579827]
  3D face registration is an important process in which a 3D face model is aligned and mapped to a template face. This paper presents a novel deep learning-based approach that combines quasi-conformal geometry with deep neural networks for partial face registration.
  arXiv  Detail & Related papers  (2024-05-16T08:03:41Z)
• Unsupervised Multimodal Surface Registration with Geometric Deep Learning [3.3403308469369577]
  GeoMorph is a novel geometric deep-learning framework designed for image registration of cortical surfaces. We show that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Such versatility and robustness suggest strong potential for various neuroscience applications.
  arXiv  Detail & Related papers  (2023-11-21T22:05:00Z)
• Quasi-orthogonality and intrinsic dimensions as measures of learning and generalisation [55.80128181112308]
  We show that dimensionality and quasi-orthogonality of neural networks' feature space may jointly serve as network's performance discriminants. Our findings suggest important relationships between the networks' final performance and properties of their randomly initialised feature spaces.
  arXiv  Detail & Related papers  (2022-03-30T21:47:32Z)
• A Deep-Discrete Learning Framework for Spherical Surface Registration [4.7633236054762875]
  Cortical surface registration is a fundamental tool for neuroimaging analysis. We propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem. Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms.
  arXiv  Detail & Related papers  (2022-03-24T11:47:11Z)
• An explainability framework for cortical surface-based deep learning [110.83289076967895]
  We develop a framework for cortical surface-based deep learning. First, we adapted a perturbation-based approach for use with surface data. We show that our explainability framework is not only able to identify important features and their spatial location but that it is also reliable and valid.
  arXiv  Detail & Related papers  (2022-03-15T23:16:49Z)
• A singular Riemannian geometry approach to Deep Neural Networks II. Reconstruction of 1-D equivalence classes [78.120734120667]
  We build the preimage of a point in the output manifold in the input space. We focus for simplicity on the case of neural networks maps from n-dimensional real spaces to (n - 1)-dimensional real spaces.
  arXiv  Detail & Related papers  (2021-12-17T11:47:45Z)
• Progressive Spatio-Temporal Graph Convolutional Network for Skeleton-Based Human Action Recognition [97.14064057840089]
  We propose a method to automatically find a compact and problem-specific network for graph convolutional networks in a progressive manner. Experimental results on two datasets for skeleton-based human action recognition indicate that the proposed method has competitive or even better classification performance.
  arXiv  Detail & Related papers  (2020-11-11T09:57:49Z)
• Primal-Dual Mesh Convolutional Neural Networks [62.165239866312334]
  We propose a primal-dual framework drawn from the graph-neural-network literature to triangle meshes. Our method takes features for both edges and faces of a 3D mesh as input and dynamically aggregates them. We provide theoretical insights of our approach using tools from the mesh-simplification literature.
  arXiv  Detail & Related papers  (2020-10-23T14:49:02Z)
• Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance [95.86944752753564]
  We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
  arXiv  Detail & Related papers  (2020-07-28T07:34:30Z)
• Cortical surface registration using unsupervised learning [8.57142014602892]
  Non-rigid cortical registration is an important and challenging task due to the geometric complexity of the human cortex. Recent learning-based methods to surfaces yields poor results due to distortions introduced by projecting a sphere to a 2D plane. We present SphereMorph, a diffeomorphic registration framework for cortical surfaces using deep networks that addresses these issues.
  arXiv  Detail & Related papers  (2020-04-09T15:59:13Z)
• Neural Network Tomography [4.407668482702675]
  Network tomography is a classic research problem in the realm of network monitoring. NeuTomography utilizes deep neural network and data augmentation to predict the unmeasured performance metrics. NeuTomography can be employed to reconstruct the original network topology.
  arXiv  Detail & Related papers  (2020-01-09T12:19:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.