GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration

• URL: http://arxiv.org/abs/2410.14805v1
• Date: Fri, 18 Oct 2024 18:21:47 GMT
• Title: GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration
• Authors: Ruoyu Zhang, Lihui Wang, Kun Tang, Jingwen Xu, Hongjiang Wei,
• Abstract summary: This paper constructs a deep learning model to study the technology of cortical surface image registration. An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed. A graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features.
• Score: 8.896542371748115
• License:
• Abstract: Currently, cortical surface registration techniques based on classical methods have been well developed. However, a key issue with classical methods is that for each pair of images to be registered, it is necessary to search for the optimal transformation in the deformation space according to a specific optimization algorithm until the similarity measure function converges, which cannot meet the requirements of real-time and high-precision in medical image registration. Researching cortical surface registration based on deep learning models has become a new direction. But so far, there are still only a few studies on cortical surface image registration based on deep learning. Moreover, although deep learning methods theoretically have stronger representation capabilities, surpassing the most advanced classical methods in registration accuracy and distortion control remains a challenge. Therefore, to address this challenge, this paper constructs a deep learning model to study the technology of cortical surface image registration. The specific work is as follows: (1) An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed, and a convolution method based on spherical harmonic transformation is introduced to register cortical surface data. This solves the problem of scale-inflexibility of spherical feature transformation and optimizes the multi-scale registration process. (2)By integrating the attention mechanism, a graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features of cortical surface data, enhancing the learning ability of the network. The results show that the graph attention module effectively enhances the network's ability to extract global features, and its registration results have significant advantages over other methods.

Related papers

• Unsupervised Multimodal Surface Registration with Geometric Deep Learning [3.3403308469369577]
  GeoMorph is a novel geometric deep-learning framework designed for image registration of cortical surfaces. We show that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Such versatility and robustness suggest strong potential for various neuroscience applications.
  arXiv  Detail & Related papers  (2023-11-21T22:05:00Z)
• Automatic Landmark Detection and Registration of Brain Cortical Surfaces via Quasi-Conformal Geometry and Convolutional Neural Networks [17.78250777571423]
  We propose a novel framework for the automatic landmark detection and registration of brain cortical surfaces. We first develop a landmark detection network (LD-Net) that allows for the automatic extraction of landmark curves. We then utilize the detected landmarks and quasi-conformal theory for achieving the surface registration.
  arXiv  Detail & Related papers  (2022-08-15T05:47:51Z)
• Inducing Gaussian Process Networks [80.40892394020797]
  We propose inducing Gaussian process networks (IGN), a simple framework for simultaneously learning the feature space as well as the inducing points. The inducing points, in particular, are learned directly in the feature space, enabling a seamless representation of complex structured domains. We report on experimental results for real-world data sets showing that IGNs provide significant advances over state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-04-21T05:27:09Z)
• Affine Medical Image Registration with Coarse-to-Fine Vision Transformer [11.4219428942199]
  We present a learning-based algorithm, Coarse-to-Fine Vision Transformer (C2FViT), for 3D affine medical image registration. Our method is superior to the existing CNNs-based affine registration methods in terms of registration accuracy, robustness and generalizability.
  arXiv  Detail & Related papers  (2022-03-29T03:18:43Z)
• A Deep-Discrete Learning Framework for Spherical Surface Registration [4.7633236054762875]
  Cortical surface registration is a fundamental tool for neuroimaging analysis. We propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem. Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms.
  arXiv  Detail & Related papers  (2022-03-24T11:47:11Z)
• Self-Supervised Graph Representation Learning for Neuronal Morphologies [75.38832711445421]
  We present GraphDINO, a data-driven approach to learn low-dimensional representations of 3D neuronal morphologies from unlabeled datasets. We show, in two different species and across multiple brain areas, that this method yields morphological cell type clusterings on par with manual feature-based classification by experts. Our method could potentially enable data-driven discovery of novel morphological features and cell types in large-scale datasets.
  arXiv  Detail & Related papers  (2021-12-23T12:17:47Z)
• Spatio-Temporal Inception Graph Convolutional Networks for Skeleton-Based Action Recognition [126.51241919472356]
  We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition. Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
  arXiv  Detail & Related papers  (2020-11-26T14:43:04Z)
• DeepGMR: Learning Latent Gaussian Mixture Models for Registration [113.74060941036664]
  Point cloud registration is a fundamental problem in 3D computer vision, graphics and robotics. In this paper, we introduce Deep Gaussian Mixture Registration (DeepGMR), the first learning-based registration method. Our proposed method shows favorable performance when compared with state-of-the-art geometry-based and learning-based registration methods.
  arXiv  Detail & Related papers  (2020-08-20T17:25:16Z)
• Learning Connectivity of Neural Networks from a Topological Perspective [80.35103711638548]
  We propose a topological perspective to represent a network into a complete graph for analysis. By assigning learnable parameters to the edges which reflect the magnitude of connections, the learning process can be performed in a differentiable manner. This learning process is compatible with existing networks and owns adaptability to larger search spaces and different tasks.
  arXiv  Detail & Related papers  (2020-08-19T04:53:31Z)
• Towards Deeper Graph Neural Networks [63.46470695525957]
  Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Several recent studies attribute this performance deterioration to the over-smoothing issue. We propose Deep Adaptive Graph Neural Network (DAGNN) to adaptively incorporate information from large receptive fields.
  arXiv  Detail & Related papers  (2020-07-18T01:11:14Z)
• Cortical surface registration using unsupervised learning [8.57142014602892]
  Non-rigid cortical registration is an important and challenging task due to the geometric complexity of the human cortex. Recent learning-based methods to surfaces yields poor results due to distortions introduced by projecting a sphere to a 2D plane. We present SphereMorph, a diffeomorphic registration framework for cortical surfaces using deep networks that addresses these issues.
  arXiv  Detail & Related papers  (2020-04-09T15:59:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.