JOSA: Joint surface-based registration and atlas construction of brain
geometry and function
- URL: http://arxiv.org/abs/2311.08544v1
- Date: Sun, 22 Oct 2023 02:16:48 GMT
- Title: JOSA: Joint surface-based registration and atlas construction of brain
geometry and function
- Authors: Jian Li, Greta Tuckute, Evelina Fedorenko, Brian L. Edlow, Adrian V.
Dalca, Bruce Fischl
- Abstract summary: JOSA is a novel cortical registration framework that jointly models the mismatch between geometry and function.
It achieves superior registration performance in both geometry and function to the state-of-the-art methods but without requiring functional data at inference.
It provides new insights into the future development of registration methods using joint analysis of the brain structure and function.
- Score: 10.584603337042532
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Surface-based cortical registration is an important topic in medical image
analysis and facilitates many downstream applications. Current approaches for
cortical registration are mainly driven by geometric features, such as sulcal
depth and curvature, and often assume that registration of folding patterns
leads to alignment of brain function. However, functional variability of
anatomically corresponding areas across subjects has been widely reported,
particularly in higher-order cognitive areas. In this work, we present JOSA, a
novel cortical registration framework that jointly models the mismatch between
geometry and function while simultaneously learning an unbiased
population-specific atlas. Using a semi-supervised training strategy, JOSA
achieves superior registration performance in both geometry and function to the
state-of-the-art methods but without requiring functional data at inference.
This learning framework can be extended to any auxiliary data to guide
spherical registration that is available during training but is difficult or
impossible to obtain during inference, such as parcellations, architectonic
identity, transcriptomic information, and molecular profiles. By recognizing
the mismatch between geometry and function, JOSA provides new insights into the
future development of registration methods using joint analysis of the brain
structure and function.
Related papers
- Unified Brain Surface and Volume Registration [27.427968036901678]
NeurAlign registers $3$D brain MRI images by jointly aligning both cortical and subcortical regions.<n>Our method consistently outperforms both classical and machine learning-based registration methods.<n>With its superior accuracy, fast inference, and ease of use, NeurAlign sets a new standard for joint cortical and subcortical registration.
arXiv Detail & Related papers (2025-12-22T23:05:26Z) - GRASPing Anatomy to Improve Pathology Segmentation [67.98147643529309]
We introduce GRASP, a modular plug-and-play framework that enhances pathology segmentation models.<n>We evaluate GRASP on two PET/CT datasets, conduct systematic ablation studies, and investigate the framework's inner workings.
arXiv Detail & Related papers (2025-08-05T12:26:36Z) - GESH-Net: Graph-Enhanced Spherical Harmonic Convolutional Networks for Cortical Surface Registration [8.896542371748115]
This paper constructs a deep learning model to study the technology of cortical surface image registration.
An unsupervised cortical surface registration network based on a multi-scale cascaded structure is designed.
A graph-enhenced module is introduced into the registration network, using the graph attention module to help the network learn global features.
arXiv Detail & Related papers (2024-10-18T18:21:47Z) - Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
In this study, we first construct the brain-effective network via the dynamic causal model.
We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE)
This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
arXiv Detail & Related papers (2024-05-21T20:37:07Z) - Improving embedding of graphs with missing data by soft manifolds [51.425411400683565]
The reliability of graph embeddings depends on how much the geometry of the continuous space matches the graph structure.
We introduce a new class of manifold, named soft manifold, that can solve this situation.
Using soft manifold for graph embedding, we can provide continuous spaces to pursue any task in data analysis over complex datasets.
arXiv Detail & Related papers (2023-11-29T12:48:33Z) - TractCloud: Registration-free tractography parcellation with a novel
local-global streamline point cloud representation [63.842881844791094]
Current tractography parcellation methods rely heavily on registration, but registration inaccuracies can affect parcellation.
We propose TractCloud, a registration-free framework that performs whole-brain tractography parcellation directly in individual subject space.
arXiv Detail & Related papers (2023-07-18T06:35:12Z) - S3M: Scalable Statistical Shape Modeling through Unsupervised
Correspondences [91.48841778012782]
We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies.
Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods.
Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
arXiv Detail & Related papers (2023-04-15T09:39:52Z) - Joint cortical registration of geometry and function using
semi-supervised learning [10.584603337042534]
We introduce a learning-based cortical registration framework, JOSA, which jointly aligns folding patterns and functional maps while simultaneously learning an optimal atlas.
We demonstrate that JOSA can substantially improve registration performance in both anatomical and functional domains over existing methods.
arXiv Detail & Related papers (2023-03-02T21:31:35Z) - Automatic Landmark Detection and Registration of Brain Cortical Surfaces
via Quasi-Conformal Geometry and Convolutional Neural Networks [17.78250777571423]
We propose a novel framework for the automatic landmark detection and registration of brain cortical surfaces.
We first develop a landmark detection network (LD-Net) that allows for the automatic extraction of landmark curves.
We then utilize the detected landmarks and quasi-conformal theory for achieving the surface registration.
arXiv Detail & Related papers (2022-08-15T05:47:51Z) - Brain Cortical Functional Gradients Predict Cortical Folding Patterns
via Attention Mesh Convolution [51.333918985340425]
We develop a novel attention mesh convolution model to predict cortical gyro-sulcal segmentation maps on individual brains.
Experiments show that the prediction performance via our model outperforms other state-of-the-art models.
arXiv Detail & Related papers (2022-05-21T14:08:53Z) - An explainability framework for cortical surface-based deep learning [110.83289076967895]
We develop a framework for cortical surface-based deep learning.
First, we adapted a perturbation-based approach for use with surface data.
We show that our explainability framework is not only able to identify important features and their spatial location but that it is also reliable and valid.
arXiv Detail & Related papers (2022-03-15T23:16:49Z) - Can neural networks learn persistent homology features? [1.1816942730023885]
Topological data analysis uses tools from topology to create representations of data.
In our work, we explore the possibility of learning several types of features extracted from persistence diagrams using neural networks.
arXiv Detail & Related papers (2020-11-30T10:58:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.