Using Structural Similarity and Kolmogorov-Arnold Networks for Anatomical Embedding of Cortical Folding Patterns
- URL: http://arxiv.org/abs/2410.23598v2
- Date: Sun, 23 Feb 2025 04:30:14 GMT
- Title: Using Structural Similarity and Kolmogorov-Arnold Networks for Anatomical Embedding of Cortical Folding Patterns
- Authors: Minheng Chen, Chao Cao, Tong Chen, Yan Zhuang, Jing Zhang, Yanjun Lyu, Xiaowei Yu, Lu Zhang, Tianming Liu, Dajiang Zhu,
- Abstract summary: The 3-hinge gyrus (3HG) is a newly defined folding pattern.<n>We propose a self-supervised framework for anatomical feature embedding of the 3HGs to build the correspondences among different brains.
- Score: 30.044545011553172
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The 3-hinge gyrus (3HG) is a newly defined folding pattern, which is the conjunction of gyri coming from three directions in cortical folding. Many studies demonstrated that 3HGs can be reliable nodes when constructing brain networks or connectome since they simultaneously possess commonality and individuality across different individual brains and populations. However, 3HGs are identified and validated within individual spaces, making it difficult to directly serve as the brain network nodes due to the absence of cross-subject correspondence. The 3HG correspondences represent the intrinsic regulation of brain organizational architecture, traditional image-based registration methods tend to fail because individual anatomical properties need to be fully respected. To address this challenge, we propose a novel self-supervised framework for anatomical feature embedding of the 3HGs to build the correspondences among different brains. The core component of this framework is to construct a structural similarity-enhanced multi-hop feature encoding strategy based on the recently developed Kolmogorov-Arnold network (KAN) for anatomical feature embedding. Extensive experiments suggest that our approach can effectively establish robust cross-subject correspondences when no one-to-one mapping exists.
Related papers
- Community-Level Modeling of Gyral Folding Patterns for Robust and Anatomically Informed Individualized Brain Mapping [29.127228105988166]
Cortical folding exhibits substantial inter-individual variability while preserving stable anatomical landmarks.<n>Existing landmark-based methods typically model each 3HG independently.<n>We propose a spectral graph representation learning framework that models community-level folding units.
arXiv Detail & Related papers (2026-02-01T23:13:01Z) - CardioComposer: Flexible and Compositional Anatomical Structure Generation with Disentangled Geometric Guidance [0.6312872285702812]
We propose a framework for guiding unconditional diffusion models of human anatomy using interpretable ellipsoidal primitives embedded in 3D space.<n>Our method involves the selection of certain tissues within multi-tissue segmentation maps, upon which we apply geometric moment losses to guide the reverse diffusion process.
arXiv Detail & Related papers (2025-09-08T23:08:23Z) - GRASPing Anatomy to Improve Pathology Segmentation [67.98147643529309]
We introduce GRASP, a modular plug-and-play framework that enhances pathology segmentation models.<n>We evaluate GRASP on two PET/CT datasets, conduct systematic ablation studies, and investigate the framework's inner workings.
arXiv Detail & Related papers (2025-08-05T12:26:36Z) - Supervised and Unsupervised protocols for hetero-associative neural networks [0.8796261172196742]
This paper introduces a learning framework for Three-Directional Associative Memory (TAM) models, extending the classical Hebbian paradigm to both supervised and unsupervised protocols within an hetero-associative setting.<n>These neural networks consist of three interconnected layers of binary neurons interacting via generalized Hebbian synaptic couplings that allow learning, storage and retrieval of structured triplets of patterns.
arXiv Detail & Related papers (2025-05-24T17:15:55Z) - GyralNet Subnetwork Partitioning via Differentiable Spectral Modularity Optimization [30.044545011553172]
We propose a differentiable subnetwork framework to modularize the organization of 3HGs within GyralNet.
By incorporating topological structural similarity and DTI-derived connectivity patterns as attribute features, our approach provides a biologically meaningful representation of cortical organization.
arXiv Detail & Related papers (2025-03-25T16:33:12Z) - JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling [62.77347895550087]
We introduce JADE, a generative framework that learns the variations of human shapes with fined-grained control.
Our key insight is a joint-aware latent representation that decomposes human bodies into skeleton structures.
To generate coherent and plausible human shapes under our proposed decomposition, we also present a cascaded pipeline.
arXiv Detail & Related papers (2024-12-29T14:18:35Z) - GASA-UNet: Global Axial Self-Attention U-Net for 3D Medical Image Segmentation [8.939740171704388]
We introduce a refined U-Net-like model featuring a novel Global Axial Self-Attention (GASA) block.
This block processes image data as a 3D entity, with each 2D plane representing a different anatomical cross-section.
Our model has demonstrated promising improvements in segmentation performance, particularly for smaller anatomical structures.
arXiv Detail & Related papers (2024-09-20T01:23:53Z) - Anatomy-guided Pathology Segmentation [56.883822515800205]
We develop a generalist segmentation model that combines anatomical and pathological information, aiming to enhance the segmentation accuracy of pathological features.
Our Anatomy-Pathology Exchange (APEx) training utilizes a query-based segmentation transformer which decodes a joint feature space into query-representations for human anatomy.
In doing so, we are able to report the best results across the board on FDG-PET-CT and Chest X-Ray pathology segmentation tasks with a margin of up to 3.3% as compared to strong baseline methods.
arXiv Detail & Related papers (2024-07-08T11:44:15Z) - Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
In this study, we first construct the brain-effective network via the dynamic causal model.
We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE)
This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
arXiv Detail & Related papers (2024-05-21T20:37:07Z) - Analyzing Regional Organization of the Human Hippocampus in 3D-PLI Using
Contrastive Learning and Geometric Unfolding [36.136619420474766]
3D polarized light imaging (3D-PLI) is an imaging modality for visualizing fiber architecture in postmortem brains with high resolution.
The rich texture in 3D-PLI images makes this modality particularly difficult to analyze and best practices for characterizing architectonic patterns still need to be established.
In this work, we demonstrate a novel method to analyze the regional organization of the human hippocampus in 3D-PLI.
arXiv Detail & Related papers (2024-02-27T18:25:16Z) - A Hierarchical Training Paradigm for Antibody Structure-sequence
Co-design [54.30457372514873]
We propose a hierarchical training paradigm (HTP) for the antibody sequence-structure co-design.
HTP consists of four levels of training stages, each corresponding to a specific protein modality.
Empirical experiments show that HTP sets the new state-of-the-art performance in the co-design problem.
arXiv Detail & Related papers (2023-10-30T02:39:15Z) - Enforcing 3D Topological Constraints in Composite Objects via Implicit Functions [60.56741715207466]
Medical applications often require accurate 3D representations of complex organs with multiple parts, such as the heart and spine.
This paper introduces a novel approach to enforce topological constraints in 3D object reconstruction using deep implicit signed distance functions.
We propose a sampling-based technique that effectively checks and enforces topological constraints between 3D shapes by evaluating signed distances at randomly sampled points throughout the volume.
arXiv Detail & Related papers (2023-07-16T10:07:15Z) - Unsupervised ensemble-based phenotyping helps enhance the
discoverability of genes related to heart morphology [57.25098075813054]
We propose a new framework for gene discovery entitled Un Phenotype Ensembles.
It builds a redundant yet highly expressive representation by pooling a set of phenotypes learned in an unsupervised manner.
These phenotypes are then analyzed via (GWAS), retaining only highly confident and stable associations.
arXiv Detail & Related papers (2023-01-07T18:36:44Z) - UNesT: Local Spatial Representation Learning with Hierarchical
Transformer for Efficient Medical Segmentation [29.287521185541298]
We show that UNesT consistently achieves state-of-the-art performance and evaluate its generalizability and data efficiency.
We show that UNesT consistently achieves state-of-the-art performance and evaluate its generalizability and data efficiency.
arXiv Detail & Related papers (2022-09-28T19:14:38Z) - Unified Embeddings of Structural and Functional Connectome via a
Function-Constrained Structural Graph Variational Auto-Encoder [2.8719792727222364]
We propose a function-constrained structural graph variational autoencoder capable of incorporating information from both functional and structural connectomes in an unsupervised fashion.
This leads to a joint low-dimensional embedding that establishes a unified spatial coordinate system for comparing across different subjects.
arXiv Detail & Related papers (2022-07-05T21:39:13Z) - Brain Cortical Functional Gradients Predict Cortical Folding Patterns
via Attention Mesh Convolution [51.333918985340425]
We develop a novel attention mesh convolution model to predict cortical gyro-sulcal segmentation maps on individual brains.
Experiments show that the prediction performance via our model outperforms other state-of-the-art models.
arXiv Detail & Related papers (2022-05-21T14:08:53Z) - Spatio-Temporal Representation Factorization for Video-based Person
Re-Identification [55.01276167336187]
We propose Spatio-Temporal Representation Factorization module (STRF) for re-ID.
STRF is a flexible new computational unit that can be used in conjunction with most existing 3D convolutional neural network architectures for re-ID.
We empirically show that STRF improves performance of various existing baseline architectures while demonstrating new state-of-the-art results.
arXiv Detail & Related papers (2021-07-25T19:29:37Z) - 2D histology meets 3D topology: Cytoarchitectonic brain mapping with
Graph Neural Networks [0.8602553195689513]
Cytoarchitecture describes the spatial organization of neuronal cells in the brain.
It allows to segregate the brain into cortical areas and subcortical nuclei.
mapping boundaries between areas requires to scan histological sections at microscopic resolution.
arXiv Detail & Related papers (2021-03-09T07:09:42Z) - TSGCNet: Discriminative Geometric Feature Learning with Two-Stream
GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes.
We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
arXiv Detail & Related papers (2020-12-26T08:02:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.