Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures

• URL: http://arxiv.org/abs/2604.05215v1
• Date: Mon, 06 Apr 2026 22:27:36 GMT
• Title: Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures
• Abstract summary: We introduce a hierarchical transformer framework for heterogeneous mesh analysis.<n>A feature projection module maps variable-length per-vertex clinical descriptors into the spatial hierarchy.<n>We validate our approach on Alzheimer's disease classification and amyloid burden prediction using volumetric brain meshes from ADNI, as well as focal cortical dysplasia detection on cortical surface meshes from the MELD dataset.
• Score: 7.663406601980095
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Representation learning on large-scale unstructured volumetric and surface meshes poses significant challenges in neuroimaging, especially when models must incorporate diverse vertex-level morphometric descriptors, such as cortical thickness, curvature, sulcal depth, and myelin content, which carry subtle disease-related signals. Current approaches either ignore these clinically informative features or support only a single mesh topology, restricting their use across imaging pipelines. We introduce a hierarchical transformer framework designed for heterogeneous mesh analysis that operates on spatially adaptive tree partitions constructed from simplicial complexes of arbitrary order. This design accommodates both volumetric and surface discretizations within a single architecture, enabling efficient multi-scale attention without topology-specific modifications. A feature projection module maps variable-length per-vertex clinical descriptors into the spatial hierarchy, separating geometric structure from feature dimensionality and allowing seamless integration of different neuroimaging feature sets. Self-supervised pretraining via masked reconstruction of both coordinates and morphometric channels on large unlabeled cohorts yields a transferable encoder backbone applicable to diverse downstream tasks and mesh modalities. We validate our approach on Alzheimer's disease classification and amyloid burden prediction using volumetric brain meshes from ADNI, as well as focal cortical dysplasia detection on cortical surface meshes from the MELD dataset, achieving state-of-the-art results across all benchmarks.

Related papers

• MRI-based Deep Radiomic Phenotyping of Neuromuscular Disorders: A Topology-driven Characterization [0.37341173401157257]
  This study introduces an automated radiomic phenotyping framework based on original features engineered across five main architectural domains.<n>We map the complex 3D architecture of heterogeneous intramuscular lipodegeneration into objective, morphologically interpretable biomarkers.
  arXiv  Detail & Related papers  (2026-08-25T11:30:17Z)
• Spatial Normalization for Cross-Domain Retinal Layer Segmentation in Optical Coherence Tomography [0.4497001527881303]
  We introduce a fovea-centered normalization framework that aligns OCT volumes into a common anatomical reference.<n>To provide a comprehensive assessment of segmentation quality, we combine conventional overlap-based metrics at B-scan level with topology-aware metrics at A-scan level and thickness-based measures at the en-face level.
  arXiv  Detail & Related papers  (2026-07-17T15:47:18Z)
• From Raw Segmentations to Simulation-Ready Cardiac Meshes: An Automated Framework for Anatomical Reconstruction and Virtual Cohort Generation [40.52388056968461]
  We present a semi-automatic pipeline that converts CT-based segmentations into simulation-ready cardiac meshes.<n>A Chamfer-distance morphing strategy deforms a high-quality template toward each segmented heart, matching individual chambers while preserving topology.<n>The pipeline is validated on 58 healthy cardiac CT scans, including all cardiac chambers and proximal vessel segments.
  arXiv  Detail & Related papers  (2026-06-29T09:07:05Z)
• PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images [51.428093790826814]
  We propose pathology Autorgressive modeling (PathAR) to factorize structure and appearance for modality-label-conditioned pathology generation.<n>PathAR stabilizes morphology under heterogeneous modality-specific appearances and enables spatially aligned image-mask pair generation.
  arXiv  Detail & Related papers  (2026-06-01T01:43:48Z)
• Geometry-Aware State Space Model: A New Paradigm for Whole-Slide Image Representation [8.483387656208363]
  Whole-slide images (WSIs) digitize tissue specimens at gigapixel resolution.<n>Current methods implicitly embed patch representations in homogeneous Euclidean spaces.<n>We introduce a hybrid hyperbolic-Euclidean representation that embeds WSI features in dual geometric spaces.
  arXiv  Detail & Related papers  (2026-05-06T17:33:30Z)
• Augmented Equivariant Mesh Networks for Anatomical Segmentation [0.0]
  Anatomical mesh segmentation requires models that operate directly on irregular surface geometry.<n>Existing task-specific mesh and point-cloud methods are not equivariant, and can degrade sharply under test-time perturbation.<n>We present EAMS, an Equivariant Anatomical Mesh Segmentor built on Equivariant Mesh Neural Networks (EMNN)
  arXiv  Detail & Related papers  (2026-05-04T23:54:07Z)
• Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers [57.54843029965778]
  Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail.<n>We propose In-Context Diffusion Transformer (IC-DiT), a layout-aware generative model that incorporates spatial layouts, textual descriptions, and visual embeddings into a unified diffusion transformer.<n>IC-DiT achieves higher fidelity, stronger spatial controllability, and better diagnostic consistency than existing methods.
  arXiv  Detail & Related papers  (2026-03-11T06:14:11Z)
• High-Fidelity Medical Shape Generation via Skeletal Latent Diffusion [10.218375997417917]
  We propose a skeletal latent diffusion framework for efficient and high-fidelity medical shape generation.<n>New shapes are generated via a latent-space diffusion model, followed by neural implicit decoding and mesh extraction.<n>Experiments on MedSDF and vessel datasets demonstrate that the proposed method achieves superior reconstruction and generation quality.
  arXiv  Detail & Related papers  (2026-03-08T07:18:27Z)
• GROVER: Graph-guided Representation of Omics and Vision with Expert Regulation for Adaptive Spatial Multi-omics Fusion [8.680469644745463]
  We propose Graph-guided Representation of Omics and Vision with Expert Regulation for Adaptive Spatial Multi-omics Fusion.<n> GROVER is a novel framework for adaptive integration of spatial multi-omics data.<n>We show that GROVER outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-11-13T06:20:37Z)
• Local properties of neural networks through the lens of layer-wise Hessians [45.88028371034407]
  We introduce a methodology for analyzing neural networks through the lens of layer-wise Hessian matrices.<n>The concept provides a formal tool for characterizing the local geometry of the parameter space.
  arXiv  Detail & Related papers  (2025-10-20T12:34:31Z)
• SPD Learning for Covariance-Based Neuroimaging Analysis: Perspectives, Methods, and Challenges [41.955864444491965]
  Neuroimaging provides a critical framework for characterizing brain activity by quantifying connectivity patterns and functional architecture across modalities.<n>Modern machine learning has significantly advanced our understanding of neural processing mechanisms through these datasets.<n>This review focuses on machine learning approaches for covariance-based neuroimaging data, where often symmetric positive definite (SPD) matrices under full-rank conditions encode inter-channel relationships.
  arXiv  Detail & Related papers  (2025-04-26T10:05:04Z)
• Mesh Denoising Transformer [104.5404564075393]
  Mesh denoising is aimed at removing noise from input meshes while preserving their feature structures. SurfaceFormer is a pioneering Transformer-based mesh denoising framework. New representation known as Local Surface Descriptor captures local geometric intricacies. Denoising Transformer module receives the multimodal information and achieves efficient global feature aggregation.
  arXiv  Detail & Related papers  (2024-05-10T15:27:43Z)
• Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentation [48.267001230607306]
  We propose a pretraining framework that enhances multiscale consistency in EM volumes. Our approach leverages a Siamese network architecture, integrating strong and weak data augmentations. It effectively captures voxel and feature consistency, showing promise for learning transferable representations for EM analysis.
  arXiv  Detail & Related papers  (2023-08-19T05:49:13Z)
• Abdominal organ segmentation via deep diffeomorphic mesh deformations [5.4173776411667935]
  Abdominal organ segmentation from CT and MRI is an essential prerequisite for surgical planning and computer-aided navigation systems. We employ template-based mesh reconstruction methods for joint liver, kidney, pancreas, and spleen segmentation. The resulting method, UNetFlow, generalizes well to all four organs and can be easily fine-tuned on new data.
  arXiv  Detail & Related papers  (2023-06-27T14:41:18Z)
• Affinity Feature Strengthening for Accurate, Complete and Robust Vessel Segmentation [48.638327652506284]
  Vessel segmentation is crucial in many medical image applications, such as detecting coronary stenoses, retinal vessel diseases and brain aneurysms. We present a novel approach, the affinity feature strengthening network (AFN), which jointly models geometry and refines pixel-wise segmentation features using a contrast-insensitive, multiscale affinity approach.
  arXiv  Detail & Related papers  (2022-11-12T05:39:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.