Joint Imaging-ROI Representation Learning via Cross-View Contrastive Alignment for Brain Disorder Classification

• URL: http://arxiv.org/abs/2603.10253v1
• Date: Tue, 10 Mar 2026 22:14:53 GMT
• Title: Joint Imaging-ROI Representation Learning via Cross-View Contrastive Alignment for Brain Disorder Classification
• Abstract summary: We propose a unified cross-view contrastive framework for joint imaging-ROI representation learning.<n>Our method learns subject-level global (imaging) and local (ROI-graph) embeddings and aligns them in a shared latent space.<n>Experiments on the ADHD-200 and ABIDE datasets demonstrate that joint learning consistently improves classification performance.
• Score: 13.749675574071873
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Brain imaging classification is commonly approached from two perspectives: modeling the full image volume to capture global anatomical context, or constructing ROI-based graphs to encode localized and topological interactions. Although both representations have demonstrated independent efficacy, their relative contributions and potential complementarity remain insufficiently understood. Existing fusion approaches are typically task-specific and do not enable controlled evaluation of each representation under consistent training settings. To address this gap, we propose a unified cross-view contrastive framework for joint imaging-ROI representation learning. Our method learns subject-level global (imaging) and local (ROI-graph) embeddings and aligns them in a shared latent space using a bidirectional contrastive objective, encouraging representations from the same subject to converge while separating those from different subjects. This alignment produces comparable embeddings suitable for downstream fusion and enables systematic evaluation of imaging-only, ROI-only, and joint configurations within a unified training protocol. Extensive experiments on the ADHD-200 and ABIDE datasets demonstrate that joint learning consistently improves classification performance over either branch alone across multiple backbone choices. Moreover, interpretability analyses reveal that imaging-based and ROI-based branches emphasize distinct yet complementary discriminative patterns, explaining the observed performance gains. These findings provide principled evidence that explicitly integrating global volumetric and ROI-level representations is a promising direction for neuroimaging-based brain disorder classification. The source code is available at https://anonymous.4open.science/r/imaging-roi-contrastive-152C/.

Related papers

• M2LG-DG: A Multi-modal Local-Global Domain Generalization Framework for Cross-site Major Depressive Disorder Classification [14.96995835279229]
  We present M2LG-DG, a source-only multimodal local-global framework for cross-site major depressive disorder (MDD) classification.<n>The framework employs a dual-stream rs-fMRI encoder, where the global pathway models inter-regional dependencies through self-attention.<n>On four held-out REST-meta-MDD sites, M2LG-DG achieves an AUC of 69.48% and exceeds the closest comparison method by 2.18 percentage points.
  arXiv  Detail & Related papers  (2026-08-31T05:59:13Z)
• Cross-Modal Semantic-Enhanced Diffusion Framework for Diabetic Retinopathy Grading [7.923081487850825]
  We propose a vision-language model tailored for diabetic retinopathy (DR) grading as the semantic guidance module.<n>We construct a cross-modal semantic conditioning vector by computing the dot product between image features and the text description features of each DR grade.<n> Experiments on the APTOS 2019 dataset demonstrate that the proposed approach achieves an accuracy of 87.5% and a macro-averaged F1 score of 0.731, outperforming a variety of representative methods.
  arXiv  Detail & Related papers  (2026-05-10T00:58:17Z)
• Brain-IT: Image Reconstruction from fMRI via Brain-Interaction Transformer [6.890296061697977]
  "Brain-IT" is a brain-inspired approach to image reconstruction from fMRI brain recordings.<n>All model components are shared by all clusters & subjects, allowing efficient training with a limited amount of data.<n>With only 1-hour of fMRI data from a new subject, we achieve results comparable to current methods trained on full 40-hour recordings.
  arXiv  Detail & Related papers  (2025-10-29T21:21:54Z)
• Anatomical Structure-Guided Medical Vision-Language Pre-training [21.68719061251635]
  We propose an Anatomical Structure-Guided (ASG) framework for learning medical visual representations. For anatomical region, we design an automatic anatomical region-sentence alignment paradigm in collaboration with radiologists. For finding and existence, we regard them as image tags, applying an image-tag recognition decoder to associate image features with their respective tags within each sample.
  arXiv  Detail & Related papers  (2024-03-14T11:29:47Z)
• Symmetrical Bidirectional Knowledge Alignment for Zero-Shot Sketch-Based Image Retrieval [69.46139774646308]
  This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR) It aims to use sketches from unseen categories as queries to match the images of the same category. We propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA)
  arXiv  Detail & Related papers  (2023-12-16T04:50:34Z)
• A2V: A Semi-Supervised Domain Adaptation Framework for Brain Vessel Segmentation via Two-Phase Training Angiography-to-Venography Translation [4.452428104996953]
  We present a semi-supervised domain adaptation framework for brain vessel segmentation from different image modalities. By relying on annotated angiographies and a limited number of annotated venographies, our framework accomplishes image-to-image translation and semantic segmentation.
  arXiv  Detail & Related papers  (2023-09-12T09:12:37Z)
• Stain based contrastive co-training for histopathological image analysis [61.87751502143719]
  We propose a novel semi-supervised learning approach for classification of histovolution images. We employ strong supervision with patch-level annotations combined with a novel co-training loss to create a semi-supervised learning framework. We evaluate our approach in clear cell renal cell and prostate carcinomas, and demonstrate improvement over state-of-the-art semi-supervised learning methods.
  arXiv  Detail & Related papers  (2022-06-24T22:25:31Z)
• ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification [11.680355561258427]
  High-resolution images hinder progress in digital pathology. patch-based processing often incorporates multiple instance learning (MIL) to aggregate local patch-level representations yielding image-level prediction. This paper proposes a transformer-based architecture specifically tailored for histological image classification. It combines fine-grained local attention with a coarse global attention mechanism to learn meaningful representations of high-resolution images at an efficient computational cost.
  arXiv  Detail & Related papers  (2022-02-15T16:55:09Z)
• Few-shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding [60.89561661441736]
  We propose a novel method for few-shot medical image segmentation. We construct our few-shot image segmentor using a deep convolutional network trained episodically. We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
  arXiv  Detail & Related papers  (2020-12-10T04:01:07Z)
• Gradient-Induced Co-Saliency Detection [81.54194063218216]
  Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection method.
  arXiv  Detail & Related papers  (2020-04-28T08:40:55Z)
• High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification [84.43394420267794]
  We propose a novel framework by learning high-order relation and topology information for discriminative features and robust alignment. Our framework significantly outperforms state-of-the-art by6.5%mAP scores on Occluded-Duke dataset.
  arXiv  Detail & Related papers  (2020-03-18T12:18:35Z)
• Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation [73.84166499988443]
  We present a novel unsupervised domain adaptation framework, named as Synergistic Image and Feature Alignment (SIFA) Our proposed SIFA conducts synergistic alignment of domains from both image and feature perspectives. Experimental results on two different tasks demonstrate that our SIFA method is effective in improving segmentation performance on unlabeled target images.
  arXiv  Detail & Related papers  (2020-02-06T13:49:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.