Benchmarking External Generalization of SPD Matrix Learning for Resting-State fMRI Connectome Prediction

• URL: http://arxiv.org/abs/2608.30418v1
• Date: Mon, 31 Aug 2026 08:15:08 GMT
• Title: Benchmarking External Generalization of SPD Matrix Learning for Resting-State fMRI Connectome Prediction
• Abstract summary: We ask whether within-dataset performance remains when the test data come from an entirely held-out rs-fMRI dataset.<n>We introduce a reproducible age-prediction benchmark across six rs-fMRI datasets.
• Score: 35.50001465263556
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Resting-state functional magnetic resonance imaging (rs-fMRI) functional connectivity (FC) matrices are widely used for individual-level prediction, but strong performance within one cohort may not generalize to a new cohort. We ask whether within-dataset performance remains when the test data come from an entirely held-out rs-fMRI dataset. Each scan is represented as a regularized symmetric positive definite (SPD) correlation connectome, which allows methods to use the geometry of the SPD manifold. We introduce a reproducible age-prediction benchmark across six rs-fMRI datasets: COBRE, ADNIDOD, Cam-CAN, ABIDE, OASIS-3, and ADNI. The benchmark compares a vectorized correlation baseline, Tangent-Space Ridge, SPDNet, and split-wise Riemannian harmonization under within-dataset GroupKFold, pooled GroupKFold, and leave-one-dataset-out (LODO) evaluation. Within-dataset and pooled GroupKFold results are substantially more favorable than LODO results. When an entire dataset is held out, prediction error increases, differences among methods narrow, and performance is strongly affected by age-range mismatch and cohort heterogeneity. The benchmark provides common inputs, model settings, data splits, and analysis scripts so that future SPD matrix learning methods can be evaluated under the same external-validation protocol.

Related papers

• Enhancing Automated Machine Learning via Homogeneous Train-Test Splitting Methods [0.0]
  This paper investigates the role of statistical similarity in train-test splitting and its consequences for AutoML model evaluation.<n>Similarity is assessed using chi-square, Kolmogorov-Smirnov, and Maximum Mean Discrepancy (MMD) tests.<n>The proposed Optimised-Distribution method treats similarity as an explicit optimisation objective and achieves the highest mean MMD similarity, 89.0%, across all strategies evaluated.
  arXiv  Detail & Related papers  (2026-07-29T08:53:11Z)
• Dataset-Origin Signatures and Shortcut Learning in Screening Mammography AI: A Cross-Dataset Case Study [0.0]
  We examined whether supplementing such data with biopsy-confirmed cases from abnormal-enriched external datasets improves performance.<n>We evaluated an EfficientNet-B5 encoder with Mammo-CLIP weights as a frozen linear probe under consistent preprocessing.
  arXiv  Detail & Related papers  (2026-07-16T19:41:48Z)
• Refnd: Preventing Data Leakage in Relational Datasets [3.5410731310203]
  Refnd is a splitting algorithm that leverages a proximity graph computed in log time using Navigable Navi Small World (HNSW)<n>We validate on an antimicrobial peptide dataset, showing that Refnd splits yield lower but more realistic evaluation than traditional splits.
  arXiv  Detail & Related papers  (2026-06-30T19:53:33Z)
• idSCD: Identifying Training Datasets through Semantic Correlation Descriptors [5.756453494739546]
  We argue that datasets leave dataset-specific traces in a model's learned semantic correlation structure.<n>We introduce a white-box semantic fingerprinting approach based on semantic correlation descriptors (SCDs)<n>We propose a practical SCD-based membership score that tests whether a target dataset is part of a model's training mixture.
  arXiv  Detail & Related papers  (2026-05-28T18:38:15Z)
• Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback [56.69850045068714]
  We introduce textitInfluence-Guided Regression (IGSR), a method that frames equation discovery as an iterative two-step process.<n>We demonstrate IGSRs effectiveness on a diverse suite of benchmarks, including LLM-SRBench, pharmacological PKPD models, an epidemiological simulation, and real-world genomic data.
  arXiv  Detail & Related papers  (2026-05-27T23:48:01Z)
• Weakly supervised covariance matrices alignment through Stiefel matrices estimation for MEG applications [64.20396555814513]
  This paper introduces a novel domain adaptation technique for time series data, called Mixing model Stiefel Adaptation (MSA) We exploit abundant unlabeled data in the target domain to ensure effective prediction by establishing pairwise correspondence with equivalent signal variances between domains. MSA outperforms recent methods in brain-age regression with task variations using magnetoencephalography (MEG) signals from the Cam-CAN dataset.
  arXiv  Detail & Related papers  (2024-01-24T19:04:49Z)
• Source-Free Collaborative Domain Adaptation via Multi-Perspective Feature Enrichment for Functional MRI Analysis [55.03872260158717]
  Resting-state MRI functional (rs-fMRI) is increasingly employed in multi-site research to aid neurological disorder analysis. Many methods have been proposed to reduce fMRI heterogeneity between source and target domains. But acquiring source data is challenging due to concerns and/or data storage burdens in multi-site studies. We design a source-free collaborative domain adaptation framework for fMRI analysis, where only a pretrained source model and unlabeled target data are accessible.
  arXiv  Detail & Related papers  (2023-08-24T01:30:18Z)
• Better May Not Be Fairer: A Study on Subgroup Discrepancy in Image Classification [73.87160347728314]
  We investigate how natural background colors play a role as spurious features by annotating the test sets of CIFAR10 and CIFAR100 into subgroups based on the background color of each image. We find that overall human-level accuracy does not guarantee consistent subgroup performances, and the phenomenon remains even on models pre-trained on ImageNet or after data augmentation (DA) Experimental results show that FlowAug achieves more consistent subgroup results than other types of DA methods on CIFAR10/100 and on CIFAR10/100-C.
  arXiv  Detail & Related papers  (2022-12-16T18:51:10Z)
• Graph-Regularized Manifold-Aware Conditional Wasserstein GAN for Brain Functional Connectivity Generation [13.009230460620369]
  We propose a graph-regularized conditional Wasserstein GAN (GR-SPD-GAN) for FC data generation on the SPD manifold. The GR-SPD-GAN clearly outperforms several state-of-the-art GANs in generating more realistic fMRI-based FC samples.
  arXiv  Detail & Related papers  (2022-12-10T14:51:44Z)
• Autoregressive Score Matching [113.4502004812927]
  We propose autoregressive conditional score models (AR-CSM) where we parameterize the joint distribution in terms of the derivatives of univariable log-conditionals (scores) For AR-CSM models, this divergence between data and model distributions can be computed and optimized efficiently, requiring no expensive sampling or adversarial training. We show with extensive experimental results that it can be applied to density estimation on synthetic data, image generation, image denoising, and training latent variable models with implicit encoders.
  arXiv  Detail & Related papers  (2020-10-24T07:01:24Z)
• New advances in enumerative biclustering algorithms with online partitioning [80.22629846165306]
  This paper further extends RIn-Close_CVC, a biclustering algorithm capable of performing an efficient, complete, correct and non-redundant enumeration of maximal biclusters with constant values on columns in numerical datasets. The improved algorithm is called RIn-Close_CVC3, keeps those attractive properties of RIn-Close_CVC, and is characterized by: a drastic reduction in memory usage; a consistent gain in runtime.
  arXiv  Detail & Related papers  (2020-03-07T14:54:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.