Analysing race and sex bias in brain age prediction

• URL: http://arxiv.org/abs/2309.10835v1
• Date: Tue, 19 Sep 2023 14:40:19 GMT
• Title: Analysing race and sex bias in brain age prediction
• Authors: Carolina Pi\c{c}arra and Ben Glocker
• Abstract summary: We analyse the commonly used ResNet-34 model by conducting a subgroup performance analysis and feature inspection. Our results reveal statistically significant differences in predictive performance between Black and White, Black and Asian, and male and female subjects.
• Score: 18.68533487971233
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Brain age prediction from MRI has become a popular imaging biomarker associated with a wide range of neuropathologies. The datasets used for training, however, are often skewed and imbalanced regarding demographics, potentially making brain age prediction models susceptible to bias. We analyse the commonly used ResNet-34 model by conducting a comprehensive subgroup performance analysis and feature inspection. The model is trained on 1,215 T1-weighted MRI scans from Cam-CAN and IXI, and tested on UK Biobank (n=42,786), split into six racial and biological sex subgroups. With the objective of comparing the performance between subgroups, measured by the absolute prediction error, we use a Kruskal-Wallis test followed by two post-hoc Conover-Iman tests to inspect bias across race and biological sex. To examine biases in the generated features, we use PCA for dimensionality reduction and employ two-sample Kolmogorov-Smirnov tests to identify distribution shifts among subgroups. Our results reveal statistically significant differences in predictive performance between Black and White, Black and Asian, and male and female subjects. Seven out of twelve pairwise comparisons show statistically significant differences in the feature distributions. Our findings call for further analysis of brain age prediction models.

Related papers

• A Demographic-Conditioned Variational Autoencoder for fMRI Distribution Sampling and Removal of Confounds [49.34500499203579]
  We create a variational autoencoder (VAE)-based model, DemoVAE, to decorrelate fMRI features from demographics. We generate high-quality synthetic fMRI data based on user-supplied demographics.
  arXiv  Detail & Related papers  (2024-05-13T17:49:20Z)
• Using Pre-training and Interaction Modeling for ancestry-specific disease prediction in UK Biobank [69.90493129893112]
  Recent genome-wide association studies (GWAS) have uncovered the genetic basis of complex traits, but show an under-representation of non-European descent individuals. Here, we assess whether we can improve disease prediction across diverse ancestries using multiomic data.
  arXiv  Detail & Related papers  (2024-04-26T16:39:50Z)
• Studying the Effects of Sex-related Differences on Brain Age Prediction using brain MR Imaging [0.3958317527488534]
  We study biases related to sex when developing a machine learning model based on brain magnetic resonance images (MRI) We investigate the effects of sex by performing brain age prediction considering different experimental designs. We found disparities in the performance of brain age prediction models when trained on distinct sex subgroups and datasets.
  arXiv  Detail & Related papers  (2023-10-17T20:55:53Z)
• Adapting Machine Learning Diagnostic Models to New Populations Using a Small Amount of Data: Results from Clinical Neuroscience [21.420302408947194]
  We develop a weighted empirical risk minimization approach that optimally combines data from a source group to make predictions on a target group. We apply this method to multi-source data of 15,363 individuals from 20 neuroimaging studies to build ML models for diagnosis of Alzheimer's disease and estimation of brain age.
  arXiv  Detail & Related papers  (2023-08-06T18:05:39Z)
• Risk of Bias in Chest Radiography Deep Learning Foundation Models [14.962566915809264]
  This study used 127,118 chest radiographs from 42,884 patients (mean age, 63 [SD] 17 years; 23,623 male, 19,261 female) from the CheXpert dataset collected between October 2002 and July 2017. Ten out of twelve pairwise comparisons across biological sex and race showed statistically significant differences in the studied foundation model. Significant differences were found between male and female (P .001) and Asian and Black patients (P .001) in the feature projections that primarily capture disease.
  arXiv  Detail & Related papers  (2022-09-07T07:16:30Z)
• Deep Learning Discovery of Demographic Biomarkers in Echocardiography [0.3957768262206625]
  We test whether it is possible to predict age, race, and sex from cardiac ultrasound images using deep learning algorithms. We trained video-based convolutional neural networks to predict age, sex, and race. We found that deep learning models were able to identify age and sex, while unable to reliably predict race.
  arXiv  Detail & Related papers  (2022-07-13T16:48:49Z)
• Machine Learning Models Are Not Necessarily Biased When Constructed Properly: Evidence from Neuroimaging Studies [19.288217559980545]
  We provide experimental data which support that when properly trained, machine learning models can generalize well across diverse conditions. Specifically, by using multi-study magnetic resonance imaging consortia for diagnosing Alzheimer's disease, schizophrenia, and autism spectrum disorder, we find that, the accuracy of well-trained models is consistent across different subgroups.
  arXiv  Detail & Related papers  (2022-05-26T15:24:39Z)
• rfPhen2Gen: A machine learning based association study of brain imaging phenotypes to genotypes [71.1144397510333]
  We learned machine learning models to predict SNPs using 56 brain imaging QTs. SNPs within the known Alzheimer disease (AD) risk gene APOE had lowest RMSE for lasso and random forest. Random forests identified additional SNPs that were not prioritized by the linear models but are known to be associated with brain-related disorders.
  arXiv  Detail & Related papers  (2022-03-31T20:15:22Z)
• LOGAN: Local Group Bias Detection by Clustering [86.38331353310114]
  We argue that evaluating bias at the corpus level is not enough for understanding how biases are embedded in a model. We propose LOGAN, a new bias detection technique based on clustering. Experiments on toxicity classification and object classification tasks show that LOGAN identifies bias in a local region.
  arXiv  Detail & Related papers  (2020-10-06T16:42:51Z)
• Patch-based Brain Age Estimation from MR Images [64.66978138243083]
  Brain age estimation from Magnetic Resonance Images (MRI) derives the difference between a subject's biological brain age and their chronological age. Early detection of neurodegeneration manifesting as a higher brain age can potentially facilitate better medical care and planning for affected individuals. We develop a new deep learning approach that uses 3D patches of the brain as well as convolutional neural networks (CNNs) to develop a localised brain age estimator.
  arXiv  Detail & Related papers  (2020-08-29T11:50:37Z)
• InsideBias: Measuring Bias in Deep Networks and Application to Face Gender Biometrics [73.85525896663371]
  This work explores the biases in learning processes based on deep neural network architectures. We employ two gender detection models based on popular deep neural networks. We propose InsideBias, a novel method to detect biased models.
  arXiv  Detail & Related papers  (2020-04-14T15:20:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.