An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation

• URL: http://arxiv.org/abs/2308.13415v1
• Date: Fri, 25 Aug 2023 14:55:38 GMT
• Title: An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation
• Authors: Tiarna Lee, Esther Puyol-Ant\'on, Bram Ruijsink, Keana Aitcheson, Miaojing Shi, Andrew P. King
• Abstract summary: We investigate how imbalances in subject sex and race affect AI-based cine cardiac magnetic resonance image segmentation. We find significant sex bias in three of the four models and racial bias in all of the models.
• Score: 8.449342469976758
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In medical imaging, artificial intelligence (AI) is increasingly being used to automate routine tasks. However, these algorithms can exhibit and exacerbate biases which lead to disparate performances between protected groups. We investigate the impact of model choice on how imbalances in subject sex and race in training datasets affect AI-based cine cardiac magnetic resonance image segmentation. We evaluate three convolutional neural network-based models and one vision transformer model. We find significant sex bias in three of the four models and racial bias in all of the models. However, the severity and nature of the bias varies between the models, highlighting the importance of model choice when attempting to train fair AI-based segmentation models for medical imaging tasks.

Related papers

• Dataset Distribution Impacts Model Fairness: Single vs. Multi-Task Learning [2.9530211066840417]
  We evaluate the performance of skin lesion classification using ResNet-based CNNs. We present a linear programming method for generating datasets with varying patient sex and class labels.
  arXiv  Detail & Related papers  (2024-07-24T15:23:26Z)
• Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging [2.0890189482817165]
  We introduce a novel analysis framework for investigating the impact of biases in medical images on AI models. We developed and tested this framework for conducting controlled in silico trials to assess bias in medical imaging AI.
  arXiv  Detail & Related papers  (2023-11-03T01:37:28Z)
• Fast Model Debias with Machine Unlearning [54.32026474971696]
  Deep neural networks might behave in a biased manner in many real-world scenarios. Existing debiasing methods suffer from high costs in bias labeling or model re-training. We propose a fast model debiasing framework (FMD) which offers an efficient approach to identify, evaluate and remove biases.
  arXiv  Detail & Related papers  (2023-10-19T08:10:57Z)
• Studying the Effects of Sex-related Differences on Brain Age Prediction using brain MR Imaging [0.3958317527488534]
  We study biases related to sex when developing a machine learning model based on brain magnetic resonance images (MRI) We investigate the effects of sex by performing brain age prediction considering different experimental designs. We found disparities in the performance of brain age prediction models when trained on distinct sex subgroups and datasets.
  arXiv  Detail & Related papers  (2023-10-17T20:55:53Z)
• The effect of data augmentation and 3D-CNN depth on Alzheimer's Disease detection [51.697248252191265]
  This work summarizes and strictly observes best practices regarding data handling, experimental design, and model evaluation. We focus on Alzheimer's Disease (AD) detection, which serves as a paradigmatic example of challenging problem in healthcare. Within this framework, we train predictive 15 models, considering three different data augmentation strategies and five distinct 3D CNN architectures.
  arXiv  Detail & Related papers  (2023-09-13T10:40:41Z)
• A systematic study of race and sex bias in CNN-based cardiac MR segmentation [6.507372382471608]
  We present the first systematic study of the impact of training set imbalance on race and sex bias in CNN-based segmentation. We focus on segmentation of the structures of the heart from short axis cine cardiac magnetic resonance images, and train multiple CNN segmentation models with different levels of race/sex imbalance. We find no significant bias in the sex experiment but significant bias in two separate race experiments, highlighting the need to consider adequate representation of different demographic groups in health datasets.
  arXiv  Detail & Related papers  (2022-09-04T14:32:00Z)
• Feature robustness and sex differences in medical imaging: a case study in MRI-based Alzheimer's disease detection [1.7616042687330637]
  We compare two classification schemes on the ADNI MRI dataset. We do not find a strong dependence of model performance for male and female test subjects on the sex composition of the training dataset.
  arXiv  Detail & Related papers  (2022-04-04T17:37:54Z)
• Analyzing the Effects of Handling Data Imbalance on Learned Features from Medical Images by Looking Into the Models [50.537859423741644]
  Training a model on an imbalanced dataset can introduce unique challenges to the learning problem. We look deeper into the internal units of neural networks to observe how handling data imbalance affects the learned features.
  arXiv  Detail & Related papers  (2022-04-04T09:38:38Z)
• What Do You See in this Patient? Behavioral Testing of Clinical NLP Models [69.09570726777817]
  We introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. We show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.
  arXiv  Detail & Related papers  (2021-11-30T15:52:04Z)
• Adversarial Sample Enhanced Domain Adaptation: A Case Study on Predictive Modeling with Electronic Health Records [57.75125067744978]
  We propose a data augmentation method to facilitate domain adaptation. adversarially generated samples are used during domain adaptation. Results confirm the effectiveness of our method and the generality on different tasks.
  arXiv  Detail & Related papers  (2021-01-13T03:20:20Z)
• Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
  Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
  arXiv  Detail & Related papers  (2020-06-11T17:29:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.