Potential sources of dataset bias complicate investigation of underdiagnosis by machine learning algorithms

• URL: http://arxiv.org/abs/2201.07856v2
• Date: Thu, 6 Jul 2023 06:01:08 GMT
• Title: Potential sources of dataset bias complicate investigation of underdiagnosis by machine learning algorithms
• Authors: M\'elanie Bernhardt, Charles Jones, Ben Glocker
• Abstract summary: Seyyed-Kalantari et al. find that models trained on three chest X-ray datasets yield disparities in false-positive rates. The study concludes that the models exhibit and potentially even amplify systematic underdiagnosis.
• Score: 20.50071537200745
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: An increasing number of reports raise concerns about the risk that machine learning algorithms could amplify health disparities due to biases embedded in the training data. Seyyed-Kalantari et al. find that models trained on three chest X-ray datasets yield disparities in false-positive rates (FPR) across subgroups on the 'no-finding' label (indicating the absence of disease). The models consistently yield higher FPR on subgroups known to be historically underserved, and the study concludes that the models exhibit and potentially even amplify systematic underdiagnosis. We argue that the experimental setup in the study is insufficient to study algorithmic underdiagnosis. In the absence of specific knowledge (or assumptions) about the extent and nature of the dataset bias, it is difficult to investigate model bias. Importantly, their use of test data exhibiting the same bias as the training data (due to random splitting) severely complicates the interpretation of the reported disparities.

Related papers

• Gaussian Copula Models for Nonignorable Missing Data Using Auxiliary Marginal Quantiles [2.867517731896504]
  We develop algorithms for estimation and imputation that are computationally efficient. We apply the model to analyze associations between lead exposure levels and end-of-grade test scores for 170,000 students in North Carolina.
  arXiv  Detail & Related papers  (2024-06-05T17:11:59Z)
• Few-shot learning for COVID-19 Chest X-Ray Classification with Imbalanced Data: An Inter vs. Intra Domain Study [49.5374512525016]
  Medical image datasets are essential for training models used in computer-aided diagnosis, treatment planning, and medical research. Some challenges are associated with these datasets, including variability in data distribution, data scarcity, and transfer learning issues when using models pre-trained from generic images. We propose a methodology based on Siamese neural networks in which a series of techniques are integrated to mitigate the effects of data scarcity and distribution imbalance.
  arXiv  Detail & Related papers  (2024-01-18T16:59:27Z)
• (Predictable) Performance Bias in Unsupervised Anomaly Detection [3.826262429926079]
  Unsupervised anomaly detection (UAD) models promise to aid in the crucial first step of disease detection. Our study quantified the disparate performance of UAD models against certain demographic subgroups.
  arXiv  Detail & Related papers  (2023-09-25T14:57:43Z)
• Analyzing the Effects of Handling Data Imbalance on Learned Features from Medical Images by Looking Into the Models [50.537859423741644]
  Training a model on an imbalanced dataset can introduce unique challenges to the learning problem. We look deeper into the internal units of neural networks to observe how handling data imbalance affects the learned features.
  arXiv  Detail & Related papers  (2022-04-04T09:38:38Z)
• Pseudo Bias-Balanced Learning for Debiased Chest X-ray Classification [57.53567756716656]
  We study the problem of developing debiased chest X-ray diagnosis models without knowing exactly the bias labels. We propose a novel algorithm, pseudo bias-balanced learning, which first captures and predicts per-sample bias labels. Our proposed method achieved consistent improvements over other state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-03-18T11:02:18Z)
• The pitfalls of using open data to develop deep learning solutions for COVID-19 detection in chest X-rays [64.02097860085202]
  Deep learning models have been developed to identify COVID-19 from chest X-rays. Results have been exceptional when training and testing on open-source data. Data analysis and model evaluations show that the popular open-source dataset COVIDx is not representative of the real clinical problem.
  arXiv  Detail & Related papers  (2021-09-14T10:59:11Z)
• On the diminishing return of labeling clinical reports [2.1431637042179683]
  We show that performant medical NLP models may be obtained with small amount of labeled data. We show quantitatively the effect of training data size on a fixed test set composed of two of the largest public chest x-ray radiology report datasets.
  arXiv  Detail & Related papers  (2020-10-27T19:51:04Z)
• Learning Invariant Feature Representation to Improve Generalization across Chest X-ray Datasets [55.06983249986729]
  We show that a deep learning model performing well when tested on the same dataset as training data starts to perform poorly when it is tested on a dataset from a different source. By employing an adversarial training strategy, we show that a network can be forced to learn a source-invariant representation.
  arXiv  Detail & Related papers  (2020-08-04T07:41:15Z)
• Deep Mining External Imperfect Data for Chest X-ray Disease Screening [57.40329813850719]
  We argue that incorporating an external CXR dataset leads to imperfect training data, which raises the challenges. We formulate the multi-label disease classification problem as weighted independent binary tasks according to the categories. Our framework simultaneously models and tackles the domain and label discrepancies, enabling superior knowledge mining ability.
  arXiv  Detail & Related papers  (2020-06-06T06:48:40Z)
• Detect and Correct Bias in Multi-Site Neuroimaging Datasets [2.750124853532831]
  We combine 35,320 magnetic resonance images of the brain from 17 studies to examine bias in neuroimaging. We take a closer look at confounding bias, which is often viewed as the main shortcoming in observational studies. We propose an extension of the recently introduced ComBat algorithm to control for global variation across image features.
  arXiv  Detail & Related papers  (2020-02-12T15:32:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.