Disparities in Dermatology AI: Assessments Using Diverse Clinical Images
- URL: http://arxiv.org/abs/2111.08006v1
- Date: Mon, 15 Nov 2021 07:04:58 GMT
- Title: Disparities in Dermatology AI: Assessments Using Diverse Clinical Images
- Authors: Roxana Daneshjou, Kailas Vodrahalli, Weixin Liang, Roberto A Novoa,
Melissa Jenkins, Veronica Rotemberg, Justin Ko, Susan M Swetter, Elizabeth E
Bailey, Olivier Gevaert, Pritam Mukherjee, Michelle Phung, Kiana Yekrang,
Bradley Fong, Rachna Sahasrabudhe, James Zou, Albert Chiou
- Abstract summary: We show that state-of-the-art dermatology AI models perform substantially worse on Diverse Dermatology Images dataset.
We find that dark skin tones and uncommon diseases, which are well represented in the DDI dataset, lead to performance drop-offs.
- Score: 9.767299882513825
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: More than 3 billion people lack access to care for skin disease. AI
diagnostic tools may aid in early skin cancer detection; however most models
have not been assessed on images of diverse skin tones or uncommon diseases. To
address this, we curated the Diverse Dermatology Images (DDI) dataset - the
first publicly available, pathologically confirmed images featuring diverse
skin tones. We show that state-of-the-art dermatology AI models perform
substantially worse on DDI, with ROC-AUC dropping 29-40 percent compared to the
models' original results. We find that dark skin tones and uncommon diseases,
which are well represented in the DDI dataset, lead to performance drop-offs.
Additionally, we show that state-of-the-art robust training methods cannot
correct for these biases without diverse training data. Our findings identify
important weaknesses and biases in dermatology AI that need to be addressed to
ensure reliable application to diverse patients and across all disease.
Related papers
- Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary
Task Integration [54.76511683427566]
This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information.
A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction.
The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
arXiv Detail & Related papers (2024-02-16T05:16:20Z) - DDI-CoCo: A Dataset For Understanding The Effect Of Color Contrast In
Machine-Assisted Skin Disease Detection [51.92255321684027]
We study the interaction between skin tone and color difference effects and suggest that color difference can be an additional reason behind model performance bias between skin tones.
Our work provides a complementary angle to dermatology AI for improving skin disease detection.
arXiv Detail & Related papers (2024-01-24T07:45:24Z) - Revamping AI Models in Dermatology: Overcoming Critical Challenges for
Enhanced Skin Lesion Diagnosis [8.430482797862926]
We present an All-In-One textbfHierarchical-textbfOut of Distribution-textbfClinical Triage model.
For a clinical image, our model generates three outputs: a hierarchical prediction, an alert for out-of-distribution images, and a recommendation for dermoscopy.
Our versatile model provides valuable decision support for lesion diagnosis and sets a promising precedent for medical AI applications.
arXiv Detail & Related papers (2023-11-02T06:08:49Z) - FEDD -- Fair, Efficient, and Diverse Diffusion-based Lesion Segmentation
and Malignancy Classification [2.076716889858164]
We introduce a Fair, Efficient, and Diverse Diffusion-based framework for skin lesion segmentation and malignancy classification.
We achieve an improvement in intersection over union of 0.18, 0.13, 0.06, and 0.07 while using only 5%, 10%, 15%, and 20% labeled samples, respectively.
Fedd trained on 10% of Diverse Dermatology Images demonstrates malignancy classification accuracy of 81%, 14% higher compared to the state-of-the-art.
arXiv Detail & Related papers (2023-07-21T15:42:01Z) - Skin Lesion Diagnosis Using Convolutional Neural Networks [0.30458514384586394]
This project aims to address the issue by collecting state-of-the-art techniques for image classification from various fields.
The models were trained using a dataset of 8012 images, and their performance was evaluated using 2003 images.
It's worth noting that this model is trained end-to-end, directly from the image to the labels, without the need for handcrafted feature extraction.
arXiv Detail & Related papers (2023-05-18T17:15:08Z) - Improving Deep Facial Phenotyping for Ultra-rare Disorder Verification
Using Model Ensembles [52.77024349608834]
We analyze the influence of replacing a DCNN with a state-of-the-art face recognition approach, iResNet with ArcFace.
Our proposed ensemble model achieves state-of-the-art performance on both seen and unseen disorders.
arXiv Detail & Related papers (2022-11-12T23:28:54Z) - Automatic Facial Skin Feature Detection for Everyone [60.31670960526022]
We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild.
To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions.
arXiv Detail & Related papers (2022-03-30T04:52:54Z) - Disparities in Dermatology AI Performance on a Diverse, Curated Clinical
Image Set [10.212881174103996]
We show that state-of-the-art AI models perform substantially worse on Diverse Dermatology Images dataset.
We find that dermatologists, who typically provide visual labels for AI training and test datasets, also perform worse on images of dark skin tones and uncommon diseases.
arXiv Detail & Related papers (2022-03-15T20:33:23Z) - Automatic Classification of Neuromuscular Diseases in Children Using
Photoacoustic Imaging [77.32032399775152]
Neuromuscular diseases (NMDs) cause a significant burden for both healthcare systems and society.
They can lead to severe progressive muscle weakness, muscle degeneration, contracture, deformity and progressive disability.
arXiv Detail & Related papers (2022-01-27T16:37:19Z) - Variational Knowledge Distillation for Disease Classification in Chest
X-Rays [102.04931207504173]
We propose itvariational knowledge distillation (VKD), which is a new probabilistic inference framework for disease classification based on X-rays.
We demonstrate the effectiveness of our method on three public benchmark datasets with paired X-ray images and EHRs.
arXiv Detail & Related papers (2021-03-19T14:13:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.