Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color

• URL: http://arxiv.org/abs/2309.05148v2
• Date: Tue, 3 Oct 2023 22:10:02 GMT
• Title: Beyond Skin Tone: A Multidimensional Measure of Apparent Skin Color
• Authors: William Thong, Przemyslaw Joniak, Alice Xiang
• Abstract summary: This paper strives to measure apparent skin color in computer vision, beyond a unidimensional scale on skin tone. We then recommend multidimensional skin color scales, relying on both skin tone and hue, for fairness assessments.
• Score: 8.850979461924267
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper strives to measure apparent skin color in computer vision, beyond a unidimensional scale on skin tone. In their seminal paper Gender Shades, Buolamwini and Gebru have shown how gender classification systems can be biased against women with darker skin tones. Subsequently, fairness researchers and practitioners have adopted the Fitzpatrick skin type classification as a common measure to assess skin color bias in computer vision systems. While effective, the Fitzpatrick scale only focuses on the skin tone ranging from light to dark. Towards a more comprehensive measure of skin color, we introduce the hue angle ranging from red to yellow. When applied to images, the hue dimension reveals additional biases related to skin color in both computer vision datasets and models. We then recommend multidimensional skin color scales, relying on both skin tone and hue, for fairness assessments.

Related papers

• Colorimetric skin tone scale for improved accuracy and reduced perceptual bias of human skin tone annotations [0.0]
  We develop a novel Colorimetric Skin Tone (CST) scale based on prior colorimetric measurements. Using experiments requiring humans to rate their own skin tone and the skin tone of subjects in images, we show that the new CST scale is more sensitive, consistent, and colorimetrically accurate.
  arXiv  Detail & Related papers  (2024-10-28T13:29:24Z)
• DDI-CoCo: A Dataset For Understanding The Effect Of Color Contrast In Machine-Assisted Skin Disease Detection [51.92255321684027]
  We study the interaction between skin tone and color difference effects and suggest that color difference can be an additional reason behind model performance bias between skin tones. Our work provides a complementary angle to dermatology AI for improving skin disease detection.
  arXiv  Detail & Related papers  (2024-01-24T07:45:24Z)
• Revisiting Skin Tone Fairness in Dermatological Lesion Classification [3.247628857305427]
  We review and compare four ITA-based approaches of skin tone classification on the ISIC18 dataset. Our analyses reveal a high disagreement among previously published studies demonstrating the risks of ITA-based skin tone estimation methods. We investigate the causes of such large discrepancy among these approaches and find that the lack of diversity in the ISIC18 dataset limits its use as a testbed for fairness analysis.
  arXiv  Detail & Related papers  (2023-08-18T15:59:55Z)
• Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets [7.519872646378834]
  We investigate how subjective understandings of skin tone are embedded in skin tone annotation procedures. Our work is the first to investigate the skin tone annotation process as a sociotechnical project.
  arXiv  Detail & Related papers  (2023-05-15T23:55:56Z)
• ColorSense: A Study on Color Vision in Machine Visual Recognition [57.916512479603064]
  We collect 110,000 non-trivial human annotations of foreground and background color labels from visual recognition benchmarks. We validate the use of our datasets by demonstrating that the level of color discrimination has a dominating effect on the performance of machine perception models. Our findings suggest that object recognition tasks such as classification and localization are susceptible to color vision bias.
  arXiv  Detail & Related papers  (2022-12-16T18:51:41Z)
• Meta Balanced Network for Fair Face Recognition [51.813457201437195]
  We systematically and scientifically study bias from both data and algorithm aspects. We propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition.
  arXiv  Detail & Related papers  (2022-05-13T10:25:44Z)
• Automatic Facial Skin Feature Detection for Everyone [60.31670960526022]
  We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild. To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions.
  arXiv  Detail & Related papers  (2022-03-30T04:52:54Z)
• Robustness Disparities in Commercial Face Detection [72.25318723264215]
  We present the first of its kind detailed benchmark of the robustness of three such systems: Amazon Rekognition, Microsoft Azure, and Google Cloud Platform. We generally find that photos of individuals who are older, masculine presenting, of darker skin type, or have dim lighting are more susceptible to errors than their counterparts in other identities.
  arXiv  Detail & Related papers  (2021-08-27T21:37:16Z)
• Analysis of Manual and Automated Skin Tone Assignments for Face Recognition Applications [8.334167427229572]
  We analyze a set of manual Fitzpatrick skin type assignments and also employ the individual typology angle to automatically estimate the skin tone from face images. The level of agreement between automated and manual approaches is found to be 96% or better for the MORPH images.
  arXiv  Detail & Related papers  (2021-04-29T22:35:47Z)
• Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Dataset [0.23746609573239755]
  This dataset includes 16,577 clinical images sourced from two dermatology atlases with Fitzpatrick skin type labels. We train a deep neural network model to classify 114 skin conditions and find that the model is most accurate on skin types similar to those it was trained on.
  arXiv  Detail & Related papers  (2021-04-20T13:37:30Z)
• Assessing The Importance Of Colours For CNNs In Object Recognition [70.70151719764021]
  Convolutional neural networks (CNNs) have been shown to exhibit conflicting properties. We demonstrate that CNNs often rely heavily on colour information while making a prediction. We evaluate a model trained with congruent images on congruent, greyscale, and incongruent images.
  arXiv  Detail & Related papers  (2020-12-12T22:55:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.