Color Invariant Skin Segmentation

• URL: http://arxiv.org/abs/2204.09882v2
• Date: Fri, 22 Apr 2022 19:48:00 GMT
• Title: Color Invariant Skin Segmentation
• Authors: Han Xu, Abhijit Sarkar, A. Lynn Abbott
• Abstract summary: This paper addresses the problem of automatically detecting human skin in images without reliance on color information. A primary motivation of the work has been to achieve results that are consistent across the full range of skin tones. We present a new approach that performs well in the absence of such information.
• Score: 17.501659517108884
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper addresses the problem of automatically detecting human skin in images without reliance on color information. A primary motivation of the work has been to achieve results that are consistent across the full range of skin tones, even while using a training dataset that is significantly biased toward lighter skin tones. Previous skin-detection methods have used color cues almost exclusively, and we present a new approach that performs well in the absence of such information. A key aspect of the work is dataset repair through augmentation that is applied strategically during training, with the goal of color invariant feature learning to enhance generalization. We have demonstrated the concept using two architectures, and experimental results show improvements in both precision and recall for most Fitzpatrick skin tones in the benchmark ECU dataset. We further tested the system with the RFW dataset to show that the proposed method performs much more consistently across different ethnicities, thereby reducing the chance of bias based on skin color. To demonstrate the effectiveness of our work, extensive experiments were performed on grayscale images as well as images obtained under unconstrained illumination and with artificial filters. Source code: https://github.com/HanXuMartin/Color-Invariant-Skin-Segmentation

Related papers

• DDI-CoCo: A Dataset For Understanding The Effect Of Color Contrast In Machine-Assisted Skin Disease Detection [51.92255321684027]
  We study the interaction between skin tone and color difference effects and suggest that color difference can be an additional reason behind model performance bias between skin tones. Our work provides a complementary angle to dermatology AI for improving skin disease detection.
  arXiv  Detail & Related papers  (2024-01-24T07:45:24Z)
• Neural Color Operators for Sequential Image Retouching [62.99812889713773]
  We propose a novel image retouching method by modeling the retouching process as performing a sequence of newly introduced trainable neural color operators. The neural color operator mimics the behavior of traditional color operators and learns pixelwise color transformation while its strength is controlled by a scalar. Our method consistently achieves the best results compared with SOTA methods in both quantitative measures and visual qualities.
  arXiv  Detail & Related papers  (2022-07-17T05:33:19Z)
• Meta Balanced Network for Fair Face Recognition [51.813457201437195]
  We systematically and scientifically study bias from both data and algorithm aspects. We propose a novel meta-learning algorithm, called Meta Balanced Network (MBN), which learns adaptive margins in large margin loss. Extensive experiments show that MBN successfully mitigates bias and learns more balanced performance for people with different skin tones in face recognition.
  arXiv  Detail & Related papers  (2022-05-13T10:25:44Z)
• Detecting Recolored Image by Spatial Correlation [60.08643417333974]
  Image recoloring is an emerging editing technique that can manipulate the color values of an image to give it a new style. In this paper, we explore a solution from the perspective of the spatial correlation, which exhibits the generic detection capability for both conventional and deep learning-based recoloring. Our method achieves the state-of-the-art detection accuracy on multiple benchmark datasets and exhibits well generalization for unknown types of recoloring methods.
  arXiv  Detail & Related papers  (2022-04-23T01:54:06Z)
• Planckian jitter: enhancing the color quality of self-supervised visual representations [32.28858433165915]
  We analyze how the traditionally used color jitter negatively impacts the quality of the color features in the learned feature representation. We replace this module with physics-based color augmentation, called Planckian jitter, which creates realistic variations in chromaticity. We show that the performance of the learned features is robust with respect to illuminant variations.
  arXiv  Detail & Related papers  (2022-02-16T11:13:37Z)
• Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification [5.71097144710995]
  We use a modified variational autoencoder to uncover skin tone bias in datasets commonly used as benchmarks. We propose an efficient yet effective algorithm for automatically labelling the skin tone of lesion images. We subsequently use two leading bias unlearning techniques to mitigate skin tone bias.
  arXiv  Detail & Related papers  (2022-02-06T18:53:06Z)
• Degrade is Upgrade: Learning Degradation for Low-light Image Enhancement [52.49231695707198]
  We investigate the intrinsic degradation and relight the low-light image while refining the details and color in two steps. Inspired by the color image formulation, we first estimate the degradation from low-light inputs to simulate the distortion of environment illumination color, and then refine the content to recover the loss of diffuse illumination color. Our proposed method has surpassed the SOTA by 0.95dB in PSNR on LOL1000 dataset and 3.18% in mAP on ExDark dataset.
  arXiv  Detail & Related papers  (2021-03-19T04:00:27Z)
• CoRe: Color Regression for Multicolor Fashion Garments [80.57724826629176]
  In this paper, we handle color detection as a regression problem to predict the exact RGB values. We include a second regression stage for refinement in our newly proposed architecture. This architecture is modular and easily expanded to detect the RGBs of all colors in a multicolor garment.
  arXiv  Detail & Related papers  (2020-10-06T16:12:30Z)
• Illumination-based Transformations Improve Skin Lesion Segmentation in Dermoscopic Images [17.60847055233247]
  We propose the first deep semantic segmentation framework for dermoscopic images which incorporates, along with the original RGB images, information extracted using the physics of skin illumination and imaging. We evaluate our method on three datasets: the ISIC 2017 Skin Lesion Challenge, the DermoFit Image Library, and the PH2 dataset.
  arXiv  Detail & Related papers  (2020-03-23T07:43:35Z)
• Real-time Segmentation and Facial Skin Tones Grading [6.222979369834314]
  We propose an efficient segmentation method based on deep convolutional neural networks (DCNNs) for the task of hair and facial skin segmentation. We achieve 90.73% Pixel Accuracy on Figaro1k dataset at over 16 FPS in the case of CPU environment. We further use masked color moment for skin tones grade evaluation and approximate 80% classification accuracy demonstrate the feasibility of the proposed scheme.
  arXiv  Detail & Related papers  (2019-12-30T11:35:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.