AI-driven Remote Facial Skin Hydration and TEWL Assessment from Selfie Images: A Systematic Solution

• URL: http://arxiv.org/abs/2509.06282v1
• Date: Mon, 08 Sep 2025 02:06:37 GMT
• Title: AI-driven Remote Facial Skin Hydration and TEWL Assessment from Selfie Images: A Systematic Solution
• Authors: Cecelia Soh, Rizhao Cai, Monalisha Paul, Dennis Sng, Alex Kot,
• Abstract summary: This work is the first study to explore skin assessment from selfie facial images without physical measurements.<n>It bridges the gap between computer vision and skin care research, enabling AI-driven accessible skin analysis for broader real-world applications.
• Score: 5.1661297672827855
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Skin health and disease resistance are closely linked to the skin barrier function, which protects against environmental factors and water loss. Two key physiological indicators can quantitatively represent this barrier function: skin hydration (SH) and trans-epidermal water loss (TEWL). Measurement of SH and TEWL is valuable for the public to monitor skin conditions regularly, diagnose dermatological issues, and personalize their skincare regimens. However, these measurements are not easily accessible to general users unless they visit a dermatology clinic with specialized instruments. To tackle this problem, we propose a systematic solution to estimate SH and TEWL from selfie facial images remotely with smartphones. Our solution encompasses multiple stages, including SH/TEWL data collection, data preprocessing, and formulating a novel Skin-Prior Adaptive Vision Transformer model for SH/TEWL regression. Through experiments, we identified the annotation imbalance of the SH/TEWL data and proposed a symmetric-based contrastive regularization to reduce the model bias due to the imbalance effectively. This work is the first study to explore skin assessment from selfie facial images without physical measurements. It bridges the gap between computer vision and skin care research, enabling AI-driven accessible skin analysis for broader real-world applications.

Related papers

• A Generative AI Approach for Reducing Skin Tone Bias in Skin Cancer Classification [2.676349883103404]
  Skin cancer is one of the most common cancers worldwide and early detection is critical for effective treatment.<n>Current AI diagnostic tools are often trained on datasets dominated by lighter skin tones, leading to reduced accuracy and fairness for people with darker skin.<n>This paper addresses the challenge of skin tone imbalance in automated skin cancer detection using dermoscopic images.
  arXiv  Detail & Related papers  (2026-02-16T00:20:56Z)
• Implementation of a Skin Lesion Detection System for Managing Children with Atopic Dermatitis Based on Ensemble Learning [0.6372261626436676]
  Atopic dermatitis, a chronic inflammatory skin disease, is diagnosed via subjective evaluations without using objective diagnostic methods.<n>Existing systems must ensure accuracy and fast response times.<n>ENSEL enhanced diagnostic accuracy by integrating various deep learning models via an ensemble approach.
  arXiv  Detail & Related papers  (2025-11-28T11:14:13Z)
• SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography [0.0]
  We introduce a novel skin segmentation technique that prioritizes skin regions to enhance the quality of the extracted signal.<n>Our model is evaluated on publicly available datasets, and we also present a new dataset, called SYNC-r, to better represent real-world conditions.<n>In addition, we demonstrate high accuracy in detecting a diverse range of skin tones, making this technique a promising option for real-world applications.
  arXiv  Detail & Related papers  (2025-10-06T19:05:55Z)
• Enhancing Skin Disease Diagnosis: Interpretable Visual Concept Discovery with SAM [41.398287899966995]
  Current AI-assisted skin image diagnosis has achieved dermatologist-level performance in classifying skin cancer.<n>We propose a novel Cross-Attentive Fusion framework for interpretable skin lesion diagnosis.
  arXiv  Detail & Related papers  (2024-09-14T20:11:25Z)
• Equitable Skin Disease Prediction Using Transfer Learning and Domain Adaptation [1.9505972437091028]
  Existing artificial intelligence (AI) models in dermatology face challenges in accurately diagnosing diseases across diverse skin tones. We employ a transfer-learning approach that capitalizes on the rich, transferable knowledge from various image domains. Among all methods, Med-ViT emerged as the top performer due to its comprehensive feature representation learned from diverse image sources.
  arXiv  Detail & Related papers  (2024-09-01T23:48:26Z)
• S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images [2.79604239303318]
  We propose S-SYNTH, the first knowledge-based, adaptable open-source skin simulation framework. We generate synthetic skin, 3D models and digitally rendered images using an anatomically inspired multi-layer, multi-representation skin and growing lesion model. We show that results obtained using synthetic data follow similar comparative trends as real dermatologic images.
  arXiv  Detail & Related papers  (2024-07-31T23:16:29Z)
• SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models [54.32264601568605]
  SkinGEN is a diagnosis-to-generation framework that generates reference demonstrations from diagnosis results provided by VLM.<n>We conduct a user study with 32 participants evaluating both the system performance and explainability.<n>Results demonstrate that SkinGEN significantly improves users' comprehension of VLM predictions and fosters increased trust in the diagnostic process.
  arXiv  Detail & Related papers  (2024-04-23T05:36:33Z)
• Optimizing Skin Lesion Classification via Multimodal Data and Auxiliary Task Integration [54.76511683427566]
  This research introduces a novel multimodal method for classifying skin lesions, integrating smartphone-captured images with essential clinical and demographic information. A distinctive aspect of this method is the integration of an auxiliary task focused on super-resolution image prediction. The experimental evaluations have been conducted using the PAD-UFES20 dataset, applying various deep-learning architectures.
  arXiv  Detail & Related papers  (2024-02-16T05:16:20Z)
• Evaluating the Efficacy of Skincare Product: A Realistic Short-Term Facial Pore Simulation [68.06388750609058]
  We propose the first simulation model to reveal facial pore changes after using skincare products. The proposed simulation is able to render realistic facial pore changes.
  arXiv  Detail & Related papers  (2023-02-23T12:00:15Z)
• LesionAid: Vision Transformers-based Skin Lesion Generation and Classification [0.0]
  This research proposes a novel multi-class prediction framework that classifies skin lesions based on ViT and ViTGAN. The framework consists of four main phases: ViTGANs, Image processing, and explainable AI.
  arXiv  Detail & Related papers  (2023-02-02T13:52:54Z)
• Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues [81.15465149555864]
  We establish the first joint face spoofing and detection benchmark using both visual appearance and physiological r cues. To enhance the r periodicity discrimination, we design a two-branch physiological network using both facial powerful rtemporal signal map and its continuous wavelet transformed counterpart as inputs.
  arXiv  Detail & Related papers  (2022-08-10T15:41:48Z)
• Automatic Facial Skin Feature Detection for Everyone [60.31670960526022]
  We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild. To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions.
  arXiv  Detail & Related papers  (2022-03-30T04:52:54Z)
• Reliability and Validity of Image-Based and Self-Reported Skin Phenotype Metrics [0.0]
  We show that measures of skin-tone for biometric performance evaluations must come from objective, characterized, and controlled sources. Results demonstrate that measures of skin-tone for biometric performance evaluations must come from objective, characterized, and controlled sources.
  arXiv  Detail & Related papers  (2021-06-18T16:12:24Z)
• The 1st Challenge on Remote Physiological Signal Sensing (RePSS) [116.88849052951856]
  We organize the first challenge on Remote Physiological Signal Sensing (RePSS) This paper presents an overview of the challenge, including data, protocol, analysis of results and discussion.
  arXiv  Detail & Related papers  (2020-03-26T06:17:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.