SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography

• URL: http://arxiv.org/abs/2510.05296v1
• Date: Mon, 06 Oct 2025 19:05:55 GMT
• Title: SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography
• Authors: Zahra Maleki, Amirhossein Akbari, Amirhossein Binesh, Babak Khalaj,
• Abstract summary: We introduce a novel skin segmentation technique that prioritizes skin regions to enhance the quality of the extracted signal.<n>Our model is evaluated on publicly available datasets, and we also present a new dataset, called SYNC-r, to better represent real-world conditions.<n>In addition, we demonstrate high accuracy in detecting a diverse range of skin tones, making this technique a promising option for real-world applications.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Remote photoplethysmography (rPPG) is an innovative method for monitoring heart rate and vital signs by using a simple camera to record a person, as long as any part of their skin is visible. This low-cost, contactless approach helps in remote patient monitoring, emotion analysis, smart vehicle utilization, and more. Over the years, various techniques have been proposed to improve the accuracy of this technology, especially given its sensitivity to lighting and movement. In the unsupervised pipeline, it is necessary to first select skin regions from the video to extract the rPPG signal from the skin color changes. We introduce a novel skin segmentation technique that prioritizes skin regions to enhance the quality of the extracted signal. It can detect areas of skin all over the body, making it more resistant to movement, while removing areas such as the mouth, eyes, and hair that may cause interference. Our model is evaluated on publicly available datasets, and we also present a new dataset, called SYNC-rPPG, to better represent real-world conditions. The results indicate that our model demonstrates a prior ability to capture heartbeats in challenging conditions, such as talking and head rotation, and maintain the mean absolute error (MAE) between predicted and actual heart rates, while other methods fail to do so. In addition, we demonstrate high accuracy in detecting a diverse range of skin tones, making this technique a promising option for real-world applications.

Related papers

• A Generative AI Approach for Reducing Skin Tone Bias in Skin Cancer Classification [2.676349883103404]
  Skin cancer is one of the most common cancers worldwide and early detection is critical for effective treatment.<n>Current AI diagnostic tools are often trained on datasets dominated by lighter skin tones, leading to reduced accuracy and fairness for people with darker skin.<n>This paper addresses the challenge of skin tone imbalance in automated skin cancer detection using dermoscopic images.
  arXiv  Detail & Related papers  (2026-02-16T00:20:56Z)
• EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance [79.66329903007869]
  We present EchoWorld, a motion-aware world modeling framework for probe guidance.<n>It encodes anatomical knowledge and motion-induced visual dynamics.<n>It is trained on more than one million ultrasound images from over 200 routine scans.
  arXiv  Detail & Related papers  (2025-04-17T16:19:05Z)
• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more.<n>We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models.<n>In this paper, we investigate how detection performance varies across model backbones, types, and datasets.<n>We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Is thermography a viable solution for detecting pressure injuries in dark skin patients? [3.8856323181885633]
  Pressure injury (PI) detection is challenging, especially in dark skin tones. Deep learning models have demonstrated considerable promise toward reliably detecting PI. We introduce a new thermal and optical imaging dataset of 35 participants focused on darker skin tones. We compare the performance of a small convolutional neural network (CNN) trained on either the thermal or the optical images on all skin tones.
  arXiv  Detail & Related papers  (2024-11-15T23:22:21Z)
• Chaos in Motion: Unveiling Robustness in Remote Heart Rate Measurement through Brain-Inspired Skin Tracking [7.688280190165613]
  Existing remote heart rate measurement methods have three serious problems. We apply chaos theory to computer vision tasks for the first time, thus a brain-inspired framework. Our method achieves Robust Skin Tracking for Heart Rate measurement, called HR-RST.
  arXiv  Detail & Related papers  (2024-04-11T12:26:10Z)
• DDI-CoCo: A Dataset For Understanding The Effect Of Color Contrast In Machine-Assisted Skin Disease Detection [51.92255321684027]
  We study the interaction between skin tone and color difference effects and suggest that color difference can be an additional reason behind model performance bias between skin tones. Our work provides a complementary angle to dermatology AI for improving skin disease detection.
  arXiv  Detail & Related papers  (2024-01-24T07:45:24Z)
• Unsupervised Skin Lesion Segmentation via Structural Entropy Minimization on Multi-Scale Superpixel Graphs [59.19218582436495]
  We propose an unsupervised Skin Lesion sEgmentation framework based on structural entropy and isolation forest outlier Detection, namely SLED. Skin lesions are segmented by minimizing the structural entropy of a superpixel graph constructed from the dermoscopic image. We characterize the consistency of healthy skin features and devise a novel multi-scale segmentation mechanism by outlier detection, which enhances the segmentation accuracy by leveraging the superpixel features from multiple scales.
  arXiv  Detail & Related papers  (2023-09-05T02:15:51Z)
• Remote Bio-Sensing: Open Source Benchmark Framework for Fair Evaluation of rPPG [2.82697733014759]
  r (pg photoplethysmography) is a technology that measures and analyzes BVP (Blood Volume Pulse) by using the light absorption characteristics of hemoglobin captured through a camera. This study is to provide a framework to evaluate various r benchmarking techniques across a wide range of datasets for fair evaluation and comparison.
  arXiv  Detail & Related papers  (2023-07-24T09:35:47Z)
• Full-Body Cardiovascular Sensing with Remote Photoplethysmography [4.123458880886283]
  Remote photoplethysmography (r) allows for noncontact monitoring of blood volume changes from a camera by detecting minor fluctuations in reflected light. We explored the feasibility of r from non-face body regions such as the arms, legs, and hands.
  arXiv  Detail & Related papers  (2023-03-16T20:37:07Z)
• DDPM-CD: Denoising Diffusion Probabilistic Models as Feature Extractors for Change Detection [31.125812018296127]
  We introduce a novel approach for change detection by pre-training a Deno Diffusionising Probabilistic Model (DDPM) DDPM learns the training data distribution by gradually converting training images into a Gaussian distribution using a Markov chain. During inference (i.e., sampling), they can generate a diverse set of samples closer to the training distribution. Experiments conducted on the LEVIR-CD, WHU-CD, DSIFN-CD, and CDD datasets demonstrate that the proposed DDPM-CD method significantly outperforms the existing change detection methods in terms of F1 score, I
  arXiv  Detail & Related papers  (2022-06-23T17:58:29Z)
• Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling [121.50704279659253]
  We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations. We then use the distilled physiological features for robust multi-task physiological measurements. The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
  arXiv  Detail & Related papers  (2020-07-16T09:39:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.