Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography
- URL: http://arxiv.org/abs/2605.00882v1
- Date: Sun, 26 Apr 2026 09:56:09 GMT
- Title: Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography
- Abstract summary: We propose a new SSL paradigm, Causal Probing (PCP)<n>PCP treats the latent r signal as the underlying physical source and the resulting pixel chrominance variations as its visual manifestation.<n>Our editor achieves both in-domain and cross-domain performance on challenging datasets such as VIPL-HR and MMPD-HR.
- Score: 38.62089038790769
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Remote Photoplethysmography (rPPG) enables convenient non-contact physiological measurement. Existing Self-Supervised Learning (SSL) methods commonly fall into a correlation trap: they tend to learn the most dominant periodic signals in the data, such as high-energy motion or illumination noise, rather than the faint, true rPPG signal, leading to poor model generalization. To address this, we propose a new SSL paradigm, Physiological Causal Probing (PCP), which treats the latent rPPG signal as the underlying physical source and the resulting pixel chrominance variations as its visual manifestation. Its core idea is to shift from passive correlation learning to active, precise intervention: it intervenes on the video based on a proposed rPPG hypothesis, and verifies whether the post-intervention changes match physical expectations. We propose the Interv-rPPG framework to implement PCP: an rPPG extractor named PhysMambaFormer hypothesizes the rPPG signal, while a Controllable Physiological Signal Editor conducts precise chrominance-domain interventions on videos based on this hypothesis. Interv-rPPG validates the physical realism of the hypothesis through `Falsifiability via Nulling' and `Axiomatic Equivariance'. Our editor achieves precise editing of the rPPG signal by intervening in the low-frequency chrominance components of the video. Our method improves both in-domain and cross-domain performance on challenging datasets such as VIPL-HR and MMPD. Furthermore, it surpasses the supervised baseline in complex cross-dataset settings, while remaining competitive on clean datasets where the intervention mechanism may introduce slight residual chrominance noise. Extensive experiments, including diagnostic analysis of nuisance sensitivity, demonstrate that the PCP paradigm effectively resists motion and illumination artifacts.
Related papers
- FCUS-rPPG: A Fast-Converging Unsupervised Framework for Remote Photoplethysmography via Gradient Oscillation Suppression [19.91628990903841]
Photoplethysmography (rmography) enables non-contact extraction of blood volume pulse (BVP) signals using consumer-grade cameras.<n>FCUS-r is a fastconverging unsupervised r framework with strong generalization capability.<n>FCUS-r consistently achieves state-of-the-art evaluations in cross-dataset performance.
arXiv Detail & Related papers (2026-06-02T02:33:27Z) - HOT: Harmonic-Constrained Optimal Transport for Remote Photoplethysmography Domain Adaptation [2.5608506499175103]
Remote photoplethysmography (rmography) enables non-contact measurement from facial videos.<n>Recent deep learning-based FDA methods have achieved strong performance on individual datasets.<n>We introduce frequency domain adaptation (FDA) as a principled strategy for modeling appearance variation in rvariance.
arXiv Detail & Related papers (2026-04-02T06:24:06Z) - Reliability-Aware Weighted Multi-Scale Spatio-Temporal Maps for Heart Rate Monitoring [7.838207563346384]
We present a Reliability-Aware Multi-Supervised Spatio-Temporal (WMST) map that models pixel reliability through the suppression of environmental noises.<n>We also introduce a new High-High wavelet map as a negative example that maintains motion and structural details while filtering out physiological information.
arXiv Detail & Related papers (2026-03-27T07:58:34Z) - Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurement [0.0]
Remote photoplethys (rmography) is an emerging physiological sensing technique that leverages subtle color variations in facial videos to estimate vital signs such as heart rate and respiratory rate.<n>This non-invasive technique has gained traction across diverse domains, but its ability to capture fine-grained temporal dynamics under real-world conditions has been underexplored.<n>We propose Graph Reperio-r, a novel framework that strategically integrates a Transformer to effectively capture the periodic structure.
arXiv Detail & Related papers (2025-11-08T09:41:34Z) - Inferring Optical Tissue Properties from Photoplethysmography using Hybrid Amortized Inference [9.6326158044961]
We introduce PPGen, a biophysical model that relates PPG signals to interpretable physiological and optical parameters.<n>We show that HAI can accurately infer physiological parameters under diverse noise and sensor conditions.
arXiv Detail & Related papers (2025-10-02T14:36:02Z) - PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement [63.007237197267834]
Existing deep learning methods are mostly physiological monitoring and lack theoretical robustness.<n>We propose a physics-informed r paradigm derived from the Navier-Stokes equations of hemodynamics, showing that the pulse signal follows a second-order system.<n>This provides a theoretical justification for using a Temporal Conal Network (TCN)<n>Phase-Net achieves state-of-the-art performance with strong efficiency, offering a theoretically grounded and deployment-ready r solution.
arXiv Detail & Related papers (2025-09-29T14:36:45Z) - PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensing [49.243031514520794]
Large Language Models (LLMs) excel at capturing long-range signals due to their text-centric design.<n>PhysLLM achieves state-the-art accuracy and robustness, demonstrating superior generalization across lighting variations and motion scenarios.
arXiv Detail & Related papers (2025-05-06T15:18:38Z) - CodePhys: Robust Video-based Remote Physiological Measurement through Latent Codebook Querying [26.97093819822487]
Remote photoplethysmography aims to measure non-contact physiological signals from facial videos.<n>Most existing methods directly extract video-based r features by designing neural networks for heart rate estimation.<n>Recent methods are easily affected by interference and degradation, resulting in noisy r signals.<n>We propose a novel method named CodePhys, which innovatively treats r measurement as a code task in a noise-free proxy space.
arXiv Detail & Related papers (2025-02-11T13:05:42Z) - Towards Understanding the Robustness of Diffusion-Based Purification: A Stochastic Perspective [65.10019978876863]
Diffusion-Based Purification (DBP) has emerged as an effective defense mechanism against adversarial attacks.<n>In this paper, we propose that the intrinsicity in the DBP process is the primary factor driving robustness.
arXiv Detail & Related papers (2024-04-22T16:10:38Z) - Identifying Rhythmic Patterns for Face Forgery Detection and
Categorization [46.21354355137544]
We propose a framework for face forgery detection and categorization consisting of: 1) a Spatial-Temporal Filtering Network (STFNet) for PPG signals, and 2) a Spatial-Temporal Interaction Network (STINet) for constraint and interaction of PPG signals.
With insight into the generation of forgery methods, we further propose intra-source and inter-source blending to boost the performance of the framework.
arXiv Detail & Related papers (2022-07-04T04:57:06Z) - PhysFormer: Facial Video-based Physiological Measurement with Temporal
Difference Transformer [55.936527926778695]
Recent deep learning approaches focus on mining subtle r clues using convolutional neural networks with limited-temporal receptive fields.
In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture.
arXiv Detail & Related papers (2021-11-23T18:57:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.