RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement

• URL: http://arxiv.org/abs/2606.28089v1
• Date: Fri, 26 Jun 2026 13:50:47 GMT
• Title: RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement
• Abstract summary: Video-based remote physiological measurement (RPM) is highly accessible but remains fragile under varying illumination, skin tones, and motion.<n>We propose RPM-Distill, a physiology-guided cross-modal distillation framework that leverages synchronized radar only during training.<n> RPM-Distill brings 81% MAE and 21% correlation improvement over unimodal baselines.
• Score: 25.785573372322137
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video-based remote physiological measurement (RPM) is highly accessible but remains fragile under varying illumination, skin tones, and motion. Radio frequency (RF) radar is largely invariant to illumination and appearance, providing complementary cardio-respiratory micro-motion cues; however, requiring radar at inference is often impractical due to its limited ubiquity and deployment overhead. We propose RPM-Distill, a physiology-guided cross-modal distillation framework that leverages synchronized radar only during training while retaining video-only inference. Our key observation is that although RGB and RF waveforms differ in sensing physics and time-domain morphology, they share similar latent periodic rhythm in the frequency domain. We thus distill physiology-structured spectral evidence to improve robustness, via losses that (i) anchor the fundamental peak, (ii) match the off-peak background distribution, and (iii) preserve spectral morphology and sharpness. To avoid negative transfer under sample-level teacher quality and alignment uncertainty, a spectral policy network predicts sample-level distillation gates and component weights from the student--teacher spectral relation map, learned with a meta bilevel objective on a small labeled validation split. Through extensive experiments in challenging conditions and cross-dataset settings, RPM-Distill brings 81\% MAE and 21\% correlation improvement over unimodal baselines. Code is at https://github.com/WJULYW/RPM-Distill.

Related papers

• CardiacMamba: Fair and Robust RGB-RF Fusion for Remote Heart Rate Estimation via State Space Modeling [36.18750971669015]
  CardiacMamba integrates optical facial cues and radio-frequency cardiac motion cues through state space modeling.<n>On the EquiPleth dataset, CardiacMamba achieves state-of-the-art performance with 0.96 bpm MAE, 3.06 bpm RMSE, and 0.97 Pearson correlation.
  arXiv  Detail & Related papers  (2026-08-16T16:05:24Z)
• Set-Based Transformer for Atmospheric Compensation in Standoff LWIR Hyperspectral Imaging [6.066442015301664]
  We present a lightweight set-based deep learning framework that takes multiple radiance measurements and estimates transmittance, atmospheric path radiance, and a shared downwelling spectrum.<n>We analyze the learned representation with a sparse autoencoder and observe that several latent features do activate on geographically coherent subsets of the test data.
  arXiv  Detail & Related papers  (2026-06-06T20:25:30Z)
• Learning to Refine: Spectral-Decoupled Iterative Refinement Framework for Precipitation Nowcasting [21.300422393514804]
  We propose a deterministic framework that reformulates nowcasting as progressive frequency-decoupled refinement.<n>SDIR first extracts a stable low-frequency synoptic skeleton, then iteratively refines high-frequency textures under physical constraints.<n> Experiments on three benchmarks show SDIR significantly outperforms SOTA methods in spatial accuracy.
  arXiv  Detail & Related papers  (2026-06-01T07:34:30Z)
• FreqPhys: Repurposing Implicit Physiological Frequency Prior for Robust Remote Photoplethysmography [54.32412212867472]
  Photoplethysmography enables contactless physiological monitoring by capturing subtle skin-color variations from videos.<n>FreqPhys is a frequency-guided rulation framework that explicitly leverages physiological frequency priors for robust signal recovery.<n>It yields significant improvements over state-of-the-art approaches, particularly under challenging motion conditions.
  arXiv  Detail & Related papers  (2026-04-01T06:25:42Z)
• SPIRIT: Adapting Vision Foundation Models for Unified Single- and Multi-Frame Infrared Small Target Detection [18.86422994684341]
  Infrared small target detection (IRSTD) is crucial for surveillance and early-warning, with deployments spanning both single-frame analysis and video-mode tracking.<n>We propose SPIRIT, a unified and VFM-compatible framework that adapts VFMs to IRSTD via lightweight physics-informed plug-ins.
  arXiv  Detail & Related papers  (2026-02-02T09:15:29Z)
• PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement [63.007237197267834]
  Existing deep learning methods are mostly physiological monitoring and lack theoretical robustness.<n>We propose a physics-informed r paradigm derived from the Navier-Stokes equations of hemodynamics, showing that the pulse signal follows a second-order system.<n>This provides a theoretical justification for using a Temporal Conal Network (TCN)<n>Phase-Net achieves state-of-the-art performance with strong efficiency, offering a theoretically grounded and deployment-ready r solution.
  arXiv  Detail & Related papers  (2025-09-29T14:36:45Z)
• LSCD: Lomb-Scargle Conditioned Diffusion for Time series Imputation [55.800319453296886]
  Time series with missing or irregularly sampled data are a persistent challenge in machine learning.<n>We introduce a different Lombiable--Scargle layer that enables a reliable computation of the power spectrum of irregularly sampled data.
  arXiv  Detail & Related papers  (2025-06-20T14:48:42Z)
• Understanding Dataset Distillation via Spectral Filtering [69.07076441512612]
  We introduce UniDD, a spectral filtering framework that unifies diverse DD objectives.<n>UniDD reveals that the essence of DD fundamentally lies in matching frequency-specific features.<n>To address this limitation, we propose Curriculum Frequency Matching (CFM), which gradually adjusts the filter parameter to cover both low- and high-frequency information.
  arXiv  Detail & Related papers  (2025-03-03T06:22:34Z)
• CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement [24.511384674989223]
  Heart rate (HR) estimation via remote photoplethys (rPl) offers a non-invasive solution for health monitoring.<n>Traditional single-modality approaches (RGB or Radio Frequency (RF)) face challenges in balancing robustness and accuracy due to lighting variations, motion artifacts, and skin tone bias.<n>We propose CardiacMamba, a multimodal RGB-RF fusion framework that leverages the complementary strengths of both modalities.
  arXiv  Detail & Related papers  (2025-02-19T11:00:34Z)
• Diffusion Probabilistic Model Made Slim [128.2227518929644]
  We introduce a customized design for slim diffusion probabilistic models (DPM) for light-weight image synthesis. We achieve 8-18x computational complexity reduction as compared to the latent diffusion models on a series of conditional and unconditional image generation tasks.
  arXiv  Detail & Related papers  (2022-11-27T16:27:28Z)
• PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer [55.936527926778695]
  Recent deep learning approaches focus on mining subtle r clues using convolutional neural networks with limited-temporal receptive fields. In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture.
  arXiv  Detail & Related papers  (2021-11-23T18:57:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.