EMPD: An Event-based Multimodal Physiological Dataset for Remote Pulse Wave Detection
- URL: http://arxiv.org/abs/2603.26699v1
- Date: Tue, 17 Mar 2026 01:25:05 GMT
- Title: EMPD: An Event-based Multimodal Physiological Dataset for Remote Pulse Wave Detection
- Abstract summary: EMPD is the first benchmark dataset specifically for non-contact physiological sensing via event cameras.<n>It provides synchronized precisely multimodal data with microsecond-level temporal precision.<n>The dataset serves as a crucial resource for developing robust algorithms in the field of neuromorphic physiological monitoring.
- Score: 17.621871238954053
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Remote photoplethysmography (rPPG) based on traditional frame-based cameras often struggles with motion artifacts and limited temporal resolution. To address these limitations, we introduce EMPD (Event-based Multimodal Physiological Dataset), the first benchmark dataset specifically designed for non-contact physiological sensing via event cameras. The dataset leverages a laser-assisted acquisition system where a high-coherence laser modulates subtle skin vibrations from the radial artery into significant signals detectable by a neuromorphic sensor. The hardware platform integrates a high-resolution event camera to capture micro-motions and intensity transients, an industrial RGB camera to provide traditional rPPG benchmarks, and a clinical-grade pulse oximeter to record ground truth PPG waveforms. EMPD contains 193 valid records collected from 83 subjects, covering a wide heart rate range (40-110 BPM) under both resting and post-exercise conditions. By providing precisely synchronized multimodal data with microsecond-level temporal precision, EMPD serves as a crucial resource for developing robust algorithms in the field of neuromorphic physiological monitoring. The dataset is publicly available at: https://doi.org/10.5281/zenodo.18765701
Related papers
- MS-rPPG: Multi-spectral State Space Model for Remote Photoplethysmography in Driver Monitoring Systems [21.37687518779808]
In this study, we investigate a driver health monitoring system based on remote heart rate estimation.<n>We introduce MS-r, a multi-spectral framework that combines RGB with near-infrared (NIR) face video to alleviate r estimation under challenging driving conditions.<n>We collected a real-world dataset called MS-Drive, which was recorded from 50 participants while driving the vehicle.
arXiv Detail & Related papers (2026-06-19T05:34:10Z) - FreqPhys: Repurposing Implicit Physiological Frequency Prior for Robust Remote Photoplethysmography [54.32412212867472]
Photoplethysmography enables contactless physiological monitoring by capturing subtle skin-color variations from videos.<n>FreqPhys is a frequency-guided rulation framework that explicitly leverages physiological frequency priors for robust signal recovery.<n>It yields significant improvements over state-of-the-art approaches, particularly under challenging motion conditions.
arXiv Detail & Related papers (2026-04-01T06:25:42Z) - PhysNeXt: Next-Generation Dual-Branch Structured Attention Fusion Network for Remote Photoplethysmography Measurement [50.524262997433546]
rmography enables measurement of heart rate and other vital signs by analyzing color variations in facial skin induced by cardiac pulsation.<n>Current methods are mainly based on either end-to-end modeling from raw videos or subtle heartbeat-related map (ST) representations.<n>We propose PhysMapXt, a dual-input deep learning framework that jointly exploits video frames and ST representations.
arXiv Detail & Related papers (2026-03-20T08:37:02Z) - Optical Linear Systems Framework for Event Sensing and Computational Neuromorphic Imaging [2.45990890510584]
Event vision sensors (neuromorphic cameras) output sparse, asynchronous ON/OFF events triggered by log-intensity threshold crossings.<n>As a nonlinear system, this event representation does not readily integrate with the linear forward models that underpin most computational imaging and optical system design.<n>We present a physics-grounded processing pipeline that maps event streams to estimates of per-pixel log-intensity and intensity derivatives, and embeds these measurements in a dynamic linear systems model.
arXiv Detail & Related papers (2026-01-20T01:23:22Z) - Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
arXiv Detail & Related papers (2025-09-11T23:12:55Z) - Efficient and Robust Multidimensional Attention in Remote Physiological Sensing through Target Signal Constrained Factorization [7.947387272047604]
We present MMRPhys, an efficient dual-branch 3D-CNN architecture designed for simultaneous estimation of photoplethysmography (rRSP) and respiratory (rRSP) signals from multimodal video inputs.<n>We demonstrate that MMRPhys with TSFM significantly outperforms state-of-the-art methods in generalization across domain shifts for rRSP estimation, while maintaining a minimal inference latency suitable for real-time applications.
arXiv Detail & Related papers (2025-05-11T15:20:45Z) - Inter-event Interval Microscopy for Event Cameras [52.05337480169517]
Event cameras, an innovative bio-inspired sensor, differ from traditional cameras by sensing changes in intensity rather than directly perceiving intensity.<n>We achieve event-to-intensity conversion using a static event camera for both static and dynamic scenes in fluorescence microscopy.<n>We have collected IEIMat dataset under various scenes including high dynamic range and high-speed scenarios.
arXiv Detail & Related papers (2025-04-07T11:05:13Z) - Time-Series U-Net with Recurrence for Noise-Robust Imaging Photoplethysmography [14.749406169315554]
Photoplethysmography system consists of three modules: face and landmark detection, time-series extraction, and pulse signal/pulse rate estimation.<n>The pulse signal estimation module, which we call TURNIP, allows the system to faithfully reconstruct the underlying pulse signal waveform.<n>Our algorithm provides reliable heart rate estimates without the need for specialized sensors or contact with the skin.
arXiv Detail & Related papers (2025-03-21T17:52:33Z) - Low latency optical-based mode tracking with machine learning deployed on FPGAs on a tokamak [0.8506991993461593]
This study demonstrates an FPGA-based high-speed camera data acquisition and processing system.
It enables application in real-time machine-learning-based tokamak diagnostic and control as well as potential applications in other scientific domains.
arXiv Detail & Related papers (2023-11-30T19:00:03Z) - PhysFormer: Facial Video-based Physiological Measurement with Temporal
Difference Transformer [55.936527926778695]
Recent deep learning approaches focus on mining subtle r clues using convolutional neural networks with limited-temporal receptive fields.
In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture.
arXiv Detail & Related papers (2021-11-23T18:57:11Z) - Video-based Remote Physiological Measurement via Cross-verified Feature
Disentangling [121.50704279659253]
We propose a cross-verified feature disentangling strategy to disentangle the physiological features with non-physiological representations.
We then use the distilled physiological features for robust multi-task physiological measurements.
The disentangled features are finally used for the joint prediction of multiple physiological signals like average HR values and r signals.
arXiv Detail & Related papers (2020-07-16T09:39:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.