Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction

• URL: http://arxiv.org/abs/2606.15597v1
• Date: Sun, 14 Jun 2026 04:48:27 GMT
• Title: Fusion-E2Pulse: A Multimodal Event-RGB Fusion Network for Non-contact Pulse Wave Reconstruction
• Abstract summary: Non-contact pulse wave reconstruction hinges on the precise recovery of waveform morphology, including the dicrotic notch.<n>We propose a novel multimodal network named Fusion-E2Pulse to exploit the synergy between frame-based integration and event-based differential sensing.<n>Experiments demonstrate that Fusion-E2Pulse achieves state-of-the-art performance, effectively balancing noise suppression and morphological fidelity.
• Score: 9.207646887958935
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Non-contact pulse wave reconstruction hinges on the precise recovery of waveform morphology, including the dicrotic notch. Conventional Red-Green-Blue (RGB)-based methods, which extract physiological signals from recorded facial videos, are constrained by the integral imaging mechanism of standard cameras, where the exposure process induces a smoothing effect that attenuates subtle vascular pulsation details. Conversely, neuromorphic event cameras, while offering exceptional sensitivity to intensity fluctuations, are inherently susceptible to noise and artifacts induced by minor motion. To exploit the synergy between frame-based integration and event-based differential sensing, we propose a novel multimodal network named Fusion-E2Pulse. This framework utilizes filtered RGB signals as structural priors to suppress motion artifacts, while leveraging the high-sensitivity of event streams to recover fine-grained morphological details. Experimental results demonstrate that Fusion-E2Pulse achieves state-of-the-art performance, effectively balancing noise suppression and morphological fidelity, achieving a mean absolute error of 0.78 bpm for heart rate estimation, a waveform correlation of 0.89, and a systolic phase duration error of 16.74 ms, validating its efficacy in reconstructing fine-grained pathological features.

Related papers

• RetiWave-Mamba: A Dual-Stream Network for Retinal Disease Detection based on Multi-scale Context and Frequency-Adaptive Mamba Projection [11.498068680313613]
  We propose a novel framework, RetiWave-Mamba, which integrates spatial-frequency domain learning with state-of-the-art state space models.<n>Our approach achieves a state-of-the-art (SOTA) classification accuracy of 98.25%, surpassing existing methods.
  arXiv  Detail & Related papers  (2026-08-18T10:38:59Z)
• CardiacMamba: Fair and Robust RGB-RF Fusion for Remote Heart Rate Estimation via State Space Modeling [36.18750971669015]
  CardiacMamba integrates optical facial cues and radio-frequency cardiac motion cues through state space modeling.<n>On the EquiPleth dataset, CardiacMamba achieves state-of-the-art performance with 0.96 bpm MAE, 3.06 bpm RMSE, and 0.97 Pearson correlation.
  arXiv  Detail & Related papers  (2026-08-16T16:05:24Z)
• Bio-SFT: Asymmetric Cortical Guidance and Retinal Adaptation for Robust HDR Reconstruction [61.07381300333128]
  Extreme luminance variation and severe quantization in dark regions make accurate reconstruction challenging.<n>Bio-SFT is a bio-inspired spiking frequency transformer for single-image HDR reconstruction.<n>Experiments on HDRTV1K show that Bio-SFT consistently improves HDR-VDP-3 and $E_ITP$ while reducing artifact propagation in symmetric guidance pipelines.
  arXiv  Detail & Related papers  (2026-07-20T01:07:54Z)
• Multi-Contrast MRI Motion Correction via Parameter-Informed Disentanglement and Adaptive Experts [56.74856091904914]
  We propose a unified framework combining parameter-informed contrast disentanglement with severity-aware adaptive correction.<n>ScanCLIP derives contrast embeddings from acquisition parameters to disentangle contrast style from anatomical content, yielding contrast-free features.<n>A Vision Transformer then estimates motion severity and routes features through a Mixture-of-Experts network, enabling targeted artifact correction.
  arXiv  Detail & Related papers  (2026-05-29T02:48:23Z)
• Functional MRI Time Series Generation via Wavelet-Based Image Transform and Spectral Flow Matching for Brain Disorder Identification [11.757645382221854]
  fMRI provides non-invasive access to dynamic brain activity by measuring blood oxygen level-dependent coefficients (BOLD) signals over time.<n>The resource-intensive nature of fMRI limits the availability of high-fidelity samples required for data-driven analysis models.<n>We propose Dual-temporaltral Flow Matching (DSpec), a novel fMRI generative framework that cascades dual frequency representation of BOLD signals with spectral flow matching.
  arXiv  Detail & Related papers  (2026-05-28T09:12:45Z)
• AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors [10.352581041881864]
  This paper introduces AnyBand-Diff, a spectral-prior-guided diffusion framework tailored for robust spectral reconstruction.<n>To ensure radiometric fidelity, a Physics-Guided Sampling mechanism is proposed.<n>Experiments confirm the effectiveness of AnyBand-Diff in generating reliable imagery.
  arXiv  Detail & Related papers  (2026-05-14T04:04:34Z)
• PhysNeXt: Next-Generation Dual-Branch Structured Attention Fusion Network for Remote Photoplethysmography Measurement [50.524262997433546]
  rmography enables measurement of heart rate and other vital signs by analyzing color variations in facial skin induced by cardiac pulsation.<n>Current methods are mainly based on either end-to-end modeling from raw videos or subtle heartbeat-related map (ST) representations.<n>We propose PhysMapXt, a dual-input deep learning framework that jointly exploits video frames and ST representations.
  arXiv  Detail & Related papers  (2026-03-20T08:37:02Z)
• B-FIRE: Binning-Free Diffusion Implicit Neural Representation for Hyper-Accelerated Motion-Resolved MRI [37.43809864791578]
  Existing 4DMRI produces acceptable artifacts of averaged breathing phases, which can blur and misrepresent dynamic information.<n>We propose B-FIRE, a binning-free diffusion implicit neural representation framework for hyper-accelerated MR reconstruction.
  arXiv  Detail & Related papers  (2026-01-07T03:23:22Z)
• PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement [63.007237197267834]
  Existing deep learning methods are mostly physiological monitoring and lack theoretical robustness.<n>We propose a physics-informed r paradigm derived from the Navier-Stokes equations of hemodynamics, showing that the pulse signal follows a second-order system.<n>This provides a theoretical justification for using a Temporal Conal Network (TCN)<n>Phase-Net achieves state-of-the-art performance with strong efficiency, offering a theoretically grounded and deployment-ready r solution.
  arXiv  Detail & Related papers  (2025-09-29T14:36:45Z)
• TIR-Diffusion: Diffusion-based Thermal Infrared Image Denoising via Latent and Wavelet Domain Optimization [11.970228442183476]
  We propose a diffusion-based TIR image denoising framework.<n>Our method fine-tunes the model via a novel loss function combining latent-space and discrete wavelet transform (DWT) / dual-tree complex wavelet transform (DTCWT) losses.<n> Experiments on benchmark datasets demonstrate superior performance of our approach compared to state-of-the-art denoising methods.
  arXiv  Detail & Related papers  (2025-07-30T06:27:32Z)
• PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification [49.37555541088792]
  Phase-Amplitude Decoupling (PAD) is a frequency-aware framework that separates phase (modality-shared) and amplitude (modality-complementary) components.<n>This work establishes a new paradigm for physics-aware multi-modal fusion in remote sensing.
  arXiv  Detail & Related papers  (2025-04-27T07:21:42Z)
• CardiacMamba: A Multimodal RGB-RF Fusion Framework with State Space Models for Remote Physiological Measurement [24.511384674989223]
  Heart rate (HR) estimation via remote photoplethys (rPl) offers a non-invasive solution for health monitoring.<n>Traditional single-modality approaches (RGB or Radio Frequency (RF)) face challenges in balancing robustness and accuracy due to lighting variations, motion artifacts, and skin tone bias.<n>We propose CardiacMamba, a multimodal RGB-RF fusion framework that leverages the complementary strengths of both modalities.
  arXiv  Detail & Related papers  (2025-02-19T11:00:34Z)
• Brain Imaging-to-Graph Generation using Adversarial Hierarchical Diffusion Models for MCI Causality Analysis [44.45598796591008]
  Brain imaging-to-graph generation (BIGG) framework is proposed to map functional magnetic resonance imaging (fMRI) into effective connectivity for mild cognitive impairment analysis. The hierarchical transformers in the generator are designed to estimate the noise at multiple scales. Evaluations of the ADNI dataset demonstrate the feasibility and efficacy of the proposed model.
  arXiv  Detail & Related papers  (2023-05-18T06:54:56Z)
• SAR Despeckling using a Denoising Diffusion Probabilistic Model [52.25981472415249]
  The presence of speckle degrades the image quality and adversely affects the performance of SAR image understanding applications. We introduce SAR-DDPM, a denoising diffusion probabilistic model for SAR despeckling. The proposed method achieves significant improvements in both quantitative and qualitative results over the state-of-the-art despeckling methods.
  arXiv  Detail & Related papers  (2022-06-09T14:00:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.