Deep Pulse-Signal Magnification for remote Heart Rate Estimation in Compressed Videos

• URL: http://arxiv.org/abs/2405.02652v2
• Date: Tue, 25 Jun 2024 16:53:21 GMT
• Title: Deep Pulse-Signal Magnification for remote Heart Rate Estimation in Compressed Videos
• Abstract summary: We present a novel approach to address the impact of video compression on r estimation. We validate our model by exhaustive evaluations on two publicly available datasets.
• Score: 9.094127664014628
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advancements in data-driven approaches for remote photoplethysmography (rPPG) have significantly improved the accuracy of remote heart rate estimation. However, the performance of such approaches worsens considerably under video compression, which is nevertheless necessary to store and transmit video data efficiently. In this paper, we present a novel approach to address the impact of video compression on rPPG estimation, which leverages a pulse-signal magnification transformation to adapt compressed videos to an uncompressed data domain in which the rPPG signal is magnified. We validate the effectiveness of our model by exhaustive evaluations on two publicly available datasets, UCLA-rPPG and UBFC-rPPG, employing both intra- and cross-database performance at several compression rates. Additionally, we assess the robustness of our approach on two additional highly compressed and widely-used datasets, MAHNOB-HCI and COHFACE, which reveal outstanding heart rate estimation results.

Related papers

• StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning [24.385061454563836]
  Remote photoplethysmography (rmography) estimates the blood volume pulse (BVP) signal from facial videos, enabling contact-free health monitoring.<n> Conventional clip-wise approaches, which use video clips as input, require capturing over one hundred frames before introducing inference.<n>We propose Stream, a unified architecture that enables low-latency frame-wise physiological signal estimation.
  arXiv  Detail & Related papers  (2026-06-22T11:31:01Z)
• MTC-VAE: Multi-Level Temporal Compression with Content Awareness [54.85288415164888]
  Latent Video Diffusion Models (LVDMs) rely on Variational Autoencoders (VAEs) to compress videos into compact latent representations.<n>We present a technique to convert fixed compression rate VAEs into models that support multi-level temporal compression.
  arXiv  Detail & Related papers  (2026-02-01T17:08:02Z)
• Joint Lossless Compression and Steganography for Medical Images via Large Language Models [63.454510290574355]
  We propose a novel joint lossless compression and steganography framework for medical images.<n>Inspired by bit plane slicing (BPS), we find it feasible to embed privacy messages into medical images in an invisible manner.
  arXiv  Detail & Related papers  (2025-08-03T14:45:51Z)
• Towards Accurate Heart Rate Measurement from Ultra-Short Video Clips via Periodicity-Guided rPPG Estimation and Signal Reconstruction [8.153034573979857]
  We aim to accurately measure HR from ultra-short 2-second video clips by addressing two key challenges.<n>First, to overcome the limited number of heartbeat cycles in ultra-short video clips, we propose an effective periodicity-guided r estimation method.<n>Second, to mitigate inaccuracies due to spectral leakage, we propose a generator to reconstruct longer r signals.
  arXiv  Detail & Related papers  (2025-06-27T10:05:00Z)
• Higher fidelity perceptual image and video compression with a latent conditioned residual denoising diffusion model [55.2480439325792]
  We propose a hybrid compression scheme optimized for perceptual quality, extending the approach of the CDC model with a decoder network.<n>We achieve up to +2dB PSNR fidelity improvements while maintaining comparable LPIPS and FID perceptual scores when compared with CDC.
  arXiv  Detail & Related papers  (2025-05-19T14:13:14Z)
• Embedding Compression Distortion in Video Coding for Machines [67.97469042910855]
  Currently, video transmission serves not only the Human Visual System (HVS) for viewing but also machine perception for analysis. We propose a Compression Distortion Embedding (CDRE) framework, which extracts machine-perception-related distortion representation and embeds it into downstream models. Our framework can effectively boost the rate-task performance of existing codecs with minimal overhead in terms of execution time, and number of parameters.
  arXiv  Detail & Related papers  (2025-03-27T13:01:53Z)
• Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models [45.94962431110573]
  Camera-based monitoring of vital signs, also known as imaging photoplethysmography (i), has seen applications in driver-monitoring, affective computing, and more. We introduce methods that combine signal processing and deep learning methods in an inverse problem.
  arXiv  Detail & Related papers  (2025-03-21T16:11:21Z)
• Generative Diffusion Model-based Compression of MIMO CSI [17.15101539701981]
  Experimental results show that our method significantly outperforms existing CSI compression algorithms. These findings underscore the potential of diffusion-based compression for practical deployment in communication systems.
  arXiv  Detail & Related papers  (2025-02-07T02:24:12Z)
• Deep adaptative spectral zoom for improved remote heart rate estimation [10.220888127527152]
  Chirp-Z Transform (CZT) can refine the spectrum to the narrow-band range of interest for heart rate, providing improved frequential resolution and, consequently, more accurate estimation. This paper presents the advantages of employing the CZT for remote HR estimation and introduces a novel data-driven adaptive CZT estimator.
  arXiv  Detail & Related papers  (2024-03-11T16:55:19Z)
• SpikeCodec: An End-to-end Learned Compression Framework for Spiking Camera [48.194993029659685]
  Bio-inspired spike camera with continuous motion recording capability has attracted tremendous attention. We propose a novel learned spike compression framework using scene recovery, variational auto-encoder plus spike simulator. To our knowledge, it is the first data-trained model for efficient and robust spike stream compression.
  arXiv  Detail & Related papers  (2023-06-25T03:11:21Z)
• Cross Modal Compression: Towards Human-comprehensible Semantic Compression [73.89616626853913]
  Cross modal compression is a semantic compression framework for visual data. We show that our proposed CMC can achieve encouraging reconstructed results with an ultrahigh compression ratio.
  arXiv  Detail & Related papers  (2022-09-06T15:31:11Z)
• Learned Video Compression via Heterogeneous Deformable Compensation Network [78.72508633457392]
  We propose a learned video compression framework via heterogeneous deformable compensation strategy (HDCVC) to tackle the problems of unstable compression performance. More specifically, the proposed algorithm extracts features from the two adjacent frames to estimate content-Neighborhood heterogeneous deformable (HetDeform) kernel offsets. Experimental results indicate that HDCVC achieves superior performance than the recent state-of-the-art learned video compression approaches.
  arXiv  Detail & Related papers  (2022-07-11T02:31:31Z)
• Flexible-Rate Learned Hierarchical Bi-Directional Video Compression With Motion Refinement and Frame-Level Bit Allocation [8.80688035831646]
  We combine motion estimation and prediction modules and compress refined residual motion vectors for improved rate-distortion performance. We exploit the gain unit to control bit allocation among intra-coded vs. bi-directionally coded frames.
  arXiv  Detail & Related papers  (2022-06-27T20:18:52Z)
• Coarse-to-fine Deep Video Coding with Hyperprior-guided Mode Prediction [50.361427832256524]
  We propose a coarse-to-fine (C2F) deep video compression framework for better motion compensation. Our C2F framework can achieve better motion compensation results without significantly increasing bit costs.
  arXiv  Detail & Related papers  (2022-06-15T11:38:53Z)
• Efficient Data Compression for 3D Sparse TPC via Bicephalous Convolutional Autoencoder [8.759778406741276]
  This work introduces a dual-head autoencoder to resolve sparsity and regression simultaneously, called textitBicephalous Convolutional AutoEncoder (BCAE) It shows advantages both in compression fidelity and ratio compared to traditional data compression methods, such as MGARD, SZ, and ZFP.
  arXiv  Detail & Related papers  (2021-11-09T21:26:37Z)
• DVC-P: Deep Video Compression with Perceptual Optimizations [22.54270922884164]
  We introduce deep video compression with perceptual optimizations (DVC-P), which aims at increasing perceptual quality of decoded videos. Specifically, a discriminator network and a mixed loss are employed to help our network trade off among distortion, perception and rate.
  arXiv  Detail & Related papers  (2021-09-22T17:20:13Z)
• Towards Compact CNNs via Collaborative Compression [166.86915086497433]
  We propose a Collaborative Compression scheme, which joints channel pruning and tensor decomposition to compress CNN models. We achieve 52.9% FLOPs reduction by removing 48.4% parameters on ResNet-50 with only a Top-1 accuracy drop of 0.56% on ImageNet 2012.
  arXiv  Detail & Related papers  (2021-05-24T12:07:38Z)
• A Foreground-background Parallel Compression with Residual Encoding for Surveillance Video [46.49202082648197]
  We propose a video compression method that extracts and compresses the foreground and background of the video separately. Our proposed method requires 69.5% less bpp (bits per pixel) than the conventional algorithm H.265 to achieve the same PSNR (36 dB) on the HECV dataset.
  arXiv  Detail & Related papers  (2020-01-18T03:35:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.