BTS-rPPG: Orthogonal Butterfly Temporal Shifting for Remote Photoplethysmography

• URL: http://arxiv.org/abs/2604.01679v1
• Date: Thu, 02 Apr 2026 06:31:09 GMT
• Title: BTS-rPPG: Orthogonal Butterfly Temporal Shifting for Remote Photoplethysmography
• Abstract summary: Remote photoplethysmography (r) enables contactless physiological sensing from facial videos by analyzing subtle appearance variations induced by blood circulation.<n>We propose BTS-r, a temporal modeling framework based on Ortho Butterfly Temporal Shifting.<n>We show that BTS-r improves long-range temporal modeling of physiological dynamics and consistently outperforms existing temporal modeling strategies for r estimation.
• Score: 2.5608506499175103
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Remote photoplethysmography (rPPG) enables contactless physiological sensing from facial videos by analyzing subtle appearance variations induced by blood circulation. However, modeling the temporal dynamics of these signals remains challenging, as many deep learning methods rely on temporal shifting or convolutional operators that aggregate information primarily from neighboring frames, resulting in predominantly local temporal modeling and limited temporal receptive fields. To address this limitation, we propose BTS-rPPG, a temporal modeling framework based on Orthogonal Butterfly Temporal Shifting (BTS). Inspired by the butterfly communication pattern in the Fast Fourier Transform (FFT), BTS establishes structured frame interactions via an XOR-based butterfly pairing schedule, progressively expanding the temporal receptive field and enabling efficient propagation of information across distant frames. Furthermore, we introduce an orthogonal feature transfer mechanism (OFT) that filters the source feature with respect to the target context before temporal shifting, retaining only the orthogonal component for cross-frame transmission. This reduces redundant feature propagation and encourages complementary temporal interaction. Extensive experiments on multiple benchmark datasets demonstrate that BTS-rPPG improves long-range temporal modeling of physiological dynamics and consistently outperforms existing temporal modeling strategies for rPPG estimation.

Related papers

• DyG$^2$T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer [86.4618122245946]
  DyG$2$T is a dynamics modeling framework that infers object motion trajectories by spatially completing and temporally discriminating Key Point representations.<n>Experiments on both synthetic and real-world datasets demonstrate that DyG$2$T achieves accurate dynamics modeling and reasoning.
  arXiv  Detail & Related papers  (2026-08-19T03:44:28Z)
• Local Spatiotemporal Convolutional Network for Robust Gait Recognition [7.0676119183443395]
  Gait recognition is a promising biometric technology that identifies individuals through their unique walking patterns.<n>Existing approaches rely on either static appearance features extracted from individual silhouette frames or employ complex sequential models.<n>We propose a Local Stemporal Convolutional Network (LSTCN), a structurally simple yet highly effective dual-branch architecture that endows standard two-dimensional convolutional networks with the capacity to extract temporal information.
  arXiv  Detail & Related papers  (2026-05-14T08:28:49Z)
• Eulerian Motion Guidance: Robust Image Animation via Bidirectional Geometric Consistency [74.90075313101933]
  This paper revisits the same optical-flow primitive through a more local supervision design.<n>We use adjacent-frame Eulerian motion fields to guide generation, where the motion signal always describes a short temporal hop.<n>To mitigate the drift artifacts common in adjacent frame generation, we introduce a Bidirectional Geometric Consistency mechanism.
  arXiv  Detail & Related papers  (2026-05-07T13:53:31Z)
• Regime Mapping of Oscillatory States in Balanced Spiking Networks with Multiple Time Scales [0.458354142255472]
  We map how postsynaptic decay (s), conduction delay (d), and plasticity rate (p) jointly shape oscillatory regimes in leaky integrate-and-fire networks.<n>Results provide a useful reference for operating-point selection, synchrony modulation studies, and future biologically grounded spiking-network modeling.
  arXiv  Detail & Related papers  (2026-04-06T15:43:16Z)
• Temporal Graph Pattern Machine [17.352525018007473]
  Temporal Graph Pattern Machine (TGPM) conceptualizes each interaction as an interaction patch synthesized via temporally-biased random walks.<n>TGPM consistently achieves state-of-the-art performance in both transductive and inductive link prediction.
  arXiv  Detail & Related papers  (2026-01-30T01:46:13Z)
• Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurement [0.0]
  Remote photoplethys (rmography) is an emerging physiological sensing technique that leverages subtle color variations in facial videos to estimate vital signs such as heart rate and respiratory rate.<n>This non-invasive technique has gained traction across diverse domains, but its ability to capture fine-grained temporal dynamics under real-world conditions has been underexplored.<n>We propose Graph Reperio-r, a novel framework that strategically integrates a Transformer to effectively capture the periodic structure.
  arXiv  Detail & Related papers  (2025-11-08T09:41:34Z)
• PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement [63.007237197267834]
  Existing deep learning methods are mostly physiological monitoring and lack theoretical robustness.<n>We propose a physics-informed r paradigm derived from the Navier-Stokes equations of hemodynamics, showing that the pulse signal follows a second-order system.<n>This provides a theoretical justification for using a Temporal Conal Network (TCN)<n>Phase-Net achieves state-of-the-art performance with strong efficiency, offering a theoretically grounded and deployment-ready r solution.
  arXiv  Detail & Related papers  (2025-09-29T14:36:45Z)
• Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [42.60778405812048]
  We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
  arXiv  Detail & Related papers  (2025-06-10T18:40:20Z)
• PhysLLM: Harnessing Large Language Models for Cross-Modal Remote Physiological Sensing [49.243031514520794]
  Large Language Models (LLMs) excel at capturing long-range signals due to their text-centric design.<n>PhysLLM achieves state-the-art accuracy and robustness, demonstrating superior generalization across lighting variations and motion scenarios.
  arXiv  Detail & Related papers  (2025-05-06T15:18:38Z)
• Efficient Discovery of Motif Transition Process for Large-Scale Temporal Graphs [28.680759318270727]
  PTMT is a novel method for discovering transition processes in large-scale temporal graphs.<n>It integrates a tree-based framework with the temporal zone (TZP) strategy, which partitions temporal zone by time and structure.<n>Results on 10 real-world datasets demonstrate that PTMT speedups range from 12.0$times$ 50.3$times$ compared to the SOTA method.
  arXiv  Detail & Related papers  (2025-04-22T15:30:04Z)
• PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer [76.40106756572644]
  Recent deep learning approaches focus on mining subtle clues using convolutional neural networks with limited-temporal receptive fields. In this paper, we propose two end-to-end video transformer based on PhysFormer and Phys++++, to adaptively aggregate both local and global features for r representation enhancement. Comprehensive experiments are performed on four benchmark datasets to show our superior performance on both intra-temporal and cross-dataset testing.
  arXiv  Detail & Related papers  (2023-02-07T15:56:03Z)
• Efficient Remote Photoplethysmography with Temporal Derivative Modules and Time-Shift Invariant Loss [6.381149074212898]
  We present a lightweight neural model for remote heart rate estimation. We focus on the efficient-temporal learning of facial photoplethysmography. Compared to existing models, our approach shows competitive accuracy with a much lower number of parameters and lower computational cost.
  arXiv  Detail & Related papers  (2022-03-21T11:08:06Z)
• PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer [55.936527926778695]
  Recent deep learning approaches focus on mining subtle r clues using convolutional neural networks with limited-temporal receptive fields. In this paper, we propose the PhysFormer, an end-to-end video transformer based architecture.
  arXiv  Detail & Related papers  (2021-11-23T18:57:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.