radarODE: An ODE-Embedded Deep Learning Model for Contactless ECG Reconstruction from Millimeter-Wave Radar

• URL: http://arxiv.org/abs/2408.01672v1
• Date: Sat, 3 Aug 2024 06:07:15 GMT
• Title: radarODE: An ODE-Embedded Deep Learning Model for Contactless ECG Reconstruction from Millimeter-Wave Radar
• Authors: Yuanyuan Zhang, Runwei Guan, Lingxiao Li, Rui Yang, Yutao Yue, Eng Gee Lim,
• Abstract summary: A novel deep learning framework called radarODE is designed to fuse the temporal and morphological features extracted from radar signals and generate ECG. radarODE achieves better performance compared with the benchmark in terms of missed detection rate, root mean square error, Pearson correlation coefficient with the improvement of 9%, 16% and 19%, respectively.
• Score: 16.52097542165782
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Radar-based contactless cardiac monitoring has become a popular research direction recently, but the fine-grained electrocardiogram (ECG) signal is still hard to reconstruct from millimeter-wave radar signal. The key obstacle is to decouple the cardiac activities in the electrical domain (i.e., ECG) from that in the mechanical domain (i.e., heartbeat), and most existing research only uses pure data-driven methods to map such domain transformation as a black box. Therefore, this work first proposes a signal model for domain transformation, and then a novel deep learning framework called radarODE is designed to fuse the temporal and morphological features extracted from radar signals and generate ECG. In addition, ordinary differential equations are embedded in radarODE as a decoder to provide morphological prior, helping the convergence of the model training and improving the robustness under body movements. After being validated on the dataset, the proposed radarODE achieves better performance compared with the benchmark in terms of missed detection rate, root mean square error, Pearson correlation coefficient with the improvement of 9%, 16% and 19%, respectively. The validation results imply that radarODE is capable of recovering ECG signals from radar signals with high fidelity and can be potentially implemented in real-life scenarios.

Related papers

• radarODE-MTL: A Multi-Task Learning Framework with Eccentric Gradient Alignment for Robust Radar-Based ECG Reconstruction [13.124543736214921]
  This work creatively deconstructs the radar-based ECG recovery into three individual tasks. It proposes a multi-task learning framework, radarODE-MTL, to increase the robustness against consistent and abrupt noises. The experimental results indicate that radarODE-MTL could reconstruct accurate ECG signals robustly from radar signals.
  arXiv  Detail & Related papers  (2024-10-11T09:28:09Z)
• Radar Fields: Frequency-Space Neural Scene Representations for FMCW Radar [62.51065633674272]
  We introduce Radar Fields - a neural scene reconstruction method designed for active radar imagers. Our approach unites an explicit, physics-informed sensor model with an implicit neural geometry and reflectance model to directly synthesize raw radar measurements. We validate the effectiveness of the method across diverse outdoor scenarios, including urban scenes with dense vehicles and infrastructure.
  arXiv  Detail & Related papers  (2024-05-07T20:44:48Z)
• Multi-stage Learning for Radar Pulse Activity Segmentation [51.781832424705094]
  Radio signal recognition is a crucial function in electronic warfare. Precise identification and localisation of radar pulse activities are required by electronic warfare systems. Deep learning-based radar pulse activity recognition methods have remained largely underexplored.
  arXiv  Detail & Related papers  (2023-12-15T01:56:27Z)
• Echoes Beyond Points: Unleashing the Power of Raw Radar Data in Multi-modality Fusion [74.84019379368807]
  We propose a novel method named EchoFusion to skip the existing radar signal processing pipeline. Specifically, we first generate the Bird's Eye View (BEV) queries and then take corresponding spectrum features from radar to fuse with other sensors.
  arXiv  Detail & Related papers  (2023-07-31T09:53:50Z)
• Semantic Segmentation of Radar Detections using Convolutions on Point Clouds [59.45414406974091]
  We introduce a deep-learning based method to convolve radar detections into point clouds. We adapt this algorithm to radar-specific properties through distance-dependent clustering and pre-processing of input point clouds. Our network outperforms state-of-the-art approaches that are based on PointNet++ on the task of semantic segmentation of radar point clouds.
  arXiv  Detail & Related papers  (2023-05-22T07:09:35Z)
• Deep Radar Inverse Sensor Models for Dynamic Occupancy Grid Maps [0.0]
  We propose a deep learning-based Inverse Sensor Model (ISM) to learn the mapping from sparse radar detections to polar measurement grids. Our approach is the first one to learn a single-frame measurement grid in the polar scheme from radars with a limited Field Of View. This enables us to flexibly use one or more radar sensors without network retraining and without requirements on 360deg sensor coverage.
  arXiv  Detail & Related papers  (2023-05-21T09:09:23Z)
• Human Behavior Recognition Method Based on CEEMD-ES Radar Selection [12.335803365712277]
  millimeter-wave radar to identify human behavior has been widely used in medical,security, and other fields. Processing multiple radar data also requires a lot of time and computational cost. The Complementary Ensemble Empirical Mode Decomposition-Energy Slice (CEEMD-ES) multistatic radar selection method is proposed to solve these problems. Experiments show that this method can effectively select the radar, and the recognition rate of three kinds of human actions is 98.53%.
  arXiv  Detail & Related papers  (2022-06-06T16:01:06Z)
• Unsupervised Domain Adaptation across FMCW Radar Configurations Using Margin Disparity Discrepancy [17.464353263281907]
  In this work, we consider the problem of unsupervised domain adaptation across radar configurations in the context of deep-learning human activity classification. We focus on the theory-inspired technique of Margin Disparity Discrepancy, which has already been proved successful in the area of computer vision. Our experiments extend this technique to radar data, achieving a comparable accuracy to fewshot supervised approaches for the same classification problem.
  arXiv  Detail & Related papers  (2022-03-09T09:11:06Z)
• Complex-valued Convolutional Neural Networks for Enhanced Radar Signal Denoising and Interference Mitigation [73.0103413636673]
  We propose the use of Complex-Valued Convolutional Neural Networks (CVCNNs) to address the issue of mutual interference between radar sensors. CVCNNs increase data efficiency, speeds up network training and substantially improves the conservation of phase information during interference removal.
  arXiv  Detail & Related papers  (2021-04-29T10:06:29Z)
• RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects [73.80316195652493]
  We tackle the problem of exploiting Radar for perception in the context of self-driving cars. We propose a new solution that exploits both LiDAR and Radar sensors for perception. Our approach, dubbed RadarNet, features a voxel-based early fusion and an attention-based late fusion.
  arXiv  Detail & Related papers  (2020-07-28T17:15:02Z)
• RSS-Net: Weakly-Supervised Multi-Class Semantic Segmentation with FMCW Radar [26.56755178602111]
  We advocate radar over the traditional sensors used for this task as it operates at longer ranges and is substantially more robust to adverse weather and illumination conditions. We exploit the largest radar-focused urban autonomy dataset collected to date, correlating radar scans with RGB cameras and LiDAR sensors. We present the network with multi-channel radar scan inputs in order to deal with ephemeral and dynamic scene objects.
  arXiv  Detail & Related papers  (2020-04-02T11:40:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.