RadHARSimulator V2: Video to Doppler Generator

• URL: http://arxiv.org/abs/2511.09022v1
• Date: Thu, 13 Nov 2025 01:26:26 GMT
• Title: RadHARSimulator V2: Video to Doppler Generator
• Abstract summary: A simulator that directly generates Doppler spectra from recorded video footage is presented in this paper.<n>Both computer vision and radar modules are included in the simulator.<n>A hybrid parallel serial neural network architecture is proposed for radar-based HAR.
• Score: 1.3706331473063882
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Radar-based human activity recognition (HAR) still lacks a comprehensive simulation method. Existing software is developed based on models or motion-captured data, resulting in limited flexibility. To address this issue, a simulator that directly generates Doppler spectra from recorded video footage (RadHARSimulator V2) is presented in this paper. Both computer vision and radar modules are included in the simulator. In computer vision module, the real-time model for object detection with global nearest neighbor is first used to detect and track human targets in the video. Then, the high-resolution network is used to estimate two-dimensional poses of the detected human targets. Next, the three-dimensional poses of the detected human targets are obtained by nearest matching method. Finally, smooth temporal three-dimensional pose estimation is achieved through Kalman filtering. In radar module, pose interpolation and smoothing are first achieved through the Savitzky-Golay method. Second, the delay model and the mirror method are used to simulate echoes in both free-space and through-the-wall scenarios. Then, range-time map is generated using pulse compression, moving target indication, and DnCNN. Next, Doppler-time map (DTM) is generated using short-time Fourier transform and DnCNN again. Finally, the ridge features on the DTM are extracted using the maximum local energy method. In addition, a hybrid parallel-serial neural network architecture is proposed for radar-based HAR. Numerical experiments are conducted and analyzed to demonstrate the effectiveness of the designed simulator and the proposed network model. The open-source code of this work can be found in: https://github.com/JoeyBGOfficial/RadHARSimulatorV2-Video-to-Doppler-Generator.

Related papers

• HybridSim: A Physics-Learning Hybrid Digital Twin for mmWave Human Sensing [16.25180983132509]
  HybridSim is a physics-learning hybrid simulator that synthesizes mmWave radar signals from dynamic human meshes under a fixed indoor room configuration.<n>We show improved agreement with a physically based reference and consistent gains on downstream radar-based human sensing tasks when using HybridSim for site-specific data augmentation.
  arXiv  Detail & Related papers  (2026-07-17T10:20:31Z)
• milliMamba: Specular-Aware Human Pose Estimation via Dual mmWave Radar with Multi-Frame Mamba Fusion [24.89937570181235]
  We present a radar-based 2D human pose estimation framework.<n>We use a Cross-View Fusion Mamba to efficiently extract features from longer sequences.<n>We also incorporate a velocity loss alongside standard keypoint loss during training.
  arXiv  Detail & Related papers  (2025-12-23T07:40:25Z)
• iGaussian: Real-Time Camera Pose Estimation via Feed-Forward 3D Gaussian Splatting Inversion [62.09575122593993]
  iGaussian is a two-stage feed-forward framework that achieves real-time camera pose estimation through direct 3D Gaussian inversion.<n> Experimental results on the NeRF Synthetic, Mip-NeRF 360, and T&T+DB datasets demonstrate a significant performance improvement over previous methods.
  arXiv  Detail & Related papers  (2025-11-18T05:22:22Z)
• MoCap2Radar: A Spatiotemporal Transformer for Synthesizing Micro-Doppler Radar Signatures from Motion Capture [1.4937905358679553]
  We present a pure machine learning process for synthesizing radar spectrograms from Motion-Capture (MoCap) data.<n>We formulate MoCap-to-spectrogram translation as a windowed sequence-to-sequence task using a transformer-based model.<n>Experiments show that the proposed approach produces visually and quantitatively plausible doppler radar spectrograms.
  arXiv  Detail & Related papers  (2025-11-14T16:35:14Z)
• Pseudo Depth Meets Gaussian: A Feed-forward RGB SLAM Baseline [64.42938561167402]
  We propose an online 3D reconstruction method using 3D Gaussian-based SLAM, combined with a feed-forward recurrent prediction module.<n>This approach replaces slow test-time optimization with fast network inference, significantly improving tracking speed.<n>Our method achieves performance on par with the state-of-the-art SplaTAM, while reducing tracking time by more than 90%.
  arXiv  Detail & Related papers  (2025-08-06T16:16:58Z)
• Through-the-Wall Radar Human Activity Recognition WITHOUT Using Neural Networks [0.0]
  I would like to try to return to the original path by attempting to eschew neural networks to achieve the TWR HAR task.<n>The micro-Doppler segmentation feature is discretized into a two-dimensional point cloud.<n>The effectiveness of the proposed method is demonstrated by numerical simulated and measured experiments.
  arXiv  Detail & Related papers  (2025-06-05T15:45:08Z)
• Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model [63.336123527432136]
  We introduce Bench2Drive-R, a generative framework that enables reactive closed-loop evaluation.<n>Unlike existing video generative models for autonomous driving, the proposed designs are tailored for interactive simulation.<n>We compare the generation quality of Bench2Drive-R with existing generative models and achieve state-of-the-art performance.
  arXiv  Detail & Related papers  (2024-12-11T06:35:18Z)
• GPS-Gaussian+: Generalizable Pixel-wise 3D Gaussian Splatting for Real-Time Human-Scene Rendering from Sparse Views [67.34073368933814]
  We propose a generalizable Gaussian Splatting approach for high-resolution image rendering under a sparse-view camera setting. We train our Gaussian parameter regression module on human-only data or human-scene data, jointly with a depth estimation module to lift 2D parameter maps to 3D space. Experiments on several datasets demonstrate that our method outperforms state-of-the-art methods while achieving an exceeding rendering speed.
  arXiv  Detail & Related papers  (2024-11-18T08:18:44Z)
• EM-GANSim: Real-time and Accurate EM Simulation Using Conditional GANs for 3D Indoor Scenes [55.2480439325792]
  We present a novel machine-learning (ML) approach (EM-GANSim) for real-time electromagnetic (EM) propagation.<n>In practice, it can compute the signal strength in a few milliseconds on any location in 3D indoor environments.
  arXiv  Detail & Related papers  (2024-05-27T17:19:02Z)
• G3R: Generating Rich and Fine-grained mmWave Radar Data from 2D Videos for Generalized Gesture Recognition [19.95047010486547]
  We develop a software pipeline that exploits wealthy 2D videos to generate realistic radar data. It addresses the challenge of simulating diversified and fine-grained reflection properties of user gestures. We implement and evaluate G3R using 2D videos from public data sources and self-collected real-world radar data.
  arXiv  Detail & Related papers  (2024-04-23T11:22:59Z)
• Generation of Realistic Synthetic Raw Radar Data for Automated Driving Applications using Generative Adversarial Networks [0.0]
  This work proposes a faster method for FMCW radar simulation capable of generating synthetic raw radar data using generative adversarial networks (GAN) The code and pre-trained weights are open-source and available on GitHub. Results have shown that the data is realistic in terms of coherent radar reflections of the motorcycle and background noise based on the comparison of chirps, the RA maps and the object detection results.
  arXiv  Detail & Related papers  (2023-08-04T17:44:27Z)
• Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes [69.03289331433874]
  We present an end-to-end audio rendering approach (Listen2Scene) for virtual reality (VR) and augmented reality (AR) applications. We propose a novel neural-network-based sound propagation method to generate acoustic effects for 3D models of real environments.
  arXiv  Detail & Related papers  (2023-02-02T04:09:23Z)
• iSDF: Real-Time Neural Signed Distance Fields for Robot Perception [64.80458128766254]
  iSDF is a continuous learning system for real-time signed distance field reconstruction. It produces more accurate reconstructions and better approximations of collision costs and gradients.
  arXiv  Detail & Related papers  (2022-04-05T15:48:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.