Scalable RF Simulation in Generative 4D Worlds

• URL: http://arxiv.org/abs/2508.12176v1
• Date: Sat, 16 Aug 2025 23:02:14 GMT
• Title: Scalable RF Simulation in Generative 4D Worlds
• Abstract summary: WaveVerse is a prompt-based, scalable framework that simulates realistic RF signals from generated indoor scenes with human motions.<n> Experiments demonstrate the effectiveness of our approach in conditioned human motion generation and highlight how phase coherence is applied to beamforming and respiration monitoring.
• Score: 12.977761033016503
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Radio Frequency (RF) sensing has emerged as a powerful, privacy-preserving alternative to vision-based methods for indoor perception tasks. However, collecting high-quality RF data in dynamic and diverse indoor environments remains a major challenge. To address this, we introduce WaveVerse, a prompt-based, scalable framework that simulates realistic RF signals from generated indoor scenes with human motions. WaveVerse introduces a language-guided 4D world generator, which includes a state-aware causal transformer for human motion generation conditioned on spatial constraints and texts, and a phase-coherent ray tracing simulator that enables the simulation of accurate and coherent RF signals. Experiments demonstrate the effectiveness of our approach in conditioned human motion generation and highlight how phase coherence is applied to beamforming and respiration monitoring. We further present two case studies in ML-based high-resolution imaging and human activity recognition, demonstrating that WaveVerse not only enables data generation for RF imaging for the first time, but also consistently achieves performance gain in both data-limited and data-adequate scenarios.

Related papers

• Task-Relevant Feature-Dynamics Fidelity Enables Zero-Shot Sim-to-Real Transfer for Robotic Ultrasound Scanning [58.25007580703646]
  We develop a TR-oriented ultrasound simulator that combines a shared structural intermediate domain, trajectory-level fixed noise, and few-step conditional flow generation.<n>In phantom experiments, a policy trained exclusively in simulation succeeded in 390 of 400 zero-shot deployments across four target planes.
  arXiv  Detail & Related papers  (2026-08-30T02:37:00Z)
• RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction [51.76737991200891]
  Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets.<n>We introduce Hand2Bot, an RGB-D video dataset that provides rich contextual information such as body posture and facial expressions.<n>We propose PassGen, a generative pipeline that synthesizes realistic handover sequences while ensuring hand-object consistency.
  arXiv  Detail & Related papers  (2026-08-13T09:55:59Z)
• RF-HOI: Recognize Human-Object Interaction with Radio Frequency Signals [19.108452211899984]
  We introduce RF-HOI, the first framework that only uses radio frequency (RF) signals for HOI recognition.<n>A key challenge of RF-HOI is that single-modality RF sensing is insufficient to recognize both actions and the objects being interacted with.<n>We develop a simulator that synthesizes multimodal RF data for diverse HOIs at scale, allowing us to fine-tune with only a small amount of real-world data.
  arXiv  Detail & Related papers  (2026-07-31T20:58:00Z)
• Semantically Annotated Multimodal Dataset for RF Interpretation and Prediction [4.872063946977515]
  Current limitations in wireless modeling and radio frequency (RF)-based AI are driven by a lack of high-quality, measurement-based datasets that connect RF signals to their physical environments.<n>We propose a new class of multimodal datasets that combines RF measurements with auxiliary modalities like high-resolution cameras and lidar to bridge the gap between RF signals and their physical causes.
  arXiv  Detail & Related papers  (2026-04-01T22:18:01Z)
• A Latent Representation Learning Framework for Hyperspectral Image Emulation in Remote Sensing [2.607903424600012]
  We propose a latent representation-based framework for hyperspectral emulation that learns a latent generative representation of hyperspectral data.<n>The proposed approach supports both spectrum-level and spatial-spectral emulation and can be trained either in a direct one-step formulation or in a two-step strategy.<n> Experiments on PROSAIL-simulated vegetation data and Sentinel-3 OLCI imagery demonstrate that the method outperforms classical regression-based emulators.
  arXiv  Detail & Related papers  (2026-03-23T12:32:09Z)
• Physically Accurate Differentiable Inverse Rendering for Radio Frequency Digital Twin [48.52428157677096]
  Digital twins, virtual simulated replicas of physical scenes, are transforming system design across industries.<n>RFDT resolves discontinuities with a physically grounded edge-diffraction transition function.
  arXiv  Detail & Related papers  (2026-03-05T23:59:15Z)
• RadioGen3D: 3D Radio Map Generation via Adversarial Learning on Large-Scale Synthetic Data [62.63849426834315]
  Radio maps are essential for efficient radio resource management in future 6G and low-altitude networks.<n>Deep learning (DL) techniques have emerged as an efficient alternative to conventional ray-tracing for radio map estimation.<n>We present the RadioGen3D framework to capture essential 3D signal propagation characteristics and antenna polarization effects.
  arXiv  Detail & Related papers  (2026-02-21T07:50:05Z)
• K-Syn: K-space Data Synthesis in Ultra Low-data Regimes [0.7817545394809559]
  This letter focuses on feature-level modeling in the frequency domain, enabling stable and rich generation even with ultra low-data regimes.<n>We integrate k-space data across time frames with multiple fusion strategies to steer and further optimize the generative trajectory.<n> Experimental results demonstrate that the proposed method possesses strong generative ability in low-data regimes.
  arXiv  Detail & Related papers  (2025-09-04T12:25:05Z)
• TIR-Diffusion: Diffusion-based Thermal Infrared Image Denoising via Latent and Wavelet Domain Optimization [11.970228442183476]
  We propose a diffusion-based TIR image denoising framework.<n>Our method fine-tunes the model via a novel loss function combining latent-space and discrete wavelet transform (DWT) / dual-tree complex wavelet transform (DTCWT) losses.<n> Experiments on benchmark datasets demonstrate superior performance of our approach compared to state-of-the-art denoising methods.
  arXiv  Detail & Related papers  (2025-07-30T06:27:32Z)
• Bridging Simulation and Reality: A 3D Clustering-Based Deep Learning Model for UAV-Based RF Source Localization [0.0]
  Unmanned aerial vehicles (UAVs) offer significant advantages for RF source localization over terrestrial methods.<n>Recent advancements in deep learning (DL) have further enhanced localization accuracy, particularly for outdoor scenarios.<n>We propose the 3D Cluster-Based RealAdaptRNet, a DL-based method leveraging 3D clustering-based feature extraction for robust localization.
  arXiv  Detail & Related papers  (2025-02-02T05:48:44Z)
• UltraRay: Introducing Full-Path Ray Tracing in Physics-Based Ultrasound Simulation [40.1753412384811]
  We propose a novel ultrasound simulation pipeline that utilizes a ray tracing algorithm to generate echo data.<n>To replicate advanced ultrasound imaging, we introduce a ray emission scheme optimized for plane wave imaging, incorporating delay and steering capabilities.<n>In doing so, our proposed approach, UltraRay, not only enhances the overall visual quality but also improves the realism of the simulated images.
  arXiv  Detail & Related papers  (2025-01-10T10:07:41Z)
• A Novel Diffusion Model for Pairwise Geoscience Data Generation with Unbalanced Training Dataset [8.453075713579631]
  We present UB-Diff'', a novel diffusion model for multi-modal paired scientific data generation.<n>One major innovation is a one-in-two-out encoder-decoder network structure, which can ensure pairwise data is obtained from a co-latent representation.<n> Experimental results on the OpenFWI dataset show that UB-Diff significantly outperforms existing techniques in terms of Fr'echet Inception Distance (FID) score and pairwise evaluation.
  arXiv  Detail & Related papers  (2025-01-01T19:49:38Z)
• High Resolution Seismic Waveform Generation using Denoising Diffusion [3.633418605694802]
  HighFEM is a generative model for high-frequency seismic-waveform generation.<n>A spectrogram representation of the seismic-waveform data is reduced to a lower-dimensional manifold via an autoencoder.<n>A state-of-the-art diffusion model is trained to generate this latent representation conditioned on key input parameters.
  arXiv  Detail & Related papers  (2024-10-25T07:01:48Z)
• KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter [49.85369344101118]
  We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea is to model the dynamic radiance field as a dynamic system whose temporally varying states are estimated based on two sources of knowledge: observations and predictions. Our KFD-NeRF demonstrates similar or even superior performance within comparable computational time and state-of-the-art view synthesis performance with thorough training.
  arXiv  Detail & Related papers  (2024-07-18T05:48:24Z)
• RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applications [55.24463002889]
  We focus on depth data synthesis and develop a range-aware RGB-D data simulation pipeline (RaSim) In particular, high-fidelity depth data is generated by imitating the imaging principle of real-world sensors. RaSim can be directly applied to real-world scenarios without any finetuning and excel at downstream RGB-D perception tasks.
  arXiv  Detail & Related papers  (2024-04-05T08:52:32Z)
• Towards High-quality HDR Deghosting with Conditional Diffusion Models [88.83729417524823]
  High Dynamic Range (LDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. DNNs still generate ghosting artifacts when LDR images have saturation and large motion. We formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition.
  arXiv  Detail & Related papers  (2023-11-02T01:53:55Z)
• Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing data [37.69303106863453]
  We propose a novel approach for phase-resolved wave surface reconstruction using neural networks. Our approach utilizes synthetic yet highly realistic training data on uniform one-dimensional grids.
  arXiv  Detail & Related papers  (2023-05-18T12:30:26Z)
• Joint fMRI Decoding and Encoding with Latent Embedding Alignment [77.66508125297754]
  We introduce a unified framework that addresses both fMRI decoding and encoding. Our model concurrently recovers visual stimuli from fMRI signals and predicts brain activity from images within a unified framework.
  arXiv  Detail & Related papers  (2023-03-26T14:14:58Z)
• Synthetic Wave-Geometric Impulse Responses for Improved Speech Dereverberation [69.1351513309953]
  We show that accurately simulating the low-frequency components of Room Impulse Responses (RIRs) is important to achieving good dereverberation. We demonstrate that speech dereverberation models trained on hybrid synthetic RIRs outperform models trained on RIRs generated by prior geometric ray tracing methods.
  arXiv  Detail & Related papers  (2022-12-10T20:15:23Z)
• VMRF: View Matching Neural Radiance Fields [57.93631771072756]
  VMRF is an innovative view matching NeRF that enables effective NeRF training without requiring prior knowledge in camera poses or camera pose distributions. VMRF introduces a view matching scheme, which exploits unbalanced optimal transport to produce a feature transport plan for mapping a rendered image with randomly camera pose to the corresponding real image. With the feature transport plan as the guidance, a novel pose calibration technique is designed which rectifies the initially randomized camera poses by predicting relative pose between the pair of rendered and real images.
  arXiv  Detail & Related papers  (2022-07-06T12:26:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.