mmWEAVER: Environment-Specific mmWave Signal Synthesis from a Photo and Activity Description

• URL: http://arxiv.org/abs/2512.11894v1
• Date: Wed, 10 Dec 2025 03:32:48 GMT
• Title: mmWEAVER: Environment-Specific mmWave Signal Synthesis from a Photo and Activity Description
• Abstract summary: mmWeaver is a novel framework that synthesizes realistic, environment-specific complex mmWave signals.<n>By conditioning on semantic and geometric priors, mmWeaver generates diverse I/Q signals at multiple resolutions.<n>Experiments show that mmWeaver achieves a complex SSIM of 0.88 and a PSNR of 35 dB, outperforming existing methods in signal realism.
• Score: 2.1178416840822027
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Realistic signal generation and dataset augmentation are essential for advancing mmWave radar applications such as activity recognition and pose estimation, which rely heavily on diverse, and environment-specific signal datasets. However, mmWave signals are inherently complex, sparse, and high-dimensional, making physical simulation computationally expensive. This paper presents mmWeaver, a novel framework that synthesizes realistic, environment-specific complex mmWave signals by modeling them as continuous functions using Implicit Neural Representations (INRs), achieving up to 49-fold compression. mmWeaver incorporates hypernetworks that dynamically generate INR parameters based on environmental context (extracted from RGB-D images) and human motion features (derived from text-to-pose generation via MotionGPT), enabling efficient and adaptive signal synthesis. By conditioning on these semantic and geometric priors, mmWeaver generates diverse I/Q signals at multiple resolutions, preserving phase information critical for downstream tasks such as point cloud estimation and activity classification. Extensive experiments show that mmWeaver achieves a complex SSIM of 0.88 and a PSNR of 35 dB, outperforming existing methods in signal realism while improving activity recognition accuracy by up to 7% and reducing human pose estimation error by up to 15%, all while operating 6-35 times faster than simulation-based approaches.

Related papers

• mmSimPrior: Learning Simulation Priors for Data-Efficient and Generalizable Real-World Radar-based Human Motion Reconstruction [12.731621912265986]
  We present mmSimPrior, a simulation-pretrained framework that factorizes transferable knowledge into signal, motion, and radar-to-motion mapping priors.<n>Experiments on mmSimPrior-Real and RT-Pose demonstrate consistent gains.
  arXiv  Detail & Related papers  (2026-07-25T00:56:44Z)
• Flow-Based Generative Modeling for Optimizing Sampling Policies in Compressed Sensing Applications [6.687252358900529]
  We present a flow-based generative framework for learning subsampling masks for compressed sensing applications.<n>For image reconstruction, our method demonstrated state-of-the-art performance, achieving Peak Signal-to-Noise Ratio of 25.17 dB at the subsampling rate of 5%.<n>Results highlight the effectiveness of task-conditioning within generative flow models and reveal a promising direction for representation learning strategies.
  arXiv  Detail & Related papers  (2026-05-22T12:35:05Z)
• Dywave: Event-Aligned Dynamic Tokenization for Heterogeneous IoT Sensing Signals [8.057104516698145]
  Internet of Things (IoT) systems continuously collect heterogeneous sensing signals from ubiquitous sensors.<n>These signals are inherently non-stationary and multi-scale, posing unique challenges for standard tokenization techniques.<n>This paper proposes Dywave, a dynamic tokenization framework for IoT sensing signals.
  arXiv  Detail & Related papers  (2026-05-13T18:27:25Z)
• Implicit Neural Representations: A Signal Processing Perspective [54.57279006229212]
  Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations.<n>This article examines the evolution of INRs from a signal processing perspective, emphasizing spectral behavior, sampling theory, and multiscale representation.<n>We highlight the utility of INRs across a broad range of applications, including inverse problems in medical and radar imaging, compression, and 3D scene representation.
  arXiv  Detail & Related papers  (2026-04-16T14:12:06Z)
• Subtractive Modulative Network with Learnable Periodic Activations [59.89799070130572]
  We propose a novel, parameter-efficient Implicit Neural Representation architecture inspired by classical subtractive synthesis.<n>Our SMN achieves a PSNR of $40+$ dB on two image datasets, comparing favorably against state-of-the-art methods in terms of both reconstruction accuracy and parameter efficiency.
  arXiv  Detail & Related papers  (2026-02-18T10:20:50Z)
• BandRC: Band Shifted Raised Cosine Activated Implicit Neural Representations [0.0]
  Implicit neural representations (INRs) have gained popularity in the computer vision community.<n>These networks can extract a continuous signal representation given a discrete signal representation.<n>We introduce a novel activation function, Band Shifted Raised Cosine Activated Implicit Neural Networks.
  arXiv  Detail & Related papers  (2025-05-16T19:08:01Z)
• Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework [57.994965436344195]
  Beamforming is a key technology in millimeter-wave (mmWave) communications that improves signal transmission by optimizing directionality and intensity.<n> multimodal sensing-aided beam prediction has gained significant attention, using various sensing data to predict user locations or network conditions.<n>Despite its promising potential, the adoption of multimodal sensing-aided beam prediction is hindered by high computational complexity, high costs, and limited datasets.
  arXiv  Detail & Related papers  (2025-04-07T15:38:25Z)
• One Snapshot is All You Need: A Generalized Method for mmWave Signal Generation [15.790309349652196]
  We propose mmGen, a framework tailored for full-scene mmWave signal generation.<n>By constructing physical signal transmission models, mmGen synthesizes human-reflected and environment-reflected mmWave signals.<n>We conduct extensive experiments using a prototype system with commercial mmWave devices and Kinect sensors.
  arXiv  Detail & Related papers  (2025-03-27T03:24:10Z)
• An LSTM Feature Imitation Network for Hand Movement Recognition from sEMG Signals [2.632402517354116]
  We propose utilizing a feature-imitating network (FIN) for closed-form temporal feature learning over a 300ms signal window on Ninapro DB2.<n>We observed that the LSTM-FIN network can achieve up to 99% R2 accuracy in feature reconstruction and 80% accuracy in hand movement recognition.
  arXiv  Detail & Related papers  (2024-05-23T21:45:15Z)
• ResFields: Residual Neural Fields for Spatiotemporal Signals [61.44420761752655]
  ResFields is a novel class of networks specifically designed to effectively represent complex temporal signals. We conduct comprehensive analysis of the properties of ResFields and propose a matrix factorization technique to reduce the number of trainable parameters. We demonstrate the practical utility of ResFields by showcasing its effectiveness in capturing dynamic 3D scenes from sparse RGBD cameras.
  arXiv  Detail & Related papers  (2023-09-06T16:59:36Z)
• Structural Vibration Signal Denoising Using Stacking Ensemble of Hybrid CNN-RNN [0.0]
  In recent years, there has been a growing trend towards the use of vibration signals in the field of bioengineering. Footstep-induced vibrations are useful for analyzing the movement of biological systems such as the human body and animals. In this paper, we propose a novel ensemble model that leverages both the ensemble of multiple signals and of recurrent and convolutional neural network predictions.
  arXiv  Detail & Related papers  (2023-03-11T00:49:45Z)
• Synthetic Wave-Geometric Impulse Responses for Improved Speech Dereverberation [69.1351513309953]
  We show that accurately simulating the low-frequency components of Room Impulse Responses (RIRs) is important to achieving good dereverberation. We demonstrate that speech dereverberation models trained on hybrid synthetic RIRs outperform models trained on RIRs generated by prior geometric ray tracing methods.
  arXiv  Detail & Related papers  (2022-12-10T20:15:23Z)
• Deep Impulse Responses: Estimating and Parameterizing Filters with Deep Networks [76.830358429947]
  Impulse response estimation in high noise and in-the-wild settings is a challenging problem. We propose a novel framework for parameterizing and estimating impulse responses based on recent advances in neural representation learning.
  arXiv  Detail & Related papers  (2022-02-07T18:57:23Z)
• Meta-Learning Sparse Implicit Neural Representations [69.15490627853629]
  Implicit neural representations are a promising new avenue of representing general signals. Current approach is difficult to scale for a large number of signals or a data set. We show that meta-learned sparse neural representations achieve a much smaller loss than dense meta-learned models.
  arXiv  Detail & Related papers  (2021-10-27T18:02:53Z)
• Motion Classification using Kinematically Sifted ACGAN-Synthesized Radar Micro-Doppler Signatures [15.351282873821935]
  In this paper, an extended approach to adversarial learning is proposed for generation of synthetic radar micro-Doppler signatures. The synthetic data is evaluated using visual interpretation, analysis of kinematic consistency, data diversity, dimensions of the latent space, and saliency maps. A 19-layer deep convolutional neural network (DCNN) is trained to classify micro-Doppler signatures acquired from an environment different from that of the dataset supplied to the adversarial network.
  arXiv  Detail & Related papers  (2020-01-19T16:50:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.