Cross-Modal Generation: From Commodity WiFi to High-Fidelity mmWave and RFID Sensing

• URL: http://arxiv.org/abs/2604.16558v1
• Date: Fri, 17 Apr 2026 08:39:56 GMT
• Title: Cross-Modal Generation: From Commodity WiFi to High-Fidelity mmWave and RFID Sensing
• Abstract summary: AIGC has shown remarkable success in CV and NLP, and has recently demonstrated promising potential in the wireless domain.<n> significant data imbalance exists across RF modalities, with abundant WiFi data but scarce mmWave and RFID data due to high acquisition cost.<n>We propose RF-CMG, a diffusion-based cross-modal generative method that leverages data-rich WiFi signals to synthesize high-fidelity RF data for scarce modalities.
• Score: 16.049962532104182
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: AIGC has shown remarkable success in CV and NLP, and has recently demonstrated promising potential in the wireless domain. However, significant data imbalance exists across RF modalities, with abundant WiFi data but scarce mmWave and RFID data due to high acquisition cost. This makes it difficult to train high-quality generative models for these data-scarce modalities. In this work, we propose RF-CMG, a diffusion-based cross-modal generative method that leverages data-rich WiFi signals to synthesize high-fidelity RF data for scarce modalities including mmWave and RFID. The key insight of RF-CMG is to decouple cross-modal generation into high-frequency guidance and low-frequency constraint, which respectively learn high-frequency distribution from limited target modality data and preserve the underlying physical structure via low-frequency constraints during generation. On this basis, we introduce a Modality-Guided Embedding (MGE) module to steer the reverse diffusion trajectory toward the target high-frequency distribution, and a Low-Frequency Modality Consistency (LFMC) module to progressively enforce low-frequency constraints to suppress the accumulation of source-modality structural biases during inference, enabling high-quality target-modality generation. Performance comparison with several prevalent generative models demonstrates that RF-CMG achieves superior performance in synthesizing RFID and mmWave signals. We further showcase the effectiveness of the data generated by RF-CMG in gesture recognition tasks, and analyze the impact of the proportion of synthetic data on downstream performance.

Related papers

• Semantically Annotated Multimodal Dataset for RF Interpretation and Prediction [4.872063946977515]
  Current limitations in wireless modeling and radio frequency (RF)-based AI are driven by a lack of high-quality, measurement-based datasets that connect RF signals to their physical environments.<n>We propose a new class of multimodal datasets that combines RF measurements with auxiliary modalities like high-resolution cameras and lidar to bridge the gap between RF signals and their physical causes.
  arXiv  Detail & Related papers  (2026-04-01T22:18:01Z)
• RF-GPT: Teaching AI to See the Wireless World [48.294819966466044]
  Large language models (LLMs) and multimodal models have become powerful general-purpose reasoning systems.<n>RF-GPT is a radio-frequency language model (RFLM) that utilizes the visual encoders of multimodals to process and understand RF spectrograms.<n>A text-only LLM then converts these captions into RF-grounded instruction-answer pairs, yielding roughly 12,000 RF scenes and 25 million examples.
  arXiv  Detail & Related papers  (2026-02-16T15:24:56Z)
• CageDroneRF: A Large-Scale RF Benchmark and Toolkit for Drone Perception [10.23151778679351]
  CageDroneRF (CDRF) is a large-scale benchmark for Radio-Frequency (RF) drone detection and identification.<n>CDRF addresses the scarcity and limited diversity of existing RF datasets.<n>This dataset spans a wide range of contemporary drone models.
  arXiv  Detail & Related papers  (2026-01-06T03:39:59Z)
• High-Energy Concentration for Federated Learning in Frequency Domain [62.90597472173119]
  We propose a novel Frequency-Domain aware FL method with high-energy concentration (FedFD) to address this problem.<n>FedFD is inspired by the discovery that the discrete cosine transform predominantly distributes energy to specific regions, referred to as high-energy concentration.<n>On five image and speech datasets, FedFD achieves superior performance than state-of-the-art methods while reducing communication costs.
  arXiv  Detail & Related papers  (2025-09-16T03:49:26Z)
• Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons [69.73249913506042]
  This paper investigates a wireless split computing architecture that employs resonate-and-fire (RF) neurons to process time-domain signals directly.<n>By resonating at tunable frequencies, RF neurons extract time-localized spectral features while maintaining low spiking activity.<n> Experimental results show that the proposed RF-SNN architecture achieves comparable accuracy to conventional LIF-SNNs and ANNs.
  arXiv  Detail & Related papers  (2025-06-24T21:14:59Z)
• Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks [55.467288506826755]
  Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks.<n>Most existing communication-efficient FL algorithms fail to reduce the significant inter-device variance.<n>We propose a novel communication-efficient FL algorithm, named FedQVR, which relies on a sophisticated variance-reduced scheme.
  arXiv  Detail & Related papers  (2025-01-20T04:26:21Z)
• Rydberg Atomic Quantum Receivers for Classical Wireless Communications and Sensing: Their Models and Performance [78.76421728334013]
  Rydberg atomic quantum receivers (RAQRs) are an eminent solution for detecting the electric field of radio frequency (RF) signals.<n>We introduce the RAQR to the wireless community by presenting an end-to-end reception scheme.<n>We then develop a corresponding equivalent baseband signal model relying on a realistic reception flow.
  arXiv  Detail & Related papers  (2024-12-07T06:25:54Z)
• Augmenting Training Data with Vector-Quantized Variational Autoencoder for Classifying RF Signals [9.99212997328053]
  This paper proposes the use of a Vector-Quantized Variational Autoencoder (VQ-VAE) to augment training data. The VQ-VAE model generates high-fidelity synthetic RF signals, increasing the diversity and fidelity of the training dataset. Our experimental results show that incorporating VQ-VAE-generated data significantly improves the classification accuracy of the baseline model.
  arXiv  Detail & Related papers  (2024-10-23T21:17:45Z)
• One-shot Generative Distribution Matching for Augmented RF-based UAV Identification [0.0]
  This work addresses the challenge of identifying Unmanned Aerial Vehicles (UAV) using radiofrequency (RF) fingerprinting in limited RF environments. The complexity and variability of RF signals, influenced by environmental interference and hardware imperfections, often render traditional RF-based identification methods ineffective. One-shot generative methods for augmenting transformed RF signals offer a significant improvement in UAV identification.
  arXiv  Detail & Related papers  (2023-01-20T02:35:43Z)
• Model-based Deep Learning Receiver Design for Rate-Splitting Multiple Access [65.21117658030235]
  This work proposes a novel design for a practical RSMA receiver based on model-based deep learning (MBDL) methods. The MBDL receiver is evaluated in terms of uncoded Symbol Error Rate (SER), throughput performance through Link-Level Simulations (LLS) and average training overhead. Results reveal that the MBDL outperforms by a significant margin the SIC receiver with imperfect CSIR.
  arXiv  Detail & Related papers  (2022-05-02T12:23:55Z)
• Encoding Frequency Constraints in Preventive Unit Commitment Using Deep Learning with Region-of-Interest Active Sampling [8.776029771500689]
  This paper presents a generic data-driven framework for frequency-constrained unit commitment (FCUC) under high renewable penetration. Deep neural networks (DNNs) are trained to predict the frequency response using real data or high-fidelity simulation data. In the data generation phase, all possible power injections are considered, and a region-of-interests active sampling is proposed to include power injection samples with frequency nadirs closer to the UFLC threshold.
  arXiv  Detail & Related papers  (2021-02-18T19:04:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.