Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels

• URL: http://arxiv.org/abs/2512.04966v1
• Date: Thu, 04 Dec 2025 16:35:09 GMT
• Title: Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels
• Authors: Guangming Liang, Mingjie Yang, Dongzhu Liu, Paul Henderson, Lajos Hanzo,
• Abstract summary: This treatise investigates pilot-free channel inference that estimates complete CSI directly from multimodal observations.<n>We develop a data-driven framework that formulates the sensing-to-channel mapping as a cross-modal flow matching problem.<n>In experiments, we build a procedural data generator based on Sionna and Blender to support realistic modeling of sensing scenes and wireless propagation.
• Score: 45.969793510760645
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate channel state information (CSI) underpins reliable and efficient wireless communication. However, acquiring CSI via pilot estimation incurs substantial overhead, especially in massive multiple-input multiple-output (MIMO) systems operating in high-Doppler environments. By leveraging the growing availability of environmental sensing data, this treatise investigates pilot-free channel inference that estimates complete CSI directly from multimodal observations, including camera images, LiDAR point clouds, and GPS coordinates. In contrast to prior studies that rely on predefined channel models, we develop a data-driven framework that formulates the sensing-to-channel mapping as a cross-modal flow matching problem. The framework fuses multimodal features into a latent distribution within the channel domain, and learns a velocity field that continuously transforms the latent distribution toward the channel distribution. To make this formulation tractable and efficient, we reformulate the problem as an equivalent conditional flow matching objective and incorporate a modality alignment loss, while adopting low-latency inference mechanisms to enable real-time CSI estimation. In experiments, we build a procedural data generator based on Sionna and Blender to support realistic modeling of sensing scenes and wireless propagation. System-level evaluations demonstrate significant improvements over pilot- and sensing-based benchmarks in both channel estimation accuracy and spectral efficiency for the downstream beamforming task.

Related papers

• Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels [49.624608869195065]
  We propose the context video semantic transmission (CVST) framework for wireless video transmission.<n>We learn a context-channel correlation map to explicitly formulate the relationships between feature groups and multiple input multiple output (MIMO) subchannels.<n>We demonstrate substantial performance gains over various standardized separated coding methods and recent wireless video semantic communication approaches.
  arXiv  Detail & Related papers  (2025-12-23T10:48:43Z)
• Flow matching-based generative models for MIMO channel estimation [13.894304144975552]
  Diffusion model (DM)-based channel estimation has shown potential in high-precision channel state information (CSI) acquisition.<n>We propose a novel flow matching (FM)-based generative model for multiple-input multiple-output (MIMO) channel estimation.<n>It achieves superior channel estimation accuracy under different channel conditions.
  arXiv  Detail & Related papers  (2025-11-14T04:05:23Z)
• Unsupervised Radio Map Construction in Mixed LoS/NLoS Indoor Environments [34.91945910235526]
  This paper aims to recover the data collection trajectory directly from the channel propagation sequence.<n>The proposed method achieves an average localization accuracy of 0.65 meters in an indoor environment.
  arXiv  Detail & Related papers  (2025-10-09T09:53:24Z)
• Channel Fingerprint Construction for Massive MIMO: A Deep Conditional Generative Approach [65.47969413708344]
  We introduce the concept of CF twins and design a conditional generative diffusion model (CGDM)<n>We employ a variational inference technique to derive the evidence lower bound (ELBO) for the log-marginal distribution of the observed fine-grained CF conditioned on the coarse-grained CF.<n>We show that the proposed approach exhibits significant improvement in reconstruction performance compared to the baselines.
  arXiv  Detail & Related papers  (2025-05-12T01:36:06Z)
• Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework [57.994965436344195]
  Beamforming is a key technology in millimeter-wave (mmWave) communications that improves signal transmission by optimizing directionality and intensity.<n> multimodal sensing-aided beam prediction has gained significant attention, using various sensing data to predict user locations or network conditions.<n>Despite its promising potential, the adoption of multimodal sensing-aided beam prediction is hindered by high computational complexity, high costs, and limited datasets.
  arXiv  Detail & Related papers  (2025-04-07T15:38:25Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Deep Learning Based Channel Estimation in High Mobility Communications Using Bi-RNN Networks [7.310043452300738]
  We propose an optimized and robust bi-directional recurrent neural network (Bi-RNN) based channel estimator to accurately estimate the doubly-selective channel. The developed Bi-GRU estimator significantly outperforms the recently proposed CNN-based estimators in different mobility scenarios.
  arXiv  Detail & Related papers  (2023-04-29T09:20:28Z)
• Pay Less But Get More: A Dual-Attention-based Channel Estimation Network for Massive MIMO Systems with Low-Density Pilots [41.213515826100696]
  We propose a dual-attention-based channel estimation network (DACEN) to realize accurate channel estimation via low-density pilots. Experimental results reveal that the proposed DACEN-based method achieves better channel estimation performance than the existing methods.
  arXiv  Detail & Related papers  (2023-03-02T05:34:25Z)
• Deep Reinforcement Learning for IRS Phase Shift Design in Spatiotemporally Correlated Environments [93.30657979626858]
  We propose a deep actor-critic algorithm that accounts for channel correlations and destination motion. We show that, when channels aretemporally correlated, the inclusion of the SNR in the state representation with function approximation in ways that inhibit convergence.
  arXiv  Detail & Related papers  (2022-11-02T22:07:36Z)
• MIMO Channel Estimation using Score-Based Generative Models [1.6752182911522517]
  We introduce a novel approach for channel estimation using deep score-based generative models. These models are trained to estimate the gradient of the log-prior distribution, and can be used to iteratively refine estimates, given observed measurements of a signal.
  arXiv  Detail & Related papers  (2022-04-14T17:23:58Z)
• Model-Driven Deep Learning Based Channel Estimation and Feedback for Millimeter-Wave Massive Hybrid MIMO Systems [61.78590389147475]
  This paper proposes a model-driven deep learning (MDDL)-based channel estimation and feedback scheme for millimeter-wave (mmWave) systems. To reduce the uplink pilot overhead for estimating the high-dimensional channels from a limited number of radio frequency (RF) chains, we propose to jointly train the phase shift network and the channel estimator as an auto-encoder. Numerical results show that the proposed MDDL-based channel estimation and feedback scheme outperforms the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-04-22T13:34:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.