PilotWiMAE: Pilot-Native Representation Learning for Wireless Channels

• URL: http://arxiv.org/abs/2605.22856v1
• Date: Tue, 19 May 2026 06:21:22 GMT
• Title: PilotWiMAE: Pilot-Native Representation Learning for Wireless Channels
• Abstract summary: We introduce PilotWiMAE, a self-supervised framework whose encoder ingests noisy pilot observations directly.<n>Pilot input shrinks the observation space by up to two orders of magnitude and also removes the unrealistic assumption of full-CSI availability.<n>We propose a decoder-centric pretraining stage following the encoder-decoder joint pretraining, which allows PilotWiMAE to demonstrate competitive channel estimation.
• Score: 19.277001743060435
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Channel foundation models assume access to fully observed channels, an assumption that fails in deployment. We introduce PilotWiMAE, a self-supervised framework whose encoder ingests noisy pilot observations directly and whose attention factorizes along the axis separating temporal from joint space-frequency processing, an inductive bias inspired by the physics of the problem. Pilot input shrinks the observation space by up to two orders of magnitude and also removes the unrealistic assumption of full-CSI availability while incurring lower latency. The factorized design generates robust representations by exploiting the separable channel structure and allows a pretraining mask ratio of $99\%$. We pair patch-normalized reconstruction, which captures small-scale fading structure, with an auxiliary scale loss that recovers the large-scale fading features, and use an AWGN curriculum to match pilot noise at pretraining and deployment. Pretrained solely on $3.5$\,GHz and evaluated at $28$\,GHz across in-distribution and out-of-distribution settings, PilotWiMAE's cross-frequency beam selection and channel characterization beat supervised baselines despite operating on a smaller observation space. To weaken the coupling between decoder capacity and representation quality, we further propose a decoder-centric pretraining stage following the encoder-decoder joint pretraining, which allows PilotWiMAE to demonstrate competitive channel estimation without sacrificing representation quality. To foster further work in this direction, we release the PilotWiMAE pretrained weights and training pipeline, together with CSIGen, our Sionna-based ray-tracing channel-generation tool, and the channel datasets used in this work.

Related papers

• Land-then-transport: A Flow Matching-Based Generative Decoder for Wireless Image Transmission [38.71668959954467]
  We propose a flow-matching generative decoder for low-latency decoding.<n>Experiments show consistent gains over JPEG2000+LDPC, DeepJSCC, and diffusion-based baselines.<n> LTT provides a deterministic, physically interpretable, and efficient framework for generative wireless image decoding.
  arXiv  Detail & Related papers  (2026-01-12T13:09:37Z)
• Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels [45.969793510760645]
  This treatise investigates pilot-free channel inference that estimates complete CSI directly from multimodal observations.<n>We develop a data-driven framework that formulates the sensing-to-channel mapping as a cross-modal flow matching problem.<n>In experiments, we build a procedural data generator based on Sionna and Blender to support realistic modeling of sensing scenes and wireless propagation.
  arXiv  Detail & Related papers  (2025-12-04T16:35:09Z)
• Rethinking Transformer-Based Blind-Spot Network for Self-Supervised Image Denoising [94.09442506816724]
  Blind-spot networks (BSN) have been prevalent neural architectures in self-supervised image denoising (SSID)<n>We build a Transformer-based Blind-Spot Network (TBSN) which shows strong local fitting and global perspective abilities.
  arXiv  Detail & Related papers  (2024-04-11T15:39:10Z)
• Joint Channel Estimation and Feedback with Masked Token Transformers in Massive MIMO Systems [74.52117784544758]
  This paper proposes an encoder-decoder based network that unveils the intrinsic frequency-domain correlation within the CSI matrix. The entire encoder-decoder network is utilized for channel compression. Our method outperforms state-of-the-art channel estimation and feedback techniques in joint tasks.
  arXiv  Detail & Related papers  (2023-06-08T06:15:17Z)
• Over-the-Air Design of GAN Training for mmWave MIMO Channel Estimation [35.62977046569772]
  We develop an unsupervised over-the-air (OTA) algorithm that utilizes noisy received pilot measurements to train a deep generative model. We then formulate channel estimation from a limited number of pilot measurements as an inverse problem. Our proposed framework has the potential to be trained online using real noisy pilot measurements.
  arXiv  Detail & Related papers  (2022-05-25T02:26:34Z)
• Model-Driven Deep Learning Based Channel Estimation and Feedback for Millimeter-Wave Massive Hybrid MIMO Systems [61.78590389147475]
  This paper proposes a model-driven deep learning (MDDL)-based channel estimation and feedback scheme for millimeter-wave (mmWave) systems. To reduce the uplink pilot overhead for estimating the high-dimensional channels from a limited number of radio frequency (RF) chains, we propose to jointly train the phase shift network and the channel estimator as an auto-encoder. Numerical results show that the proposed MDDL-based channel estimation and feedback scheme outperforms the state-of-the-art approaches.
  arXiv  Detail & Related papers  (2021-04-22T13:34:53Z)
• CAnet: Uplink-aided Downlink Channel Acquisition in FDD Massive MIMO using Deep Learning [51.72869237847767]
  In frequency-division duplexing systems, the downlink channel state information (CSI) acquisition scheme leads to high training and feedback overheads. We propose an uplink-aided downlink channel acquisition framework using deep learning to reduce these overheads.
  arXiv  Detail & Related papers  (2021-01-12T10:12:28Z)
• End-to-end Learning for OFDM: From Neural Receivers to Pilotless Communication [12.325545487629297]
  We explore the gains of end-to-end learning over a frequency- and time-selective fading channel. With imperfect channel knowledge at the receiver, the shaping gains observed on AWGN channels vanish. We identify two other sources of performance improvements.
  arXiv  Detail & Related papers  (2020-09-11T07:33:00Z)
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms [98.78553146823829]
  Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks. In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
  arXiv  Detail & Related papers  (2020-02-19T14:04:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.