RFPrompt: Prompt-Based Expert Adaptation of the Large Wireless Model for Modulation Classification
- URL: http://arxiv.org/abs/2605.03279v1
- Date: Tue, 05 May 2026 02:09:58 GMT
- Title: RFPrompt: Prompt-Based Expert Adaptation of the Large Wireless Model for Modulation Classification
- Abstract summary: We investigate prompt-based adaptation as a general mechanism for OOD transfer in wireless foundation models.<n>We propose RFPrompt, a parameter-efficient framework that introduces learnable deep prompt tokens while keeping the pretrained backbone frozen.<n>Results show that prompt-based adaptation consistently improves robustness under distribution shift and limited supervision.
- Score: 7.858819231575403
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Automatic modulation classification (AMC) in real-world deployments demands robustness to distribution shifts arising from hardware impairments, unseen propagation environments, and recording conditions never encountered during training. Although wireless foundation models offer a promising starting point for robust RF representation learning, an important open question is how to adapt them efficiently to out-of-distribution (OOD) downstream tasks without overwriting the structure learned during large-scale pre-training. In this paper, we investigate prompt-based adaptation as a general mechanism for OOD transfer in wireless foundation models. We propose RFPrompt, a parameter-efficient framework that introduces learnable deep prompt tokens while keeping the pretrained backbone frozen, enabling task-specific adaptation with minimal trainable parameters. We instantiate and evaluate this approach on the Large Wireless Model (LWM), a mixture-of-experts wireless foundation model, and study its behavior under both standard and OOD modulation-classification settings. Results show that prompt-based adaptation consistently improves robustness under distribution shift and limited supervision, particularly on real-world over-the-air IQ data, while preserving strong parameter efficiency. These findings suggest that prompt learning is a practical and effective strategy for adapting wireless foundation models to challenging downstream RF environments.
Related papers
- A Graph Foundation Model for Wireless Resource Allocation [37.503398874234094]
We propose a graph foundation model for resource allocation based on a pre-training and fine-tuning paradigm to extract unified representations.<n>Specifically, we introduce an interference-aware Transformer architecture with a bias projector that injects interference topologies into global attention mechanisms.<n>Experiments demonstrate that the proposed framework achieves state-of-the-art performance and scales effectively with increased model capacity.
arXiv Detail & Related papers (2026-04-08T06:07:28Z) - A Multi-Modal Foundational Model for Wireless Communication and Sensing [5.101849923596286]
This work introduces a task-agnostic, multi-modal foundational model for physical-layer wireless systems.<n>It learns transferable, physics-aware representations across heterogeneous modalities, enabling robust generalization across tasks and environments.<n>Our evaluations demonstrate superior generalization, robustness to deployment shifts, and reduced data requirements compared to task-specific baselines.
arXiv Detail & Related papers (2026-02-03T21:03:23Z) - Adaptive Linear Path Model-Based Diffusion [52.84663832658799]
We introduce Linear Path Model-Based Diffusion (LP-MBD), which replaces the variance-preserving schedule with a flow-matching linear probability path.<n>We also propose Adaptive LP-MBD (ALP-MBD), which leverages reinforcement learning to adjust diffusion steps and noise levels according to task complexity and environmental conditions.
arXiv Detail & Related papers (2026-02-02T21:33:03Z) - GateRA: Token-Aware Modulation for Parameter-Efficient Fine-Tuning [51.79350934271497]
GateRA is a unified framework that introduces token-aware modulation to dynamically adjust the strength of PEFT updates.<n>By incorporating adaptive gating into standard PEFT branches, GateRA enables selective, token-level adaptation.<n> Experiments on multiple commonsense reasoning benchmarks demonstrate that GateRA consistently outperforms or matches prior PEFT methods.
arXiv Detail & Related papers (2025-11-15T17:55:47Z) - Flexible Locomotion Learning with Diffusion Model Predictive Control [46.432397190673505]
We present Diffusion-MPC, which leverages a learned generative diffusion model as an approximate dynamics prior for planning.<n>Our design enables strong test-time adaptability, allowing the planner to adjust to new reward specifications without retraining.<n>We validate Diffusion-MPC on real world, demonstrating strong locomotion and flexible adaptation.
arXiv Detail & Related papers (2025-10-05T14:51:13Z) - In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory [54.92893355284945]
Deep learning-based wireless receivers offer the potential to dynamically adapt to varying channel environments.<n>Current adaptation strategies, including joint training, hypernetwork-based methods, and meta-learning, either demonstrate limited flexibility or necessitate explicit optimization through gradient descent.<n>This paper presents gradient-free adaptation techniques rooted in the emerging paradigm of in-context learning (ICL)
arXiv Detail & Related papers (2025-06-18T06:43:55Z) - Plug-and-Play AMC: Context Is King in Training-Free, Open-Set Modulation with LLMs [22.990537822143907]
Automatic Modulation Classification (AMC) is critical for efficient spectrum management and robust wireless communications.<n>We propose an innovative framework that integrates traditional signal processing techniques with Large-Language Models.<n>This work lays the foundation for scalable, interpretable, and versatile signal classification systems in next-generation wireless networks.
arXiv Detail & Related papers (2025-05-06T02:07:47Z) - Model Predictive Task Sampling for Efficient and Robust Adaptation [57.414812940406996]
We introduce Model Predictive Task Sampling (MPTS), a framework that bridges the task space and adaptation risk distributions.<n>MPTS employs a generative model to characterize the episodic optimization process and predicts task-specific adaptation risk via posterior inference.<n>MPTS seamlessly integrates into zero-shot, few-shot, and supervised finetuning settings.
arXiv Detail & Related papers (2025-01-19T13:14:53Z) - Vaccinating Federated Learning for Robust Modulation Classification in Distributed Wireless Networks [0.0]
We propose FedVaccine, a novel AMC model aimed at improving generalizability across signals with varying noise levels.
FedVaccine overcomes the limitations of existing FL-based AMC models' linear aggregation by employing a split-learning strategy.
These findings highlight FedVaccine's potential to enhance the reliability and performance of AMC systems in practical wireless network environments.
arXiv Detail & Related papers (2024-10-16T17:48:47Z) - Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models [79.41139393080736]
Large language models (LLMs) have rapidly advanced and demonstrated impressive capabilities.
In-Context Learning (ICL) and.
Efficient Fine-Tuning (PEFT) are currently two mainstream methods for augmenting.
LLMs to downstream tasks.
We propose Reference Trustable Decoding (RTD), a paradigm that allows models to quickly adapt to new tasks without fine-tuning.
arXiv Detail & Related papers (2024-09-30T10:48:20Z) - Maximum Likelihood Distillation for Robust Modulation Classification [50.51144496609274]
We build on knowledge distillation ideas and adversarial training to build more robust AMC systems.
We propose to use the Maximum Likelihood function, which could solve the AMC problem in offline settings, to generate better training labels.
arXiv Detail & Related papers (2022-11-01T21:06:11Z) - Model-based Deep Learning Receiver Design for Rate-Splitting Multiple
Access [65.21117658030235]
This work proposes a novel design for a practical RSMA receiver based on model-based deep learning (MBDL) methods.
The MBDL receiver is evaluated in terms of uncoded Symbol Error Rate (SER), throughput performance through Link-Level Simulations (LLS) and average training overhead.
Results reveal that the MBDL outperforms by a significant margin the SIC receiver with imperfect CSIR.
arXiv Detail & Related papers (2022-05-02T12:23:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.