Bayesian-Guided Cooperative RL Beamforming for Wireless Adversarial User Detection

• URL: http://arxiv.org/abs/2607.25417v1
• Date: Tue, 28 Jul 2026 08:15:31 GMT
• Title: Bayesian-Guided Cooperative RL Beamforming for Wireless Adversarial User Detection
• Abstract summary: Next-generation wireless networks are expected to go beyond simple data transmission and simultaneously provide high data rates, efficiency, and security.<n>In this work, the integration of machine learning with beamforming enables adaptive and data-driven beam direction selection, improving both the efficiency and security of wireless links.<n>We demonstrate that the reinforcement learning-based approaches, namely Q-learning and SARSA, consistently outperform random selection in terms of total channel capacity, attacker detection accuracy, and performance stability.
• Score: 6.141945506223323
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In next-generation wireless networks, communication systems are expected to go beyond simple data transmission and simultaneously provide high data rates, efficiency, and security. This requirement has motivated the extensive adoption of machine learning methods to develop intelligent and real-time network management frameworks, enabling the system to continuously monitor and react to channel variations and user behavior while maintaining efficient information delivery. In this context, the integration of machine learning with beamforming enables adaptive and data-driven beam direction selection, improving both the efficiency and security of wireless links. In this work, a 3GPP-based system model is first implemented under a no-attacker scenario, and an exhaustive search is employed as a reference to identify the best beamforming configurations. The proposed framework is then evaluated in the presence of an attacker and under different network scalability conditions. We demonstrate that the reinforcement learning-based approaches, namely Q-learning and SARSA (State-Action-Reward-State-Action), consistently outperform random selection in terms of total channel capacity, attacker detection accuracy, and performance stability. Among the evaluated reinforcement learning methods, Q-learning achieves the best overall trade-off between detection accuracy and computational efficiency. Our results indicate that the proposed framework provides a stable, scalable, and effective solution for joint beamforming and security-aware decision-making in dynamic and adversarial wireless environments.

Related papers

• 6G Sensing Security: Distributed Game-Theoretic RL for Urban Beamforming and Attacker Detection [6.141945506223323]
  ISAC enables the system to transmit information efficiently and observe and interpret channel variations and user behavior.<n>Motivated by this capability, this work focuses on detecting an active attacker in an urban environment scenario.<n>We apply game-theoretic approaches to model the interaction between legitimate users and the attacker, and integrate the resulting utility-based formulation into a reinforcement learning framework.
  arXiv  Detail & Related papers  (2026-07-07T10:25:46Z)
• ASACK : Adaptive Safe Active Continual Koopman Learning for Uncertain Systems with Contractive Guarantees [0.38887448816036313]
  Koopman operator theory provides a framework for representing nonlinear dynamics through a linear operator acting on lifted observables.<n>We propose a unified framework for continual adaptive Koopman learning that enables safe and efficient online refinement of learned models.<n>The proposed approach unifies learning, deployment, and safety within a control framework without sacrificing real-time efficiency.
  arXiv  Detail & Related papers  (2026-05-10T17:11:51Z)
• Agentic AI as a Network Control-Plane Intelligence Layer for Federated Learning over 6G [47.84137752186323]
  We propose an Agentic AI as the control layer for managing federated learning over 6G networks.<n>A set of specialized agents focused on retrieval, planning, coding, and evaluation handle client selection, incentive structuring, scheduling, resource allocation, adaptive local training, and code generation.<n>The use of closed-loop evaluation and memory allows the system to consistently refine its decisions.
  arXiv  Detail & Related papers  (2026-03-10T03:27:33Z)
• RL-Aided Cognitive ISAC: Robust Detection and Sensing-Communication Trade-offs [4.7199341867016456]
  This paper proposes a reinforcement learning-aided cognitive framework for integrated sensing and communication.<n>A Wald-type detector is employed for robust target detection under non-Gaussian clutter.<n>A SARSA-based RL algorithm enables adaptive estimation of target positions without prior environmental knowledge.
  arXiv  Detail & Related papers  (2025-11-04T15:49:51Z)
• DRL-based Dolph-Tschebyscheff Beamforming in Downlink Transmission for Mobile Users [52.9870460238443]
  We propose a deep reinforcement learning-based blind beamforming technique using a learnable Dolph-Tschebyscheff antenna array.<n>Our simulation results show that the proposed method can support data rates very close to the best possible values.
  arXiv  Detail & Related papers  (2025-02-03T11:50:43Z)
• Balancing Security and Accuracy: A Novel Federated Learning Approach for Cyberattack Detection in Blockchain Networks [10.25938198121523]
  This paper presents a novel Collaborative Cyberattack Detection (CCD) system aimed at enhancing the security of blockchain-based data-sharing networks. We explore the effects of various noise types on key performance metrics, including attack detection accuracy, deep learning model convergence time, and the overall runtime of global model generation. Our findings reveal the intricate trade-offs between ensuring data privacy and maintaining system performance, offering valuable insights into optimizing these parameters for diverse CCD environments.
  arXiv  Detail & Related papers  (2024-09-08T04:38:07Z)
• Digital Twin-Assisted Data-Driven Optimization for Reliable Edge Caching in Wireless Networks [60.54852710216738]
  We introduce a novel digital twin-assisted optimization framework, called D-REC, to ensure reliable caching in nextG wireless networks. By incorporating reliability modules into a constrained decision process, D-REC can adaptively adjust actions, rewards, and states to comply with advantageous constraints.
  arXiv  Detail & Related papers  (2024-06-29T02:40:28Z)
• Recursively Feasible Probabilistic Safe Online Learning with Control Barrier Functions [60.26921219698514]
  We introduce a model-uncertainty-aware reformulation of CBF-based safety-critical controllers. We then present the pointwise feasibility conditions of the resulting safety controller. We use these conditions to devise an event-triggered online data collection strategy.
  arXiv  Detail & Related papers  (2022-08-23T05:02:09Z)
• Offline Contextual Bandits for Wireless Network Optimization [107.24086150482843]
  In this paper, we investigate how to learn policies that can automatically adjust the configuration parameters of every cell in the network in response to the changes in the user demand. Our solution combines existent methods for offline learning and adapts them in a principled way to overcome crucial challenges arising in this context.
  arXiv  Detail & Related papers  (2021-11-11T11:31:20Z)
• Rethinking the Tradeoff in Integrated Sensing and Communication: Recognition Accuracy versus Communication Rate [21.149708253108788]
  Integrated sensing and communication (ISAC) is a promising technology to improve the band-utilization efficiency. There exists a tradeoff between the sensing and communication performance. This paper formulates and solves a multi-objective optimization problem which simultaneously maximizes the recognition accuracy and the communication data rate.
  arXiv  Detail & Related papers  (2021-07-20T17:00:35Z)
• Learning to Continuously Optimize Wireless Resource in a Dynamic Environment: A Bilevel Optimization Perspective [52.497514255040514]
  This work develops a new approach that enables data-driven methods to continuously learn and optimize resource allocation strategies in a dynamic environment. We propose to build the notion of continual learning into wireless system design, so that the learning model can incrementally adapt to the new episodes. Our design is based on a novel bilevel optimization formulation which ensures certain fairness" across different data samples.
  arXiv  Detail & Related papers  (2021-05-03T07:23:39Z)
• Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks [82.33619654835348]
  Intelligent surface (IRS) has been employed to reshape the wireless channels by controlling individual scattering elements' phase shifts. Due to the large size of scattering elements, the passive beamforming is typically challenged by the high computational complexity. In this article, we focus on machine learning (ML) approaches for performance in IRS-assisted wireless networks.
  arXiv  Detail & Related papers  (2020-08-29T08:39:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.