Cooperative Deep Reinforcement Learning for Fair RIS Allocation

• URL: http://arxiv.org/abs/2603.25572v1
• Date: Thu, 26 Mar 2026 15:46:32 GMT
• Title: Cooperative Deep Reinforcement Learning for Fair RIS Allocation
• Abstract summary: We consider RISs as shared infrastructure that must be dynamically assigned among competing base stations.<n>We propose a fairness-aware collaborative multi-agent reinforcement learning approach.<n>Results show that the proposed framework effectively redistributes RIS resources toward weaker-performing cells.
• Score: 2.217288163160845
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The deployment of reconfigurable intelligent surfaces (RISs) introduces new challenges for resource allocation in multi-cell wireless networks, particularly when user loads are uneven across base stations. In this work, we consider RISs as shared infrastructure that must be dynamically assigned among competing base stations, and we address this problem using a simultaneous ascending auction mechanism. To mitigate performance imbalances between cells, we propose a fairness-aware collaborative multi-agent reinforcement learning approach in which base stations adapt their bidding strategies based on both expected utility gains and relative service quality. A centrally computed performance-dependent fairness indicator is incorporated into the agents' observations, enabling implicit coordination without direct inter-base-station communication. Simulation results show that the proposed framework effectively redistributes RIS resources toward weaker-performing cells, substantially improving the rates of the worst-served users while preserving overall throughput. The results demonstrate that fairness-oriented RIS allocation can be achieved through cooperative learning, providing a flexible tool for balancing efficiency and equity in future wireless networks.

Related papers

• Constraint-Aware Aggregation for Federated Reinforcement Learning in Microgrid Energy Coordination [1.675857332621569]
  Federated Reinforcement Learning (FedRL) enables coordination of distributed energy resources without sharing raw local data.<n>Standard aggregation methods such as FedAvg do not account for system-level constraints, often leading to unsafe global behavior.<n>We propose aggregation rules that incorporate both local performance and estimated constraint violation into the server-side update.
  arXiv  Detail & Related papers  (2026-07-14T13:33:25Z)
• DeFRiS: Silo-Cooperative IoT Applications Scheduling via Decentralized Federated Reinforcement Learning [62.347535250646196]
  This paper proposes DeFRiS, a Decentralized Federated Reinforcement Learning framework for robust and scalable Silo-cooperative IoT application scheduling.<n>DeFRiS integrates three innovations: (i) an action-space-agnostic policy utilizing candidate resource scoring to enable seamless knowledge transfer across heterogeneous silos; (ii) a silo-optimized local learning mechanism combining Generalized Advantage Estimation with clipped policy updates to resolve sparse delayed reward challenges; and (iii) a Dual-Track Non-IID robust decentralized aggregation protocol leveraging gradient fingerprints for similarity-aware knowledge transfer and anomaly detection.
  arXiv  Detail & Related papers  (2026-03-16T02:02:38Z)
• Heterogeneous Agent Collaborative Reinforcement Learning [52.99813668995983]
  Heterogeneous Agent Collaborative Reinforcement Learning (HACRL)<n>Building on this paradigm, we propose HACPO, a collaborative RL algorithm that enables principled rollout sharing to maximize sample utilization and cross-agent knowledge transfer.<n>Experiments across diverse heterogeneous model combinations and reasoning benchmarks show that HACPO consistently improves all participating agents, outperforming GSPO by an average of 3.3% while using only half the rollout cost.
  arXiv  Detail & Related papers  (2026-03-03T05:09:49Z)
• Auction-Based RIS Allocation With DRL: Controlling the Cost-Performance Trade-Off [2.217288163160845]
  We study the allocation of reconfigurable intelligent surfaces (RISs) in a multi-cell wireless network, where base stations compete for control of shared RIS units deployed at the cell edges.<n>We integrate deep reinforcement learning (DRL) agents that learn to maximize performance while adhering to budget constraints.<n>Our results highlight the potential of combining auction-based allocation with adaptive RL mechanisms for efficient and fair utilization of RISs in next-generation wireless networks.
  arXiv  Detail & Related papers  (2026-02-18T06:22:14Z)
• Bayesian Optimization for Non-Cooperative Game-Based Radio Resource Management [3.652142532307204]
  This paper considers formulating the resource allocation among spectrum sharing BSs as a non-cooperative game.<n>We propose PPR-UCB, a novel Bayesian optimization strategy that learns from sequential decision-evaluation pairs.<n>Experiments on downlink transmission power allocation in a multi-cell multi-antenna system demonstrate the efficiency of PPR-UCB.
  arXiv  Detail & Related papers  (2025-12-01T03:44:43Z)
• Federated Attention: A Distributed Paradigm for Collaborative LLM Inference over Edge Networks [63.541114376141735]
  Large language models (LLMs) are proliferating rapidly at the edge, delivering intelligent capabilities across diverse application scenarios.<n>However, their practical deployment in collaborative scenarios confronts fundamental challenges: privacy vulnerabilities, communication overhead, and computational bottlenecks.<n>We propose Federated Attention (FedAttn), which integrates the federated paradigm into the self-attention mechanism.
  arXiv  Detail & Related papers  (2025-11-04T15:14:58Z)
• Client Selection Strategies for Federated Semantic Communications in Heterogeneous IoT Networks [0.3683202928838613]
  The exponential growth of IoT devices presents critical challenges in bandwidth-constrained wireless networks.<n>This paper presents a novel federated semantic communication framework that enables collaborative training of bandwidth-efficient models for image reconstruction.
  arXiv  Detail & Related papers  (2025-06-20T15:11:20Z)
• Cluster-Aware Multi-Round Update for Wireless Federated Learning in Heterogeneous Environments [25.405210975577834]
  This paper proposes a clustering strategy that leverages prior knowledge similarity to group devices with similar data and communication characteristics.<n>A novel Cluster- Aware Multi-round Update (CAMU) strategy is proposed, which treats clusters as the basic units and adjusts the local update frequency based on the clustered contribution threshold.
  arXiv  Detail & Related papers  (2025-05-06T02:48:48Z)
• Heterogeneous Multi-Agent Reinforcement Learning for Distributed Channel Access in WLANs [47.600901884970845]
  This paper investigates the use of multi-agent reinforcement learning (MARL) to address distributed channel access in wireless local area networks.<n>In particular, we consider the challenging yet more practical case where the agents heterogeneously adopt value-based or policy-based reinforcement learning algorithms to train the model.<n>We propose a heterogeneous MARL training framework, named QPMIX, which adopts a centralized training with distributed execution paradigm to enable heterogeneous agents to collaborate.
  arXiv  Detail & Related papers  (2024-12-18T13:50:31Z)
• A Federated Reinforcement Learning Framework for Link Activation in Multi-link Wi-Fi Networks [3.093231349723552]
  Multi-link operation (MLO) can result in higher interference and channel contention, leading to lower performance and reliability. In this paper, we propose the use of a collaborative machine learning approach to train models across multiple distributed agents without exchanging data. Results show that the FRL-based decentralized MLO-LA strategy achieves a better throughput fairness, and so a higher reliability.
  arXiv  Detail & Related papers  (2023-04-28T09:39:10Z)
• Compressed Regression over Adaptive Networks [58.79251288443156]
  We derive the performance achievable by a network of distributed agents that solve, adaptively and in the presence of communication constraints, a regression problem. We devise an optimized allocation strategy where the parameters necessary for the optimization can be learned online by the agents.
  arXiv  Detail & Related papers  (2023-04-07T13:41:08Z)
• Federated Distributionally Robust Optimization for Phase Configuration of RISs [106.4688072667105]
  We study the problem of robust reconfigurable intelligent surface (RIS)-aided downlink communication over heterogeneous RIS types in a supervised learning setting. By modeling downlink communication over heterogeneous RIS designs as different workers that learn how to optimize phase configurations in a distributed manner, we solve this distributed learning problem. Our proposed algorithm requires fewer communication rounds to achieve the same worst-case distribution test accuracy compared to competitive baselines.
  arXiv  Detail & Related papers  (2021-08-20T07:07:45Z)
• Phase Configuration Learning in Wireless Networks with Multiple Reconfigurable Intelligent Surfaces [50.622375361505824]
  Reconfigurable Intelligent Surfaces (RISs) are highly scalable technology capable of offering dynamic control of electro-magnetic wave propagation. One of the major challenges with RIS-empowered wireless communications is the low-overhead dynamic configuration of multiple RISs. We devise low-complexity supervised learning approaches for the RISs' phase configurations.
  arXiv  Detail & Related papers  (2020-10-09T05:35:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.