Learning Power Control Protocol for In-Factory 6G Subnetworks
- URL: http://arxiv.org/abs/2505.05967v1
- Date: Fri, 09 May 2025 11:39:18 GMT
- Title: Learning Power Control Protocol for In-Factory 6G Subnetworks
- Authors: Uyoata E. Uyoata, Gilberto Berardinelli, Ramoni Adeogun,
- Abstract summary: In-X Subnetworks are envisioned to meet the stringent demands of short-range communication in diverse 6G use cases.<n>Power control is critical to mitigating the impact of interference resulting from potentially high subnetwork density.<n>This paper introduces a novel multi-agent reinforcement learning framework designed to enable access points to autonomously learn both signaling and power control protocols.
- Score: 0.8466004732265869
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In-X Subnetworks are envisioned to meet the stringent demands of short-range communication in diverse 6G use cases. In the context of In-Factory scenarios, effective power control is critical to mitigating the impact of interference resulting from potentially high subnetwork density. Existing approaches to power control in this domain have predominantly emphasized the data plane, often overlooking the impact of signaling overhead. Furthermore, prior work has typically adopted a network-centric perspective, relying on the assumption of complete and up-to-date channel state information (CSI) being readily available at the central controller. This paper introduces a novel multi-agent reinforcement learning (MARL) framework designed to enable access points to autonomously learn both signaling and power control protocols in an In-Factory Subnetwork environment. By formulating the problem as a partially observable Markov decision process (POMDP) and leveraging multi-agent proximal policy optimization (MAPPO), the proposed approach achieves significant advantages. The simulation results demonstrate that the learning-based method reduces signaling overhead by a factor of 8 while maintaining a buffer flush rate that lags the ideal "Genie" approach by only 5%.
Related papers
- Power Allocation for Delay Optimization in Device-to-Device Networks: A Graph Reinforcement Learning Approach [32.49886544394408]
This paper explores a novel power power approach for delay optimization, utilizing neural networks (GNNs)-based reinforcement learning (RL) in device-to-device (D2D) communication.<n>The proposed method effectively reduces average delay while ensuring user fairness, outperforms baseline methods, and exhibits and generalization capability.
arXiv Detail & Related papers (2025-05-19T09:37:00Z) - Channel Fingerprint Construction for Massive MIMO: A Deep Conditional Generative Approach [65.47969413708344]
We introduce the concept of CF twins and design a conditional generative diffusion model (CGDM)<n>We employ a variational inference technique to derive the evidence lower bound (ELBO) for the log-marginal distribution of the observed fine-grained CF conditioned on the coarse-grained CF.<n>We show that the proposed approach exhibits significant improvement in reconstruction performance compared to the baselines.
arXiv Detail & Related papers (2025-05-12T01:36:06Z) - Lightweight Learning for Grant-Free Activity Detection in Cell-Free Massive MIMO Networks [0.19662978733004596]
Grant-free random access (GF-RA) is a promising access technique for massive machine-type communications (mMTC) in future wireless networks.<n>This study investigates the efficiency of employing supervised machine learning techniques to tackle the challenges on the device activity detection (AD)<n>We propose a novel lightweight data-driven algorithmic framework specifically designed for activity detection in GF-RA for mMTC.
arXiv Detail & Related papers (2025-03-14T11:18:47Z) - Scalable spectral representations for multi-agent reinforcement learning in network MDPs [13.782868855372774]
A popular model for multi-agent control, Network Markov Decision Processes (MDPs) pose a significant challenge to efficient learning.
We first derive scalable spectral local representations for network MDPs, which induces a network linear subspace for the local $Q$-function of each agent.
We design a scalable algorithmic framework for continuous state-action network MDPs, and provide end-to-end guarantees for the convergence of our algorithm.
arXiv Detail & Related papers (2024-10-22T17:45:45Z) - Perimeter Control with Heterogeneous Metering Rates for Cordon Signals: A Physics-Regularized Multi-Agent Reinforcement Learning Approach [12.86346901414289]
Perimeter Control (PC) strategies have been proposed to address urban road network control in oversaturated situations.
This paper leverages a Multi-Agent Reinforcement Learning (MARL)-based traffic signal control framework to decompose this PC problem.
A physics regularization approach for the MARL framework is proposed to ensure the distributed cordon signal controllers are aware of the global network state.
arXiv Detail & Related papers (2023-08-24T13:51:16Z) - A Safe Genetic Algorithm Approach for Energy Efficient Federated
Learning in Wireless Communication Networks [53.561797148529664]
Federated Learning (FL) has emerged as a decentralized technique, where contrary to traditional centralized approaches, devices perform a model training in a collaborative manner.
Despite the existing efforts made in FL, its environmental impact is still under investigation, since several critical challenges regarding its applicability to wireless networks have been identified.
The current work proposes a Genetic Algorithm (GA) approach, targeting the minimization of both the overall energy consumption of an FL process and any unnecessary resource utilization.
arXiv Detail & Related papers (2023-06-25T13:10:38Z) - Power Control for 6G Industrial Wireless Subnetworks: A Graph Neural
Network Approach [2.0932869978899453]
6th Generation (6G) industrial wirelessworks are expected to replace wired connectivity for control operation in robots and production modules.
Existing solutions for centralized power control may require full channel state information (CSI) of all the desired and interfering links.
This paper presents a novel solution for centralized power control for industrialworks based on Graph Neural Networks (GNNs)
arXiv Detail & Related papers (2022-12-30T15:04:38Z) - Artificial Intelligence Empowered Multiple Access for Ultra Reliable and
Low Latency THz Wireless Networks [76.89730672544216]
Terahertz (THz) wireless networks are expected to catalyze the beyond fifth generation (B5G) era.
To satisfy the ultra-reliability and low-latency demands of several B5G applications, novel mobility management approaches are required.
This article presents a holistic MAC layer approach that enables intelligent user association and resource allocation, as well as flexible and adaptive mobility management.
arXiv Detail & Related papers (2022-08-17T03:00:24Z) - AI-aided Traffic Control Scheme for M2M Communications in the Internet
of Vehicles [61.21359293642559]
The dynamics of traffic and the heterogeneous requirements of different IoV applications are not considered in most existing studies.
We consider a hybrid traffic control scheme and use proximal policy optimization (PPO) method to tackle it.
arXiv Detail & Related papers (2022-03-05T10:54:05Z) - Federated Learning over Wireless IoT Networks with Optimized
Communication and Resources [98.18365881575805]
Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention.
It is of interest to investigate fast responding and accurate FL schemes over wireless systems.
We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
arXiv Detail & Related papers (2021-10-22T13:25:57Z) - Optimal Power Allocation for Rate Splitting Communications with Deep
Reinforcement Learning [61.91604046990993]
This letter introduces a novel framework to optimize the power allocation for users in a Rate Splitting Multiple Access network.
In the network, messages intended for users are split into different parts that are a single common part and respective private parts.
arXiv Detail & Related papers (2021-07-01T06:32:49Z) - Distributed Voltage Regulation of Active Distribution System Based on
Enhanced Multi-agent Deep Reinforcement Learning [9.7314654861242]
This paper proposes a data-driven distributed voltage control approach based on the spectrum clustering and the enhanced multi-agent deep reinforcement learning (MADRL) algorithm.
The proposed method can significantly reduce the requirements of communications and knowledge of system parameters.
It also effectively deals with uncertainties and can provide online coordinated control based on the latest local information.
arXiv Detail & Related papers (2020-05-31T15:48:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.