A reinforcement learning approach to improve communication performance and energy utilization in fog-based IoT

• URL: http://arxiv.org/abs/2106.00654v1
• Date: Tue, 1 Jun 2021 17:38:20 GMT
• Title: A reinforcement learning approach to improve communication performance and energy utilization in fog-based IoT
• Authors: Babatunji Omoniwa, Maxime Gueriau and Ivana Dusparic
• Abstract summary: We propose a Q-learning-based decentralized approach where each mobile fog relay agent (MFRA) is controlled by an autonomous agent. Our approach is able to ensure reliable delivery of data and reduce overall energy cost by 56.76% -- 88.03%.
• Score: 3.158346511479111
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent research has shown the potential of using available mobile fog devices (such as smartphones, drones, domestic and industrial robots) as relays to minimize communication outages between sensors and destination devices, where localized Internet-of-Things services (e.g., manufacturing process control, health and security monitoring) are delivered. However, these mobile relays deplete energy when they move and transmit to distant destinations. As such, power-control mechanisms and intelligent mobility of the relay devices are critical in improving communication performance and energy utilization. In this paper, we propose a Q-learning-based decentralized approach where each mobile fog relay agent (MFRA) is controlled by an autonomous agent which uses reinforcement learning to simultaneously improve communication performance and energy utilization. Each autonomous agent learns based on the feedback from the destination and its own energy levels whether to remain active and forward the message, or become passive for that transmission phase. We evaluate the approach by comparing with the centralized approach, and observe that with lesser number of MFRAs, our approach is able to ensure reliable delivery of data and reduce overall energy cost by 56.76\% -- 88.03\%.

Related papers

• Energy-Efficient Flying LoRa Gateways: A Multi-Agent Reinforcement Learning Approach [8.65375886947338]
  We deploy flying LoRa gateways mounted on unmanned aerial vehicles (UAVs) to collect data from LoRa end devices and transmit it to a central server. Our primary objective is to maximize the global system energy efficiency of wireless LoRa networks by joint optimization of transmission power, spreading factor, bandwidth, and user association.
  arXiv  Detail & Related papers  (2025-02-05T17:16:40Z)
• Reinforcement Learning for Enhancing Sensing Estimation in Bistatic ISAC Systems with UAV Swarms [4.387337528923525]
  This paper introduces a novel Multi-Agent Reinforcement Learning (MARL) framework to enhance integrated sensing and communication networks. By framing the positioning and trajectory optimization of UAVs as a Partially Observable Markov Decision Process, we develop a MARL approach. We implement a decentralized cooperative MARL strategy to enable UAVs to develop effective communication protocols.
  arXiv  Detail & Related papers  (2025-01-11T06:57:52Z)
• Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective [1.088537320059347]
  Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning. However, the practical deployment of FL systems faces a significant bottleneck: the communication overhead. This survey investigates various strategies and advancements made in communication-efficient FL.
  arXiv  Detail & Related papers  (2024-05-30T19:21:33Z)
• Multi-Objective Optimization for UAV Swarm-Assisted IoT with Virtual Antenna Arrays [55.736718475856726]
  Unmanned aerial vehicle (UAV) network is a promising technology for assisting Internet-of-Things (IoT) Existing UAV-assisted data harvesting and dissemination schemes require UAVs to frequently fly between the IoTs and access points. We introduce collaborative beamforming into IoTs and UAVs simultaneously to achieve energy and time-efficient data harvesting and dissemination.
  arXiv  Detail & Related papers  (2023-08-03T02:49:50Z)
• Decentralized federated learning methods for reducing communication cost and energy consumption in UAV networks [8.21384946488751]
  Unmanned aerial vehicles (UAV) play many roles in a modern smart city such as the delivery of goods, mapping real-time road traffic and monitoring pollution. Traditional machine learning models for drones encounter data privacy problems, communication costs and energy limitations. We propose two aggregation methods: Commutative FL and Alternate FL, based on the existing architecture of decentralised Federated Learning for UAV Networks (DFL-UN)
  arXiv  Detail & Related papers  (2023-04-13T14:00:34Z)
• The Internet of Senses: Building on Semantic Communications and Edge Intelligence [67.75406096878321]
  The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human receptors' We elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms may satisfy the requirements of IoS use cases.
  arXiv  Detail & Related papers  (2022-12-21T03:37:38Z)
• Towards Energy Efficient Distributed Federated Learning for 6G Networks [9.386341375741225]
  IoT/edge devices need to transmit the data directly to the base station for training the model using machine learning techniques. Data transmission introduces privacy issues that might lead to security concerns and monetary losses. We propose distributed federated learning (DBFL) framework that overcomes the connectivity and energy efficiency issues for distant devices.
  arXiv  Detail & Related papers  (2022-01-19T06:37:57Z)
• Federated Learning over Wireless IoT Networks with Optimized Communication and Resources [98.18365881575805]
  Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention. It is of interest to investigate fast responding and accurate FL schemes over wireless systems. We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
  arXiv  Detail & Related papers  (2021-10-22T13:25:57Z)
• To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices [78.38046945665538]
  federated learning (FL) over massive mobile edge devices opens new horizons for numerous intelligent mobile applications. FL imposes huge communication and computation burdens on participating devices due to periodical global synchronization and continuous local training. We develop a convergence-guaranteed FL algorithm enabling flexible communication compression.
  arXiv  Detail & Related papers  (2020-12-22T02:54:18Z)
• Communication Efficient Federated Learning with Energy Awareness over Wireless Networks [51.645564534597625]
  In federated learning (FL), the parameter server and the mobile devices share the training parameters over wireless links. We adopt the idea of SignSGD in which only the signs of the gradients are exchanged. Two optimization problems are formulated and solved, which optimize the learning performance. Considering that the data may be distributed across the mobile devices in a highly uneven fashion in FL, a sign-based algorithm is proposed.
  arXiv  Detail & Related papers  (2020-04-15T21:25:13Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.