A Deep Reinforcement Learning-based Adaptive Charging Policy for Wireless Rechargeable Sensor Networks

• URL: http://arxiv.org/abs/2208.07824v1
• Date: Tue, 16 Aug 2022 16:10:52 GMT
• Title: A Deep Reinforcement Learning-based Adaptive Charging Policy for Wireless Rechargeable Sensor Networks
• Authors: Ngoc Bui, Phi Le Nguyen, Viet Anh Nguyen, Phan Thuan Do
• Abstract summary: Wireless power transfer technology is emerging as a reliable solution for energizing the sensors. We propose a novel adaptive charging scheme using a deep reinforcement learning (DRL) approach. Our model can adapt to spontaneous changes in the network topology.
• Score: 14.67786743033424
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor. Wireless power transfer technology is emerging as a reliable solution for energizing the sensors by deploying a mobile charger (MC) to recharge the sensor. However, designing an optimal charging path for the MC is challenging because of uncertainties arising in the networks. The energy consumption rate of the sensors may fluctuate significantly due to unpredictable changes in the network topology, such as node failures. These changes also lead to shifts in the importance of each sensor, which are often assumed to be the same in existing works. We address these challenges in this paper by proposing a novel adaptive charging scheme using a deep reinforcement learning (DRL) approach. Specifically, we endow the MC with a charging policy that determines the next sensor to charge conditioning on the current state of the network. We then use a deep neural network to parametrize this charging policy, which will be trained by reinforcement learning techniques. Our model can adapt to spontaneous changes in the network topology. The empirical results show that the proposed algorithm outperforms the existing on-demand algorithms by a significant margin.

Related papers

• DynamiQS: Quantum Secure Authentication for Dynamic Charging of Electric Vehicles [61.394095512765304]
  Dynamic Wireless Power Transfer (DWPT) is a novel technology that allows charging an electric vehicle while driving. Recent advancements in quantum computing jeopardize classical public key cryptography. We propose DynamiQS, the first post-quantum secure authentication protocol for dynamic wireless charging.
  arXiv  Detail & Related papers  (2023-12-20T09:40:45Z)
• Sensor Placement for Learning in Flow Networks [6.680930089714339]
  This paper investigates the sensor placement problem for networks. We first formalize the problem under a flow conservation assumption and show that it is NP-hard to place a fixed set of sensors optimally. Next, we propose an efficient and adaptive greedy for sensor placement that scales to large networks.
  arXiv  Detail & Related papers  (2023-12-12T01:08:08Z)
• Physical-Layer Semantic-Aware Network for Zero-Shot Wireless Sensing [74.12670841657038]
  Device-free wireless sensing has recently attracted significant interest due to its potential to support a wide range of immersive human-machine interactive applications. Data heterogeneity in wireless signals and data privacy regulation of distributed sensing have been considered as the major challenges that hinder the wide applications of wireless sensing in large area networking systems. We propose a novel zero-shot wireless sensing solution that allows models constructed in one or a limited number of locations to be directly transferred to other locations without any labeled data.
  arXiv  Detail & Related papers  (2023-12-08T13:50:30Z)
• Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control [63.310780486820796]
  We show how a parameterization of recurrent connectivity influences robustness in closed-loop settings. We find that closed-form continuous-time neural networks (CfCs) with fewer parameters can outperform their full-rank, fully-connected counterparts.
  arXiv  Detail & Related papers  (2023-10-05T21:44:18Z)
• Intelligent Communication Planning for Constrained Environmental IoT Sensing with Reinforcement Learning [19.715387333728152]
  Internet of Things (IoT) devices are often power-constrained and utilize wireless communication schemes with limited bandwidth. We formulate the communication planning problem of IoT sensors that track the state of the environment. We propose a multi-agent reinforcement learning (MARL) method to find the optimal communication policies for each sensor.
  arXiv  Detail & Related papers  (2023-08-19T22:59:09Z)
• A distributed neural network architecture for dynamic sensor selection with application to bandwidth-constrained body-sensor networks [53.022158485867536]
  We propose a dynamic sensor selection approach for deep neural networks (DNNs) It is able to derive an optimal sensor subset selection for each specific input sample instead of a fixed selection for the entire dataset. We show how we can use this dynamic selection to increase the lifetime of a wireless sensor network (WSN) by imposing constraints on how often each node is allowed to transmit.
  arXiv  Detail & Related papers  (2023-08-16T14:04:50Z)
• Environmental Sensor Placement with Convolutional Gaussian Neural Processes [65.13973319334625]
  It is challenging to place sensors in a way that maximises the informativeness of their measurements, particularly in remote regions like Antarctica. Probabilistic machine learning models can suggest informative sensor placements by finding sites that maximally reduce prediction uncertainty. This paper proposes using a convolutional Gaussian neural process (ConvGNP) to address these issues.
  arXiv  Detail & Related papers  (2022-11-18T17:25:14Z)
• A Reinforcement Learning Approach to Sensing Design in Resource-Constrained Wireless Networked Control Systems [0.0]
  We consider a wireless network of smart sensors (agents) that monitor a dynamical process and send measurements to a base station. Smart sensors are equipped with both sensing and computation, and can either send raw measurements or process them prior to transmission. We propose a Reinforcement Learning approach to learn an efficient policy that dynamically decides when measurements are to be processed at each sensor.
  arXiv  Detail & Related papers  (2022-04-01T21:55:11Z)
• Offline Contextual Bandits for Wireless Network Optimization [107.24086150482843]
  In this paper, we investigate how to learn policies that can automatically adjust the configuration parameters of every cell in the network in response to the changes in the user demand. Our solution combines existent methods for offline learning and adapts them in a principled way to overcome crucial challenges arising in this context.
  arXiv  Detail & Related papers  (2021-11-11T11:31:20Z)
• ChaRRNets: Channel Robust Representation Networks for RF Fingerprinting [0.0]
  We present complex-valued Convolutional Neural Networks (CNNs) for RF fingerprinting. We focus on the problem of fingerprinting wireless IoT devices in-the-wild using Deep Learning (DL) techniques.
  arXiv  Detail & Related papers  (2021-05-08T03:03:21Z)
• A supervised active learning method for identifying critical nodes in Wireless Sensor Network [0.27920304852537525]
  We propose an active learning approach to address the computational overhead of identifying critical nodes in a wireless sensor network (WSN) The proposed approach can overcome biasing in identifying non-critical nodes and needs much less effort in fine-tuning to adapt to the dynamic nature of WSN. Experiments show that the proposed method has more flexibility, compared to the state-of-the-art, to be employed in large scale WSN environments.
  arXiv  Detail & Related papers  (2020-04-19T15:48:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.