Push- and Pull-based Effective Communication in Cyber-Physical Systems

• URL: http://arxiv.org/abs/2401.10921v1
• Date: Mon, 15 Jan 2024 10:06:17 GMT
• Title: Push- and Pull-based Effective Communication in Cyber-Physical Systems
• Authors: Pietro Talli, Federico Mason, Federico Chiariotti, and Andrea Zanella
• Abstract summary: We propose an analytical model for push- and pull-based communication in CPSs, observing that the policy optimality coincides with Cyber Value Information (VoI) state. Our results also highlight that, despite providing a better optimal solution, implementable push-based communication strategies may underperform even in relatively simple scenarios.
• Score: 15.079887992932692
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In Cyber Physical Systems (CPSs), two groups of actors interact toward the maximization of system performance: the sensors, observing and disseminating the system state, and the actuators, performing physical decisions based on the received information. While it is generally assumed that sensors periodically transmit updates, returning the feedback signal only when necessary, and consequently adapting the physical decisions to the communication policy, can significantly improve the efficiency of the system. In particular, the choice between push-based communication, in which updates are initiated autonomously by the sensors, and pull-based communication, in which they are requested by the actuators, is a key design step. In this work, we propose an analytical model for optimizing push- and pull-based communication in CPSs, observing that the policy optimality coincides with Value of Information (VoI) maximization. Our results also highlight that, despite providing a better optimal solution, implementable push-based communication strategies may underperform even in relatively simple scenarios.

Related papers

• Communication Learning in Multi-Agent Systems from Graph Modeling Perspective [62.13508281188895]
  We introduce a novel approach wherein we conceptualize the communication architecture among agents as a learnable graph. We introduce a temporal gating mechanism for each agent, enabling dynamic decisions on whether to receive shared information at a given time.
  arXiv  Detail & Related papers  (2024-11-01T05:56:51Z)
• Integrated Push-and-Pull Update Model for Goal-Oriented Effective Communication [40.57990979803115]
  We consider an end-to-end status update system where a sensing agent observes a source, generates and transmits updates to an actuation agent. We integrate the push- and pull-based update communication models to obtain a push-and-pull model. Our results show the proposed push-and-pull model outperforms models solely based on push- or pull-based updates.
  arXiv  Detail & Related papers  (2024-07-19T07:57:31Z)
• Effective Communication with Dynamic Feature Compression [25.150266946722]
  We study a prototypal system in which an observer must communicate its sensory data to a robot controlling a task. We consider an ensemble Vector Quantized Variational Autoencoder (VQ-VAE) encoding, and train a Deep Reinforcement Learning (DRL) agent to dynamically adapt the quantization level. We tested the proposed approach on the well-known CartPole reference control problem, obtaining a significant performance increase.
  arXiv  Detail & Related papers  (2024-01-29T15:35:05Z)
• Reasoning with the Theory of Mind for Pragmatic Semantic Communication [62.87895431431273]
  A pragmatic semantic communication framework is proposed in this paper. It enables effective goal-oriented information sharing between two-intelligent agents. Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits.
  arXiv  Detail & Related papers  (2023-11-30T03:36:19Z)
• Multi-Agent Reinforcement Learning for Pragmatic Communication and Control [40.11766545693947]
  We propose a joint design that combines goal-oriented communication and networked control into a single optimization model. Joint training of the communication and control systems can significantly improve the overall performance.
  arXiv  Detail & Related papers  (2023-02-28T08:30:24Z)
• Semantic and Effective Communication for Remote Control Tasks with Dynamic Feature Compression [23.36744348465991]
  Coordination of robotic swarms and the remote wireless control of industrial systems are among the major use cases for 5G and beyond systems. In this work, we consider a prototypal system in which an observer must communicate its sensory data to an actor controlling a task. We propose an ensemble Vector Quantized Variational Autoencoder (VQ-VAE) encoding, and train a Deep Reinforcement Learning (DRL) agent to dynamically adapt the quantization level.
  arXiv  Detail & Related papers  (2023-01-14T11:43:56Z)
• Age of Semantics in Cooperative Communications: To Expedite Simulation Towards Real via Offline Reinforcement Learning [53.18060442931179]
  We propose the age of semantics (AoS) for measuring semantics freshness of status updates in a cooperative relay communication system. We derive an online deep actor-critic (DAC) learning scheme under the on-policy temporal difference learning framework. We then put forward a novel offline DAC scheme, which estimates the optimal control policy from a previously collected dataset.
  arXiv  Detail & Related papers  (2022-09-19T11:55:28Z)
• Optimal Power Allocation for Rate Splitting Communications with Deep Reinforcement Learning [61.91604046990993]
  This letter introduces a novel framework to optimize the power allocation for users in a Rate Splitting Multiple Access network. In the network, messages intended for users are split into different parts that are a single common part and respective private parts.
  arXiv  Detail & Related papers  (2021-07-01T06:32:49Z)
• Deep reinforcement learning of event-triggered communication and control for multi-agent cooperative transport [9.891241465396098]
  We explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for cooperative transport. Our framework exploits event-triggered architecture, namely, a feedback controller that computes the communication input and a triggering mechanism that determines when the input has to be updated again.
  arXiv  Detail & Related papers  (2021-03-29T01:16:12Z)
• Path Design and Resource Management for NOMA enhanced Indoor Intelligent Robots [58.980293789967575]
  A communication enabled indoor intelligent robots (IRs) service framework is proposed. Lego modeling method is proposed, which can deterministically describe the indoor layout and channel state. The investigated radio map is invoked as a virtual environment to train the reinforcement learning agent.
  arXiv  Detail & Related papers  (2020-11-23T21:45:01Z)
• Optimizing Interactive Systems via Data-Driven Objectives [70.3578528542663]
  We propose an approach that infers the objective directly from observed user interactions. These inferences can be made regardless of prior knowledge and across different types of user behavior. We introduce Interactive System (ISO), a novel algorithm that uses these inferred objectives for optimization.
  arXiv  Detail & Related papers  (2020-06-19T20:49:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.