Semantic Communication and Control Co-Design for Multi-Objective Correlated Dynamics

• URL: http://arxiv.org/abs/2410.02303v1
• Date: Thu, 3 Oct 2024 08:38:54 GMT
• Title: Semantic Communication and Control Co-Design for Multi-Objective Correlated Dynamics
• Authors: Abanoub M. Girgis, Hyowoon Seo, Mehdi Bennis,
• Abstract summary: This letter introduces a machine-learning approach to learning the semantic dynamics of correlated systems. By leveraging the Koopman operator in an autoencoder (AE) framework, the system's state evolution is linearized in the latent space. Signal temporal logic (STL) is incorporated through a logical semantic Koopman (LSK) model to encode system-specific control rules.
• Score: 33.18378000044136
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This letter introduces a machine-learning approach to learning the semantic dynamics of correlated systems with different control rules and dynamics. By leveraging the Koopman operator in an autoencoder (AE) framework, the system's state evolution is linearized in the latent space using a dynamic semantic Koopman (DSK) model, capturing the baseline semantic dynamics. Signal temporal logic (STL) is incorporated through a logical semantic Koopman (LSK) model to encode system-specific control rules. These models form the proposed logical Koopman AE framework that reduces communication costs while improving state prediction accuracy and control performance, showing a 91.65% reduction in communication samples and significant performance gains in simulation.

Related papers

• Architecting AgentOS: From Token-Level Context to Emergent System-Level Intelligence [13.062618208633483]
  This paper proposes AgentOS, a holistic conceptual framework that redefines the Large Language Models as a "Reasoning Kernel" governed by structured operating system logic.<n>By mapping classical OS abstractions such as memory paging interrupt handling and process scheduling onto LLM native constructs, this review provides a rigorous roadmap for architecting resilient scalable and self-evolving cognitive environments.
  arXiv  Detail & Related papers  (2026-02-24T14:12:21Z)
• Executable Ontologies: Synthesizing Event Semantics with Dataflow Architecture [51.56484100374058]
  We demonstrate that integrating semantic event semantics with a dataflow architecture addresses the limitations of traditional Business Process Management systems.<n>The boldsea-engine's architecture interprets semantic models as executable algorithms without compilation.<n>It enables the modification of event models at runtime ensures transparency, and seamlessly merges data and business logic within a unified semantic framework.
  arXiv  Detail & Related papers  (2025-09-11T18:12:46Z)
• Deep Bilinear Koopman Model for Real-Time Vehicle Control in Frenet Frame [0.0]
  This paper presents a deep Koopman approach for modeling and control of vehicle dynamics within the curvilinear Frenet frame.<n>The proposed framework uses a deep neural network architecture to simultaneously learn the Koopman operator and its associated invariant subspace from the data.<n>The proposed controller achieved significant reductions in tracking error relative to baseline controllers, confirming its suitability for real-time implementation in embedded autonomous vehicle systems.
  arXiv  Detail & Related papers  (2025-07-16T18:49:44Z)
• Designing Robust Software Sensors for Nonlinear Systems via Neural Networks and Adaptive Sliding Mode Control [2.884893167166808]
  This paper presents a novel approach to designing software sensors for nonlinear dynamical systems.<n>Unlike traditional model-based observers that rely on explicit transformations or linearization, the proposed framework integrates neural networks with adaptive Sliding Mode Control (SMC)<n>The training methodology leverages the system's governing equations as a physics-based constraint, enabling observer synthesis without access to ground-truth state trajectories.
  arXiv  Detail & Related papers  (2025-07-09T13:06:58Z)
• Modeling and Performance Analysis for Semantic Communications Based on Empirical Results [53.805458017074294]
  We propose an Alpha-Beta-Gamma (ABG) formula to model the relationship between the end-to-end measurement and SNR. For image reconstruction tasks, the proposed ABG formula can well fit the commonly used DL networks, such as SCUNet, and Vision Transformer. To the best of our knowledge, this is the first theoretical expression between end-to-end performance metrics and SNR for semantic communications.
  arXiv  Detail & Related papers  (2025-04-29T06:07:50Z)
• LANGTRAJ: Diffusion Model and Dataset for Language-Conditioned Trajectory Simulation [94.84458417662404]
  LangTraj is a language-conditioned scene-diffusion model that simulates the joint behavior of all agents in traffic scenarios. By conditioning on natural language inputs, LangTraj provides flexible and intuitive control over interactive behaviors. LangTraj demonstrates strong performance in realism, language controllability, and language-conditioned safety-critical simulation.
  arXiv  Detail & Related papers  (2025-04-15T17:14:06Z)
• Multi-Step Deep Koopman Network (MDK-Net) for Vehicle Control in Frenet Frame [0.0]
  This paper introduces a novel deep learning-based Koopman modeling approach that employs deep neural networks to capture the full vehicle dynamics. The superior accuracy of the Koopman model compared to identified linear models is shown for a double lane change maneuver.
  arXiv  Detail & Related papers  (2025-03-04T20:57:38Z)
• Variational Source-Channel Coding for Semantic Communication [6.55201432222942]
  The current semantic communication systems are generally modeled as an Auto-Encoder (AE) AE lacks a deep integration of AI principles with communication strategies due to its inability to effectively capture channel dynamics. This paper explores the inclusion of data distortion distinguishes semantic communication from classical communication. A Variational Source-Channel Coding (VSCC) method is proposed for constructing semantic communication systems.
  arXiv  Detail & Related papers  (2024-09-26T03:42:05Z)
• Semantic Communication for Cooperative Perception using HARQ [51.148203799109304]
  We leverage an importance map to distill critical semantic information, introducing a cooperative perception semantic communication framework. To counter the challenges posed by time-varying multipath fading, our approach incorporates the use of frequency-division multiplexing (OFDM) along with channel estimation and equalization strategies. We introduce a novel semantic error detection method that is integrated with our semantic communication framework in the spirit of hybrid automatic repeated request (HARQ)
  arXiv  Detail & Related papers  (2024-08-29T08:53:26Z)
• Learning Noise-Robust Stable Koopman Operator for Control with Hankel DMD [1.0742675209112622]
  We propose a noise-robust learning framework for the Koopman operator of nonlinear dynamical systems. We leverage observables generated by the system dynamics, when the system dynamics is known, through a Hankel matrix. We approximate them with a neural network while maintaining structural similarities to discrete Polyflow.
  arXiv  Detail & Related papers  (2024-08-13T03:39:34Z)
• Agent-driven Generative Semantic Communication with Cross-Modality and Prediction [57.335922373309074]
  We propose a novel agent-driven generative semantic communication framework based on reinforcement learning. In this work, we develop an agent-assisted semantic encoder with cross-modality capability, which can track the semantic changes, channel condition, to perform adaptive semantic extraction and sampling. The effectiveness of the designed models has been verified using the UA-DETRAC dataset, demonstrating the performance gains of the overall A-GSC framework.
  arXiv  Detail & Related papers  (2024-04-10T13:24:27Z)
• Temporally-Consistent Koopman Autoencoders for Forecasting Dynamical Systems [42.6886113798806]
  We introduce the Temporally-Consistent Koopman Autoencoder (tcKAE) tcKAE generates accurate long-term predictions even with constrained and noisy training data. We demonstrate tcKAE's superior performance over state-of-the-art KAE models across a variety of test cases.
  arXiv  Detail & Related papers  (2024-03-19T00:48:25Z)
• A Transition System Abstraction Framework for Neural Network Dynamical System Models [2.414910571475855]
  This paper proposes a transition system abstraction framework for neural network dynamical system models. The framework is able to abstract a data-driven neural network model into a transition system, making the neural network model interpretable.
  arXiv  Detail & Related papers  (2024-02-18T23:49:18Z)
• Data-driven Nonlinear Model Reduction using Koopman Theory: Integrated Control Form and NMPC Case Study [56.283944756315066]
  We propose generic model structures combining delay-coordinate encoding of measurements and full-state decoding to integrate reduced Koopman modeling and state estimation. A case study demonstrates that our approach provides accurate control models and enables real-time capable nonlinear model predictive control of a high-purity cryogenic distillation column.
  arXiv  Detail & Related papers  (2024-01-09T11:54:54Z)
• KEEC: Koopman Embedded Equivariant Control [29.738391644702947]
  An efficient way to control systems with unknown nonlinear dynamics is to find an appropriate embedding or representation. Koopman Embedded Equivariant Control (KEEC) learns an embedding of the states and vector fields such that a Koopman operator is approximated as the latent dynamics. Our algorithm achieves superior performances in the experiments conducted on various control domains.
  arXiv  Detail & Related papers  (2023-12-04T00:11:27Z)
• Reasoning with the Theory of Mind for Pragmatic Semantic Communication [62.87895431431273]
  A pragmatic semantic communication framework is proposed in this paper. It enables effective goal-oriented information sharing between two-intelligent agents. Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits.
  arXiv  Detail & Related papers  (2023-11-30T03:36:19Z)
• Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders [5.037881619912574]
  In this paper, we investigate latent space separation methods for structural syntactic injection in Transformer-based VAEs. Specifically, we explore how syntactic structures can be leveraged in the encoding stage through the integration of graph-based and sequential models. Our empirical evaluation, carried out on natural language sentences and mathematical expressions, reveals that the proposed end-to-end VAE architecture can result in a better overall organisation of the latent space.
  arXiv  Detail & Related papers  (2023-11-14T22:47:23Z)
• ConCerNet: A Contrastive Learning Based Framework for Automated Conservation Law Discovery and Trustworthy Dynamical System Prediction [82.81767856234956]
  This paper proposes a new learning framework named ConCerNet to improve the trustworthiness of the DNN based dynamics modeling. We show that our method consistently outperforms the baseline neural networks in both coordinate error and conservation metrics.
  arXiv  Detail & Related papers  (2023-02-11T21:07:30Z)
• Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantization [76.68866368409216]
  We propose learning to dynamically select discretization tightness conditioned on inputs. We show that dynamically varying tightness in communication bottlenecks can improve model performance on visual reasoning and reinforcement learning tasks.
  arXiv  Detail & Related papers  (2022-02-02T23:54:26Z)
• Relational State-Space Model for Stochastic Multi-Object Systems [24.234120525358456]
  This paper introduces the relational state-space model (R-SSM), a sequential hierarchical latent variable model. R-SSM makes use of graph neural networks (GNNs) to simulate the joint state transitions of multiple correlated objects. The utility of R-SSM is empirically evaluated on synthetic and real time-series datasets.
  arXiv  Detail & Related papers  (2020-01-13T03:45:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.