Coupled Control and Wireless World Models for Resilient Remote Robotic Control

• URL: http://arxiv.org/abs/2609.04851v1
• Date: Fri, 04 Sep 2026 08:09:55 GMT
• Title: Coupled Control and Wireless World Models for Resilient Remote Robotic Control
• Abstract summary: This paper proposes a communication-aware remote robotic control framework based on coupled control and wireless Joint Embedding Predictive Architecture (JEPA)<n>The learned latent representations enable predictive communication scheduling by jointly forecasting future robot states and wireless conditions.<n>An adaptive resilience mechanism detects latent prediction discrepancies and efficiently adapts perception embeddings to accommodate wireless and visual environmental changes.
• Score: 26.76550154183091
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Remote robotic systems operating over wireless networks must maintain reliable control despite limited communication resources, changing channel conditions, and environmental disturbances.However, continuously transmitting high-dimensional sensory observations, such as camera images, increases communication overhead and energy consumption while reducing robustness under unreliable connectivity.To address these challenges, this paper proposes a resilient communication-aware remote robotic control framework based on coupled control and wireless Joint Embedding Predictive Architecture (JEPA) world models that jointly capture robot dynamics and wireless channel evolution from visual observations and a combination of raw and structured radio frequency (RF) representations based on spectrograms and Persistence Images(PIs).The learned latent representations enable predictive communication scheduling by jointly forecasting future robot states and wireless conditions, thereby reducing unnecessary uplink transmissions while maintaining reliable control performance.Furthermore, an adaptive resilience mechanism detects latent prediction discrepancies and efficiently adapts perception embeddings to accommodate wireless and visual environmental changes without retraining the complete control policy.The proposed framework is evaluated in a synchronized Gazebo-Robot Operating System (ROS)-Sionna robot-wireless simulation environment under diverse wireless propagation and perception perturbations.Experimental results demonstrate significant improvements in communication efficiency, robustness, and resilience while maintaining navigation performance compared with conventional Proportional Integral Derivative (PID), model-free Deep Q-Network (DQN), and predictive approaches based on Vision Transformers(ViTs).

Related papers

• A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
  Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
  arXiv  Detail & Related papers  (2026-08-11T01:51:08Z)
• Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation [45.11184664928145]
  Wireless extended reality (XR) teleoperation provides embodied interaction capability for collecting humanoid robot demonstrations.<n>This paper develops a system framework that integrates sampling, transmission, the reconstruction and formulates a communication-rate optimization.
  arXiv  Detail & Related papers  (2026-05-19T03:13:09Z)
• World Model-Enabled Causal Digital Twins for Semantic Communications in Physical AI Systems [37.02293452905313]
  This paper investigates goal-oriented semantic communications for physical AI systems with closed-loop sensing-communication-inference-control.<n>In particular, the problem of semantic communications is formulated as a long-term return-per-bit under wireless bit-budget constraints.<n>A world-model-enabled causal digital twin (WM-CDT) framework is proposed to capture the dynamics of closed-loop AI systems.
  arXiv  Detail & Related papers  (2026-05-15T18:41:51Z)
• Physical-AI: From Channel Awareness to Environmental Intelligence in 6G Wireless Networks [100.92510794177822]
  Conventional wireless networks rely on instantaneous channel state information (CSI) and react to channel variations without explicitly modeling the physical environment.<n>We propose Physical-AI: a new architecture for environment-aware wireless networking, where radio signals enable sensing, modeling, and interaction with the environment.<n>We show that the proposed framework reduces outage probability and blockage-response latency, particularly under increasing beam-switching delays.
  arXiv  Detail & Related papers  (2026-05-12T09:02:20Z)
• Hierarchical JEPA Meets Predictive Remote Control in Beyond 5G Networks [24.374628979591872]
  We propose a Hierarchical Joint-Embedding Predictive Architecture (H-JEPA) for scalable predictive control.<n>Instead of transmitting states, device observations are encoded into low-dimensional embeddings that preserve essential dynamics.<n>H-JEPA enables up to 42.83 % more devices to be supported under limited wireless capacity without compromising control performance.
  arXiv  Detail & Related papers  (2026-01-28T17:04:06Z)
• STAR-RIS-assisted Collaborative Beamforming for Low-altitude Wireless Networks [58.13757830013997]
  Wireless networks based on uncrewed aerial vehicles (UAVs) offer high mobility, flexibility, and coverage for urban communications.<n>They face severe signal attenuation in dense environments due to obstructions.<n>To address this critical issue, we consider introducing collaborative beam of UAVs and omni-directional re-altitude beamforming.
  arXiv  Detail & Related papers  (2025-10-25T01:28:37Z)
• From Pixels to CSI: Distilling Latent Dynamics For Efficient Wireless Resource Management [31.080933663717257]
  We propose a novel machine learning technique to jointly model and predict the dynamics of the control system.<n>We show that our proposed approach reduces transmit power by over 50% while maintaining control performance comparable to baseline methods.
  arXiv  Detail & Related papers  (2025-06-19T11:08:20Z)
• Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks [55.467288506826755]
  Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks.<n>Most existing communication-efficient FL algorithms fail to reduce the significant inter-device variance.<n>We propose a novel communication-efficient FL algorithm, named FedQVR, which relies on a sophisticated variance-reduced scheme.
  arXiv  Detail & Related papers  (2025-01-20T04:26:21Z)
• Wireless Human-Machine Collaboration in Industry 5.0 [75.78721184383897]
  Wireless Human-Machine Collaboration represents a critical advancement for Industry 5.0. Stability analysis certifies how the closed-loop system will behave under model randomness. This paper establishes a fundamental WHMC model incorporating dual wireless loops for machine and human control.
  arXiv  Detail & Related papers  (2024-10-18T03:44:10Z)
• Joint Sensing, Communication, and AI: A Trifecta for Resilient THz User Experiences [118.91584633024907]
  A novel joint sensing, communication, and artificial intelligence (AI) framework is proposed so as to optimize extended reality (XR) experiences over terahertz (THz) wireless systems.
  arXiv  Detail & Related papers  (2023-04-29T00:39:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.