Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm
- URL: http://arxiv.org/abs/2606.26048v2
- Date: Fri, 26 Jun 2026 16:48:43 GMT
- Title: Deep Reinforcement Learning-Enhanced Event-Triggered Data-Driven Predictive Control for a 3D Cable-Driven Soft Robotic Arm
- Abstract summary: We propose an adaptive reinforcement-learning-based event-triggered DeePC framework for soft robotic control.<n> RL-ET-DeePC reduces optimization frequency by up to 66% compared to periodic DeePC.<n> Hardware experiments on a three-dimensional cable-driven soft robotic arm demonstrate zero-shot transfer.
- Score: 15.863274172058759
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Soft robots are challenging to control due to their nonlinear and time-varying dynamics. Data-enabled predictive control (DeePC) offers a model-free alternative by directly leveraging measured input-output trajectories to construct a predictive controller. However, its receding-horizon formulation requires solving a constrained optimization problem at every sampling instant, which can be computationally demanding for real-time deployment on resource-limited robotic platforms. To address this limitation, we propose an adaptive reinforcement-learning-based event-triggered DeePC (RL-ET-DeePC) framework for soft robotic control. A model-free RL policy is trained to determine when to invoke the DeePC optimizer based on the current system state representation, thereby reducing unnecessary optimization calls while preserving closed-loop performance. Simulation results show that RL-ET-DeePC reduces optimization frequency by up to 66% compared to periodic DeePC, while maintaining comparable tracking accuracy. Hardware experiments on a three-dimensional cable-driven soft robotic arm demonstrate zero-shot transfer, achieving a 34% reduction in optimization frequency with tracking accuracy comparable to periodic DeePC and more consistent performance than a static threshold-based event-triggered baseline.
Related papers
- A Neural Network Based Teleoperation for Remote Controlled Vehicles [98.38733381483934]
Direct teleoperation of vehicles faces critical technical bottlenecks.<n> communication latency and the operator's inability to physically perceive unmodeled environmental disturbances.<n>We propose a tailored unilateral teleoperation framework.
arXiv Detail & Related papers (2026-08-11T01:51:08Z) - Behavior Cloning of MPC for 3-DOF Robotic Manipulators [0.0]
Model Predictive Control (MPC) provides strong stability and robustness, but it imposes a significant computational burden on real-time systems.<n>This paper investigates the application of Behavior Cloning to approximate MPC policies for the real-time control of a 3-degree-of-freedom robotic manipulator.
arXiv Detail & Related papers (2026-05-29T21:51:43Z) - Accelerating Sampling-Based Control via Learned Linear Koopman Dynamics [4.946483489399818]
This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics.<n>We replace the nonlinear dynamics used for trajectory propagation with a learned linear deep Koopman operator (DKO) model, enabling faster rollout and more efficient trajectory sampling.<n>The resulting controller, termed MPPI-DK, is validated on hardware through reference-tracking experiments on a quadruped robot.
arXiv Detail & Related papers (2026-03-05T17:15:52Z) - Towards a Self-Driving Trigger at the LHC: Adaptive Response in Real Time [8.632121079404772]
Real-time data filtering and selection must process extremely high-rate data streams.<n>These systems are typically designed as static, hand-tuned menus of selection criteria.<n>We explore the concept of a self-driving trigger that reallocates resources and adjusts thresholds dynamically in real-time.
arXiv Detail & Related papers (2026-01-13T19:00:02Z) - Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization [81.35990332700389]
Approximate model-predictive control (AMPC) aims to imitate an MPC's behavior with a neural network.<n>During deployment, the parameters of the underlying MPC must usually be fine-tuned.<n>Recent work addresses this problem by adapting AMPC without retraining using approximated sensitivities of the MPC's optimization problem.
arXiv Detail & Related papers (2025-12-16T12:24:08Z) - TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Acceleration [64.32072516882947]
Diffusion Policy excels in embodied control but suffers from high inference latency and computational cost.<n>We propose Temporal-aware Reinforcement-based Speculative Diffusion Policy (TS-DP)<n>TS-DP achieves up to 4.17 times faster inference with over 94% accepted drafts, reaching an inference frequency of 25 Hz.
arXiv Detail & Related papers (2025-12-13T07:53:14Z) - RAPID^3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformer [86.57077884971478]
Diffusion Transformers (DiTs) excel at visual generation yet remain hampered by slow sampling.<n>We introduce RAPID3: Tri-Level Reinforced Acceleration Policies for Diffusion Transformers.<n>It delivers image-wise acceleration with zero updates to the base generator.<n>It achieves nearly 3x faster sampling with competitive generation quality.
arXiv Detail & Related papers (2025-09-26T13:20:52Z) - Large Language Model-Empowered Decision Transformer for UAV-Enabled Data Collection [71.84636717632206]
Unmanned aerial vehicles (UAVs) for reliable and energy-efficient data collection from spatially distributed devices holds great promise in supporting Internet of Things (IoT) applications.<n>We propose a joint language model (LLM) to learn effective UAV control policies.<n>LLM-CRDT outperforms benchmark online and offline methods, achieving up to 36.7% higher energy efficiency than current state-of-the-art DT approaches.
arXiv Detail & Related papers (2025-09-17T13:05:08Z) - Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllers [0.9674641730446749]
Model Predictive Path Integral control is a powerful sampling-based approach suitable for complex robotic tasks.<n>This paper introduces robust feedback gains derived from sensitivity used in gradient-based MPC.<n>We demonstrate the effectiveness of F-MPPI in simulations through real-world experiments on two robotic platforms.
arXiv Detail & Related papers (2025-06-17T07:47:33Z) - R^3: On-device Real-Time Deep Reinforcement Learning for Autonomous
Robotics [9.2327813168753]
This paper presents R3, a holistic solution for managing timing, memory, and algorithm performance in on-device real-time DRL training.
R3 employs (i) a deadline-driven feedback loop with dynamic batch sizing for optimizing timing, (ii) efficient memory management to reduce memory footprint and allow larger replay buffer sizes, and (iii) a runtime coordinator guided by runtime analysis and a runtime profiler for adjusting memory resource reservations.
arXiv Detail & Related papers (2023-08-29T05:48:28Z) - Guided Constrained Policy Optimization for Dynamic Quadrupedal Robot
Locomotion [78.46388769788405]
We introduce guided constrained policy optimization (GCPO), an RL framework based upon our implementation of constrained policy optimization (CPPO)
We show that guided constrained RL offers faster convergence close to the desired optimum resulting in an optimal, yet physically feasible, robotic control behavior without the need for precise reward function tuning.
arXiv Detail & Related papers (2020-02-22T10:15:53Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.