Real-Time and Accurate Collision-Free Teleoperation via Differentiable Constraint-Based Trajectory Planning

• URL: http://arxiv.org/abs/2606.08725v1
• Date: Sun, 07 Jun 2026 16:39:56 GMT
• Title: Real-Time and Accurate Collision-Free Teleoperation via Differentiable Constraint-Based Trajectory Planning
• Abstract summary: A common strategy to mitigate this issue is to enhance the operator's input using optimal-control-based trajectory planning.<n>We adapt a recent formulation of differentiable collision-avoidance constraints, based on duality in convex optimization, to the teleoperation setting.<n>Results show that our approach achieves lower computation times while enabling more accurate obstacle modeling.
• Score: 1.4699455652461726
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In teleoperation, the human operator typically controls only the end-effector pose, which often leads to self-collisions of the manipulator and collisions with environmental obstacles, since joints and links are not controlled individually. A common strategy to mitigate this issue is to enhance the operator's input using optimal-control-based trajectory planning. As derivative-based solvers require differentiable constraints, existing approaches either approximate robots and obstacles with spheres, reducing geometric accuracy, or approximate derivatives, degrading convergence and increasing computation times. We address these limitations by adapting a recent formulation of differentiable collision-avoidance constraints, based on duality in convex optimization, to the teleoperation setting. The robot is approximated with capsules and the environment with polytopes. We compare the resulting trajectory planning method against state-of-the-art techniques in simulation with varying numbers of obstacles and evaluate it on a UR5e manipulator in a real-world teleoperation test. Results show that our approach achieves lower computation times while enabling more accurate obstacle modeling, leading to smoother and collision-free end-effector teleoperation.

Related papers

• Coordinated Motion Planning for Multi-Arm Systems via Iterative LQ Games [21.845592692945047]
  This paper presents an iterative Linear Quadratic (LQ) game framework for multi-manipulator motion planning.<n>Our framework produces smooth, safe, and efficient trajectories in high-dimensional settings, outperforming traditional methods.
  arXiv  Detail & Related papers  (2026-08-27T21:33:38Z)
• Predictive Relative-Velocity Steering for Safe Robotic Manipulator Teleoperation in Dynamic Environments [7.297209090323272]
  We propose a lightweight and modular framework for proactive collision avoidance.<n>The framework first predicts potential collisions based on time-to-collision with integrated overshoot protection.<n>The deflection changes only the direction of the relative velocity while preserving its magnitude.
  arXiv  Detail & Related papers  (2026-08-13T14:17:12Z)
• Biconvex Optimization for Smooth Minimum-Time Trajectories around Convex Obstacles [49.315843050082925]
  We present a bi approach for minimum-time motion planning convex obstacles that is guaranteed to converge.<n>We find that the proposed method produces high-quality trajectories with times to produce state-of-the-art decomposition of variables.
  arXiv  Detail & Related papers  (2026-08-03T19:48:24Z)
• Simulation-Informed Diffusion for Decentralized Multi-robot Motion Planning [56.240199425429445]
  Multi-robot motion planning requires each robot to generate collision-free trajectories from local observations.<n>Most existing planners generate trajectories from a static snapshot of the local observation.<n>This paper introduces Simulation-Informed Diffusion (SID), a decentralized framework built on constraint-aware diffusion models.
  arXiv  Detail & Related papers  (2026-05-26T21:17:53Z)
• MIRROR: Visual Motion Imitation via Real-time Retargeting and Teleoperation with Parallel Differential Inverse Kinematics [20.41490560492412]
  Real-time humanoid teleoperation requires responsive inverse kinematics (IK) that are both responsive and constraint-safe under redundancy and self-collision constraints.<n>We propose a GPU-parallelized, continuation-based differential IK that improves escape from such constraint-induced local minima while preserving real-time performance, promoting safety and stability.<n>The method is paired with a visual skeletal pose estimation pipeline that enables robust, real-time upper-body teleoperation on the THEMIS humanoid robot hardware in real-world tasks.
  arXiv  Detail & Related papers  (2026-03-25T06:49:58Z)
• Iterative Convex Optimization with Control Barrier Functions for Obstacle Avoidance among Polytopes [3.8436274588467696]
  Obstacle avoidance by polytopic robots is a challenging problem in optimization-based control and trajectory planning.<n>Existing methods rely on hyperiable distance approximations, such as ellipsoids, which distort geometric dynamics.<n>In this paper, we propose a novel iterative convexity- finite-horizon optimization framework for safety-critical navigation programs.
  arXiv  Detail & Related papers  (2026-03-06T05:10:44Z)
• ReMoSPLAT: Reactive Mobile Manipulation Control on a Gaussian Splat [3.983697124458495]
  Reactive control can gracefully coordinate the motion of the base and the arm of a mobile manipulator.<n>We present ReMoSPLAT, a reactive controller based on a quadratic program formulation for mobile manipulation.
  arXiv  Detail & Related papers  (2025-12-10T13:52:08Z)
• Differentiable Constrained Imitation Learning for Robot Motion Planning and Control [0.26999000177990923]
  We develop a framework for constraint robotic motion planning and control, as well as traffic agent simulation. We focus on mobile robot and automated driving applications. Simulated experiments of mobile robot navigation and automated driving provide evidence for the performance of the proposed method.
  arXiv  Detail & Related papers  (2022-10-21T08:19:45Z)
• Simultaneous Contact-Rich Grasping and Locomotion via Distributed Optimization Enabling Free-Climbing for Multi-Limbed Robots [60.06216976204385]
  We present an efficient motion planning framework for simultaneously solving locomotion, grasping, and contact problems. We demonstrate our proposed framework in the hardware experiments, showing that the multi-limbed robot is able to realize various motions including free-climbing at a slope angle 45deg with a much shorter planning time.
  arXiv  Detail & Related papers  (2022-07-04T13:52:10Z)
• Nonprehensile Riemannian Motion Predictive Control [57.295751294224765]
  We introduce a novel Real-to-Sim reward analysis technique to reliably imagine and predict the outcome of taking possible actions for a real robotic platform. We produce a closed-loop controller to reactively push objects in a continuous action space. We observe that RMPC is robust in cluttered as well as occluded environments and outperforms the baselines.
  arXiv  Detail & Related papers  (2021-11-15T18:50:04Z)
• Scalable Differentiable Physics for Learning and Control [99.4302215142673]
  Differentiable physics is a powerful approach to learning and control problems that involve physical objects and environments. We develop a scalable framework for differentiable physics that can support a large number of objects and their interactions.
  arXiv  Detail & Related papers  (2020-07-04T19:07:51Z)
• First Steps: Latent-Space Control with Semantic Constraints for Quadruped Locomotion [73.37945453998134]
  Traditional approaches to quadruped control employ simplified, hand-derived models. This significantly reduces the capability of the robot since its effective kinematic range is curtailed. In this work, these challenges are addressed by framing quadruped control as optimisation in a structured latent space. A deep generative model captures a statistical representation of feasible joint configurations, whilst complex dynamic and terminal constraints are expressed via high-level, semantic indicators. We validate the feasibility of locomotion trajectories optimised using our approach both in simulation and on a real-worldmal quadruped.
  arXiv  Detail & Related papers  (2020-07-03T07:04:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.