Safety-Critical Bilateral Teleoperation for Omnidirectional Aerial Manipulation Using Force-Sensorless Haptic Feedback

• URL: http://arxiv.org/abs/2608.21735v1
• Date: Sat, 22 Aug 2026 02:35:42 GMT
• Title: Safety-Critical Bilateral Teleoperation for Omnidirectional Aerial Manipulation Using Force-Sensorless Haptic Feedback
• Abstract summary: The paper presents a safety-critical bilateral teleoperation framework for omnidirectional aerial manipulators that integrates visual and force-sensorless haptic wrench feedback.<n>By actual experiments with a hexarotor-based omnidirectional aerial manipulator, we demonstrate that the proposed method avoids haptic feedback during free-flight, provides directionally consistent feedback under physical interaction, and can be operated for diverse manipulative tasks.
• Score: 25.02259961202887
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a safety-critical bilateral teleoperation framework for omnidirectional aerial manipulators that integrates visual and force-sensorless haptic wrench feedback. Unlike existing approaches that either rely on onboard force/torque sensors or use model-dependent wrench estimates, which may become unreliable under model uncertainties or induce unintended feedback during free-flight, our method implements a hierarchical safety filter based on control barrier functions to avoid such limitations. The safety filter, being the key contribution, explicitly accounts for tracking errors arising from physical interaction between the aerial manipulator and its surroundings while enforcing thrust limits, a factor overlooked despite its critical importance for flight safety. This safety filter adjusts the command from the operator to ensure safe and stable aerial manipulation and avoid motor saturation. The adjustment made by the filter is mapped to haptic feedback, which is intuitive to the operator and conveys information on physical interaction and impending motor saturation. By actual experiments with a hexarotor-based omnidirectional aerial manipulator, we demonstrate that the proposed method avoids haptic feedback during free-flight, provides directionally consistent feedback under physical interaction, and can be operated for diverse manipulative tasks. Moreover, an ablation study further shows that the saturation filter improves interaction stability by explicitly preventing motor saturation and informing the operator of corrective actions.

Related papers

• SonicNudge: Controlled Displacement of Hovering UAVs via Estimator-Controller Coupling [11.293063979196434]
  SonicNudge is an attack primitive that transforms low-level inertial errors into controlled displacement of hovering or slow-moving UAVs.<n>This behavior is especially relevant to UAV tasks that require hovering, station-keeping, slow approach, or precise final alignment.
  arXiv  Detail & Related papers  (2026-08-26T03:03:32Z)
• Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving [46.17295445504376]
  Adverse weather conditions can distort pixel correspondences and violate the assumptions embedded in the self-supervised loss function.<n>While radar is a widely adopted sensor in adverse weather conditions, the sparse distribution of radar points in the Point of View (POV) poses challenges for self-supervised fusion.<n>We propose a novel self-training pipeline using unpaired real all-weather data through multi-teacher distillation and robust radar fusion.
  arXiv  Detail & Related papers  (2026-07-23T17:11:33Z)
• Safety-Critical Adaptive Impedance Control via Nonsmooth Control Barrier Functions under State and Input Constraints [3.1685575193428845]
  We propose an online adaptive impedance control framework that enforces joint-state safety while achieving compliant interaction under uncertain dynamics.<n>The approach combines a quadratic-program-based safety filter with a novel composed position-velocity non-smooth control barrier function.<n>A disturbance-observer-enhanced safety mechanism improves robustness against modelling errors and external interaction forces.
  arXiv  Detail & Related papers  (2026-05-27T12:04:03Z)
• AWARE: Adaptive Whole-body Active Rotating Control for Enhanced LiDAR-Inertial Odometry under Human-in-the-Loop Interaction [15.502575136823237]
  Resource-constrained UAV platforms are often limited to narrow-field-of-view LiDAR sensors.<n>AWAKE is a bio-inspired whole-body active yawing framework that exploits the UAV's own rotational agility to extend the effective sensor horizon.<n>A Safe Flight Corridor mechanism ensures operational safety within this HITL paradigm by decoupling the operator's navigational intent from autonomous yaw optimization.
  arXiv  Detail & Related papers  (2026-04-12T12:07:58Z)
• A Closed-Form CLF-CBF Controller for Whole-Body Continuum Soft Robot Collision Avoidance [45.63674336069651]
  Soft continuum manipulators provide passive safety through mechanical compliance.<n>Existing approaches, such as sampling-based planning, are often computationally expensive and lack formal safety guarantees.<n>This paper presents a closed-form Control Lyapunov Function--Control Barrier Function (CLF--CBF) controller for real-time 3D obstacle avoidance.
  arXiv  Detail & Related papers  (2026-03-19T19:34:49Z)
• Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control [46.47619556874003]
  We propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning policy for legged locomotion.<n>The admittance controller maps external wrenches--such as those applied by a human during physical interaction--into desired end-effector velocities, allowing for compliant behavior.<n>We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
  arXiv  Detail & Related papers  (2026-03-02T22:31:12Z)
• A Precise Real-Time Force-Aware Grasping System for Robust Aerial Manipulation [5.804333840515478]
  Aerial manipulation requires force-aware capabilities to enable safe and effective grasping and physical interaction.<n>We propose a novel force-aware grasping framework incorporating six low-cost, sensitive skin-like tactile sensors.<n>The proposed framework enables precise force-aware grasping control, allowing safe manipulation of fragile objects and real-time weight measurement of grasped items.
  arXiv  Detail & Related papers  (2026-02-09T12:40:34Z)
• Aerial Manipulation with Contact-Aware Onboard Perception and Hybrid Control [11.342874824540493]
  Aerial manipulation (AM) promises to move Unmanned Aerial Vehicles (UAVs) beyond passive inspection to contact-rich tasks such as grasping, assembly, and in-situ maintenance.<n>We present a fully onboard perception-control pipeline for contact-rich AM that achieves accurate motion tracking and regulated contact wrenches without external motion capture (MoCap)<n> Experiments show that our approach closes the perception-to-wrench loop using only onboard sensing, yielding a velocity estimation improvement of 66.01% at contact, reliable target approach, and stable force holding-pointing toward deployable, in-the-wild aerial manipulation.
  arXiv  Detail & Related papers  (2026-02-09T04:10:39Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising [49.86409475232849]
  Trajectory prediction is fundamental in computer vision and autonomous driving. Existing approaches in this field often assume precise and complete observational data. We present a novel method for out-of-sight trajectory prediction that leverages a vision-positioning technique.
  arXiv  Detail & Related papers  (2024-04-02T18:30:29Z)
• SAFE-SIM: Safety-Critical Closed-Loop Traffic Simulation with Diffusion-Controllable Adversaries [94.84458417662407]
  We introduce SAFE-SIM, a controllable closed-loop safety-critical simulation framework. Our approach yields two distinct advantages: 1) generating realistic long-tail safety-critical scenarios that closely reflect real-world conditions, and 2) providing controllable adversarial behavior for more comprehensive and interactive evaluations. We validate our framework empirically using the nuScenes and nuPlan datasets across multiple planners, demonstrating improvements in both realism and controllability.
  arXiv  Detail & Related papers  (2023-12-31T04:14:43Z)
• Learning Control Barrier Functions from Expert Demonstrations [69.23675822701357]
  We propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs) We analyze an optimization-based approach to learning a CBF that enjoys provable safety guarantees under suitable Lipschitz assumptions on the underlying dynamical system. To the best of our knowledge, these are the first results that learn provably safe control barrier functions from data.
  arXiv  Detail & Related papers  (2020-04-07T12:29:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.