Collision-Aware Humanoid Whole-Body Control under Imperfect Tracking Targets

• URL: http://arxiv.org/abs/2609.16405v1
• Date: Mon, 14 Sep 2026 22:22:02 GMT
• Title: Collision-Aware Humanoid Whole-Body Control under Imperfect Tracking Targets
• Abstract summary: Whole-body controllers (WBCs) execute commands that track targets while maintaining balance and stability.<n>Most WBCs are blind to scene geometry, which can lead to collisions due to perception, planning, or teleoperation errors.<n>We propose RECAL, a layer that wraps a blind WBC to trade off target tracking against collision avoidance using external scene geometry.
• Score: 11.010074477825272
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Humanoid robots often execute motion commands through whole-body controllers (WBCs) that track targets while maintaining balance and stability. However, most WBCs are blind to scene geometry, which can lead to collisions from imperfect target motions that are geometrically unsafe due to perception, planning, or teleoperation errors. We propose RECAL, a Robot--Environment Cross-Attention Layer that wraps a blind WBC to trade off target tracking against collision avoidance using external scene geometry. RECAL supports collision-aware tracking of floating-base and end-effector commands, including collision avoidance for held objects. It represents the robot, held objects, and environment as point clouds, using cross-attention between robot/object points and the environment to produce geometry-aware control features. In simulation, RECAL improves collision avoidance while preserving target-tracking performance across frozen-arm and adaptive-arm locomotion, object-carrying, and standing-manipulation scenarios relative to alternative geometry-aware WBC architectures. We further demonstrate the controller on a real Digit V3 humanoid robot.

Related papers

• GigaBrain-WBC-0.5: A Behavior World Model for Robust Whole-Body Control with Environment Interaction [68.67772166423812]
  We present GigaBrain-WBC-0.5, the first Behavior World Model (BWM) for humanoid whole-body control.<n>Rather than a purely reactive tracker, we train a causal Transformer to jointly predict its next action, next state, and the distribution over its next latent behavior command.<n>An automatic terrain-annotation pipeline recovers full 3D contact geometry from retargeted motion, enabling terrain annotation at the scale of existing motion datasets.
  arXiv  Detail & Related papers  (2026-08-18T18:21:36Z)
• DemoBridge: A Simulation-in-the-Loop Toolkit for Single-View Human Demonstration Retargeting [49.70827726228219]
  We present DemoBridge, a toolkit that turns a single-view RGB stereo recording of a human hand demonstration into an executable, physics-validated robot-arm trajectory.<n>At the core of DemoBridge is a single collision-aware planner.<n>A physics simulator runs in the loop. It validates each phase as it is produced and backtracks on failure, so a demonstration that cannot be reproduced as given is re-planned rather than discarded.
  arXiv  Detail & Related papers  (2026-07-10T15:31:04Z)
• SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control [14.952269223197751]
  This paper presents SplatCtrl, a unified framework for real-time scene reconstruction and reactive robot motion generation.<n>Building on 3D Gaussian Splatting (3D-GS), we introduce a hybrid voxel-based filtering and dynamic Gaussian relocation strategy.<n>For safe and reactive control, we propose a method for deriving continuous signed distance functions from isotropic Gaussians.
  arXiv  Detail & Related papers  (2026-07-09T21:18:39Z)
• Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration [19.192199380267393]
  We introduce TouchSafeBench, a benchmark for evaluating collision grounding in vision-language models (VLMs)<n>TouchSafeBench contains 2,940 simulated indoor co-presence episodes across social navigation and social rearrangement.<n>We study two deployment-facing tasks: classifying the current safety state and warning about imminent collision before contact.
  arXiv  Detail & Related papers  (2026-05-29T12:04:38Z)
• Simulation-Informed Diffusion for Decentralized Multi-robot Motion Planning [56.240199425429445]
  Multi-robot motion planning requires each robot to generate collision-free trajectories from local observations.<n>Most existing planners generate trajectories from a static snapshot of the local observation.<n>This paper introduces Simulation-Informed Diffusion (SID), a decentralized framework built on constraint-aware diffusion models.
  arXiv  Detail & Related papers  (2026-05-26T21:17:53Z)
• Sliding Mode Control for Safe Trajectory Tracking with Moving Obstacles Avoidance: Experimental Validation on Planar Robots [1.7044368816068716]
  This paper presents a unified control framework for robust trajectory tracking and moving obstacle avoidance.<n>The proposed architecture guarantees tracking in the presence of external disturbances while strictly enforcing collision avoidance constraints.<n>The efficacy and versatility of the approach are validated through numerical simulations and extensive real-world experiments.
  arXiv  Detail & Related papers  (2026-04-27T14:20:10Z)
• Safe Human-to-Humanoid Motion Imitation Using Control Barrier Functions [3.6775347543802686]
  This paper presents a vision-based framework that enables a humanoid robot to imitate human movements while avoiding collisions.<n>Safety is enforced through commands to prevent both self-collisions and human-robot collisions.<n> Simulation results validate the effectiveness of the proposed framework for real-time collision-aware motion imitation.
  arXiv  Detail & Related papers  (2026-04-13T13:28:15Z)
• RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control [71.51781695764872]
  We present a system for collision-free control of a robot manipulator that uses only RGB views of the world. Perceptual input of a tabletop scene is provided by multiple images of an RGB camera that is either handheld or mounted on the robot end effector. A NeRF-like process is used to reconstruct the 3D geometry of the scene, from which the Euclidean full signed distance function (ESDF) is computed. A model predictive control algorithm is then used to control the manipulator to reach a desired pose while avoiding obstacles in the ESDF.
  arXiv  Detail & Related papers  (2022-10-21T01:45:08Z)
• COPILOT: Human-Environment Collision Prediction and Localization from Egocentric Videos [62.34712951567793]
  The ability to forecast human-environment collisions from egocentric observations is vital to enable collision avoidance in applications such as VR, AR, and wearable assistive robotics. We introduce the challenging problem of predicting collisions in diverse environments from multi-view egocentric videos captured from body-mounted cameras. We propose a transformer-based model called COPILOT to perform collision prediction and localization simultaneously.
  arXiv  Detail & Related papers  (2022-10-04T17:49:23Z)
• Nonprehensile Riemannian Motion Predictive Control [57.295751294224765]
  We introduce a novel Real-to-Sim reward analysis technique to reliably imagine and predict the outcome of taking possible actions for a real robotic platform. We produce a closed-loop controller to reactively push objects in a continuous action space. We observe that RMPC is robust in cluttered as well as occluded environments and outperforms the baselines.
  arXiv  Detail & Related papers  (2021-11-15T18:50:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.