WT-UMI: Tactile-based Whole-Body Manipulation via Force-Supervised Contact-Aware Planning

• URL: http://arxiv.org/abs/2606.13232v1
• Date: Thu, 11 Jun 2026 11:45:58 GMT
• Title: WT-UMI: Tactile-based Whole-Body Manipulation via Force-Supervised Contact-Aware Planning
• Abstract summary: Whole-body humanoid manipulation of bulky, deformable, and shared-load objects requires distributed contact sensing and explicit force regulation.<n>This paper presents textbfWT-UMI, a wearable whole-body tactile interface worn by human operators or mounted on humanoids.
• Score: 7.150534189488604
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Whole-body humanoid manipulation of bulky, deformable, and shared-load objects requires distributed contact sensing and explicit force regulation, yet most imitation policies treat contact force only implicitly. On the other hand, different demonstration sources provide complementary modalities with inherent trade-offs: human demonstrations capture natural contact forces but not robot-executable actions, while teleoperation directly records robot actions but with less natural force regulation. This paper presents \textbf{WT-UMI}, a wearable whole-body tactile interface worn by human operators or mounted on humanoids, providing accurate observations of tactile images, contact forces, and end-effector poses across both human demonstration and humanoid teleoperation modes. We introduce a force-conditioned target-pose correction module that converts measured human poses into contact-aware robot targets by learning corrections from teleoperation data. To leverage the natural force interaction in human data, we propose a force-supervised planner that predicts end-effector pose chunks and contact-force trajectories. The predicted contact force serves as the reference for a tactile-based admittance controller. Across five contact-rich tasks spanning deformable objects, bulky rigid objects, and human--humanoid collaboration, WT-UMI improves success rate and reduces contact-position tracking error over four policy baselines. Our project page is available at https://wt-umi.github.io/WTUMI/.

Related papers

• FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation [11.102182448786307]
  Contact-rich loco-manipulation requires a bridge between semantic action generation and physical interaction control.<n>We propose FWBC-VLA, a force-aware framework that bridges task-level VLA action generation and low-level whole-body compensation control.<n>For loco-manipulation tasks, all parameters of the pretrained VLA backbone are fine-tuned on our WL&Arm dataset.
  arXiv  Detail & Related papers  (2026-09-03T14:10:47Z)
• ReForce: Learning Force-aware Retargeting for Dexterous Manipulation [9.525202879335618]
  ReForce is a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact.<n>It supports both online force-aware teleoperation and offline data translation.<n>It achieves lower force-tracking error and stronger multi-finger contact engagement on contact-rich tasks such as paper-cup grasping and tongs manipulation.
  arXiv  Detail & Related papers  (2026-08-16T06:13:14Z)
• Active Contact Sensing for Robust Robot-to-Human Object Handover [22.323829143922676]
  We propose an active sensing approach for robust object handovers.<n>A firm grasp produces forces in multiple directions, while an accidental touch does not.<n>Our method achieved a 97.5% success rate -- over 30% higher than two common baselines.
  arXiv  Detail & Related papers  (2026-05-06T07:59:02Z)
• Functional Force-Aware Retargeting from Virtual Human Demos to Soft Robot Policies [22.000828900701237]
  We introduce SoftAct, a framework for teaching soft robot hands to perform human-like manipulation skills by explicitly reasoning about contact forces.<n>Unlike conventional approaches that retarget human joint trajectories, SoftAct employs two-stage, force-aware algorithm.
  arXiv  Detail & Related papers  (2026-04-01T17:59:35Z)
• ZeroWBC: Learning Natural Visuomotor Humanoid Control Directly from Human Egocentric Video [52.78703020909145]
  We introduce ZeroWBC, a novel framework that learns a natural humanoid visuomotor control policy directly from human egocentric videos.<n>Our approach first fine-tunes a Vision-Language Model (VLM) to predict future whole-body human motions based on text instructions and egocentric visual context.<n>Experiments on the Unitree G1 humanoid robot demonstrate that our method outperforms baseline approaches in motion naturalness and versatility.
  arXiv  Detail & Related papers  (2026-03-10T04:19:43Z)
• CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation [54.7399209456857]
  We present CLOT, a real-time whole-body humanoid teleoperation system that achieves closed-loop global motion tracking.<n>CLOT synchronizes operator and robot poses in a closed loop, enabling drift-free human-to-humanoid mimicry over long timehorizons.<n>We propose a data-driven randomization strategy that decouples observation trajectories from reward evaluation, enabling smooth and stable global corrections.
  arXiv  Detail & Related papers  (2026-02-13T12:03:13Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer [34.13467792368733]
  We introduce OSMO, a wearable tactile glove designed for human-to-robot skill transfer.<n>We demonstrate that a robot policy trained exclusively on human demonstrations is capable of executing a challenging contact-rich manipulation task.
  arXiv  Detail & Related papers  (2025-12-09T18:56:30Z)
• GentleHumanoid: Learning Upper-body Compliance for Contact-rich Human and Object Interaction [14.278503723930998]
  GentleHumanoid is a framework that integrates impedance control into a whole-body motion tracking policy to achieve upper-body compliance.<n>We evaluate our approach in both simulation and on the Unitree G1 humanoid across tasks requiring different levels of compliance.
  arXiv  Detail & Related papers  (2025-11-06T18:59:33Z)
• ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning [59.64325421657381]
  Humanoid whole-body loco-manipulation promises transformative capabilities for daily service and warehouse tasks.<n>We introduce ResMimic, a two-stage residual learning framework for precise and expressive humanoid control from human motion data.<n>Results show substantial gains in task success, training efficiency, and robustness over strong baselines.
  arXiv  Detail & Related papers  (2025-10-06T17:47:02Z)
• Feel the Force: Contact-Driven Learning from Humans [52.36160086934298]
  Controlling fine-grained forces during manipulation remains a core challenge in robotics.<n>We present FeelTheForce, a robot learning system that models human tactile behavior to learn force-sensitive manipulation.<n>Our approach grounds robust low-level force control in scalable human supervision, achieving a 77% success rate across 5 force-sensitive manipulation tasks.
  arXiv  Detail & Related papers  (2025-06-02T17:57:52Z)
• FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learning [70.65987250853311]
  force feedback is readily available in most robot arms, but not commonly used in teleoperation and policy learning.<n>We present a low-cost, intuitive, bilateral teleoperation setup that relays external forces of the follower arm back to the teacher arm.<n>We then introduce FACTR, a policy learning method that employs a curriculum which corrupts the visual input with decreasing intensity throughout training.
  arXiv  Detail & Related papers  (2025-02-24T18:59:07Z)
• HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpit [52.12750762494588]
  This paper introduces HOMIE, a semi-autonomous teleoperation system.<n>It combines a reinforcement learning policy for body control mapped to a pedal, an isomorphic exoskeleton arm for arm control, and motion-sensing gloves for hand control.<n>The system is fully open-source, demos and code can be found in our https://homietele.org/.
  arXiv  Detail & Related papers  (2025-02-18T16:33:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.