TactAlign: Human-to-Robot Policy Transfer via Tactile Alignment

• URL: http://arxiv.org/abs/2602.13579v1
• Date: Sat, 14 Feb 2026 03:31:32 GMT
• Title: TactAlign: Human-to-Robot Policy Transfer via Tactile Alignment
• Abstract summary: Existing human-to-robot (H2R) approaches that incorporate touch assume identical tactile sensors, require paired data, and involve little to no embodiment gap between human demonstrator and the robots.<n>We propose TactAlign, a cross-embodiment tactile alignment method that transfers human-collected tactile signals to a robot with different embodiment.
• Score: 32.07730277045068
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Human demonstrations collected by wearable devices (e.g., tactile gloves) provide fast and dexterous supervision for policy learning, and are guided by rich, natural tactile feedback. However, a key challenge is how to transfer human-collected tactile signals to robots despite the differences in sensing modalities and embodiment. Existing human-to-robot (H2R) approaches that incorporate touch often assume identical tactile sensors, require paired data, and involve little to no embodiment gap between human demonstrator and the robots, limiting scalability and generality. We propose TactAlign, a cross-embodiment tactile alignment method that transfers human-collected tactile signals to a robot with different embodiment. TactAlign transforms human and robot tactile observations into a shared latent representation using a rectified flow, without paired datasets, manual labels, or privileged information. Our method enables low-cost latent transport guided by hand-object interaction-derived pseudo-pairs. We demonstrate that TactAlign improves H2R policy transfer across multiple contact-rich tasks (pivoting, insertion, lid closing), generalizes to unseen objects and tasks with human data (less than 5 minutes), and enables zero-shot H2R transfer on a highly dexterous tasks (light bulb screwing).

Related papers

• Temporal Tactile Encoding and Compliance for Intent-Aware Robot-to-Human Bimanual Handover [4.0318506932466445]
  Reliable robot-to-human handover requires the robot to infer when the person is ready to receive the object, and release it safely, comfortably, and at the right time.<n>This is challenging because visual observations alone may not disambiguate clear taking intent from accidental contact, weak grasping, wrong-direction forces, or transient interactions.<n>Our approach couples a VLA model with a compliance controller that reduces interaction forces during object transfer.<n>We evaluate the complete system in a human-subject study against two baselines: one without tactile feedback and one using tactile feedback without compliance control.
  arXiv  Detail & Related papers  (2026-09-04T15:34:47Z)
• Towards Human-level Dexterous Teleoperation [62.77371751776912]
  Human-level dexterous teleoperation requires precise control of object motion via dynamic hand-object contact.<n>We introduce TeleDexter, a hand-object co-tracking controller that maps operator intent into learned, low-level contact execution.<n>We evaluate TeleDexter on seven challenging dexterous teleoperation tasks spanning object reorientation and long-horizon tool use across two dexterous hands.
  arXiv  Detail & Related papers  (2026-07-13T12:36:47Z)
• What Matters When Cotraining Robot Manipulation Policies on Everyday Human Videos? [51.606902362959495]
  We use a new dataset of 532 human videos with 28 hours of high-quality triangulated hand labels and natural motions.<n>We find that hand pose quality affects transfer, but even with accurate hands, the inherent motion gap hinders transfer unless the vision and policy networks specialize to each embodiment.
  arXiv  Detail & Related papers  (2026-06-04T18:24:23Z)
• Active Contact Sensing for Robust Robot-to-Human Object Handover [22.323829143922676]
  We propose an active sensing approach for robust object handovers.<n>A firm grasp produces forces in multiple directions, while an accidental touch does not.<n>Our method achieved a 97.5% success rate -- over 30% higher than two common baselines.
  arXiv  Detail & Related papers  (2026-05-06T07:59:02Z)
• UniDex: A Robot Foundation Suite for Universal Dexterous Hand Control from Egocentric Human Videos [65.2981273885678]
  Dexterous manipulation remains challenging due to the cost of collecting real-robot teleoperation data.<n>We present UniDex, a robot foundation suite that couples a large-scale robot-centric dataset with a unified vision-language-action (VLA) policy.<n>UniDex-Dataset, UniDex-VLA, and UniDex-Cap provide a scalable foundation suite for universal dexterous manipulation.
  arXiv  Detail & Related papers  (2026-03-23T17:49:12Z)
• EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration [67.13034606664333]
  EgoHumanoid is the first framework to co-train a vision-language-action policy using egocentric human demonstrations.<n>A portable system for scalable human data collection is developed.
  arXiv  Detail & Related papers  (2026-02-10T18:59:03Z)
• DexImit: Learning Bimanual Dexterous Manipulation from Monocular Human Videos [56.64773686434068]
  We propose DexImit, an automated framework that converts human manipulation videos into physically plausible robot data.<n>DexImit can generate large-scale robot data based on human videos, either from the Internet or video generation models.<n>It is capable of handling diverse manipulation tasks, including tool use, long-horizon tasks, and fine-grained manipulations.
  arXiv  Detail & Related papers  (2026-02-10T18:59:02Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
  TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
  arXiv  Detail & Related papers  (2026-01-28T04:22:47Z)
• UniTacHand: Unified Spatio-Tactile Representation for Human to Robotic Hand Skill Transfer [24.322055599503372]
  We propose to collect low-cost human manipulation data using haptic gloves for tactile-based robotic policy learning.<n>The misalignment between human and robotic tactile data makes it challenging to transfer policies learned from human data to robots.<n>We propose UniTacHand, a unified representation to align robotic tactile information captured by dexterous hands with human hand touch obtained from gloves.
  arXiv  Detail & Related papers  (2025-12-24T15:18:54Z)
• OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer [34.13467792368733]
  We introduce OSMO, a wearable tactile glove designed for human-to-robot skill transfer.<n>We demonstrate that a robot policy trained exclusively on human demonstrations is capable of executing a challenging contact-rich manipulation task.
  arXiv  Detail & Related papers  (2025-12-09T18:56:30Z)
• Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation [2.0318411357438086]
  We investigate how tactile sensing can help bridge differences between robotic embodiments in the context of collaborative manipulation.<n>We present an approach that uses tactile sensors and behavior cloning to transfer policies from robots with these capabilities to those without.<n>We demonstrate this positive transfer on four different tactile-enabled embodiments using the same policy trained on force-controlled robot data.
  arXiv  Detail & Related papers  (2024-09-23T10:45:41Z)
• Learning Visuotactile Skills with Two Multifingered Hands [80.99370364907278]
  We explore learning from human demonstrations using a bimanual system with multifingered hands and visuotactile data. Our results mark a promising step forward in bimanual multifingered manipulation from visuotactile data.
  arXiv  Detail & Related papers  (2024-04-25T17:59:41Z)
• MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation [8.738889129462013]
  "MimicTouch" is a novel framework for learning policies directly from demonstrations provided by human users with their hands.<n>The key innovations are i) a human tactile data collection system which collects multi-modal tactile dataset for learning human's tactile-guided control strategy, and ii) an imitation learning-based framework for learning human's tactile-guided control strategy through such data.
  arXiv  Detail & Related papers  (2023-10-25T18:34:06Z)
• Human Grasp Classification for Reactive Human-to-Robot Handovers [50.91803283297065]
  We propose an approach for human-to-robot handovers in which the robot meets the human halfway. We collect a human grasp dataset which covers typical ways of holding objects with various hand shapes and poses. We present a planning and execution approach that takes the object from the human hand according to the detected grasp and hand position.
  arXiv  Detail & Related papers  (2020-03-12T19:58:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.