Touch2Trace: Tactile-Driven Imitation Learning for Dexterous Cable Tracing
- URL: http://arxiv.org/abs/2609.15921v1
- Date: Mon, 14 Sep 2026 17:32:25 GMT
- Title: Touch2Trace: Tactile-Driven Imitation Learning for Dexterous Cable Tracing
- Abstract summary: We introduce Touch2Trace, a tactile-driven imitation-learning system for dexterous cable tracing.<n>We provide, to our knowledge, the first systematic real-world characterization of how encoder pretraining, control rate, temporal context, and spatial resolution each shape policy performance.<n>Results quantify the influence of key parameters in tactile-driven systems for reliable dexterous deformable object manipulation.
- Score: 14.47442816420603
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Dexterous manipulation of deformable objects demands continuous fingertip-level regulation of pressure, friction, and incipient slip. We study one of the most challenging cases: dexterous cable tracing, feeding a cable through the hand with repeated pinch-and-curl motions of the thumb and index finger. We introduce Touch2Trace, a tactile-driven imitation-learning system for this task, and provide, to our knowledge, the first systematic real-world characterization of how encoder pretraining, control rate, temporal context, and spatial resolution each shape policy performance. The winning learning recipe combines a tactile encoder pretrained for a custom 32 x 32 piezoresistive sensor (TacV5) via self-supervised learning with a lightweight transformer policy trained on teleoperated demonstrations via behavior cloning, deployed at 60 Hz on a Tesollo DG-5F hand. Tactile feedback without vision or explicit cable-state estimation significantly improves tracing performance versus a proprioception-only baseline: from 0.2 cm to 20.1 cm mean distance and 0% to 93% success rate, with zero-shot transfer to unseen cables and routing conditions. The results quantify the influence of key parameters in tactile-driven systems for reliable dexterous deformable object manipulation.
Related papers
- Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
arXiv Detail & Related papers (2026-08-25T07:25:27Z) - TactX: Learning Shared Tactile Representations Across Diverse Sensors [18.127088232068456]
We propose TactX, a framework for learning a transferable tactile representation across sensors.<n>TactX maps heterogeneous tactile observations into a shared latent space through modality-specific encoders trained on paired contact data.<n>Experiments show that TactX aligns tactile representations across sensors while preserving object-level contact information.
arXiv Detail & Related papers (2026-06-30T07:09:40Z) - T-Rex: Tactile-Reactive Dexterous Manipulation [139.71263755530654]
We introduce a variable-rate Mixture-of-Transformers (MoT) architecture equipped with a novel temporal tactile VQ-VAE encoder.<n>We demonstrate the effectiveness of tactile-reactive policies on 12 manipulation tasks requiring delicate force control and deformable object manipulation.
arXiv Detail & Related papers (2026-06-15T17:59:55Z) - FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation [66.22092641373067]
FTP-1 is the first generalist foundation tactile policy pretrained to acquire transferable tactile manipulation abilities.<n>It supports varied tactile inputs, including image-, array-, and state-based signals.<n>It learns tactile skills that transfer beyond the sensors seen during pretraining.
arXiv Detail & Related papers (2026-06-11T09:30:09Z) - Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learning [6.509572742369941]
We propose a framework for tactile-only blind grasping that is deployable on a physical multi-fingered robotic hand.<n>We introduce a Real2Sim tactile calibration pipeline that constructs a contact-calibrated digital-twin simulator capable of reproducing real tactile signals.<n>Second, we improve the expressiveness of sparse tactile observations using a layout-aware tactile encoder, which incorporates sensor-geometry priors through self-supervised pretraining.<n>Third, to improve generalization to unseen objects, we train object-specific reinforcement-learning experts in the calibrated simulator and aggregate their successful grasp trajectories into a tactile-conditioned Diffusion Policy.
arXiv Detail & Related papers (2026-06-10T07:46:38Z) - UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking [47.900334665380115]
We propose UniVTAC, a simulation-based visuo-tactile data platform.<n>We introduce the UniVTAC encoder, a visuo-tactile encoder trained on large-scale simulation-synthesized data.<n>We present the UniVTAC Benchmark, which consists of eight representative visuo-tactile manipulation tasks.
arXiv Detail & Related papers (2026-02-10T18:57:00Z) - UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
arXiv Detail & Related papers (2026-02-01T11:03:01Z) - TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
arXiv Detail & Related papers (2026-01-28T04:22:47Z) - TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation [11.834021644402148]
Robotic manipulation tasks such as inserting a key into a lock or plugging a USB device into a port can fail when visual perception is insufficient to detect misalignment.<n>Here, we introduce TranTac, a data-efficient and low-cost tactile sensing and control framework.<n>Our customized sensing system can detect dynamic translational and torsional deformations at the micrometer scale.
arXiv Detail & Related papers (2025-09-20T06:25:59Z) - ControlTac: Force- and Position-Controlled Tactile Data Augmentation with a Single Reference Image [24.223013595239916]
ControlTac is a controllable framework that generates realistic tactile images conditioned on a single reference tactile image, contact force, and contact position.<n>We demonstrate that ControlTac can effectively augment tactile datasets and lead to consistent gains.
arXiv Detail & Related papers (2025-05-26T20:01:17Z) - Learning to Detect Slip with Barometric Tactile Sensors and a Temporal
Convolutional Neural Network [7.346580429118843]
We present a learning-based method to detect slip using barometric tactile sensors.
We train a temporal convolution neural network to detect slip, achieving high detection accuracies.
We argue that barometric tactile sensing technology, combined with data-driven learning, is suitable for many manipulation tasks such as slip compensation.
arXiv Detail & Related papers (2022-02-19T08:21:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.