ReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction

• URL: http://arxiv.org/abs/2608.01824v1
• Date: Mon, 03 Aug 2026 07:31:10 GMT
• Title: ReTouch: Empowering Contact-Rich Dexterous Manipulation with Online-Refined Tactile Prediction
• Abstract summary: We introduce ReTouch, a vision-language--action model (VLA) that supports contact-rich dexterous manipulation.<n>ReTouch builds on two main innovations for tactile representation and closed-loop action generation.
• Score: 42.34171808182058
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fusing tactile signals has proven effective for contact-rich manipulation, enabling robots to perceive contact states and adapt to rapidly changing physical interactions. Yet effectively integrating tactile feedback into dexterous manipulation remains underexplored. In this work, we introduce ReTouch, a vision-language-action model (VLA) that supports contact-rich dexterous manipulation through tactile predictions continually refined online using execution-time feedback. ReTouch builds on two main innovations for tactile representation and closed-loop action generation. First, its Tactile-Patch Encoder represents tactile observations as structured tactile patch features that preserve finger identity and local contact structure, providing contact cues for fine-grained dexterous control. Second, its high-frequency action module jointly predicts future tactile states and action chunks and refines both using incoming tactile feedback during execution. This closed-loop refinement keeps tactile predictions aligned with evolving physical interactions, enabling responsive action correction and improving robustness to contact changes and execution errors. We further introduce XHT-Dataset, comprising 900 real-world demonstrations across seven contact-rich tasks collected on an XHand--UR7e platform, and evaluate ReTouch through closed-loop real-robot experiments. ReTouch surpasses the strongest baseline by 18.4 and 23.8 percentage points in average success rate under standard and challenging conditions, respectively, demonstrating its effectiveness and robustness.

Related papers

• TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation [14.063238637690597]
  Dexterous manipulation in everyday environments requires both anticipation and reaction.<n>We introduce TouchWorld, a predictive-and-reactive tactile foundation model for dexterous manipulation.
  arXiv  Detail & Related papers  (2026-07-08T11:28:13Z)
• UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models [32.87879913150572]
  We propose a unified tactile learning framework for contact-rich manipulation.<n>We show that our method improves success rate, manipulation accuracy, and contact robustness over existing methods.
  arXiv  Detail & Related papers  (2026-06-30T14:24:00Z)
• Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention [53.84395207661823]
  We propose Tactile-WAM, a touch-aware WAM with a Tactile Asymmetric Attention Mechanism (TAAM)<n>On ManiFeel, Tactile-WAM improves the mean success rate by 38.9% overall and by 86% on contact-rich tasks.
  arXiv  Detail & Related papers  (2026-06-25T06:54:56Z)
• TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation [46.82050380051203]
  Contact-rich manipulation requires robots to continuously regulate and regulate physical dynamic contact transitions or complex surface geometries.<n>Recent imitation learning methods improve contact-aware control by incorporating tactile or force feedback, but they rarely model the asymmetric roles of global force and local tactile sensing.<n>We propose TacForeSight, a lightweight force foresight framework for real-time manipulation.
  arXiv  Detail & Related papers  (2026-06-09T17:59:03Z)
• Feel Robot Feels: Tactile Feedback Array Glove for Dexterous Manipulation [29.061513339025026]
  We present TAG, a low-cost glove system that integrates precise hand motion capture with high-resolution tactile feedback.<n>For motion capture, TAG employs a non-contact magnetic sensing design that provides drift-free, electromagnetically robust 21-DoF joint tracking.<n>We show that TAG enables reliable real-time perception of contact geometry and dynamic force, improves success rates in contact-rich teleoperation tasks, and increases the reliability of demonstration data collection for learning-based manipulation.
  arXiv  Detail & Related papers  (2026-03-30T15:04:13Z)
• OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation [57.133721026727706]
  We present textbfOmniViTac, a large-scale visuo-tactile-action dataset comprising $21,000+$ trajectories across $86$ tasks and $100+$ objects.<n>We propose textbf OmniVTA, a world-model-based visuo-tactile manipulation framework that integrates four tightly coupled modules.
  arXiv  Detail & Related papers  (2026-03-19T17:52:42Z)
• Contact-Grounded Policy: Dexterous Visuotactile Policy with Generative Contact Grounding [5.936373185672394]
  Contact-Grounded Policy (CGP) is a visuotactile policy that grounds multi-point contacts by predicting coupled trajectories of actual robot state and tactile feedback.<n>CGP consists of two components: (i) a conditional diffusion model that forecasts future robot state and tactile feedback in a compressed latent space, and (ii) a learned contact-consistency mapping.<n>We evaluate CGP using a physical four-finger Allegro V5 hand with Digit360 fingertip tactile sensors, and a simulated five-finger Tesollo DG-5F hand with dense whole-hand tactile arrays.
  arXiv  Detail & Related papers  (2026-03-05T21:22:49Z)
• TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
  TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
  arXiv  Detail & Related papers  (2026-01-28T04:22:47Z)
• OPENTOUCH: Bringing Full-Hand Touch to Real-World Interaction [93.88239833545623]
  We present OpenTouch, the first in-the-wild egocentric full-hand tactile dataset.<n>We show that tactile signals provide a compact yet powerful cue for grasp understanding.<n>We aim to advance multimodal egocentric perception, embodied learning, and contact-rich robotic manipulation.
  arXiv  Detail & Related papers  (2025-12-18T18:18:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.