OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies

• URL: http://arxiv.org/abs/2607.03723v1
• Date: Sat, 04 Jul 2026 06:11:03 GMT
• Title: OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies
• Abstract summary: We introduce OmniTacTune, a policy-agnostic real-world RL pipeline.<n>It adapts tactile feedback to pretrained visual policies through residual correction.<n>It generalizes across diverse contact-rich tasks, visual base policies, and tactile representations.
• Score: 12.067164216746542
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visual policies learned from human videos, teleoperation, and robot demonstrations offer scalable motion priors, but often fail in contact-rich manipulation, where success significantly depends on local force and contact geometry. Tactile sensing provides these complementary signals, yet tactile data remain costly to collect and hard to generalize across sensors, robots, and tasks. We introduce OmniTacTune, a policy-agnostic real-world RL pipeline that adapts tactile feedback to pretrained visual policies through residual correction. OmniTacTune uses a two-stage design: it first bootstraps tactile-aware learning from autonomous base-policy rollouts, then learns a lightweight tactile residual policy through online interaction. Extensive experiments show that OmniTacTune generalizes across diverse contact-rich tasks, visual base policies, and tactile representations. Across four real-world contact-rich tasks, it improves visual base policies from 5-40% success to 85-100% within 40-80 minutes, demonstrating an efficient path for adapting tactile feedback to scalable visual robot policies. Project page: https://colinyu1.github.io/omnitactune-site/

Related papers

• ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation [30.004466515831634]
  ViTacWorld is an action-conditioned visuo-tactile world model for scalable contact-rich robot manipulation.<n>It exploits the fact that tactile signals are directly grounded in physical contact and can exhibit a smaller simulation-to-real gap than purely visual observations.<n>It is the first framework that uses a world model for robot visuo-tactile-action trajectory generation and policy evaluation.
  arXiv  Detail & Related papers  (2026-07-24T17:59:33Z)
• FTP-1: A Generalist Foundation Tactile Policy Across Tactile Sensors for Contact-Rich Manipulation [66.22092641373067]
  FTP-1 is the first generalist foundation tactile policy pretrained to acquire transferable tactile manipulation abilities.<n>It supports varied tactile inputs, including image-, array-, and state-based signals.<n>It learns tactile skills that transfer beyond the sensors seen during pretraining.
  arXiv  Detail & Related papers  (2026-06-11T09:30:09Z)
• TacCoRL: Integrating Tactile Feedback into VLA via Simulation [38.963250081631834]
  Vision-language-action (VLA) models provide strong visual, language, and action priors for robot manipulation.<n>We present TacCoRL, a scalable framework that injects Tactile feedback into VLA policies.<n>We use a real-aligned simulator as a closed-loop training environment for contact interaction.
  arXiv  Detail & Related papers  (2026-06-10T07:20:36Z)
• Learning Tactile-Aware Quadrupedal Loco-Manipulation Policies [33.25194785586049]
  We present a tactile-aware loco-manipulation policy learning pipeline with a hierarchical structure.<n>First, we leverage real-world human demonstrations to train a tactile-conditioned visuotactile high-level policy.<n>Second, we perform large-scale reinforcement learning in simulation to learn a tactile-aware whole-body control policy.
  arXiv  Detail & Related papers  (2026-04-29T21:46:58Z)
• OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulation [57.133721026727706]
  We present textbfOmniViTac, a large-scale visuo-tactile-action dataset comprising $21,000+$ trajectories across $86$ tasks and $100+$ objects.<n>We propose textbf OmniVTA, a world-model-based visuo-tactile manipulation framework that integrates four tightly coupled modules.
  arXiv  Detail & Related papers  (2026-03-19T17:52:42Z)
• Semantic-Contact Fields for Category-Level Generalizable Tactile Tool Manipulation [82.63833405368159]
  Generalizing tool manipulation requires both semantic planning and precise physical control.<n>We propose Semantic-Contact Fields (SCFields), a unified 3D representation fusing visual semantics with dense contact estimates.<n> Experiments on scraping, crayon drawing, and peeling demonstrate robust category-level generalization.
  arXiv  Detail & Related papers  (2026-02-14T16:05:08Z)
• TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
  TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
  arXiv  Detail & Related papers  (2026-01-28T04:22:47Z)
• Feel the Force: Contact-Driven Learning from Humans [52.36160086934298]
  Controlling fine-grained forces during manipulation remains a core challenge in robotics.<n>We present FeelTheForce, a robot learning system that models human tactile behavior to learn force-sensitive manipulation.<n>Our approach grounds robust low-level force control in scalable human supervision, achieving a 77% success rate across 5 force-sensitive manipulation tasks.
  arXiv  Detail & Related papers  (2025-06-02T17:57:52Z)
• PolyTouch: A Robust Multi-Modal Tactile Sensor for Contact-rich Manipulation Using Tactile-Diffusion Policies [4.6090500060386805]
  PolyTouch is a novel robot finger that integrates camera-based tactile sensing, acoustic sensing, and peripheral visual sensing into a single design.<n>Experiments demonstrate a 20-fold increase in lifespan over commercial tactile sensors, with a design that is both easy to manufacture and scalable.
  arXiv  Detail & Related papers  (2025-04-27T19:50:31Z)
• Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation [58.95799126311524]
  Humans can accomplish contact-rich tasks using vision and touch, with highly reactive capabilities such as fast response to external changes and adaptive control of contact forces.<n>Existing visual imitation learning approaches rely on action chunking to model complex behaviors.<n>We introduce TactAR, a low-cost teleoperation system that provides real-time tactile feedback through Augmented Reality.
  arXiv  Detail & Related papers  (2025-03-04T18:58:21Z)
• Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins [17.412763585521688]
  We present the Visuo-Skin (ViSk) framework, a simple approach that uses a transformer-based policy and treats skin sensor data as additional tokens alongside visual information. ViSk significantly outperforms both vision-only and optical tactile sensing based policies. Further analysis reveals that combining tactile and visual modalities enhances policy performance and spatial generalization, achieving an average improvement of 27.5% across tasks.
  arXiv  Detail & Related papers  (2024-10-22T17:59:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.