TacO: Benchmarking Tactile Sensors for Object Manipulation

• URL: http://arxiv.org/abs/2605.21976v1
• Date: Thu, 21 May 2026 04:11:03 GMT
• Title: TacO: Benchmarking Tactile Sensors for Object Manipulation
• Abstract summary: We provide a systematic, task-driven evaluation of tactile sensors for robot manipulation.<n>We propose a framework for selecting and evaluating sensors based on manipulation policy performance.<n>All of the tactile sensors, code, data, and hardware setup will be publicly available on the project website.
• Score: 19.422699530305966
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Vision-based learning from demonstrations has achieved remarkable success in enabling robots to perform manipulation tasks and high-level semantic reasoning, yet it remains insufficient for complex, contact-rich manipulation. While there is broad agreement that tactile sensing improves manipulation, there is no empirical guidance on which tactile sensors are best suited for which manipulation tasks. In this paper, we provide a systematic, task-driven evaluation of tactile sensors for robot manipulation and propose a framework for selecting and evaluating sensors based on manipulation policy performance. Separate manipulation policies are trained for tactile sensors of four distinct modalities: visual, acoustic, magnetic, and resistive, across three tasks: pick-and-place with unknown mass, object reorientation, and plug insertion. For each task, an analysis of how sensor properties such as spatial resolution, shear sensing, and tactile representation, and the inherent material friction affect task performances is done. Rather than tactile sensing being universally beneficial in the same way, our results show that the usefulness of tactile information depends strongly on sensor modality, material properties, and the specific manipulation tasks. All of the tactile sensors, code, data, and hardware setup will be publicly available on the project website.

Related papers

• TactX: Learning Shared Tactile Representations Across Diverse Sensors [18.127088232068456]
  We propose TactX, a framework for learning a transferable tactile representation across sensors.<n>TactX maps heterogeneous tactile observations into a shared latent space through modality-specific encoders trained on paired contact data.<n>Experiments show that TactX aligns tactile representations across sensors while preserving object-level contact information.
  arXiv  Detail & Related papers  (2026-06-30T07:09:40Z)
• TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation [50.608989079323784]
  We propose TouchThinker, a tactile-language framework that scales tactile commonsense reasoning to the open world from both data and representation perspectives.<n>First, we construct TouchThinker-1M, a million-scale, multi-source tactile reasoning dataset covering textbf415 objects, textbf8 scenarios, and textbf7 sensor types.<n>Then, we propose action-aware modeling mechanism to improve tactile representation efficiency and enable efficient reasoning.
  arXiv  Detail & Related papers  (2026-06-10T03:58:32Z)
• AetheRock: An Arm-Worn Robot Teaching System for Force-Guided Vision-Tactile Learning [56.20593626288444]
  AetheRock is an arm-worn device featuring a modular and easily manufactured visuo-tactile sensor, GelSlim-MiniFab, at the fingertip.<n>We propose ForceVT, a representation learning framework that uses force and vision to guide fidelity-agnostic tactile learning.
  arXiv  Detail & Related papers  (2026-06-08T17:38:57Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• The Role of Touch: Towards Optimal Tactile Sensing Distribution in Anthropomorphic Hands for Dexterous In-Hand Manipulation [4.855486859170293]
  This work investigates the impact of tactile feedback from various regions of the fingers and palm in performing in-hand object reorientation tasks.<n>We identify which tactile sensing configurations contribute to improving the efficiency and accuracy of manipulation.
  arXiv  Detail & Related papers  (2025-09-18T14:13:26Z)
• A model-free approach to fingertip slip and disturbance detection for grasp stability inference [0.0]
  We propose a method for assessing grasp stability using tactile sensing. We use highly sensitive Uskin tactile sensors mounted on an Allegro hand to test and validate our method.
  arXiv  Detail & Related papers  (2023-11-22T09:04:26Z)
• Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
  Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. vision-based tactile sensors are being widely used for various robotic perception and control tasks. We present a method for interactive perception using vision-based tactile sensors for a part mating task.
  arXiv  Detail & Related papers  (2023-03-10T16:27:37Z)
• TANDEM: Learning Joint Exploration and Decision Making with Tactile Sensors [15.418884994244996]
  We focus on the process of guiding tactile exploration, and its interplay with task-related decision making. We propose TANDEM, an architecture to learn efficient exploration strategies in conjunction with decision making. We demonstrate this method on a tactile object recognition task, where a robot equipped with a touch sensor must explore and identify an object from a known set based on tactile feedback alone.
  arXiv  Detail & Related papers  (2022-03-01T23:55:09Z)
• Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network [7.346580429118843]
  We present a learning-based method to detect slip using barometric tactile sensors. We train a temporal convolution neural network to detect slip, achieving high detection accuracies. We argue that barometric tactile sensing technology, combined with data-driven learning, is suitable for many manipulation tasks such as slip compensation.
  arXiv  Detail & Related papers  (2022-02-19T08:21:56Z)
• PyTouch: A Machine Learning Library for Touch Processing [68.32055581488557]
  We present PyTouch, the first machine learning library dedicated to the processing of touch sensing signals. PyTouch is designed to be modular, easy-to-use and provides state-of-the-art touch processing capabilities as a service. We evaluate PyTouch on real-world data from several tactile sensors on touch processing tasks such as touch detection, slip and object pose estimations.
  arXiv  Detail & Related papers  (2021-05-26T18:55:18Z)
• Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors [7.35805050004643]
  We present a learning-based method to detect slip using barometric tactile sensors. We are able to achieve slip detection accuracies of greater than 91%. We show that barometric tactile sensing technology, combined with data-driven learning, is potentially suitable for many complex manipulation tasks.
  arXiv  Detail & Related papers  (2021-03-24T19:29:03Z)
• OmniTact: A Multi-Directional High Resolution Touch Sensor [109.28703530853542]
  Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. We introduce OmniTact, a multi-directional high-resolution tactile sensor. We evaluate the capabilities of OmniTact on a challenging robotic control task.
  arXiv  Detail & Related papers  (2020-03-16T01:31:29Z)
• The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? [57.366931129764815]
  We collect more than 9,000 grasping trials using a two-finger gripper equipped with GelSight high-resolution tactile sensors on each finger.<n>Our experimental results indicate that incorporating tactile readings substantially improve grasping performance.
  arXiv  Detail & Related papers  (2017-10-16T05:32:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.