MagicSkin: Balancing Marker and Markerless Modes in Vision-Based Tactile Sensors with a Translucent Skin

• URL: http://arxiv.org/abs/2512.06829v1
• Date: Sun, 07 Dec 2025 12:59:15 GMT
• Title: MagicSkin: Balancing Marker and Markerless Modes in Vision-Based Tactile Sensors with a Translucent Skin
• Abstract summary: MagicSkin is a novel tactile skin with translucent, tinted markers balancing the modes of marker and markerless for Vision-based tactile sensors.<n>It enables simultaneous tangential displacement tracking, force prediction, and surface preservation detail.<n>The translucent markers impressively enhance rather than degrade sensing performance compared with traditional markerless and inked marker design.
• Score: 52.946698368609844
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Vision-based tactile sensors (VBTS) face a fundamental trade-off in marker and markerless design on the tactile skin: opaque ink markers enable measurement of force and tangential displacement but completely occlude geometric features necessary for object and texture classification, while markerless skin preserves surface details but struggles in measuring tangential displacements effectively. Current practice to solve the above problem via UV lighting or virtual transfer using learning-based models introduces hardware complexity or computing burdens. This paper introduces MagicSkin, a novel tactile skin with translucent, tinted markers balancing the modes of marker and markerless for VBTS. It enables simultaneous tangential displacement tracking, force prediction, and surface detail preservation. This skin is easy to plug into GelSight-family sensors without requiring additional hardware or software tools. We comprehensively evaluate MagicSkin in downstream tasks. The translucent markers impressively enhance rather than degrade sensing performance compared with traditional markerless and inked marker design: it achieves best performance in object classification (99.17\%), texture classification (93.51\%), tangential displacement tracking (97\% point retention) and force prediction (66\% improvement in total force error). These experimental results demonstrate that translucent skin eliminates the traditional performance trade-off in marker or markerless modes, paving the way for multimodal tactile sensing essential in tactile robotics. See videos at this \href{https://zhuochenn.github.io/MagicSkin_project/}{link}.

Related papers

• Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
  We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
  arXiv  Detail & Related papers  (2026-08-25T07:25:27Z)
• Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention [53.84395207661823]
  We propose Tactile-WAM, a touch-aware WAM with a Tactile Asymmetric Attention Mechanism (TAAM)<n>On ManiFeel, Tactile-WAM improves the mean success rate by 38.9% overall and by 86% on contact-rich tasks.
  arXiv  Detail & Related papers  (2026-06-25T06:54:56Z)
• TacVerse: A Multi-Sensor Dataset and Benchmark for Cross-Sensor Vision-Based Tactile Perception [7.968185063285978]
  We present TacVerse, a multi-sensor dataset and benchmark for cross-sensor vision-based tactile perception.<n>The dataset contains 106,800 tactile images from seven vision-based tactile sensors.<n>Strong within-sensor performance across all tasks indicates that the collected tactile observations are informative for the target objectives.
  arXiv  Detail & Related papers  (2026-06-24T14:22:48Z)
• MAMMA: Markerless & Automatic Multi-Person Motion Action Capture [37.06717786024836]
  MAMMA is a markerless motion-capture pipeline that recovers SMPL-X parameters from multi-view video of two-person interaction sequences.<n>We introduce a method that predicts dense 2D surface landmarks conditioned on segmentation masks.<n>We demonstrate that our approach can handle complex person--person interaction and offers greater accuracy than existing methods.
  arXiv  Detail & Related papers  (2025-06-16T02:04:51Z)
• Kalib: Easy Hand-Eye Calibration with Reference Point Tracking [52.4190876409222]
  Kalib is an automatic hand-eye calibration method that leverages the generalizability of visual foundation models to overcome challenges.<n>During calibration, a kinematic reference point is tracked in the camera coordinate 3D coordinates in the space behind the robot.<n>Kalib's user-friendly design and minimal setup requirements make it a possible solution for continuous operation in unstructured environments.
  arXiv  Detail & Related papers  (2024-08-20T06:03:40Z)
• A Locality-based Neural Solver for Optical Motion Capture [37.28597049192196]
  Given noisy marker data, we propose a new heterogeneous graph neural network which treats markers and joints as different types of nodes. We show that our method outperforms state-of-the-art methods in terms of prediction accuracy of occluded marker position error.
  arXiv  Detail & Related papers  (2023-09-01T12:40:17Z)
• Object Discovery from Motion-Guided Tokens [50.988525184497334]
  We augment the auto-encoder representation learning framework with motion-guidance and mid-level feature tokenization. Our approach enables the emergence of interpretable object-specific mid-level features.
  arXiv  Detail & Related papers  (2023-03-27T19:14:00Z)
• Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
  Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. vision-based tactile sensors are being widely used for various robotic perception and control tasks. We present a method for interactive perception using vision-based tactile sensors for a part mating task.
  arXiv  Detail & Related papers  (2023-03-10T16:27:37Z)
• DeepFormableTag: End-to-end Generation and Recognition of Deformable Fiducial Markers [27.135078472097895]
  Existing detection methods assume that markers are printed on ideally planar surfaces. A fiducial marker generator creates a set of free-form color patterns to encode significantly large-scale information. A differentiable image simulator creates a training dataset of photorealistic scene images with the deformed markers. A trained marker detector seeks the regions of interest and recognizes multiple marker patterns simultaneously.
  arXiv  Detail & Related papers  (2022-06-16T09:29:26Z)
• Spatio-temporal Attention Model for Tactile Texture Recognition [25.06942319117782]
  We propose a novel Spatio-Temporal Attention Model (STAM) for tactile texture recognition. The proposed STAM pays attention to both spatial focus of each single tactile texture and the temporal correlation of a tactile sequence. In the experiments to discriminate 100 different fabric textures, the spatially and temporally selective attention has resulted in a significant improvement of the recognition accuracy.
  arXiv  Detail & Related papers  (2020-08-10T22:32:34Z)
• Deep Soft Procrustes for Markerless Volumetric Sensor Alignment [81.13055566952221]
  In this work, we improve markerless data-driven correspondence estimation to achieve more robust multi-sensor spatial alignment. We incorporate geometric constraints in an end-to-end manner into a typical segmentation based model and bridge the intermediate dense classification task with the targeted pose estimation one. Our model is experimentally shown to achieve similar results with marker-based methods and outperform the markerless ones, while also being robust to the pose variations of the calibration structure.
  arXiv  Detail & Related papers  (2020-03-23T10:51:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.