Transferring Tactile Data Across Sensors

• URL: http://arxiv.org/abs/2410.14310v1
• Date: Fri, 18 Oct 2024 09:15:47 GMT
• Title: Transferring Tactile Data Across Sensors
• Abstract summary: This article introduces a novel method for translating data between tactile sensors. We demonstrate the approach by translating BioTac signals into the DIGIT sensor. Our framework consists of three steps: first, converting signal data into corresponding 3D deformation meshes; second, translating these 3D deformation meshes from one sensor to another; and third, generating output images.
• Score: 1.5566524830295307
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility in applications like slip detection and object identification, this sensor is now deprecated, making many existing datasets obsolete. This article introduces a novel method for translating data between tactile sensors by exploiting sensor deformation information rather than output signals. We demonstrate the approach by translating BioTac signals into the DIGIT sensor. Our framework consists of three steps: first, converting signal data into corresponding 3D deformation meshes; second, translating these 3D deformation meshes from one sensor to another; and third, generating output images using the converted meshes. Our approach enables the continued use of valuable datasets.

Related papers

• Language-Guided Representation Learning for Robust Cross-Sensor Material Recognition [1.441595027675735]
  We propose a language-guided distillation framework for learning sensor-robust tactile representations.<n>We construct a 39K-sample touch-language dataset with human-annotated material labels.<n>We train a tactile encoder to align sensor-specific tactile images with language embeddings in a shared semantic space.
  arXiv  Detail & Related papers  (2026-09-13T20:53:14Z)
• TactX: Learning Shared Tactile Representations Across Diverse Sensors [18.127088232068456]
  We propose TactX, a framework for learning a transferable tactile representation across sensors.<n>TactX maps heterogeneous tactile observations into a shared latent space through modality-specific encoders trained on paired contact data.<n>Experiments show that TactX aligns tactile representations across sensors while preserving object-level contact information.
  arXiv  Detail & Related papers  (2026-06-30T07:09:40Z)
• Heterogeneous Tactile Transformer [12.676986440348543]
  Heterogeneous Tactile Transformer (HTT) is a framework that learns shared tactile representations across heterogeneous sensors.<n>Pretraining uses our novel Heterogeneous Paired Tactile dataset, containing 1.6M synchronized frames across four vision- and array-based tactile sensors.<n> HTT is shown to learn transferable representations that adapt to new tasks and previously unseen sensors.
  arXiv  Detail & Related papers  (2026-06-29T08:24:38Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Sensor-Invariant Tactile Representation [11.153753622913843]
  High-resolution tactile sensors have become critical for embodied perception and robotic manipulation. A key challenge in the field is the lack of transferability between sensors due to design and manufacturing variations. We introduce a novel method for extracting Sensor-Invariant Tactile Representations (SITR), enabling zero-shot transfer across optical tactile sensors.
  arXiv  Detail & Related papers  (2025-02-27T00:12:50Z)
• AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors [11.506370451126378]
  Visuo-tactile sensors aim to emulate human tactile perception, enabling robots to understand and manipulate objects. We introduce TacQuad, an aligned multi-modal tactile multi-sensor dataset from four different visuo-tactile sensors. We propose AnyTouch, a unified static-dynamic multi-sensor representation learning framework with a multi-level structure.
  arXiv  Detail & Related papers  (2025-02-15T08:33:25Z)
• ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception [1.5566524830295307]
  ACROSS is a framework for translating data between tactile sensors by exploiting sensor deformation information. We demonstrate our approach to the most challenging problem of going from a low-dimensional tactile representation to a high-dimensional one.
  arXiv  Detail & Related papers  (2024-11-13T11:29:14Z)
• Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks [6.742250322226066]
  T3 is a framework for tactile representation learning that scales across multi-sensors and multi-tasks. T3 pre-trained with FoTa achieved zero-shot transferability in certain sensor-task pairings. T3 is also effective as a tactile encoder for long horizon contact-rich manipulation.
  arXiv  Detail & Related papers  (2024-06-19T15:39:27Z)
• UniTR: A Unified and Efficient Multi-Modal Transformer for Bird's-Eye-View Representation [113.35352122662752]
  We present an efficient multi-modal backbone for outdoor 3D perception named UniTR. UniTR processes a variety of modalities with unified modeling and shared parameters. UniTR is also a fundamentally task-agnostic backbone that naturally supports different 3D perception tasks.
  arXiv  Detail & Related papers  (2023-08-15T12:13:44Z)
• On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks [61.74608497496841]
  Training on inaccurate or corrupt data induces model bias and hampers generalisation capabilities. This paper investigates the effect of sensor errors for the dense 3D vision tasks of depth estimation and reconstruction.
  arXiv  Detail & Related papers  (2023-03-26T22:32:44Z)
• Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
  Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. vision-based tactile sensors are being widely used for various robotic perception and control tasks. We present a method for interactive perception using vision-based tactile sensors for a part mating task.
  arXiv  Detail & Related papers  (2023-03-10T16:27:37Z)
• Transformer-Based Sensor Fusion for Autonomous Driving: A Survey [0.0]
  Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best performing sensor-fusion 3D-detection-framework. We briefly go through the Vision transformers (ViT) basics, so that readers can easily follow through the paper. In conclusion we summarize with sensor-fusion trends to follow and provoke future research.
  arXiv  Detail & Related papers  (2023-02-22T16:28:20Z)
• Learning Online Multi-Sensor Depth Fusion [100.84519175539378]
  SenFuNet is a depth fusion approach that learns sensor-specific noise and outlier statistics. We conduct experiments with various sensor combinations on the real-world CoRBS and Scene3D datasets.
  arXiv  Detail & Related papers  (2022-04-07T10:45:32Z)
• Bayesian Imitation Learning for End-to-End Mobile Manipulation [80.47771322489422]
  Augmenting policies with additional sensor inputs, such as RGB + depth cameras, is a straightforward approach to improving robot perception capabilities. We show that using the Variational Information Bottleneck to regularize convolutional neural networks improves generalization to held-out domains. We demonstrate that our method is able to help close the sim-to-real gap and successfully fuse RGB and depth modalities.
  arXiv  Detail & Related papers  (2022-02-15T17:38:30Z)
• WaveGlove: Transformer-based hand gesture recognition using multiple inertial sensors [0.0]
  Hand Gesture Recognition (HGR) based on inertial data has grown considerably in recent years. In this work we explore the benefits of using multiple inertial sensors.
  arXiv  Detail & Related papers  (2021-05-04T20:50:53Z)
• Proximity Sensing: Modeling and Understanding Noisy RSSI-BLE Signals and Other Mobile Sensor Data for Digital Contact Tracing [12.070047847431884]
  Social-distancing via efficient contact tracing has emerged as the primary health strategy to dampen the spread of COVID-19. We present a novel system to estimate pair-wise individual proximity, via a joint model of Bluetooth Low Energy (BLE) signals with other on-device sensors.
  arXiv  Detail & Related papers  (2020-09-04T03:01:52Z)
• OmniTact: A Multi-Directional High Resolution Touch Sensor [109.28703530853542]
  Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. We introduce OmniTact, a multi-directional high-resolution tactile sensor. We evaluate the capabilities of OmniTact on a challenging robotic control task.
  arXiv  Detail & Related papers  (2020-03-16T01:31:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.