BIFTA: Brain-Inspired Few-Shot Tactile Adaptation for Unknown Sensors

• URL: http://arxiv.org/abs/2609.08673v1
• Date: Tue, 08 Sep 2026 12:39:36 GMT
• Title: BIFTA: Brain-Inspired Few-Shot Tactile Adaptation for Unknown Sensors
• Abstract summary: We propose the Brain-Inspired Few-Shot Tactile Adaptation (BIFTA) framework to adapt a frozen encoder to an unknown tactile sensor.<n>BIFTA preserves pretrained representations through dual-view statistical memory.<n>It builds on the brain's rapid sensory adaptation mechanism to adapt a frozen encoder to an unknown tactile sensor.
• Score: 9.215504075946754
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Advances in tactile sensing have made contact-rich perception possible, accelerating progress in robotic manipulation, material understanding, and embodied interaction. However, because optical design, elastomer mechanics, and imaging geometry differ substantially across tactile sensors, models trained on known sensor types can suffer an abrupt performance collapse on unknown sensors. To address this problem, we propose the Brain-Inspired Few-Shot Tactile Adaptation (BIFTA) framework; it draws on the brain's rapid sensory adaptation mechanism to adapt a frozen encoder to an unknown tactile sensor from a small labeled support set. BIFTA preserves pretrained representations through dual-view statistical memory, constructs support-conditioned spectral graphs to repair sensor-dependent feature neighborhoods, and applies uncertainty-gated recurrent propagation to strengthen reliable cross-query evidence. Extensive benchmarks across three tactile datasets show that BIFTA substantially improves adaptation to unknown sensors: with only 10\% labeled target data on SITR, it raises mean Sparsh accuracy from 6.86\% for the frozen source classifier to 87.09\%, exceeding the strongest implemented prior comparison by 47.22 percentage points, and these gains generalize across datasets, pretrained backbones, and tactile tasks. These results validate BIFTA for data-efficient adaptation to unknown tactile sensors and offer a promising route toward tactile models that transfer across heterogeneous hardware.

Related papers

• Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
  We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
  arXiv  Detail & Related papers  (2026-08-25T07:25:27Z)
• VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios [7.9567869558684094]
  VQ-Touch is a tactile generation framework that supports both cross-sensor and multi-scenario applications.<n>To efficiently extract complex deformation and texture features from the data, we propose DM-VQGAN.<n>We introduce a discrete diffusion decoder with a unified conditioning interface, supporting multimodal generation tasks such as images and labels.
  arXiv  Detail & Related papers  (2026-07-16T08:53:41Z)
• TactX: Learning Shared Tactile Representations Across Diverse Sensors [18.127088232068456]
  We propose TactX, a framework for learning a transferable tactile representation across sensors.<n>TactX maps heterogeneous tactile observations into a shared latent space through modality-specific encoders trained on paired contact data.<n>Experiments show that TactX aligns tactile representations across sensors while preserving object-level contact information.
  arXiv  Detail & Related papers  (2026-06-30T07:09:40Z)
• Heterogeneous Tactile Transformer [12.676986440348543]
  Heterogeneous Tactile Transformer (HTT) is a framework that learns shared tactile representations across heterogeneous sensors.<n>Pretraining uses our novel Heterogeneous Paired Tactile dataset, containing 1.6M synchronized frames across four vision- and array-based tactile sensors.<n> HTT is shown to learn transferable representations that adapt to new tasks and previously unseen sensors.
  arXiv  Detail & Related papers  (2026-06-29T08:24:38Z)
• TacVerse: A Multi-Sensor Dataset and Benchmark for Cross-Sensor Vision-Based Tactile Perception [7.968185063285978]
  We present TacVerse, a multi-sensor dataset and benchmark for cross-sensor vision-based tactile perception.<n>The dataset contains 106,800 tactile images from seven vision-based tactile sensors.<n>Strong within-sensor performance across all tasks indicates that the collected tactile observations are informative for the target objectives.
  arXiv  Detail & Related papers  (2026-06-24T14:22:48Z)
• Design and Validation of a Lightweight 1D CNN for Affective Touch Classification in Soft Plush Companions [59.49967357689445]
  Soft, sensorized companions offer a physically safe and emotionally intuitive interface for socially assistive technologies.<n>This study presents a complete open-source dilated real-based framework for the development and validation of deep learning models for affective touch recognition in soft interactive companions.
  arXiv  Detail & Related papers  (2026-04-16T10:20:05Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Sensor-Invariant Tactile Representation [11.153753622913843]
  High-resolution tactile sensors have become critical for embodied perception and robotic manipulation.<n>A key challenge in the field is the lack of transferability between sensors due to design and manufacturing variations.<n>We introduce a novel method for extracting Sensor-Invariant Tactile Representations (SITR), enabling zero-shot transfer across optical tactile sensors.
  arXiv  Detail & Related papers  (2025-02-27T00:12:50Z)
• MSSIDD: A Benchmark for Multi-Sensor Denoising [55.41612200877861]
  We introduce a new benchmark, the Multi-Sensor SIDD dataset, which is the first raw-domain dataset designed to evaluate the sensor transferability of denoising models. We propose a sensor consistency training framework that enables denoising models to learn the sensor-invariant features.
  arXiv  Detail & Related papers  (2024-11-18T13:32:59Z)
• Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
  We propose Elastic Interaction of Particles (EIP) for tactile simulation. EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact. We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
  arXiv  Detail & Related papers  (2021-08-11T03:49:59Z)
• Semantics-aware Adaptive Knowledge Distillation for Sensor-to-Vision Action Recognition [131.6328804788164]
  We propose a framework, named Semantics-aware Adaptive Knowledge Distillation Networks (SAKDN), to enhance action recognition in vision-sensor modality (videos) The SAKDN uses multiple wearable-sensors as teacher modalities and uses RGB videos as student modality.
  arXiv  Detail & Related papers  (2020-09-01T03:38:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.