SpikingTac: A Miniaturized Neuromorphic Visuotactile Sensor for High-Precision Dynamic Tactile Imprint Tracking
- URL: http://arxiv.org/abs/2602.23654v1
- Date: Fri, 27 Feb 2026 03:39:06 GMT
- Title: SpikingTac: A Miniaturized Neuromorphic Visuotactile Sensor for High-Precision Dynamic Tactile Imprint Tracking
- Abstract summary: SpikingTac is a highly integrated neuromorphic tactile sensor, achieved with a total material cost of less than $150.<n>We construct a global dynamic state map coupled with an unsupervised denoising network to enable precise tracking.<n>In dynamic tasks, SpikingTac limits the obstacle-avoidance overshoot to 6.2mm, representing a 5-fold performance improvement over conventional frame-based sensors.
- Score: 10.206129577114874
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: High-speed event-driven tactile sensors are essential for achieving human-like dynamic manipulation, yet their integration is often limited by the bulkiness of standard event cameras. This paper presents SpikingTac, a miniaturized, highly integrated neuromorphic tactile sensor featuring a custom standalone event camera module, achieved with a total material cost of less than \$150. We construct a global dynamic state map coupled with an unsupervised denoising network to enable precise tracking at a 1000~Hz perception rate and 350~Hz tracking frequency. Addressing the viscoelastic hysteresis of silicone elastomers, we propose a hysteresis-aware incremental update law with a spatial gain damping mechanism. Experimental results demonstrate exceptional zero-point stability, achieving a 100\% return-to-origin success rate with a minimal mean bias of 0.8039 pixels, even under extreme torsional deformations. In dynamic tasks, SpikingTac limits the obstacle-avoidance overshoot to 6.2~mm, representing a 5-fold performance improvement over conventional frame-based sensors. Furthermore, the sensor achieves sub-millimeter geometric accuracy, with Root Mean Square Error (RMSE) of 0.0952~mm in localization and 0.0452~mm in radius measurement.
Related papers
- Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
arXiv Detail & Related papers (2026-08-25T07:25:27Z) - Sen-Cap: Sensor-Flexible and Noise-Resilient Human Motion Capture via LiDAR-Camera Integration [50.18488308004802]
Sen-Cap is a 3D motion capture framework that integrates multi-modal data from LiDAR and camera.<n>Sen-Cap achieves state-of-the-art performance on major metrics on Human-M3 and FreeMotion.<n>This combination of flexibility and robustness opens new opportunities for motion capture in real-world scenarios.
arXiv Detail & Related papers (2026-08-03T14:16:18Z) - A Model-Based Decoupling Strategy for Proprioception and Contact Sensing in an Architected Soft Manipulator [49.225033144914214]
We present a model-based strategy that decouples proprioceptive and contact signals from fluidic pressure sensors embedded in a soft architected segment.<n>On a single ITH segment, this approach achieves proprioceptive shape estimation with a relative bending error of 0.11 +/- 0.02 and a contact detection rate of 97% across 178 trials.
arXiv Detail & Related papers (2026-07-17T03:03:19Z) - Dense Force Estimation with an Event-based Optical Tactile Sensor [3.671333019917016]
We introduce the first framework for dense 3D force field reconstruction using event-based optical tactile sensors.<n>Our approach estimates 3D surface displacements from event data and maps them to forces via the inverse Finite Elements Method (iFEM)<n>Experiments demonstrate accurate reconstruction of physically grounded forces, achieving a mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N)<n>This work constitutes a first step toward enabling dense force feedback for high-frequency control in robotic grasping and dexterous manipulation.
arXiv Detail & Related papers (2026-06-08T12:57:21Z) - Stereo-Inertial Poser: Towards Metric-Accurate Shape-Aware Motion Capture Using Sparse IMUs and a Single Stereo Camera [54.967647497048205]
We present Stereo-Inertial Poser, a real-time motion capture system that estimates metric-accurate and shape-aware 3D human motion.<n>We replace the monocular RGB with stereo vision, enabling direct 3D keypoint extraction and body shape parameter estimation.<n>Our method produces drift-free global translation under a long recording time and reduces foot-skating effects.
arXiv Detail & Related papers (2026-03-02T17:46:38Z) - MLRecon: Robust Markerless Freehand 3D Ultrasound Reconstruction via Coarse-to-Fine Pose Estimation [8.489758968497188]
We present MLRecon, a robust markerless 3D US reconstruction framework delivering drift-resilient 6D probe pose tracking.<n>Our pipeline enables continuous markerless tracking of the probe, augmented by a vision-guided divergence detector.<n>Experiments demonstrate that MLRecon significantly outperforms competing sensorless and sensor-aided methods.
arXiv Detail & Related papers (2026-03-01T08:39:21Z) - UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
arXiv Detail & Related papers (2026-02-01T11:03:01Z) - An Event-Based Opto-Tactile Skin [6.8948204974942255]
This paper presents a neuromorphic, event-driven tactile sensing system for soft, large-area skin.<n>It is based on the Dynamic Vision Sensors (DVS) integrated with a flexible silicone optical waveguide skin.<n>Such a design produces events as changes in brightness are detected, and estimates press positions on the 2D skin surface through triangulation.
arXiv Detail & Related papers (2026-01-07T13:17:20Z) - Stretchable and High-Precision Optical Tactile Sensor for Trajectory Tracking of Parallel Mechanisms [6.327690818318062]
We develop a stretchable tactile sensor based on the proposed continuous spectral-filtering principle.<n>This proposed sensor enables a high-linear spatial response (0.996) even during stretching and bending, and high continuous spatial (7 m) and force (5 mN) resolutions.
arXiv Detail & Related papers (2025-12-24T02:13:16Z) - MATE: Motion-Augmented Temporal Consistency for Event-based Point Tracking [58.719310295870024]
This paper presents an event-based framework for tracking any point.<n>To resolve ambiguities caused by event sparsity, a motion-guidance module incorporates kinematic vectors into the local matching process.<n>The method improves the $Survival_50$ metric by 17.9% over event-only tracking of any point baseline.
arXiv Detail & Related papers (2024-12-02T09:13:29Z) - MSSIDD: A Benchmark for Multi-Sensor Denoising [55.41612200877861]
We introduce a new benchmark, the Multi-Sensor SIDD dataset, which is the first raw-domain dataset designed to evaluate the sensor transferability of denoising models.
We propose a sensor consistency training framework that enables denoising models to learn the sensor-invariant features.
arXiv Detail & Related papers (2024-11-18T13:32:59Z) - Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulation [20.713880984921385]
Evetac is an event-based optical tactile sensor.
We develop touch processing algorithms to process its measurements online at 1000 Hz.
Evetac's output and the marker tracking provide meaningful features for learning data-driven slip detection and prediction models.
arXiv Detail & Related papers (2023-12-02T22:01:49Z) - DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields [71.94156412354054]
We propose Dynamic Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields (DynaMoN)<n>DynaMoN handles dynamic content for initial camera pose estimation and statics-focused ray sampling for fast and accurate novel-view synthesis.<n>We extensively evaluate our approach on two real-world dynamic datasets, the TUM RGB-D dataset and the BONN RGB-D Dynamic dataset.
arXiv Detail & Related papers (2023-09-16T08:46:59Z) - Enhancing the sensitivity of atom-interferometric inertial sensors using
robust control [0.0]
Operation in real-world environments is challenging due to external interference, platform noise, and constraints on size, weight, and power.
We show that tailored light pulses designed using robust control techniques mitigate significant error sources in an atom-interferometric accelerometer.
arXiv Detail & Related papers (2023-03-07T06:50:52Z) - Monocular Depth Estimation for Soft Visuotactile Sensors [24.319343057803973]
We investigate the application of state-of-the-art monocular depth estimation to infer dense internal (tactile) depth maps directly from an internal single small IR imaging sensor.
We show that deep networks typically used for long-range depth estimation (1-100m) can be effectively trained for precise predictions at a much shorter range (1-100mm) inside a mostly textureless deformable fluid-filled sensor.
We propose a simple supervised learning process to train an object-agnostic network requiring less than 10 random poses in contact for less than 10 seconds for a small set of diverse objects.
arXiv Detail & Related papers (2021-01-05T17:51:11Z) - Learning Camera Miscalibration Detection [83.38916296044394]
This paper focuses on a data-driven approach to learn the detection of miscalibration in vision sensors, specifically RGB cameras.
Our contributions include a proposed miscalibration metric for RGB cameras and a novel semi-synthetic dataset generation pipeline based on this metric.
By training a deep convolutional neural network, we demonstrate the effectiveness of our pipeline to identify whether a recalibration of the camera's intrinsic parameters is required or not.
arXiv Detail & Related papers (2020-05-24T10:32:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.