An Event-Based Opto-Tactile Skin

• URL: http://arxiv.org/abs/2601.03907v1
• Date: Wed, 07 Jan 2026 13:17:20 GMT
• Title: An Event-Based Opto-Tactile Skin
• Abstract summary: This paper presents a neuromorphic, event-driven tactile sensing system for soft, large-area skin.<n>It is based on the Dynamic Vision Sensors (DVS) integrated with a flexible silicone optical waveguide skin.<n>Such a design produces events as changes in brightness are detected, and estimates press positions on the 2D skin surface through triangulation.
• Score: 6.8948204974942255
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents a neuromorphic, event-driven tactile sensing system for soft, large-area skin, based on the Dynamic Vision Sensors (DVS) integrated with a flexible silicone optical waveguide skin. Instead of repetitively scanning embedded photoreceivers, this design uses a stereo vision setup comprising two DVS cameras looking sideways through the skin. Such a design produces events as changes in brightness are detected, and estimates press positions on the 2D skin surface through triangulation, utilizing Density-Based Spatial Clustering of Applications with Noise (DBSCAN) to find the center of mass of contact events resulting from pressing actions. The system is evaluated over a 4620 mm2 probed area of the skin using a meander raster scan. Across 95 % of the presses visible to both cameras, the press localization achieved a Root-Mean-Squared Error (RMSE) of 4.66 mm. The results highlight the potential of this approach for wide-area flexible and responsive tactile sensors in soft robotics and interactive environments. Moreover, we examined how the system performs when the amount of event data is strongly reduced. Using stochastic down-sampling, the event stream was reduced to 1/1024 of its original size. Under this extreme reduction, the average localization error increased only slightly (from 4.66 mm to 9.33 mm), and the system still produced valid press localizations for 85 % of the trials. This reduction in pass rate is expected, as some presses no longer produce enough events to form a reliable cluster for triangulation. These results show that the sensing approach remains functional even with very sparse event data, which is promising for reducing power consumption and computational load in future implementations. The system exhibits a detection latency distribution with a characteristic width of 31 ms.

Related papers

• Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
  We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
  arXiv  Detail & Related papers  (2026-08-25T07:25:27Z)
• Detection and Ranging of Transient Extrinsic Contacts Based on 6D Dynamic Tactile Sensing [5.84990179018828]
  Transient extrinsic contact detection and ranging (TECDAR) is a simple yet fast and efficient method for detecting and ranging contact of grasped objects.<n>High bandwidth and compact data size enable the system to rapidly detect and localize contact between grasped objects and their surroundings.<n>We envision such techniques advancing the future of robotics, including precision assembly, surgical assistance, and autonomous exploration in touch-dominant environments.
  arXiv  Detail & Related papers  (2026-08-07T10:27:37Z)
• Dense Force Estimation with an Event-based Optical Tactile Sensor [3.671333019917016]
  We introduce the first framework for dense 3D force field reconstruction using event-based optical tactile sensors.<n>Our approach estimates 3D surface displacements from event data and maps them to forces via the inverse Finite Elements Method (iFEM)<n>Experiments demonstrate accurate reconstruction of physically grounded forces, achieving a mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N)<n>This work constitutes a first step toward enabling dense force feedback for high-frequency control in robotic grasping and dexterous manipulation.
  arXiv  Detail & Related papers  (2026-06-08T12:57:21Z)
• A skin-like conformal sensor for real-time shape mapping [2.128937994248034]
  Real-time 3D shape sensing is essential for robust control and interpretation of deformable systems during motion.<n>Here, we introduce a scalable, skin-like sensor that reconstructs its continuous 3D deformation in real time from distributed strain measurements.<n>A 5-by-5 array with a 12 mm pitch achieves a mean surface reconstruction error of 0.62 mm with 0.1s latency across all tested scenarios.
  arXiv  Detail & Related papers  (2026-05-02T00:19:19Z)
• No Dense Tensors Needed: Fully Sparse Object Detection on Event-Camera Voxel Grids [0.3823356975862005]
  Event cameras produce asynchronous, high-dynamic-range streams well suited for detecting small, fast-moving drones.<n>Most event-based detectors convert the sparse event stream into dense tensors, discarding the representational efficiency of neuromorphic sensing.<n>We propose SparseVoxelDet, the first fully sparse object detector for event cameras, in which backbone feature extraction, feature pyramid fusion, and the detection head all operate exclusively on occupied voxel positions.
  arXiv  Detail & Related papers  (2026-03-23T07:12:14Z)
• An Event-Driven E-Skin System with Dynamic Binary Scanning and real time SNN Classification [4.939047188463064]
  This paper presents a novel hardware system for high-speed, event-sparse sampling-based electronic skin (e-skin)<n>The system is built around a 16x16 piezoresistive tactile array with front end and introduces a event-based binary scan search strategy to classify the digits.<n>Despite significant efficiency gains, the system maintains a high classification accuracy of 92.11% for real-time handwritten digit recognition.
  arXiv  Detail & Related papers  (2026-03-11T08:42:05Z)
• SpikingTac: A Miniaturized Neuromorphic Visuotactile Sensor for High-Precision Dynamic Tactile Imprint Tracking [10.206129577114874]
  SpikingTac is a highly integrated neuromorphic tactile sensor, achieved with a total material cost of less than $150.<n>We construct a global dynamic state map coupled with an unsupervised denoising network to enable precise tracking.<n>In dynamic tasks, SpikingTac limits the obstacle-avoidance overshoot to 6.2mm, representing a 5-fold performance improvement over conventional frame-based sensors.
  arXiv  Detail & Related papers  (2026-02-27T03:39:06Z)
• Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensor [58.305341034419136]
  We present the first dense SLAM system with a monocular camera and a light-weight ToF sensor. We propose a multi-modal implicit scene representation that supports rendering both the signals from the RGB camera and light-weight ToF sensor. Experiments demonstrate that our system well exploits the signals of light-weight ToF sensors and achieves competitive results.
  arXiv  Detail & Related papers  (2023-08-28T07:56:13Z)
• High-precision and low-latency widefield diamond quantum sensing with neuromorphic vision sensors [17.98109004256033]
  Neuromorphic vision sensor pre-processes the detected signals in optically detected magnetic resonance measurements for quantum sensing. Experiment with an off-the-shelf event camera demonstrated a 13x improvement in temporal resolution. Development provides new insights for high-precision and low-latency widefield quantum sensing.
  arXiv  Detail & Related papers  (2023-06-25T02:37:44Z)
• EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks [107.62975594230687]
  We demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms.
  arXiv  Detail & Related papers  (2023-04-14T15:23:28Z)
• The KFIoU Loss for Rotated Object Detection [115.334070064346]
  In this paper, we argue that one effective alternative is to devise an approximate loss who can achieve trend-level alignment with SkewIoU loss. Specifically, we model the objects as Gaussian distribution and adopt Kalman filter to inherently mimic the mechanism of SkewIoU. The resulting new loss called KFIoU is easier to implement and works better compared with exact SkewIoU.
  arXiv  Detail & Related papers  (2022-01-29T10:54:57Z)
• Long-Range Thermal 3D Perception in Low Contrast Environments [0.0]
  This report discusses the results of Phase I effort to prove the feasibility of dramatic improvement of the microbolometer-based Long Wave Infrared (LWIR) detectors sensitivity. The resulting low SWaP-C thermal depth-sensing system will enable the situational awareness of Autonomous Air Vehicles for Advanced Air Mobility (AAM) It will provide robust 3D information of the surrounding environment, including low-contrast static and moving objects, at far distances in degraded visual conditions and GPS-denied areas.
  arXiv  Detail & Related papers  (2021-12-10T01:16:44Z)
• A soft thumb-sized vision-based sensor with accurate all-round force perception [19.905154050561013]
  Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight.
  arXiv  Detail & Related papers  (2021-11-10T20:46:23Z)
• Fast Motion Understanding with Spatiotemporal Neural Networks and Dynamic Vision Sensors [99.94079901071163]
  This paper presents a Dynamic Vision Sensor (DVS) based system for reasoning about high speed motion. We consider the case of a robot at rest reacting to a small, fast approaching object at speeds higher than 15m/s. We highlight the results of our system to a toy dart moving at 23.4m/s with a 24.73deg error in $theta$, 18.4mm average discretized radius prediction error, and 25.03% median time to collision prediction error.
  arXiv  Detail & Related papers  (2020-11-18T17:55:07Z)
• Near-chip Dynamic Vision Filtering for Low-Bandwidth Pedestrian Detection [99.94079901071163]
  This paper presents a novel end-to-end system for pedestrian detection using Dynamic Vision Sensors (DVSs) We target applications where multiple sensors transmit data to a local processing unit, which executes a detection algorithm. Our detector is able to perform a detection every 450 ms, with an overall testing F1 score of 83%.
  arXiv  Detail & Related papers  (2020-04-03T17:36:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.