Dense Force Estimation with an Event-based Optical Tactile Sensor

• URL: http://arxiv.org/abs/2606.09451v1
• Date: Mon, 08 Jun 2026 12:57:21 GMT
• Title: Dense Force Estimation with an Event-based Optical Tactile Sensor
• Abstract summary: We introduce the first framework for dense 3D force field reconstruction using event-based optical tactile sensors.<n>Our approach estimates 3D surface displacements from event data and maps them to forces via the inverse Finite Elements Method (iFEM)<n>Experiments demonstrate accurate reconstruction of physically grounded forces, achieving a mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N)<n>This work constitutes a first step toward enabling dense force feedback for high-frequency control in robotic grasping and dexterous manipulation.
• Score: 3.671333019917016
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Humans rely on spatially dense, geometry and force-aware tactile feedback at high temporal resolution for dexterous manipulation. While vision-based tactile sensors enable dense force estimation, they are limited by camera frame rates, motion blur, and data bandwidth. Event-based optical tactile sensors offer an attractive alternative with microsecond temporal resolution and low motion blur, but existing methods are restricted to predicting only net forces. We introduce the first framework for dense 3D force field reconstruction using event-based optical tactile sensors. Our approach estimates 3D surface displacements from event data and maps them to forces via the inverse Finite Elements Method (iFEM). Shear displacements are recovered through the proposed event-based marker tracking algorithm, while normal displacements are predicted by a convolutional neural network trained on a collected dataset of synchronized force-displacement-event data. Experiments demonstrate accurate reconstruction of physically grounded forces, achieving a mean absolute error of (0.14 N, 0.10 N, 0.93 N) over force ranges up to (4 N, 4 N, 20 N), while operating at an average of 100 Hz. This work constitutes a first step toward enabling dense force feedback for high-frequency control in robotic grasping and dexterous manipulation.

Related papers

• Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
  We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
  arXiv  Detail & Related papers  (2026-08-25T07:25:27Z)
• FasTac: A Curved Multispectral Vision-Based Tactile Sensor for High-Speed High-Precision 3D Shape and Force Perception [9.044476538600104]
  This article presents FasTac, a curved vision-based tactile sensor integrating multispectral photometric stereo, dynamic-convolution force estimation, and hardware acceleration on a field-programmable gate array (FPGA)<n>Single-image-sensor simultaneous multispectral imaging provides spatially aligned observations for robust surface normal estimation, followed by boundary-prior fast Poisson depth reconstruction.<n> experiments show that near-infrared (NIR) illumination and the boundary prior decrease depth mean absolute error (MAE) from 0.2730 mm to 0.0415 mm.
  arXiv  Detail & Related papers  (2026-07-30T16:00:51Z)
• TacSE3: Equivariant SE(3) Motion Estimation from Low-Texture Visuotactile Images for In-Gripper Tracking and Compensation [21.692486374633418]
  TacSE3 is a tactile motion-estimation pipeline that converts low-texture visuotactile observations into a decoupled three-dimensional force field.<n>The method derives planar translation from contact-centroid motion and estimates rotation primarily from shear-related tactile responses.<n>Experiments with paired DM-Tac fingertip sensors show that dual-sensor sensing reduces translation-rotation ambiguity, supports rotation tracking across axes and object geometries, and provides a lightweight compensation signal.
  arXiv  Detail & Related papers  (2026-05-18T06:38:06Z)
• SLAT-Phys: Fast Material Property Field Prediction from Structured 3D Latents [55.26273954022457]
  Estimating the material property field of 3D assets is critical for physics-based simulation, robotics, and digital twin generation.<n>We present SLAT-Phys, an end-to-end method that predicts spatially varying material property fields of 3D assets directly from a single RGB image without explicit 3D reconstruction.
  arXiv  Detail & Related papers  (2026-03-25T06:14:03Z)
• SpikingTac: A Miniaturized Neuromorphic Visuotactile Sensor for High-Precision Dynamic Tactile Imprint Tracking [10.206129577114874]
  SpikingTac is a highly integrated neuromorphic tactile sensor, achieved with a total material cost of less than $150.<n>We construct a global dynamic state map coupled with an unsupervised denoising network to enable precise tracking.<n>In dynamic tasks, SpikingTac limits the obstacle-avoidance overshoot to 6.2mm, representing a 5-fold performance improvement over conventional frame-based sensors.
  arXiv  Detail & Related papers  (2026-02-27T03:39:06Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Physics Informed Neural Networks for design optimisation of diamond particle detectors for charged particle fast-tracking at high luminosity hadron colliders [70.66815108184498]
  Future high-luminosity hadron colliders demand tracking detectors with extreme radiation tolerance, high spatial precision, and sub-nanosecond timing.<n>3D diamond pixel sensors offer these capabilities due to diamond's radiation hardness and high carrier mobility.<n>We model the phenomenon through a 3rd-order, 3+1D PDE derived as a quasi-stationary approximation of Maxwell's equations.
  arXiv  Detail & Related papers  (2025-09-25T13:09:28Z)
• Geometric Neural Distance Fields for Learning Human Motion Priors [51.99890740169883]
  We introduce a novel 3D generative human motion prior that enables robust, temporally consistent, and physically plausible 3D motion recovery.<n>Our experiments show significant and consistent gains: trained on the AMASS dataset, NRMF remarkably generalizes across multiple input modalities.
  arXiv  Detail & Related papers  (2025-09-11T17:58:18Z)
• EMoTive: Event-guided Trajectory Modeling for 3D Motion Estimation [59.33052312107478]
  Event cameras offer possibilities for 3D motion estimation through continuous adaptive pixel-level responses to scene changes.<n>This paper presents EMove, a novel event-based framework that models-uniform trajectories via event-guided parametric curves.<n>For motion representation, we introduce a density-aware adaptation mechanism to fuse spatial and temporal features under event guidance.<n>The final 3D motion estimation is achieved through multi-temporal sampling of parametric trajectories, flows and depth motion fields.
  arXiv  Detail & Related papers  (2025-03-14T13:15:54Z)
• FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors [18.88211706267447]
  We tackle the problem of estimating 3D contact forces using vision-based tactile sensors. Our goal is to estimate contact forces over a large range (up to 15 N) on any objects while generalizing across different vision-based tactile sensors.
  arXiv  Detail & Related papers  (2024-10-02T21:28:19Z)
• A soft thumb-sized vision-based sensor with accurate all-round force perception [19.905154050561013]
  Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight.
  arXiv  Detail & Related papers  (2021-11-10T20:46:23Z)
• Real-Time Tactile Grasp Force Sensing Using Fingernail Imaging via Deep Neural Networks [3.42658286826597]
  This paper introduces a novel approach for the real-time estimation of 3D tactile forces exerted by human fingertips via vision only. The introduced approach is entirely monocular vision-based and does not require any physical force sensor. It is scalable, non-intrusive, and easily fused with other perception systems such as body pose estimation.
  arXiv  Detail & Related papers  (2021-09-30T16:07:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.