GelSphere: An Omnidirectional Rolling Vision-Based Tactile Sensor for Online 3D Reconstruction and Normal Force Estimation

• URL: http://arxiv.org/abs/2603.14104v1
• Date: Sat, 14 Mar 2026 20:22:52 GMT
• Title: GelSphere: An Omnidirectional Rolling Vision-Based Tactile Sensor for Online 3D Reconstruction and Normal Force Estimation
• Abstract summary: We present GelSphere, a spherical vision-based tactile sensor designed for real-time continuous surface scanning.<n>Unlike traditional vision-based tactile sensors that can only sense locally and are damaged when slid across surfaces, our design enables omnidirectional rolling on surfaces.<n>The sensor streams tactile images through Wi-Fi, with online large-surface reconstruction capabilities.
• Score: 2.803505954180182
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We present GelSphere, a spherical vision-based tactile sensor designed for real-time continuous surface scanning. Unlike traditional vision-based tactile sensors that can only sense locally and are damaged when slid across surfaces, and cylindrical tactile sensors that can only roll along a fixed direction, our design enables omnidirectional rolling on surfaces. We accomplish this through our novel sensing system design, which has steel balls inside the sensor, forming a bearing layer between the gel and the rigid housing that allows rolling motion in all axes. The sensor streams tactile images through Wi-Fi, with online large-surface reconstruction capabilities. We present quantitative results for both reconstruction accuracy and image fusion performance. The results show that our sensor maintains geometric fidelity and high reconstruction accuracy even under multi-directional rolling, enabling uninterrupted surface scanning.

Related papers

• Talk2Sensors: 3D Visual Grounding in Autonomous Driving via Sensor-Adaptive Physical Cue Matching [66.91228384649921]
  We introduce Talk2Sensors, the first multi-sensor 3D visual grounding dataset built upon camera, LiDAR, and 4D radar.<n>We propose TSFormer, a unified Transformer-based framework for language-guided 3D visual grounding in autonomous driving.
  arXiv  Detail & Related papers  (2026-08-05T07:58:35Z)
• Toward Geometry-Scalable Whole-Body Touch for Humanoids: A 3D-Printed Conformal EIT Skin [66.36050076244905]
  Whole-body tactile sensing is a prerequisite for humanoids that operate in contact-rich human environments.<n>We present a conformal electrical tactile tomography skin fabricated through a geometry-adaptable additive-manufacturing workflow.
  arXiv  Detail & Related papers  (2026-08-03T11:33:30Z)
• Form-Fitting, Large-Area Sensor Mounting for Obstacle Detection [99.11587290390071]
  We introduce a low-cost method for mounting sensors onto robot links for large-area sensing coverage.<n>Using computer aided design (CAD), a robot skin covering, or skin unit, can be procedurally generated to fit around a nondevelopable surface.<n>The skin unit embeds mounts for printed circuit boards of any size to keep sensors in fixed and known locations.
  arXiv  Detail & Related papers  (2026-03-24T21:20:57Z)
• PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction [76.9760302941819]
  PolGS++ is a polarimetric Gaussian Splatting framework for fast reflective surface reconstruction.<n>We introduce a depth-guided visibility mask acquisition mechanism that enables angle-of-polarization (AoP)-based tangent-space consistency constraints.
  arXiv  Detail & Related papers  (2026-03-11T14:11:42Z)
• NLiPsCalib: An Efficient Calibration Framework for High-Fidelity 3D Reconstruction of Curved Visuotactile Sensors [6.94308778422421]
  We present NLiPsCalib, a physics-consistent and efficient calibration framework for curved visuotactile sensors.<n>We further introduce NLiPsTac, a controllable-light-source tactile sensor developed to validate our framework.
  arXiv  Detail & Related papers  (2026-03-10T07:50:49Z)
• TacFinRay: Soft Tactile Fin-Ray Finger with Indirect Tactile Sensing for Robust Grasping [7.580154170757244]
  We present a tactile-sensorized Fin-Ray finger that enables simultaneous detection of contact location and indentation depth.<n>A hinge mechanism is integrated between the soft Fin-Ray structure and a rigid sensing module.<n>Deformation patterns captured by an internal camera are processed using a convolutional neural network to infer contact conditions.
  arXiv  Detail & Related papers  (2025-12-06T18:24:11Z)
• Fluidically Innervated Lattices Make Versatile and Durable Tactile Sensors [43.33741954317892]
  We introduce a passive soft robotic fingertip with integrated tactile sensing, fabricated using a 3D-printed elastomer lattice with embedded air channels.<n>This sensorization approach, termed fluidic innervation, transforms the lattice into a tactile sensor by detecting pressure changes within sealed air channels.
  arXiv  Detail & Related papers  (2025-07-28T18:00:04Z)
• PhySense: Sensor Placement Optimization for Accurate Physics Sensing [53.58729034895666]
  PhySense is a framework that learns to jointly reconstruct physical fields and to optimize sensor placements.<n>It achieves state-of-the-art physics sensing accuracy and discovers informative sensor placements previously unconsidered.
  arXiv  Detail & Related papers  (2025-05-19T14:59:11Z)
• GelBelt: A Vision-based Tactile Sensor for Continuous Sensing of Large Surfaces [7.84516438523304]
  We introduce a vision-based tactile sensor designed for continuous surface sensing applications.<n>Our design uses an elastomeric belt and two wheels to continuously scan the target surface.<n>Results indicate that the proposed sensor can rapidly scan large-scale surfaces with high accuracy at speeds up to 45 mm/s.
  arXiv  Detail & Related papers  (2025-01-09T15:00:03Z)
• DenseTact: Optical Tactile Sensor for Dense Shape Reconstruction [0.0]
  Vision-based tactile sensors have been widely used as rich tactile feedback has been correlated with increased performance in manipulation tasks. Existing tactile sensor solutions with high resolution have limitations that include low accuracy, expensive components, or lack of scalability. This paper proposes an inexpensive, scalable, and compact tactile sensor with high-resolution surface deformation modeling for surface reconstruction of the 3D sensor surface.
  arXiv  Detail & Related papers  (2022-01-04T22:26:14Z)
• A soft thumb-sized vision-based sensor with accurate all-round force perception [19.905154050561013]
  Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight.
  arXiv  Detail & Related papers  (2021-11-10T20:46:23Z)
• Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
  We propose Elastic Interaction of Particles (EIP) for tactile simulation. EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact. We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
  arXiv  Detail & Related papers  (2021-08-11T03:49:59Z)
• Active 3D Shape Reconstruction from Vision and Touch [66.08432412497443]
  Humans build 3D understandings of the world through active object exploration, using jointly their senses of vision and touch. In 3D shape reconstruction, most recent progress has relied on static datasets of limited sensory data such as RGB images, depth maps or haptic readings. We introduce a system composed of: 1) a haptic simulator leveraging high spatial resolution vision-based tactile sensors for active touching of 3D objects; 2) a mesh-based 3D shape reconstruction model that relies on tactile or visuotactile priors to guide the shape exploration; and 3) a set of data-driven solutions with either tactile or visuo
  arXiv  Detail & Related papers  (2021-07-20T15:56:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.