Soft Surfaced Vision-Based Tactile Sensing for Bipedal Robot Applications

• URL: http://arxiv.org/abs/2602.18638v2
• Date: Tue, 24 Feb 2026 14:04:56 GMT
• Title: Soft Surfaced Vision-Based Tactile Sensing for Bipedal Robot Applications
• Abstract summary: We present a vision-based tactile foot sensor that endows a bipedal robot with a skin-like deformable layer that captures contact deformations optically.<n>Our method estimates contact pose, visualizes shear, computes center of pressure, classifies terrain, and detects geometric features of the contact patch.<n>These findings suggest that integrating tactile perception into legged robot feet improves stability, adaptability, and environmental awareness.
• Score: 2.6432141226459334
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Legged locomotion benefits from embodied sensing, where perception emerges from the physical interaction between body and environment. We present a soft-surfaced, vision-based tactile foot sensor that endows a bipedal robot with a skin-like deformable layer that captures contact deformations optically, turning foot-ground interactions into rich haptic signals. From a contact image stream, our method estimates contact pose (position and orientation), visualizes shear, computes center of pressure (CoP), classifies terrain, and detects geometric features of the contact patch. We validate these capabilities on a tilting platform and in visually obscured conditions, showing that foot-borne tactile feedback improves balance control and terrain awareness beyond proprioception alone. These findings suggest that integrating tactile perception into legged robot feet improves stability, adaptability, and environmental awareness, offering a promising direction toward more compliant and intelligent locomotion systems. For the supplementary video, please visit: https://youtu.be/ceJiy9q_2Aw

Related papers

• AdaDexGrasp: Adaptive Dexterous Grasping via 3D Visuo-Tactile Representation Fusion [60.79507611737292]
  Humans achieve stable and adaptive grasps by seamlessly integrating visual perception and tactile feedback.<n>Existing robotic grasping approaches rely on visual inputs and lack mechanisms for tactile-guided adaptation after contact.<n>We propose a unified visuo-tactile-fusion grasping framework that integrates grasp generation, feasibility prediction, and adaptive refinement.
  arXiv  Detail & Related papers  (2026-08-06T16:29:11Z)
• Towards Artificial Nerves: Biomimetic Optical-Fiber Tactile Sensing for Robots [5.779924847774939]
  OptiTac is a biomimetic tactile sensor that emulates the mechanoreceptor-to-nerve architecture of human touch.<n>This work demonstrates how evolutionary principles from biology can guide the development of artificial nerve systems for robots.
  arXiv  Detail & Related papers  (2026-07-17T08:34:01Z)
• NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation [0.7378853859331618]
  NoContactNoWorries is a framework that fuses RGB-D vision with the robot's proprioception to infer binary contact states.<n>We show that the inferred contact signal supports downstream reinforcement learning agents for in-hand object reorientation.
  arXiv  Detail & Related papers  (2026-06-23T11:36:46Z)
• FingerEye: Continuous and Unified Vision-Tactile Sensing for Dexterous Manipulation [8.809778152652724]
  Dexterous robotic manipulation requires comprehensive perception across all phases of interaction.<n>We introduce FingerEye, a compact and cost-effective sensor that provides continuous vision-tactile feedback throughout the interaction process.<n>We develop a vision-tactile imitation learning policy that fuses signals from multiple FingerEye sensors to learn dexterous manipulation behaviors from limited real-world data.
  arXiv  Detail & Related papers  (2026-04-22T15:37:34Z)
• Digitizing Touch with an Artificial Multimodal Fingertip [51.7029315337739]
  Humans and robots both benefit from using touch to perceive and interact with the surrounding environment. Here, we describe several conceptual and technological innovations to improve the digitization of touch. These advances are embodied in an artificial finger-shaped sensor with advanced sensing capabilities.
  arXiv  Detail & Related papers  (2024-11-04T18:38:50Z)
• Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing [15.970078821894758]
  We introduce a system that leverages visual and tactile sensory inputs to enable dexterous in-hand manipulation. Robot Synesthesia is a novel point cloud-based tactile representation inspired by human tactile-visual synesthesia.
  arXiv  Detail & Related papers  (2023-12-04T12:35:43Z)
• Tactile Estimation of Extrinsic Contact Patch for Stable Placement [64.06243248525823]
  We present the design of feedback skills for robots that must learn to stack complex-shaped objects on top of each other. We estimate the contact patch between a grasped object and its environment using force and tactile observations.
  arXiv  Detail & Related papers  (2023-09-25T21:51:48Z)
• Attention for Robot Touch: Tactile Saliency Prediction for Robust Sim-to-Real Tactile Control [12.302685367517718]
  High-resolution tactile sensing can provide accurate information about local contact in contact-rich robotic tasks. We study a new concept: textittactile saliency for robot touch, inspired by the human touch attention mechanism from neuroscience.
  arXiv  Detail & Related papers  (2023-07-26T21:19:45Z)
• Tactile-Filter: Interactive Tactile Perception for Part Mating [54.46221808805662]
  Humans rely on touch and tactile sensing for a lot of dexterous manipulation tasks. vision-based tactile sensors are being widely used for various robotic perception and control tasks. We present a method for interactive perception using vision-based tactile sensors for a part mating task.
  arXiv  Detail & Related papers  (2023-03-10T16:27:37Z)
• Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
  We propose Elastic Interaction of Particles (EIP) for tactile simulation. EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact. We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
  arXiv  Detail & Related papers  (2021-08-11T03:49:59Z)
• OmniTact: A Multi-Directional High Resolution Touch Sensor [109.28703530853542]
  Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. We introduce OmniTact, a multi-directional high-resolution tactile sensor. We evaluate the capabilities of OmniTact on a challenging robotic control task.
  arXiv  Detail & Related papers  (2020-03-16T01:31:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.