Tactile-Proprioceptive Sensor Fusion for Contact Wrench Estimation in Whole-Body Physical Human-Robot Interaction

• URL: http://arxiv.org/abs/2605.28412v1
• Date: Wed, 27 May 2026 12:47:25 GMT
• Title: Tactile-Proprioceptive Sensor Fusion for Contact Wrench Estimation in Whole-Body Physical Human-Robot Interaction
• Abstract summary: This paper presents a tactile-proprioceptive sensor fusion framework for natural physical human-robot interaction.<n>Tactile cues from pneumatic skin pads serve as contact indicators that bypass the ambiguity between frictional residues and applied external forces.<n>We fuse these cues with motor-current-based proprioception to reconstruct multi-axis contact forces on the robot surface.
• Score: 6.839826083147316
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Direct physical guidance is a natural means of teaching and interacting with robots, and robotic skins make a key contribution by enabling sensitive contact sensing and localization. This paper presents a tactile-proprioceptive sensor fusion framework for natural physical human-robot interaction. Tactile cues from pneumatic skin pads serve as contact indicators that bypass the ambiguity between frictional residues and applied external forces, enabling highly sensitive contact detection without explicit friction identification. We fuse these cues with motor-current-based proprioception to reconstruct multi-axis contact forces on the robot surface. To maintain accuracy during motion, we employ a temporal convolutional network (TCN) to mitigate friction hysteresis during stick-slip transitions, reducing uncertainty at contact onset and yielding smooth, responsive guidance. We validate the approach on a skin-integrated robot arm: (i) multi-axis forces are reconstructed in stationary contacts, and (ii) simultaneous force estimation and kinesthetic teaching are demonstrated. Results indicate improved sensitivity and responsiveness across diverse contact conditions compared with tactile-only and proprioceptive-only baselines, supporting tactile-proprioceptive fusion as a reliable pathway to safe, intuitive physical human-robot interaction.

Related papers

• AdaDexGrasp: Adaptive Dexterous Grasping via 3D Visuo-Tactile Representation Fusion [60.79507611737292]
  Humans achieve stable and adaptive grasps by seamlessly integrating visual perception and tactile feedback.<n>Existing robotic grasping approaches rely on visual inputs and lack mechanisms for tactile-guided adaptation after contact.<n>We propose a unified visuo-tactile-fusion grasping framework that integrates grasp generation, feasibility prediction, and adaptive refinement.
  arXiv  Detail & Related papers  (2026-08-06T16:29:11Z)
• Current as Touch: Proprioceptive Contact Feedback for Compliant Dexterous Manipulation [21.695801136739558]
  We propose a proprioception-driven framework that learns contact-aware compliance cues from motor current and joint states.<n>Our method predicts a compliance reference position: an ideal joint-position target for a standard PD controller.<n>Experiments show stable compliant grasping, safer and more efficient teleoperation, and improved downstream policy learning without external tactile or force sensors.
  arXiv  Detail & Related papers  (2026-07-03T17:59:50Z)
• Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation [74.87716678195099]
  Visuo-Tactile policies leveraging optical tactile sensors have shown great promise in contact-rich manipulation.<n>Despite their advantages, extracting fine-grained contact states necessary for contact-rich manipulation remains an open challenge.<n>We propose a motion-aware tactile representation to facilitate contact-rich manipulation.
  arXiv  Detail & Related papers  (2026-06-29T08:20:18Z)
• PRIME: Physically-consistent Robotic Inertial and Motion Estimation for Legged and Humanoid Robots [6.944742823560998]
  We propose PRIME to enable accurate motion estimation from onboard kinematics in real-world deployment.<n>Our approach incorporates differentiable contact dynamics with smoothed complementarity constraints and an Anitescu-style friction model.<n> PRIME can be calibrated to provide high-quality data for downstream learning applications, including large-scale behavior modeling and robot foundation models.
  arXiv  Detail & Related papers  (2026-05-17T22:43:10Z)
• Feel Robot Feels: Tactile Feedback Array Glove for Dexterous Manipulation [29.061513339025026]
  We present TAG, a low-cost glove system that integrates precise hand motion capture with high-resolution tactile feedback.<n>For motion capture, TAG employs a non-contact magnetic sensing design that provides drift-free, electromagnetically robust 21-DoF joint tracking.<n>We show that TAG enables reliable real-time perception of contact geometry and dynamic force, improves success rates in contact-rich teleoperation tasks, and increases the reliability of demonstration data collection for learning-based manipulation.
  arXiv  Detail & Related papers  (2026-03-30T15:04:13Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Multimodal Sensing for Robot-Assisted Sub-Tissue Feature Detection in Physiotherapy Palpation [6.494549465524354]
  We present a compact multimodal sensor that integrates high-resolution vision-based tactile imaging with a 6-axis force-torque sensor.<n>Preliminary results show that combining tactile and force modalities enables robust subsurface feature detection and controlled robotic palpation.
  arXiv  Detail & Related papers  (2025-12-24T06:35:48Z)
• Towards Immersive Human-X Interaction: A Real-Time Framework for Physically Plausible Motion Synthesis [51.95817740348585]
  Human-X is a novel framework designed to enable immersive and physically plausible human interactions across diverse entities.<n>Our method jointly predicts actions and reactions in real-time using an auto-regressive reaction diffusion planner.<n>Our framework is validated in real-world applications, including virtual reality interface for human-robot interaction.
  arXiv  Detail & Related papers  (2025-08-04T06:35:48Z)
• Fluidically Innervated Lattices Make Versatile and Durable Tactile Sensors [43.33741954317892]
  We introduce a passive soft robotic fingertip with integrated tactile sensing, fabricated using a 3D-printed elastomer lattice with embedded air channels.<n>This sensorization approach, termed fluidic innervation, transforms the lattice into a tactile sensor by detecting pressure changes within sealed air channels.
  arXiv  Detail & Related papers  (2025-07-28T18:00:04Z)
• Tactile Estimation of Extrinsic Contact Patch for Stable Placement [64.06243248525823]
  We present the design of feedback skills for robots that must learn to stack complex-shaped objects on top of each other. We estimate the contact patch between a grasped object and its environment using force and tactile observations.
  arXiv  Detail & Related papers  (2023-09-25T21:51:48Z)
• Elastic Tactile Simulation Towards Tactile-Visual Perception [58.44106915440858]
  We propose Elastic Interaction of Particles (EIP) for tactile simulation. EIP models the tactile sensor as a group of coordinated particles, and the elastic property is applied to regulate the deformation of particles during contact. We further propose a tactile-visual perception network that enables information fusion between tactile data and visual images.
  arXiv  Detail & Related papers  (2021-08-11T03:49:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.