SlipSense: Multimodal Sensing for Online Slip Detection in Legged Robots

• URL: http://arxiv.org/abs/2606.24350v1
• Date: Tue, 23 Jun 2026 09:40:36 GMT
• Title: SlipSense: Multimodal Sensing for Online Slip Detection in Legged Robots
• Abstract summary: SlipSense is a novel framework for online force-based slip detection using a custom lightweight sensorized foot for quadrupeds to detect slip.<n>The framework integrates a multimodal sensor design with a LSTM-based model to infer ground reaction forces and detect slip-indicative anomalies during locomotion.<n>Our method detects early-stage slips down to an average displacement of 24.1 +/-6.4mm with an overall accuracy of 85.9%.
• Score: 0.8411385346896411
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Legged robots rely on accurate ground interaction awareness to traverse variable terrains, such as slippery surfaces. Existing slip detection methods often rely on kinematics and proprioception, which lack the sensitivity to detect early-stage slips that occur prior to catastrophic instability. Thus, this paper presents SlipSense, a novel framework for online force-based slip detection using a custom lightweight sensorized foot for quadrupeds to detect slip. The framework integrates a multimodal sensor design with a LSTM-based model to infer ground reaction forces and detect slip-indicative anomalies during locomotion. The proposed framework is deployed on a Unitree Go1 quadruped to demonstrate blind online slip detection over a slippery terrain. Our method detects early-stage slips down to an average displacement of 24.1 +/-6.4mm with an overall accuracy of 85.9%. This represents a 3.3-fold finer detection resolution and a 24% relative accuracy improvement over a standard kinematic baseline that uses foot velocity inferred through state estimation. The work in this paper serves as a foundation for force-aware gait adaptation in legged robotic locomotion, allowing future controllers to estimate terrain friction and adjust constraints, thus improving the overall stability of the system.

Related papers

• SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection [15.908150948122573]
  SlipSense is a multimodal slip-detection framework built on TacV5.<n>The framework performs modality-specific encoding, intra-sensor fusion, and cross-modal attention with causal temporal prediction at 240 Hz.<n>When trained solely on UMI data, SlipSense generalizes zero-shot to a Tesollo dexterous hand, transferring across unseen objects, distinct sensor units, and robotic platforms without retraining.
  arXiv  Detail & Related papers  (2026-09-14T17:23:59Z)
• Robust Slip Detection and Material Classification via Spatiotemporal Transformers on a Uniformly-Illuminated Visuo-Tactile Sensor [52.33204893988409]
  We propose a visuo-tactile sensor featuring customized uniform illumination, alongside a unified perception framework.<n>The proposed hardware-software framework provides high-fidelity feedback and a powerful multi-modal perception baseline for complex robotic manipulation.
  arXiv  Detail & Related papers  (2026-08-25T07:25:27Z)
• From swept contact to pose: Probe-aware registration via complementary-shape docking [41.01931030228033]
  Contact registration is essential for high-precision robotic manipulation.<n>We propose a calibration-free alternative that reformulates contact registration as complementary-shape docking.<n>Our solver integrates a global-to-local search via 3D FFT correlation over low-discrepancy SO(3) samples.
  arXiv  Detail & Related papers  (2026-05-20T16:56:39Z)
• Contact Status Recognition and Slip Detection with a Bio-inspired Tactile Hand [0.7850663096185592]
  Slip detection and timely prevention are necessary for a robot in unstructured and universal environments.<n>In this work, we addressed this issue by utilizing multimodal tactile feedback from a five-fingered bio-inspired hand.
  arXiv  Detail & Related papers  (2026-03-19T00:12:27Z)
• Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control [46.47619556874003]
  We propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning policy for legged locomotion.<n>The admittance controller maps external wrenches--such as those applied by a human during physical interaction--into desired end-effector velocities, allowing for compliant behavior.<n>We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
  arXiv  Detail & Related papers  (2026-03-02T22:31:12Z)
• Axle Sensor Fusion for Online Continual Wheel Fault Detection in Wayside Railway Monitoring [1.1199585259018456]
  This work presents a semantic-aware, label-efficient continual learning framework for railway fault diagnostics.<n>The model detects minor imperfections due to flats and polygonization, while adapting to evolving operational conditions.
  arXiv  Detail & Related papers  (2026-02-18T00:14:18Z)
• Estimating Scene Flow in Robot Surroundings with Distributed Miniaturized Time-of-Flight Sensors [41.45395153490076]
  We present an approach for scene flow estimation from low-density and noisy point clouds acquired from Time of Flight (ToF) sensors distributed on the robot body.<n>The proposed method clusters points from consecutive frames and applies Iterative Closest Point (ICP) to estimate a dense motion flow.<n>We employ a fitness-based classification to distinguish between stationary and moving points and an inlier removal strategy to refine geometric correspondences.
  arXiv  Detail & Related papers  (2025-04-03T09:57:51Z)
• Leveraging distributed contact force measurements for slip detection: a physics-based approach enabled by a data-driven tactile sensor [5.027571997864706]
  This paper describes a novel model-based slip detection pipeline that can predict possibly failing grasps in real-time. A vision-based tactile sensor that accurately estimates distributed forces was integrated into a grasping setup composed of a six degrees-of-freedom cobot and a two-finger gripper. Results show that the system can reliably predict slip while manipulating objects of different shapes, materials, and weights.
  arXiv  Detail & Related papers  (2021-09-23T17:12:46Z)
• Bandit Quickest Changepoint Detection [55.855465482260165]
  Continuous monitoring of every sensor can be expensive due to resource constraints. We derive an information-theoretic lower bound on the detection delay for a general class of finitely parameterized probability distributions. We propose a computationally efficient online sensing scheme, which seamlessly balances the need for exploration of different sensing options with exploitation of querying informative actions.
  arXiv  Detail & Related papers  (2021-07-22T07:25:35Z)
• VILENS: Visual, Inertial, Lidar, and Leg Odometry for All-Terrain Legged Robots [5.789654849162465]
  We present visual inertial lidar legged navigation system (VILENS) for legged robots. The key novelty is the tight fusion of four different sensor modalities to achieve reliable operation. We show an average improvement of 62% translational and 51% rotational errors compared to a state-of-the-art loosely coupled approach.
  arXiv  Detail & Related papers  (2021-07-15T11:05:00Z)
• Accurate Alignment Inspection System for Low-resolution Automotive and Mobility LiDAR [125.41260574344933]
  An accurate inspection system is proposed for estimating a LiDAR alignment error after sensor attachment on a mobility system such as a vehicle or robot. The proposed method uses only a single target board at the fixed position to estimate the three orientations (roll, tilt, and yaw) and the horizontal position of the LiDAR attachment with sub-degree and millimeter level accuracy.
  arXiv  Detail & Related papers  (2020-08-24T17:47:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.