Proprioceptive External Torque Learning for Floating Base Robot and its Applications to Humanoid Locomotion

• URL: http://arxiv.org/abs/2309.04138v1
• Date: Fri, 8 Sep 2023 05:33:56 GMT
• Title: Proprioceptive External Torque Learning for Floating Base Robot and its Applications to Humanoid Locomotion
• Abstract summary: This paper introduces a method for learning external joint torque solely using proprioceptive sensors (encoders and IMUs) for a floating base robot. Real robot experiments demonstrate that the network can estimate the external torque and contact wrench with significantly smaller errors. The study also validates that the estimated contact wrench can be utilized for zero moment point (ZMP) feedback control.
• Score: 17.384713355349476
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The estimation of external joint torque and contact wrench is essential for achieving stable locomotion of humanoids and safety-oriented robots. Although the contact wrench on the foot of humanoids can be measured using a force-torque sensor (FTS), FTS increases the cost, inertia, complexity, and failure possibility of the system. This paper introduces a method for learning external joint torque solely using proprioceptive sensors (encoders and IMUs) for a floating base robot. For learning, the GRU network is used and random walking data is collected. Real robot experiments demonstrate that the network can estimate the external torque and contact wrench with significantly smaller errors compared to the model-based method, momentum observer (MOB) with friction modeling. The study also validates that the estimated contact wrench can be utilized for zero moment point (ZMP) feedback control, enabling stable walking. Moreover, even when the robot's feet and the inertia of the upper body are changed, the trained network shows consistent performance with a model-based calibration. This result demonstrates the possibility of removing FTS on the robot, which reduces the disadvantages of hardware sensors. The summary video is available at https://youtu.be/gT1D4tOiKpo.

Related papers

• Scalable Open-Source Visuotactile Sensor for 6-Axis Contact Wrench Estimation in Tensegrity Robots [6.030441869707218]
  This paper presents a scalable, open-source visuotactile sensing system for tensegrity robots.<n>The proposed endcap sensor integrates an elastomeric shell, a 3D-printed thermoplastic polyurethane interface, and a rigid base housing an embedded camera and LED illumination ring.<n>A tactile-to-wrench neural network maps shear vector fields to six-dimensional force and torque measurements.
  arXiv  Detail & Related papers  (2026-07-17T05:21:06Z)
• Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation [17.63466252699545]
  Human-like dexterous hands offer human-level manipulation capabilities but remain difficult to train the control policies that can deploy on real hardware.<n>We present a sim-to-real reinforcement learning method that leverages dense tactile feedback combined with joint torque sensing.<n>This is the first demonstration of controllable grasping on a multi-finger dexterous hand trained entirely in simulation and transferred zero-shot on real hardware.
  arXiv  Detail & Related papers  (2026-07-06T11:15:36Z)
• FACTR 2: Learning External Force Sensing for Commodity Robot Arms Improves Policy Learning [54.93624123794711]
  Contact-rich manipulation requires force sensitivity, but many robot arms lack dedicated force sensors due to their high cost.<n>We present Neural External Torque Estimation (torque), a data-driven method that estimates external joint torques without needing any dedicated force sensors.<n>Next enables force-aware teleoperation on low-cost arms and improves policy learning through Force-Informed Re-Sampling Training.
  arXiv  Detail & Related papers  (2026-06-10T17:59:35Z)
• Sim-to-Real Transfer for Muscle-Actuated Robots via Generalized Actuator Networks [53.12548325396181]
  Tendon drives paired with soft muscle actuation enable faster and safer robots.<n>We propose a sim-to-real pipeline that learns a neural network model of this complex actuation.<n>We successfully deploy precise goal-reaching and dynamic ball-in-a-cup policies trained entirely in simulation.
  arXiv  Detail & Related papers  (2026-04-10T16:52:54Z)
• Safe Whole-Body Loco-Manipulation via Combined Model and Learning-based Control [46.47619556874003]
  We propose a whole-body controller that combines a model-based admittance control for the manipulator arm with a Reinforcement Learning policy for legged locomotion.<n>The admittance controller maps external wrenches--such as those applied by a human during physical interaction--into desired end-effector velocities, allowing for compliant behavior.<n>We validate our approach in both simulation and hardware using the Unitree Go2 quadruped robot with a 6-DoF arm and wrist-mounted 6-DoF Force/Torque sensor.
  arXiv  Detail & Related papers  (2026-03-02T22:31:12Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation [12.509181374985936]
  Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities.<n>But training control policies that can directly deploy on real hardware remains difficult due to contact-rich physics.<n>We present a practical framework that utilizes dense tactile feedback combined with joint torque sensing to regulate physical interactions.
  arXiv  Detail & Related papers  (2026-01-06T07:26:39Z)
• Enhancing Tactile-based Reinforcement Learning for Robotic Control [32.565866574593635]
  We develop self-supervised learning (SSL) methodologies to more effectively harness tactile observations.<n>We empirically demonstrate that sparse binary tactile signals are critical for dexterity.<n>We release the Robot Tactile Olympiad (RoTO) benchmark to standardise and promote future research in tactile-based manipulation.
  arXiv  Detail & Related papers  (2025-10-24T16:15:05Z)
• Robot-R1: Reinforcement Learning for Enhanced Embodied Reasoning in Robotics [55.05920313034645]
  We introduce Robot-R1, a novel framework that leverages reinforcement learning to enhance embodied reasoning specifically for robot control.<n>Inspired by the DeepSeek-R1 learning approach, Robot-R1 samples reasoning-based responses and reinforces those that lead to more accurate predictions.<n>Our experiments show that models trained with Robot-R1 outperform SFT methods on embodied reasoning tasks.
  arXiv  Detail & Related papers  (2025-05-29T16:41:12Z)
• Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation [50.34179054785646]
  We present Taccel, a high-performance simulation platform that integrates IPC and ABD to model robots, tactile sensors, and objects with both accuracy and unprecedented speed. Taccel provides precise physics simulation and realistic tactile signals while supporting flexible robot-sensor configurations through user-friendly APIs. These capabilities position Taccel as a powerful tool for scaling up tactile robotics research and development.
  arXiv  Detail & Related papers  (2025-04-17T12:57:11Z)
• LPAC: Learnable Perception-Action-Communication Loops with Applications to Coverage Control [80.86089324742024]
  We propose a learnable Perception-Action-Communication (LPAC) architecture for the problem. CNN processes localized perception; a graph neural network (GNN) facilitates robot communications. Evaluations show that the LPAC models outperform standard decentralized and centralized coverage control algorithms.
  arXiv  Detail & Related papers  (2024-01-10T00:08:00Z)
• Learning-based adaption of robotic friction models [48.453527255659296]
  We introduce a novel approach to adapt an existing friction model to new dynamics using as little data as possible. Our proposed estimator outperforms the conventional model-based approach and the base neural network significantly. Our method does not rely on data with external load during training, eliminating the need for external torque sensors.
  arXiv  Detail & Related papers  (2023-10-25T14:50:15Z)
• Robot Learning with Sensorimotor Pre-training [98.7755895548928]
  We present a self-supervised sensorimotor pre-training approach for robotics. Our model, called RPT, is a Transformer that operates on sequences of sensorimotor tokens. We find that sensorimotor pre-training consistently outperforms training from scratch, has favorable scaling properties, and enables transfer across different tasks, environments, and robots.
  arXiv  Detail & Related papers  (2023-06-16T17:58:10Z)
• Fine Robotic Manipulation without Force/Torque Sensor [9.908082209033612]
  A typical 6-axis Force/Torque (F/T) sensor is mounted between the robot's wrist and the end-effector in order to measure the forces exerted by the environment onto the robot (the external wrench) Although a typical 6-axis F/T sensor can provide highly accurate measurements, it is expensive and vulnerable to drift and external impacts. Existing methods aiming at estimating the external wrench using only the robot's internal signals are limited in scope. We present a Neural Network based method and argue that by devoting particular attention to the training data structure, it is possible to accurately estimate the
  arXiv  Detail & Related papers  (2023-01-31T05:06:04Z)
• 6N-DoF Pose Tracking for Tensegrity Robots [5.398092221687385]
  Tensegrity robots are composed of rigid compressive elements (rods) and flexible tensile elements (e.g., cables) This work aims to address the pose tracking of tensegrity robots through a markerless, vision-based method. An iterative optimization process is proposed to estimate the 6-DoF poses of each rigid element of a tensegrity robot from an RGB-D video.
  arXiv  Detail & Related papers  (2022-05-29T20:55:29Z)
• Model Predictive Control for Fluid Human-to-Robot Handovers [50.72520769938633]
  Planning motions that take human comfort into account is not a part of the human-robot handover process. We propose to generate smooth motions via an efficient model-predictive control framework. We conduct human-to-robot handover experiments on a diverse set of objects with several users.
  arXiv  Detail & Related papers  (2022-03-31T23:08:20Z)
• Training Robots without Robots: Deep Imitation Learning for Master-to-Robot Policy Transfer [4.318590074766604]
  Deep imitation learning is promising for robot manipulation because it only requires demonstration samples. Existing demonstration methods have deficiencies; bilateral teleoperation requires a complex control scheme and is expensive. This research proposes a new master-to-robot (M2R) policy transfer system that does not require robots for teaching force feedback-based manipulation tasks.
  arXiv  Detail & Related papers  (2022-02-19T10:55:10Z)
• Online Body Schema Adaptation through Cost-Sensitive Active Learning [63.84207660737483]
  The work was implemented in a simulation environment, using the 7DoF arm of the iCub robot simulator. A cost-sensitive active learning approach is used to select optimal joint configurations. The results show cost-sensitive active learning has similar accuracy to the standard active learning approach, while reducing in about half the executed movement.
  arXiv  Detail & Related papers  (2021-01-26T16:01:02Z)
• DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation [16.54834671357377]
  General purpose in-hand manipulation remains one of the unsolved challenges of robotics. We introduce DIGIT, an inexpensive, compact, and high-resolution tactile sensor geared towards in-hand manipulation.
  arXiv  Detail & Related papers  (2020-05-29T17:07:54Z)
• Populations of Spiking Neurons for Reservoir Computing: Closed Loop Control of a Compliant Quadruped [64.64924554743982]
  We present a framework for implementing central pattern generators with spiking neural networks to obtain closed loop robot control. We demonstrate the learning of predefined gait patterns, speed control and gait transition on a simulated model of a compliant quadrupedal robot.
  arXiv  Detail & Related papers  (2020-04-09T14:32:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.