Towards Torque-Driven Reinforcement Learning for Quadruped Locomotion

• URL: http://arxiv.org/abs/2607.18365v1
• Date: Mon, 20 Jul 2026 16:35:53 GMT
• Title: Towards Torque-Driven Reinforcement Learning for Quadruped Locomotion
• Abstract summary: This paper explores an RL torque control framework for heavyweight high-torque quadrupeds.<n>Using Nvidia's Isaac Sim and Isaac Lab, simulation results of the RL torque control policy are shown on the Unitree B1 quadruped.<n>The quadruped can walk up and down stairs without the aid of an exteroceptive sensor.
• Score: 0.3867363075280543
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Reinforcement learning (RL) for legged robots is advancing locomotion, demonstrating its ability to adapt to new and challenging terrain. Traditionally, these RL locomotion frameworks are position-based, making the policy less adaptable to terrain types and requiring state estimation techniques in the observation space, i.e., linear velocity. Moreover, these RL frameworks often use small, lightweight quadrupeds that are limited in their viability for high-complexity tasks due to hardware constraints. This work explores an RL torque control framework for heavyweight high-torque quadrupeds. The RL framework in this paper can traverse rough terrain and effectively track a desired linear velocity without requiring knowledge of the agent's current velocity. Using Nvidia's Isaac Sim and Isaac Lab, simulation results of the RL torque control policy are shown on the Unitree B1 quadruped, achieving speeds of 3.5 m/s and 1.5 rad/s. In addition, the quadruped can walk up and down stairs without the aid of an exteroceptive sensor.

Related papers

• Extending the Speed Limit of Quadrupedal Locomotion via Refined Actuator Modeling and Adaptive Command Scheduling [0.9298381080776307]
  We propose a high-speed locomotion framework that reduces sim-to-real discrepancies and stabilizes learning over a wide command distribution.<n>A refined actuator model explicitly captures high-speed voltage coupling and magnetic saturation, enabling a more accurate representation of the torque-speed envelope.<n>Experiments on the 36.5 kg quadruped BlackPanther2 demonstrate speeds of up to 13.2 m/s on a treadmill and 11.65 m/s outdoors, establishing a new state-of-the-art and, to the best of our knowledge, a world record for quadrupedal robot locomotion.
  arXiv  Detail & Related papers  (2026-09-09T08:45:38Z)
• Isaac Sim-to-Real: Reinforcement Learning based Locomotion for Quadrupeds [0.3867363075280543]
  This work presents a robust RL locomotion framework capable of whole-body control.<n>The proposed framework utilizes Nvidia's new set of simulation tools, Isaac Sim, and its companion RL framework, Isaac Lab, for training, achieving a zero-shot sim-to-real policy.<n>The performance of our policy is validated on physical hardware using the Unitree Go1, with experimental results showing similar velocity tracking performance to the quadruped's integrated controller.
  arXiv  Detail & Related papers  (2026-07-20T16:27:56Z)
• RPL: Learning Robust Humanoid Perceptive Locomotion on Challenging Terrains [53.674116167774095]
  We propose a two-stage training framework that enables multi-directional locomotion on challenging terrains.<n>RPL first trains expert policies with privileged height map observations to master decoupled locomotion and manipulation skills.<n>We then distill them into a transformer policy that leverages multiple depth cameras to cover a wide range of views.<n>For scalable depth distillation, we develop an efficient multi-depth system that ray-casts against both dynamic robot meshes and static terrain meshes.
  arXiv  Detail & Related papers  (2026-02-03T02:17:08Z)
• Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction [86.53248703859718]
  We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy.<n>Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings.
  arXiv  Detail & Related papers  (2025-12-08T11:42:41Z)
• Impedance Matching: Enabling an RL-Based Running Jump in a Quadruped Robot [7.516046071926082]
  We propose a new framework to mitigate the gap between simulated and real robots. Our framework offers a structured guideline for parameter selection and the range for dynamics randomization in simulation. Results are, to the best of our knowledge, one of the highest and longest running jumps demonstrated by an RL-based control policy in a real quadruped robot.
  arXiv  Detail & Related papers  (2024-04-23T14:52:09Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Learning and Adapting Agile Locomotion Skills by Transferring Experience [71.8926510772552]
  We propose a framework for training complex robotic skills by transferring experience from existing controllers to jumpstart learning new tasks. We show that our method enables learning complex agile jumping behaviors, navigating to goal locations while walking on hind legs, and adapting to new environments.
  arXiv  Detail & Related papers  (2023-04-19T17:37:54Z)
• Learning a Single Near-hover Position Controller for Vastly Different Quadcopters [56.37274861303324]
  This paper proposes an adaptive near-hover position controller for quadcopters. It can be deployed to quadcopters of very different mass, size and motor constants. It also shows rapid adaptation to unknown disturbances during runtime.
  arXiv  Detail & Related papers  (2022-09-19T17:55:05Z)
• Learning Torque Control for Quadrupedal Locomotion [22.415419916292187]
  This paper introduces a learning torque control framework for quadrupedal locomotion. It trains an RL policy that directly predicts joint torques at a high frequency, thus circumventing the use of PD controllers. To our knowledge, this is the first attempt of learning torque control for quadrupedal locomotion with an end-to-end single neural network.
  arXiv  Detail & Related papers  (2022-03-10T07:09:05Z)
• GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model [18.66472547798549]
  We show how model-free reinforcement learning can be effectively used with a centroidal model to generate robust control policies for quadrupedal locomotion. We show the potential of the method by demonstrating stepping-stone locomotion, two-legged in-place balance, balance beam locomotion, and sim-to-real transfer without further adaptations.
  arXiv  Detail & Related papers  (2021-04-20T05:55:13Z)
• Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots [121.42930679076574]
  We present a model-free reinforcement learning framework for training robust locomotion policies in simulation. domain randomization is used to encourage the policies to learn behaviors that are robust across variations in system dynamics. We demonstrate this on versatile walking behaviors such as tracking a target walking velocity, walking height, and turning yaw.
  arXiv  Detail & Related papers  (2021-03-26T07:14:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.