Bicycle Acrobatics with Reinforcement Learning

• URL: http://arxiv.org/abs/2608.00880v1
• Date: Sat, 01 Aug 2026 21:54:40 GMT
• Title: Bicycle Acrobatics with Reinforcement Learning
• Abstract summary: We use Reinforcement Learning to enable a bicycle robot to learn and compose a diverse repertoire of dynamic acrobatic stunts.<n>The robot acquires autonomous single and multi-table forward and lateral jumps, steerable jumps, front flips, kip-ups, kip-downs, driving, wheelies, bunny hops, and three-point turns.<n>We validate the approach on the Ultra Mobility Vehicle (UMV), a custom bicycle robot, in simulation and hardware.
• Score: 3.1700350168889018
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Bicycle robots are fast and energy efficient, but their simple mechanical design and their underactuated and non-holonomic dynamics make highly agile maneuvers difficult to achieve. Here, we use Reinforcement Learning (RL) to enable a bicycle robot to learn and compose a diverse repertoire of dynamic acrobatic stunts. Using different RL formulations such as waypoint following, pose reaching, twist tracking, guided tracking, and motion imitation, the robot acquires autonomous single and multi-table forward and lateral jumps, steerable jumps, front flips, kip-ups, kip-downs, driving, wheelies, bunny hops, and three-point turns. To coordinate these behaviors, we introduce an orchestrator that transitions between policies using state-dependent triggers, enabling robust long-horizon acrobatic stunts. We validate the approach on the Ultra Mobility Vehicle (UMV), a custom bicycle robot, in simulation and hardware. The robot repeatedly traverses tables up to 1 m high, performs more than 15 consecutive autonomous jumps while following waypoints, handles previously unseen multi-table configurations, executes continuous repertoires of kipups, jumps, flips, kip-downs, over more than 20 consecutive trials, and performs more than 10 consecutive autonomous and steerable repertoires of wheelies, lateral jumps, and single-wheel jump downs. These results demonstrate that RL can endow bicycle robots with levels of agility previously associated primarily with legged platforms while preserving the speed and efficiency of wheeled locomotion, establishing a foundation for bicycle acrobatics.

Related papers

• Control Design for a Rideable Animatronic Two-Wheeled Robot with Quadruped Form [0.0]
  We develop a rideable two-wheeled robot equipped with four limbs as a future partner mobility concept.<n>The character reproduced by this robot carries the protagonist on its back and exhibits a dynamic quadrupedal gait.<n>We focus on a robust selfbalancing control method that maintains stability even during rapid limb movements.
  arXiv  Detail & Related papers  (2026-07-14T04:22:39Z)
• Reinforcement Learning-Based Control for an Inline Skating Humanoid Robot [10.006591553493807]
  We train and deploy a reinforcement learning control policy that enables novel locomotion strategies for a humanoid robot modified to equip consumer inline skates instead of conventional feet.<n>Our skating strategies emerge entirely from our reward structure, without reliance on human motion data, imitation learning, or kinematic priors.<n>Our policy demonstrates up to a 50% reduction in Cost of Transport compared to standard walking gaits.
  arXiv  Detail & Related papers  (2026-06-30T15:25:06Z)
• System Design of the Ultra Mobility Vehicle: A Driving, Balancing, and Jumping Bicycle Robot [20.113840669330596]
  Trials cyclists and mountain bike riders can hop, jump, balance, and drive on one or both wheels.<n>This 23.5 kg robot is capable of high speeds and jumping on and over large obstacles.
  arXiv  Detail & Related papers  (2026-02-25T17:05:09Z)
• Jumping Control for a Quadrupedal Wheeled-Legged Robot via NMPC and DE Optimization [14.88101223616473]
  Quadrupedal wheeled-legged robots combine the advantages of legged and wheeled locomotion to achieve superior mobility.<n> executing dynamic jumps remains a significant challenge due to the additional degrees of freedom introduced by wheeled legs.<n>This paper develops a mini-sized wheeled-legged robot for agile motion and presents a novel motion control framework.
  arXiv  Detail & Related papers  (2026-02-25T06:13:59Z)
• Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
  We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-02-17T18:59:11Z)
• Humanoid Whole-Body Locomotion on Narrow Terrain via Dynamic Balance and Reinforcement Learning [54.26816599309778]
  We propose a novel whole-body locomotion algorithm based on dynamic balance and Reinforcement Learning (RL)<n> Specifically, we introduce a dynamic balance mechanism by leveraging an extended measure of Zero-Moment Point (ZMP)-driven rewards and task-driven rewards in a whole-body actor-critic framework.<n> Experiments conducted on a full-sized Unitree H1-2 robot verify the ability of our method to maintain balance on extremely narrow terrains.
  arXiv  Detail & Related papers  (2025-02-24T14:53:45Z)
• Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [106.32794844077534]
  This paper presents a study on using deep reinforcement learning to create dynamic locomotion controllers for bipedal robots. We develop a general control solution that can be used for a range of dynamic bipedal skills, from periodic walking and running to aperiodic jumping and standing. This work pushes the limits of agility for bipedal robots through extensive real-world experiments.
  arXiv  Detail & Related papers  (2024-01-30T10:48:43Z)
• Robot Parkour Learning [70.56172796132368]
  Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly. We develop a reinforcement learning method inspired by direct collocation to generate parkour skills. We distill these skills into a single vision-based parkour policy and transfer it to a quadrupedal robot using its egocentric depth camera.
  arXiv  Detail & Related papers  (2023-09-11T17:59:17Z)
• Barkour: Benchmarking Animal-level Agility with Quadruped Robots [70.97471756305463]
  We introduce the Barkour benchmark, an obstacle course to quantify agility for legged robots. Inspired by dog agility competitions, it consists of diverse obstacles and a time based scoring mechanism. We present two methods for tackling the benchmark.
  arXiv  Detail & Related papers  (2023-05-24T02:49:43Z)
• Robust and Versatile Bipedal Jumping Control through Reinforcement Learning [141.56016556936865]
  This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a robot to accomplish a large variety of jumping tasks, such as jumping to different locations and directions. We develop a new policy structure that encodes the robot's long-term input/output (I/O) history while also providing direct access to a short-term I/O history.
  arXiv  Detail & Related papers  (2023-02-19T01:06:09Z)
• Advanced Skills through Multiple Adversarial Motion Priors in Reinforcement Learning [10.445369597014533]
  We present an approach to augment the concept of adversarial motion prior-based reinforcement learning. We show that multiple styles and skills can be learned simultaneously without notable performance differences. Our approach is validated in several real-world experiments with a wheeled-legged quadruped robot.
  arXiv  Detail & Related papers  (2022-03-23T09:24:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.