Cooperative Long Rope Skipping via Multi-Agent Reinforcement Learning

• URL: http://arxiv.org/abs/2606.08064v1
• Date: Sat, 06 Jun 2026 09:01:18 GMT
• Title: Cooperative Long Rope Skipping via Multi-Agent Reinforcement Learning
• Abstract summary: Long rope skipping requires two rope turners to cooperatively swing the rope while adapting to a player under different jumping rhythms.<n>We propose Marope, a multi-agent reinforcement learning framework for cooperative long rope skipping with multiple humanoid robots.<n>We evaluate our approach on Unitree G1 humanoid robots in both simulation and real-world settings.
• Score: 24.141546090585162
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Humans exhibit remarkable motor agility, enabling a wide range of dynamic skills such as running and jumping, which highlights the great potential of humanoid robots for athletic locomotion. Among athletic sports, long rope skipping requires two rope turners to cooperatively swing the rope while adapting to a player under different jumping rhythms, making it a meaningful yet challenging task for humanoid robots. Although existing methods for humanoid sports have achieved success in single-agent and interaction-free settings, such as running, dancing, and parkour, task scenarios that require precise coordination among multiple participants remain largely unexplored. To this end, we propose Marope, a multi-agent reinforcement learning (MARL) framework for cooperative long rope skipping with multiple humanoid robots. Specifically, Marope adopts a hierarchical reinforcement learning framework for policy training. At the lower level, it learns decentralized rope manipulation policies through MARL, while at the upper level, a centralized scheduling policy is trained to coordinate the execution of the lower-level policies. To improve generalization across different player behavioral styles, Marope further incorporates diverse jumping policies into cooperative game training. We evaluate our approach on Unitree G1 humanoid robots in both simulation and real-world settings. Experimental results demonstrate that Marope outperforms various baselines, achieving more efficient and stable rope manipulation as well as more robust and adaptable cooperation with varied players.

Related papers

• LadderMan: Learning Humanoid Perceptive Ladder Climbing [56.550077812088404]
  We present textbfLadderMan, a unified system that enables humanoid robots to robustly climb diverse ladders.<n>Our climbing policy is built on a scalable two-stage learning pipeline, where we use hybrid motion tracking to learn multiple climbing experts.<n>We further train a separate manipulation policy using a dual-agent formulation, allowing stable on-ladder manipulation via teleoperation.
  arXiv  Detail & Related papers  (2026-06-04T08:47:08Z)
• Superhuman Safe and Agile Racing through Multi-Agent Reinforcement Learning [22.65712097455206]
  We show that multi-agent reinforcement learning provides the safety scaffolding required for real-world interaction.<n>We train agents to navigate complex aerodynamic interactions and strategic maneuvering with a variable number of racers.<n>Our agents outperform reducing collision rates by 50 % compared to state-of-the-art single-agent baselines.
  arXiv  Detail & Related papers  (2026-05-21T17:15:54Z)
• Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching [77.28042137892943]
  We present Perceptive Humanoid Parkour (PHP), a modular framework that enables humanoid robots to autonomously perform long-horizon, vision-based parkour.<n>We train motion-tracking reinforcement learning expert policies for these composed motions, and distill them into a single depth-based, multi-skill student policy.<n>We validate our framework with extensive real-world experiments on a Unitree G1 humanoid robot.
  arXiv  Detail & Related papers  (2026-02-17T18:59:11Z)
• Toward Real-World Cooperative and Competitive Soccer with Quadrupedal Robot Teams [18.20205072720915]
  We present a hierarchical multi-agent reinforcement learning (MARL) framework that enables fully autonomous and decentralized quadruped robot soccer.<n>First, a set of highly dynamic low-level skills is trained for legged locomotion and ball manipulation, such as walking, dribbling, and kicking.<n>On top of these, a high-level strategic planning policy is trained with Multi-Agent Proximal Policy Optimization (MAPPO) via Fictitious Self-Play.
  arXiv  Detail & Related papers  (2025-05-20T02:20:54Z)
• Robot Parkour Learning [70.56172796132368]
  Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly. We develop a reinforcement learning method inspired by direct collocation to generate parkour skills. We distill these skills into a single vision-based parkour policy and transfer it to a quadrupedal robot using its egocentric depth camera.
  arXiv  Detail & Related papers  (2023-09-11T17:59:17Z)
• Barkour: Benchmarking Animal-level Agility with Quadruped Robots [70.97471756305463]
  We introduce the Barkour benchmark, an obstacle course to quantify agility for legged robots. Inspired by dog agility competitions, it consists of diverse obstacles and a time based scoring mechanism. We present two methods for tackling the benchmark.
  arXiv  Detail & Related papers  (2023-05-24T02:49:43Z)
• Robust and Versatile Bipedal Jumping Control through Reinforcement Learning [141.56016556936865]
  This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a robot to accomplish a large variety of jumping tasks, such as jumping to different locations and directions. We develop a new policy structure that encodes the robot's long-term input/output (I/O) history while also providing direct access to a short-term I/O history.
  arXiv  Detail & Related papers  (2023-02-19T01:06:09Z)
• From Motor Control to Team Play in Simulated Humanoid Football [56.86144022071756]
  We train teams of physically simulated humanoid avatars to play football in a realistic virtual environment. In a sequence of stages, players first learn to control a fully articulated body to perform realistic, human-like movements. They then acquire mid-level football skills such as dribbling and shooting. Finally, they develop awareness of others and play as a team, bridging the gap between low-level motor control at a timescale of milliseconds.
  arXiv  Detail & Related papers  (2021-05-25T20:17:10Z)
• Two-stage training algorithm for AI robot soccer [2.0757564643017092]
  Two-stage heterogeneous centralized training is proposed to improve the learning performance of heterogeneous agents. The proposed method is applied to 5 versus 5 AI robot soccer for validation.
  arXiv  Detail & Related papers  (2021-04-13T04:24:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.