Vision-Based Dribbling for Humanoid Soccer via Privileged Representation Learning

• URL: http://arxiv.org/abs/2607.12702v1
• Date: Tue, 14 Jul 2026 12:27:58 GMT
• Title: Vision-Based Dribbling for Humanoid Soccer via Privileged Representation Learning
• Abstract summary: Dribbling a soccer ball while evading active opponents requires simultaneous balance, precise ball control, and awareness of a dynamic adversary under onboard sensing and real-time constraints.<n>We propose an integrated approach in which a temporal depth encoder is embedded into a reinforcement learning policy through a task-specific projection layer.<n>We apply this framework to a simulated Booster T1 humanoid robot and show that it is possible to learn vision-based, opponent-aware dribbling directly from depth observations.
• Score: 2.1866669929322837
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent advances in humanoid robotics have highlighted the importance of deployable loco-manipulation skills. Dribbling a soccer ball while evading active opponents requires simultaneous balance, precise ball control, and awareness of a dynamic adversary under onboard sensing and real-time constraints. Existing approaches typically separate perception and motion, which can be effective in controlled settings but may fail under occlusions, fast ball movements, and complex opponent interactions, since perception is not directly optimized for control. We propose an integrated approach in which a temporal depth encoder is embedded into a reinforcement learning policy through a task-specific projection layer. We apply this framework to a simulated Booster T1 humanoid robot and show that it is possible to learn vision-based, opponent-aware dribbling directly from depth observations, without explicit state estimation or privileged scene information. The learned policy achieves 100% success in nominal target-driven dribbling and 96% success with a single static obstacle, while reaching 46% success against an actively moving ball-attacker opponent. These results demonstrate that the proposed framework supports robust vision-based dribbling in nominal and moderately dynamic settings, and provides a strong foundation for handling more challenging moving-adversary scenarios.

Related papers

• Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking [78.30338456206984]
  We introduce a novel framework for training general-purpose 3D foothold-tracking policies.<n>By dynamically providing footstep support through a goal sampler, this method enables the learned policy to be agnostic to specific terrains.<n>Our new target representation effectively mitigates challenges arising in the real world, such as noisy and inaccurate pose estimation and foot contact estimation.
  arXiv  Detail & Related papers  (2026-06-06T16:44:56Z)
• SMASH: Mastering Scalable Whole-Body Skills for Humanoid Ping-Pong with Egocentric Vision [53.709632118234936]
  Methodname is a modular system for agile humanoid table tennis.<n>It unifies scalable whole-body skill learning with onboard egocentric perception.<n>We demonstrate the first humanoid table-tennis system capable of consecutive strikes using onboard sensing alone.
  arXiv  Detail & Related papers  (2026-04-01T17:11:52Z)
• CyboRacket: A Perception-to-Action Framework for Humanoid Racket Sports [12.562008425243578]
  CyboRacket is a hierarchical perception-to-action framework for humanoid racket sports.<n>It integrates onboard visual perception, physics-based trajectory prediction, and large-scale pre-trained whole-body control.<n>We present results in a vision-based humanoid tennis-hitting task.
  arXiv  Detail & Related papers  (2026-03-15T21:01:14Z)
• Learning Soccer Skills for Humanoid Robots: A Progressive Perception-Action Framework [50.6604971348824]
  Soccer presents a significant challenge for humanoid robots, demanding tightly integrated perception-action capabilities.<n>We propose Perception-Action integrated Decision-making (PAiD), a progressive architecture that decomposes soccer skill acquisition into three stages.<n> Experiments on the Unitree G1 demonstrate high-fidelity human-like kicking with robust performance under diverse conditions.
  arXiv  Detail & Related papers  (2026-02-05T05:05:03Z)
• Learning Agile Striker Skills for Humanoid Soccer Robots from Noisy Sensory Input [28.158114356214863]
  This paper presents a reinforcement learning-based system that enables humanoid robots to execute robust continual ball-kicking.<n>The system extends a typical teacher-student training framework.<n>Key design elements are critical for closing the sim-to-real gap and sustaining performance under perceptual uncertainty.
  arXiv  Detail & Related papers  (2025-12-06T21:27:50Z)
• Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration [58.4036440289082]
  Hand-object motion-capture (MoCap) offer large-scale, contact-rich demonstrations and hold promise for dexterous robotic scopes.<n>We introduce Dexplore, a unified single-loop optimization that performs repositories and tracking to learn robot control policies directly from MoCap at scale.
  arXiv  Detail & Related papers  (2025-09-11T17:59:07Z)
• KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skills [58.73043119128804]
  This paper presents a physics-based humanoid control framework, aiming to master highly-dynamic human behaviors such as Kungfu and dancing.<n>For motion processing, we design a pipeline to extract, filter out, correct, and retarget motions, while ensuring compliance with physical constraints.<n>For motion imitation, we formulate a bi-level optimization problem to dynamically adjust the tracking accuracy tolerance.<n>In experiments, we train whole-body control policies to imitate a set of highly-dynamic motions.
  arXiv  Detail & Related papers  (2025-06-15T13:58:53Z)
• Learning coordinated badminton skills for legged manipulators [12.514822343998908]
  We introduce an approach for enabling legged mobile manipulators to play badminton.<n>We propose a unified reinforcement learning-based control policy for whole-body visuomotor skills.<n>Our method includes a shuttlecock prediction model, constrained reinforcement learning for robust motion control, and integrated system identification techniques.
  arXiv  Detail & Related papers  (2025-05-29T01:26:30Z)
• Open-World Drone Active Tracking with Goal-Centered Rewards [62.21394499788672]
  Drone Visual Active Tracking aims to autonomously follow a target object by controlling the motion system based on visual observations.<n>We propose DAT, the first open-world drone active air-to-ground tracking benchmark.<n>We also propose GC-VAT, which aims to improve the performance of drone tracking targets in complex scenarios.
  arXiv  Detail & Related papers  (2024-12-01T09:37:46Z)
• DexDribbler: Learning Dexterous Soccer Manipulation via Dynamic Supervision [26.9579556496875]
  Joint manipulation of moving objects and locomotion with legs, such as playing soccer, receive scant attention in the learning community. We propose a feedback control block to compute the necessary body-level movement accurately and using the outputs as dynamic joint-level locomotion supervision. We observe that our learning scheme can not only make the policy network converge faster but also enable soccer robots to perform sophisticated maneuvers.
  arXiv  Detail & Related papers  (2024-03-21T11:16:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.