Physics Models for Sim-to-Real Transfer in Professional-Level Robot Table Tennis
- URL: http://arxiv.org/abs/2606.28805v2
- Date: Wed, 01 Jul 2026 02:30:35 GMT
- Title: Physics Models for Sim-to-Real Transfer in Professional-Level Robot Table Tennis
- Abstract summary: In table tennis, a ball follows complex, counterintuitive trajectories that a robot must track and precisely counter within fractions of a second.<n>Training a reinforcement learning policy capable of these skills is prohibitively expensive and dangerous in the real world.<n>We present physics models for aerodynamic ball flight, ball-table contact, and ball-racket contact that accurately capture the ball behavior over a vast range of speeds and spins relevant to the game.
- Score: 40.32087961270485
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: At competitive speeds and spins, a table tennis ball follows complex, counterintuitive trajectories that a robot must track and precisely counter within fractions of a second. Training a reinforcement learning policy capable of these skills is prohibitively expensive and dangerous in the real world, making high-fidelity simulation essential. Transferability of such policies, however, critically depends on how faithfully the simulation captures real-world dynamics - a requirement made even more stringent by the adversarial nature of the game, where any modeling inaccuracy becomes an exploitable weakness for the opponent. Prior state-of-the-art in robot table tennis generally focuses on a limited range of velocities and spins and fails to capture the richness of ball behaviors encountered in professional-level play. In this work, we present physics models for aerodynamic ball flight, ball-table contact, and ball-racket contact. that accurately capture the ball behavior over a vast range of speeds and spins relevant to the game. Specifically, we model drag and Magnus force coefficients as functions of Reynolds number and spin ratio in the aerodynamics equations. For the table contact model we model effects of ball buckling on the coefficient of restitution and incorporate residuals into the instantaneous point-contact models. For the racket contact model, we introduce a residual neural network component to complement coefficients related to normal and tangential coefficients of restitution as well as torsional spin damping. Evaluated on an unprecedentedly large dataset of competitive matches (277 games), the proposed models significantly reduces prediction errors (e.g., 59% median landing-position error reduction). The resulting models were used to train the RL policies for the first real-world robot table tennis AI agent capable of competing against professional players.
Related papers
- Hardware Design for Table Tennis Robot Capable of Beating Professional Players [32.40740138722726]
This paper focuses on the hardware specifications required for a table tennis robot to beat professional players.<n>After analyzing the motions of elite players, we defined target specifications for the workspace, payload, external-force resistance, physical performance, serve capability, and end-effector accuracy.<n>Based on these specifications, we developed "Ace", a custom 8-DoF robot.
arXiv Detail & Related papers (2026-06-25T06:14:03Z) - Learning Racket-Ball Bounce Dynamics Across Diverse Rubbers for Robotic Table Tennis [5.245633032900991]
We present a unified framework for modeling ball-racket interactions across 10 racket configurations.<n>We collect a dataset of racket-ball bounces spanning a broad range of incident velocities and spins.<n>Our approach reduces post-impact velocity and spin prediction errors across all racket types, with the largest improvements observed for nonstandard rubbers.
arXiv Detail & Related papers (2026-04-13T11:47:10Z) - Sim-to-Real Transfer for Muscle-Actuated Robots via Generalized Actuator Networks [53.12548325396181]
Tendon drives paired with soft muscle actuation enable faster and safer robots.<n>We propose a sim-to-real pipeline that learns a neural network model of this complex actuation.<n>We successfully deploy precise goal-reaching and dynamic ball-in-a-cup policies trained entirely in simulation.
arXiv Detail & Related papers (2026-04-10T16:52:54Z) - Learning Human-Like Badminton Skills for Humanoid Robots [25.27775061243493]
We propose a progressive reinforcement learning framework designed to evolve a robot from a "mimic" to a capable "striker"<n>Our approach establishes a robust motor prior from human data, distills it into a compact, model-based state representation, and stabilizes dynamics via adversarial priors.<n>We validate our framework through the mastery of diverse skills, including lifts and drop shots, in simulation.
arXiv Detail & Related papers (2026-02-09T08:09:52Z) - Deterministic Reconstruction of Tennis Serve Mechanics: From Aerodynamic Constraints to Internal Torques via Rigid-Body Dynamics [0.0]
This paper proposes a physics-based approach to the tennis serve using a 12-degree-of-freedom multi-segment model of the human upper body.<n>By elucidating the dissociation between visible kinematics and internal kinetics, this study provides a first-principles framework for understanding the mechanics of the tennis serve.
arXiv Detail & Related papers (2025-12-20T11:32:40Z) - RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking [50.200035833530876]
RobotDancing is a simple, scalable framework that predicts residual joint targets to explicitly correct dynamics discrepancies.<n>It can track multi-minute, high-energy behaviors (jumps, spins, cartwheels) and deploys zero-shot to hardware with high motion tracking quality.
arXiv Detail & Related papers (2025-09-25T03:30:34Z) - Physical Autoregressive Model for Robotic Manipulation without Action Pretraining [65.8971623698511]
We build upon autoregressive video generation models to propose a Physical Autoregressive Model (PAR)<n>PAR leverages the world knowledge embedded in video pretraining to understand physical dynamics without requiring action pretraining.<n>Experiments on the ManiSkill benchmark show that PAR achieves a 100% success rate on the PushCube task.
arXiv Detail & Related papers (2025-08-13T13:54:51Z) - Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation [88.83749146867665]
Existing approaches learn a policy to predict a distant next-best end-effector pose.<n>They then compute the corresponding joint rotation angles for motion using inverse kinematics.<n>We propose Kinematics enhanced Spatial-TemporAl gRaph diffuser.
arXiv Detail & Related papers (2025-03-13T17:48:35Z) - Learning-based adaption of robotic friction models [50.72489248401199]
We introduce a novel approach to adapt an existing friction model to new dynamics using as little data as possible.<n>Our method does not rely on data with external load during training, eliminating the need for external torque sensors.
arXiv Detail & Related papers (2023-10-25T14:50:15Z) - Black-Box vs. Gray-Box: A Case Study on Learning Table Tennis Ball
Trajectory Prediction with Spin and Impacts [12.103456313315764]
We present a method for table tennis ball trajectory filtering and prediction.
We use data to learn parameters of the dynamics model, of an extended Kalman filter, and of a neural model that infers the ball's initial condition.
arXiv Detail & Related papers (2023-05-24T14:28:22Z) - Real-to-Sim: Predicting Residual Errors of Robotic Systems with Sparse
Data using a Learning-based Unscented Kalman Filter [65.93205328894608]
We learn the residual errors between a dynamic and/or simulator model and the real robot.
We show that with the learned residual errors, we can further close the reality gap between dynamic models, simulations, and actual hardware.
arXiv Detail & Related papers (2022-09-07T15:15:12Z) - Hierarchical Reinforcement Learning for Precise Soccer Shooting Skills
using a Quadrupedal Robot [76.04391023228081]
We address the problem of enabling quadrupedal robots to perform precise shooting skills in the real world using reinforcement learning.
We propose a hierarchical framework that leverages deep reinforcement learning to train a robust motion control policy.
We deploy the proposed framework on an A1 quadrupedal robot and enable it to accurately shoot the ball to random targets in the real world.
arXiv Detail & Related papers (2022-08-01T22:34:51Z) - Learning to Play Table Tennis From Scratch using Muscular Robots [34.34824536814943]
This work is the first to (a) fail-safe learn of a safety-critical dynamic task using anthropomorphic robot arms, (b) learn a precision-demanding problem with a PAM-driven system, and (c) train robots to play table tennis without real balls.
Videos and datasets are available at muscularTT.embodied.ml.
arXiv Detail & Related papers (2020-06-10T16:43:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.