Solving Physics Olympiad via Reinforcement Learning on Physics Simulators

• URL: http://arxiv.org/abs/2604.11805v1
• Date: Mon, 13 Apr 2026 17:59:40 GMT
• Title: Solving Physics Olympiad via Reinforcement Learning on Physics Simulators
• Abstract summary: We show that physics simulators can serve as a powerful alternative source of supervision for training LLMs for physical reasoning.<n>Our models exhibit zero-shot sim-to-real transfer to real-world physics benchmarks.
• Score: 44.60747141807886
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We have witnessed remarkable advances in LLM reasoning capabilities with the advent of DeepSeek-R1. However, much of this progress has been fueled by the abundance of internet question-answer (QA) pairs, a major bottleneck going forward, since such data is limited in scale and concentrated mainly in domains like mathematics. In contrast, other sciences such as physics lack large-scale QA datasets to effectively train reasoning-capable models. In this work, we show that physics simulators can serve as a powerful alternative source of supervision for training LLMs for physical reasoning. We generate random scenes in physics engines, create synthetic question-answer pairs from simulated interactions, and train LLMs using reinforcement learning on this synthetic data. Our models exhibit zero-shot sim-to-real transfer to real-world physics benchmarks: for example, training solely on synthetic simulated data improves performance on IPhO (International Physics Olympiad) problems by 5-10 percentage points across model sizes. These results demonstrate that physics simulators can act as scalable data generators, enabling LLMs to acquire deep physical reasoning skills beyond the limitations of internet-scale QA data. Code available at: https://sim2reason.github.io/.

Related papers

• NewtPhys: Do Foundation Models Understand Newtonian Physics? [25.906063461629504]
  Previous work has evaluated physics reasoning in foundation models using synthetic or semi-synthetic scenes.<n>NewtPhys is a 4D physically annotated dataset built from multiview images of real-world scenes with physics-grounded simulations.
  arXiv  Detail & Related papers  (2026-06-02T17:59:12Z)
• GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training [86.70824679370524]
  We present GeoPT, a unified pre-trained model for general physics simulation based on lifted geometric pre-training.<n>The core idea is to augment geometry with synthetic dynamics, enabling dynamics-aware self-supervision without physics labels.
  arXiv  Detail & Related papers  (2026-02-23T22:32:08Z)
• SimuScene: Training and Benchmarking Code Generation to Simulate Physical Scenarios [71.65387146697319]
  Large language models (LLMs) have been extensively studied for tasks like math competitions, complex coding, and scientific reasoning.<n>We propose SimuScene, the first systematic study that trains and evaluates LLMs on simulating physical scenarios.<n>We build an automatic pipeline to collect data, with human verification to ensure quality.
  arXiv  Detail & Related papers  (2026-02-11T13:26:02Z)
• SIMPACT: Simulation-Enabled Action Planning using Vision-Language Models [60.80050275581661]
  Vision-Language Models (VLMs) exhibit remarkable common-sense and semantic reasoning capabilities.<n>They lack a grounded understanding of physical dynamics.<n>We present S, a test-time, SIMulation-enabled ACTion Planning framework.<n>Our method demonstrates state-of-the-art performance on five challenging, real-world rigid-body and deformable manipulation tasks.
  arXiv  Detail & Related papers  (2025-12-05T18:51:03Z)
• PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis [52.905353023326306]
  We propose PhysWorld, a framework that synthesizes physically plausible and diverse demonstrations to learn efficient world models.<n>Experiments show that PhysWorld has competitive performance while enabling inference speeds 47 times faster than the recent state-of-the-art method, i.e., PhysTwin.
  arXiv  Detail & Related papers  (2025-10-24T13:25:39Z)
• PhysiX: A Foundation Model for Physics Simulations [27.359872113159405]
  We introduce PhysiX, the first large-scale foundation model for physics simulation.<n>We show that PhysiX effectively addresses the data bottleneck, outperforming task-specific baselines.<n>Our results indicate that knowledge learned from natural videos can be successfully transferred to physics simulation.
  arXiv  Detail & Related papers  (2025-06-21T18:10:12Z)
• Scaling Physical Reasoning with the PHYSICS Dataset [39.960500815534836]
  PHYSICS is a dataset containing 16,568 high-quality physics problems spanning subjects and difficulty levels.<n>It covers five major physics domains: Mechanics, Electromagnetism, Thermodynamics, Optics, and Modern Physics.<n>It also spans a wide range of difficulty levels, from high school to graduate-level physics courses.
  arXiv  Detail & Related papers  (2025-05-21T17:06:28Z)
• DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors [75.83647027123119]
  We propose to learn the physical properties of a material field with video diffusion priors.<n>We then utilize a physics-based Material-Point-Method simulator to generate 4D content with realistic motions.
  arXiv  Detail & Related papers  (2024-06-03T16:05:25Z)
• Physics simulation capabilities of LLMs [0.0]
  Large Language Models (LLMs) can solve some undergraduate-level to graduate-level physics textbook problems and are proficient at coding. We present an evaluation of state-of-the-art (SOTA) LLMs on PhD-level to research-level computational physics problems.
  arXiv  Detail & Related papers  (2023-12-04T18:06:41Z)
• Data-Efficient Learning for Complex and Real-Time Physical Problem Solving using Augmented Simulation [49.631034790080406]
  We present a task for navigating a marble to the center of a circular maze. We present a model that learns to move a marble in the complex environment within minutes of interacting with the real system.
  arXiv  Detail & Related papers  (2020-11-14T02:03:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.