stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation

• URL: http://arxiv.org/abs/2605.21800v1
• Date: Wed, 20 May 2026 22:58:15 GMT
• Title: stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation
• Abstract summary: We present stable-worldmodel (swm), an open-source platform for standardized and reproducible world modeling research and evaluation.<n>It delivers (1) a high-performance Lance-based data layer with native support and conversion tools for MP4, HDF5, and LeRobot datasets, (2) clean, well-tested implementations of modern world model baselines and planning solvers, and (3) a broad suite of environments and tasks extended with controllable visual, geometric, and physical factors of variation.
• Score: 42.196526861319775
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: World models are central to building agents that can reason, plan, and generalize beyond their training data. However, research on world models is currently fragmented, with disparate codebases, data pipelines, and evaluation protocols hindering reproducibility and fair comparison. Current practice is further limited by three key bottlenecks: fragile one-off codebases, slow video data loading, and the lack of standardized generalization benchmarks. We present stable-worldmodel (swm), an open-source platform for standardized and reproducible world modeling research and evaluation. It delivers (1) a high-performance Lance-based data layer with native support and conversion tools for MP4, HDF5, and LeRobot datasets, (2) clean, well-tested implementations of modern world model baselines and planning solvers, and (3) a broad suite of environments and tasks extended with controllable visual, geometric, and physical factors of variation for systematic in-silico evaluation of dynamics understanding, control performance, representation quality, and out-of-distribution generalization. By unifying the full pipeline under a single, scalable framework, \texttt{swm} dramatically reduces research overhead and accelerates trustworthy progress toward reliable world models.

Related papers

• Reduced-Order Models: The Mother of World Models [0.12062777974093623]
  World models are compressed latent representations of an environment that support action-conditioned prediction and planning.<n>This paper argues that the functional anatomy of a world model was independently developed, deployed, and analyzed decades earlier.<n>We argue that the outstanding obstacle to deploying world models in systems that cannot fail is not predictive fidelity but verifiability.
  arXiv  Detail & Related papers  (2026-07-03T11:05:06Z)
• WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform [130.8118909583659]
  We introduce WorldArena 2.0, an expanded benchmark for embodied world model evaluation.<n>WorldArena 2.0 systematically broadens embodied world model evaluation along three dimensions: modality, functionality, and platform.<n>Under a standardized protocol, WorldArena 2.0 comprehensively evaluates perceptual quality, interactive utility, and cross-platform performance.
  arXiv  Detail & Related papers  (2026-05-18T06:18:21Z)
• ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation [66.02142169323521]
  Vision-Language-Action models and world models have recently emerged as promising paradigms for general-purpose robotic intelligence.<n>Existing benchmarks are largely simulator-centric, which provide controllability but fail to capture the reality gap caused by perception noise.<n>We introduce ManipArena, a standardized evaluation framework designed to bridge simulation and real-world execution.
  arXiv  Detail & Related papers  (2026-03-30T15:06:41Z)
• stable-worldmodel-v1: Reproducible World Modeling Research and Evaluation [46.55784222514516]
  We introduce stable-worldmodel (SWM), a modular, tested, and documented world-model research ecosystem.<n>SWM provides efficient data-collection tools, standardized environments, planning algorithms, and baseline implementations.<n>We demonstrate the utility of SWM by using it to study zero-shot robustness in DINO-WM.
  arXiv  Detail & Related papers  (2026-02-09T18:04:22Z)
• Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback [51.22403664895878]
  Agent2World is a tool-augmented multi-agent framework that achieves strong inference-time world-model generation.<n>It also serves as a data engine for supervised fine-tuning, by grounding generation in multi-agent feedback.
  arXiv  Detail & Related papers  (2025-12-26T18:54:14Z)
• WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World [100.68103378427567]
  Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally.<n>We introduce WorldLens, a full-spectrum benchmark evaluating how well a model builds, understands, and behaves within its generated world.<n>We further construct WorldLens-26K, a large-scale dataset of human-annotated videos with numerical scores and textual rationales, and develop WorldLens-Agent.
  arXiv  Detail & Related papers  (2025-12-11T18:59:58Z)
• A Comprehensive Survey on World Models for Embodied AI [14.457261562275121]
  Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states.<n>This survey presents a unified framework for world models in embodied AI.
  arXiv  Detail & Related papers  (2025-10-19T07:12:32Z)
• Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCereal [25.756741188074862]
  This paper presents a structured approach to integrate geospatial foundation models into operational mapping systems.<n>Our protocol has three key steps: defining application requirements, adapting the model to domain-specific data and conducting rigorous empirical testing.<n>Results highlight the model's strong spatial and temporal generalization capabilities.
  arXiv  Detail & Related papers  (2025-07-16T15:10:32Z)
• AI in a vat: Fundamental limits of efficient world modelling for agent sandboxing and interpretability [84.52205243353761]
  Recent work proposes using world models to generate controlled virtual environments in which AI agents can be tested before deployment.<n>We investigate ways of simplifying world models that remain agnostic to the AI agent under evaluation.
  arXiv  Detail & Related papers  (2025-04-06T20:35:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.