AlayaWorld: Long-Horizon and Playable Video World Generation
- URL: http://arxiv.org/abs/2607.06291v1
- Date: Tue, 07 Jul 2026 13:59:57 GMT
- Title: AlayaWorld: Long-Horizon and Playable Video World Generation
- Abstract summary: We present textbfAlayaWorld, a full-stack open-source framework for building interactive generative worlds.<n>AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning.
- Score: 36.52656377442462
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Game worlds have traditionally been built through labor-intensive production pipelines, making them costly to develop, difficult to customization, and expensive to modify after deployment. Recent advances in video world models offer a fundamentally different paradigm. Rather than explicitly authoring every component of a virtual environment, these models autoregressively synthesize future observations conditioned on the current world state and user interactions, enabling playable worlds to be generated online. Trained on both gameplay recordings and real-world videos, they can capture diverse visual appearances and physical dynamics, opening new opportunities for interactive applications beyond gaming, including embodied intelligence. In this paper, we present \textbf{AlayaWorld}, a full-stack open-source framework for building interactive generative worlds. AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning. The framework unifies the complete development-from data preparation model architecture, model training, inference acceleration, and deployment-within a modular and extensible architecture. Alongside the framework, we release reproducible pipelines, reference implementations, evaluation tools, and comprehensive documentation, establishing a practical foundation for future research and real-time applications of generative world models.
Related papers
- Code World Model: Coding Agent as World Brain [51.31807545747191]
We introduce Code World Model, a framework that separates world evolution from visual realization.<n>A coding agent serves as the world brain, reasoning about events and their consequences.<n>To connect executable state with visual generation, we introduce a proxy representation that encodes frame-wisetemporal constraints into a proxy video.
arXiv Detail & Related papers (2026-08-26T15:37:33Z) - AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report [39.20781986625199]
AlayaWorld is an interactive long-horizon video world model that generates 24-fps video at 540p and 720p.<n>Built on a 15B video diffusion transformer, AlayaWorld generates short latent chunks autoregressively under camera trajectories.<n>On iWorld-Bench, AlayaWorld achieves the best performance over long-horizon generation.
arXiv Detail & Related papers (2026-07-20T17:15:41Z) - OpenWorldLib: A Unified Codebase and Definition of Advanced World Models [69.28080690708092]
We introduce OpenWorldLib, a comprehensive and standardized inference framework for Advanced World Models.<n>We propose a clear definition: a world model is a model or framework centered on perception, equipped with interaction and long-term memory capabilities, for understanding and predicting the complex world.<n>Based on this definition, OpenWorldLib integrates models across different tasks within a unified framework, enabling efficient reuse and collaborative inference.
arXiv Detail & Related papers (2026-04-06T14:19:48Z) - MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines [55.641812280108574]
We introduce an explicit external memory into the system that is continually updated by user actions and queried throughout the generation roll-out.<n>This design gives users direct, editable control over environment structure via an editable memory representation.<n>It naturally extends to real-time multiplayer rollouts with coherent viewpoints and consistent cross-player interactions.
arXiv Detail & Related papers (2026-03-03T18:58:17Z) - Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model [19.937724706042804]
Hunyuan-GameCraft-2 is a new paradigm of instruction-driven interaction for generative game world modeling.<n>Our model allows users to control game video contents through natural language prompts, keyboard, or mouse signals.<n>Our model generates temporally coherent and causally grounded interactive game videos.
arXiv Detail & Related papers (2025-11-28T18:26:39Z) - WorldGen: From Text to Traversable and Interactive 3D Worlds [87.95088818329403]
We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts.<n>Our approach transforms natural language descriptions into fully textured environments that can be immediately explored or edited within standard game engines.<n>This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
arXiv Detail & Related papers (2025-11-20T22:13:18Z) - Simulating the Visual World with Artificial Intelligence: A Roadmap [48.64639618440864]
Video generation is shifting from generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility.<n>This survey provides a systematic overview of this evolution, conceptualizing modern video foundation models as the combination of two core components.<n>We trace the progression of video generation through four generations, culminating in a video generation model that embodies intrinsic physical plausibility.
arXiv Detail & Related papers (2025-11-11T18:59:50Z) - LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation [35.4193352348583]
We propose a simple yet effective 3D world generation framework that streamlines the industrial production pipeline of 3D environments.<n>LatticeWorld creates large-scale 3D interactive worlds with dynamic agents, featuring competitive multi-agent interaction.<n>LatticeWorld achieves over a $90times$ increase in industrial production efficiency.
arXiv Detail & Related papers (2025-09-05T17:22:33Z) - Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model [15.16063778402193]
Matrix-Game 2.0 is an interactive world model generates long videos on-the-fly via few-step auto-regressive diffusion.<n>It can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS.
arXiv Detail & Related papers (2025-08-18T15:28:53Z) - WorldDreamer: Towards General World Models for Video Generation via
Predicting Masked Tokens [75.02160668328425]
We introduce WorldDreamer, a pioneering world model to foster a comprehensive comprehension of general world physics and motions.
WorldDreamer frames world modeling as an unsupervised visual sequence modeling challenge.
Our experiments show that WorldDreamer excels in generating videos across different scenarios, including natural scenes and driving environments.
arXiv Detail & Related papers (2024-01-18T14:01:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.