MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines

• URL: http://arxiv.org/abs/2603.06679v1
• Date: Tue, 03 Mar 2026 18:58:17 GMT
• Title: MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Engines
• Abstract summary: We introduce an explicit external memory into the system that is continually updated by user actions and queried throughout the generation roll-out.<n>This design gives users direct, editable control over environment structure via an editable memory representation.<n>It naturally extends to real-time multiplayer rollouts with coherent viewpoints and consistent cross-player interactions.
• Score: 55.641812280108574
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Video world models have shown immense promise for interactive simulation and entertainment, but current systems still struggle with two important aspects of interactivity: user control over the environment for reproducible, editable experiences, and shared inference where players hold influence over a common world. To address these limitations, we introduce an explicit external memory into the system, a persistent state operating independent of the model's context window, that is continually updated by user actions and queried throughout the generation roll-out. Unlike conventional diffusion game engines that operate as next-frame predictors, our approach decomposes generation into Memory, Observation, and Dynamics modules. This design gives users direct, editable control over environment structure via an editable memory representation, and it naturally extends to real-time multiplayer rollouts with coherent viewpoints and consistent cross-player interactions.

Related papers

• Programmable World Model [37.43654073749753]
  We introduce Programmable World Model, a framework that decouples world-state evolution from visual observation generation.<n>An agent translates natural-language instructions into executable programs that specify entity states and state-transition rules.<n>A lightweight engine executes these programs to update and maintain an explicit, persistent global world state.
  arXiv  Detail & Related papers  (2026-09-09T17:59:32Z)
• EchoWM: Open and Enterable Omnimodal World Models [71.49148067556887]
  EchoWM is an omnimodal world model for enterable generative media.<n>It responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech.
  arXiv  Detail & Related papers  (2026-08-24T12:39:59Z)
• From Pixels to States: Rethinking Interactive World Models as Game Engines [32.66997200688335]
  This paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation.<n>We present a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay with frame-aligned player actions, ground-truth game states, and visual observations.
  arXiv  Detail & Related papers  (2026-07-15T17:48:48Z)
• Infinite Worlds with Versatile Interactions [72.56254206708059]
  LingBot-World 2.0 (also known as LingBot-World-Infinity) is an advanced iteration of LingBot-World.<n>This update introduces highly diverse interactive elements, comprising a broader spectrum of actions.<n>To facilitate a shared experience, we develop an interface that permits multiple players to simultaneously immerse themselves in this vivid world simulator.
  arXiv  Detail & Related papers  (2026-07-08T15:33:25Z)
• AlayaWorld: Long-Horizon and Playable Video World Generation [36.52656377442462]
  We present textbfAlayaWorld, a full-stack open-source framework for building interactive generative worlds.<n>AlayaWorld enables open-ended real-time interaction, allowing users to freely navigate and perform diverse actions such as combat, spell casting, and monster summoning.
  arXiv  Detail & Related papers  (2026-07-07T13:59:57Z)
• ActionParty: Multi-Subject Action Binding in Generative Video Games [117.52562594944679]
  ActionParty is a controllable multi-subject world model for generative video games.<n>We demonstrate the first video world model capable of controlling up to seven players simultaneously across 46 diverse environments.
  arXiv  Detail & Related papers  (2026-04-02T17:59:58Z)
• Animate Any Character in Any World [61.112404900403284]
  We introduce AniX, leveraging the realism and structural grounding of static world generation.<n>Users can provide a 3DGS scene and a character, then direct the character through natural language to perform diverse behaviors.<n>AiX synthesizes temporally coherent video clips that preserve visual fidelity with the provided scene and character.
  arXiv  Detail & Related papers  (2025-12-18T18:59:18Z)
• Astra: General Interactive World Model with Autoregressive Denoising [73.6594791733982]
  Astra is an interactive general world model that generates real-world futures for diverse scenarios.<n>We propose an autoregressive denoising architecture and use temporal causal attention to aggregate past observations.<n>Astra achieves interactive, consistent, and general long-term video prediction and supports various forms of interactions.
  arXiv  Detail & Related papers  (2025-12-09T18:59:57Z)
• Hunyuan-GameCraft-2: Instruction-following Interactive Game World Model [19.937724706042804]
  Hunyuan-GameCraft-2 is a new paradigm of instruction-driven interaction for generative game world modeling.<n>Our model allows users to control game video contents through natural language prompts, keyboard, or mouse signals.<n>Our model generates temporally coherent and causally grounded interactive game videos.
  arXiv  Detail & Related papers  (2025-11-28T18:26:39Z)
• Amorphous Fortress Online: Collaboratively Designing Open-Ended Multi-Agent AI and Game Environments [1.8802008255570535]
  Amorphous Fortress Online is a web-based platform where users can design petri-dish-like environments and games consisting of multi-agent AI characters.<n>Users can play, create, and share artificial life and game environments made up of microscopic but transparent finite-state machine agents.
  arXiv  Detail & Related papers  (2025-02-08T16:25:52Z)
• Large Model Empowered Metaverse: State-of-the-Art, Challenges and Opportunities [28.81101395387858]
  The Metaverse is an immersive, persistent digital ecosystem where users can interact, socialize, and work within 3D virtual environments.<n>This paper investigates the integration of large models within the Metaverse.<n>We propose a generative AI-based framework for optimizing Metaverse rendering.
  arXiv  Detail & Related papers  (2025-01-18T13:52:48Z)
• The Matrix: Infinite-Horizon World Generation with Real-Time Moving Control [16.075784652681172]
  We present The Matrix, the first foundational realistic world simulator capable of generating continuous 720p real-scene video streams.<n>The Matrix allows users to traverse diverse terrains in continuous, uncut hour-long sequences.<n>The Matrix can simulate a BMW X3 driving through an office setting--an environment present in neither gaming data nor real-world sources.
  arXiv  Detail & Related papers  (2024-12-04T18:59:05Z)
• Unbounded: A Generative Infinite Game of Character Life Simulation [68.37260000219479]
  We introduce the concept of a generative infinite game, a video game that transcends the traditional boundaries of finite, hard-coded systems by using generative models. We leverage recent advances in generative AI to create Unbounded: a game of character life simulation that is fully encapsulated in generative models.
  arXiv  Detail & Related papers  (2024-10-24T17:59:31Z)
• LARP: Language-Agent Role Play for Open-World Games [19.80040627487576]
  Language Agent for Role-Playing (LARP) is a cognitive architecture that encompasses memory processing and a decision-making assistant. The framework refines interactions between users and agents, predefined with unique backgrounds and personalities. It highlights the diverse uses of language models in a range of areas such as entertainment, education, and various simulation scenarios.
  arXiv  Detail & Related papers  (2023-12-24T10:08:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.