90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development

• URL: http://arxiv.org/abs/2509.26161v1
• Date: Tue, 30 Sep 2025 12:14:56 GMT
• Title: 90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development
• Authors: Runxin Yang, Yuxuan Wan, Shuqing Li, Michael R. Lyu,
• Abstract summary: This paper introduces UniGen, the first end-to-end coordinated multi-agent framework that automates zero-coding development of runnable 3D games from natural language requirements.<n>Results demonstrate that UniGen not only democratizes game creation by requiring no coding from the user, but also reduces development time by 91.4%.
• Score: 35.877919141619614
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Developing 3D games requires specialized expertise across multiple domains, including programming, 3D modeling, and engine configuration, which limits access to millions of potential creators. Recently, researchers have begun to explore automated game development. However, existing approaches face three primary challenges: (1) limited scope to 2D content generation or isolated code snippets; (2) requirement for manual integration of generated components into game engines; and (3) poor performance on handling interactive game logic and state management. While Multimodal Large Language Models (MLLMs) demonstrate potential capabilities to ease the game generation task, a critical gap still remains in translating these outputs into production-ready, executable game projects based on game engines such as Unity and Unreal Engine. To bridge the gap, this paper introduces UniGen, the first end-to-end coordinated multi-agent framework that automates zero-coding development of runnable 3D games from natural language requirements. Specifically, UniGen uses a Planning Agent that interprets user requirements into structured blueprints and engineered logic descriptions; after which a Generation Agent produces executable C# scripts; then an Automation Agent handles engine-specific component binding and scene construction; and lastly a Debugging Agent provides real-time error correction through conversational interaction. We evaluated UniGen on three distinct game prototypes. Results demonstrate that UniGen not only democratizes game creation by requiring no coding from the user, but also reduces development time by 91.4%. We release UniGen at https://github.com/yxwan123/UniGen. A video demonstration is available at https://www.youtube.com/watch?v=xyJjFfnxUx0.

Related papers

• NitroGen: An Open Foundation Model for Generalist Gaming Agents [101.41866522979548]
  NitroGen is a vision-action foundation model for generalist gaming agents.<n>It is trained on 40,000 hours of gameplay videos across more than 1,000 games.
  arXiv  Detail & Related papers  (2026-01-04T16:24:50Z)
• WorldGen: From Text to Traversable and Interactive 3D Worlds [87.95088818329403]
  We introduce WorldGen, a system that enables the automatic creation of large-scale, interactive 3D worlds directly from text prompts.<n>Our approach transforms natural language descriptions into fully textured environments that can be immediately explored or edited within standard game engines.<n>This work represents a step towards accessible, generative world-building at scale, advancing the frontier of 3D generative AI for applications in gaming, simulation, and immersive social environments.
  arXiv  Detail & Related papers  (2025-11-20T22:13:18Z)
• Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generation [85.68100076594197]
  Hunyuan3D Studio is an end-to-end AI-powered content creation platform designed to revolutionize the game production pipeline.<n>At its core, Hunyuan3D Studio integrates a suite of advanced neural modules into a cohesive and user-friendly system.
  arXiv  Detail & Related papers  (2025-09-16T08:33:03Z)
• ScriptDoctor: Automatic Generation of PuzzleScript Games via Large Language Models and Tree Search [3.608541939158718]
  ScriptDoctor is a Large Language Model-driven system for automatically generating and testing games in PuzzleScript.<n>It generates and tests game design ideas in an iterative loop, where human-authored examples are used to ground the system's output.<n>It serves as a concrete example of the potential of automated, open-ended LLM-based in generating novel game content.
  arXiv  Detail & Related papers  (2025-06-06T20:40:19Z)
• Position: Interactive Generative Video as Next-Generation Game Engine [32.7449148483466]
  We propose Interactive Generative Video (IGV) as the foundation for Generative Game Engines (GGE)<n>IGV's unique strengths include unlimited high-quality content synthesis, physics-aware world modeling, user-controlled interactivity, long-term memory capabilities, and causal reasoning.<n>Our work charts a new course for game development in the AI era, envisioning a future where AI-powered generative systems fundamentally reshape how games are created and experienced.
  arXiv  Detail & Related papers  (2025-03-21T17:59:22Z)
• Cardiverse: Harnessing LLMs for Novel Card Game Prototyping [9.029874576285085]
  Card games require extensive human effort in creative ideation and gameplay evaluation.<n>Recent advances in Large Language Models offer opportunities to automate these processes.<n>This paper introduces a comprehensive automated card game prototyping framework.
  arXiv  Detail & Related papers  (2025-02-10T23:47:35Z)
• Playable Game Generation [22.17100581717806]
  We propose emphPlayGen, which encompasses game data generation, an autoregressive DiT-based diffusion model, and a playability-based evaluation framework.<n>PlayGen achieves real-time interaction, ensures sufficient visual quality, and provides accurate interactive mechanics simulation.
  arXiv  Detail & Related papers  (2024-12-01T16:53:02Z)
• Open Role-Playing with Delta-Engines [50.86533710515017]
  We propose a new style of game-play to bridge self-expression and role-playing: emphopen role-playing games (ORPGs)<n>Our vision is that, in the real world, we are individually similar when we are born, but we grow into unique ones as a result of the strongly different choices we make afterward.<n>In an ORPG, we empower players with freedom to decide their own growing curves through natural language inputs, ultimately becoming unique characters.
  arXiv  Detail & Related papers  (2024-08-11T18:32:29Z)
• Instruction-Driven Game Engines on Large Language Models [59.280666591243154]
  The IDGE project aims to democratize game development by enabling a large language model to follow free-form game rules. We train the IDGE in a curriculum manner that progressively increases the model's exposure to complex scenarios. Our initial progress lies in developing an IDGE for Poker, a universally cherished card game.
  arXiv  Detail & Related papers  (2024-03-30T08:02:16Z)
• Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion Models [68.85478477006178]
  We present a Promptable Game Model (PGM) for neural video game simulators. It allows a user to play the game by prompting it with high- and low-level action sequences. Most captivatingly, our PGM unlocks the director's mode, where the game is played by specifying goals for the agents in the form of a prompt. Our method significantly outperforms existing neural video game simulators in terms of rendering quality and unlocks applications beyond the capabilities of the current state of the art.
  arXiv  Detail & Related papers  (2023-03-23T17:43:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.