Cutscene Agent: An LLM Agent Framework for Automated 3D Cutscene Generation

• URL: http://arxiv.org/abs/2604.25318v1
• Date: Tue, 28 Apr 2026 07:28:14 GMT
• Title: Cutscene Agent: An LLM Agent Framework for Automated 3D Cutscene Generation
• Abstract summary: Cutscene Agent is an agent framework for automated end-to-end cutscene generation.<n>The framework makes three contributions:.<n>a Cutscene Toolkit built on the Model Context Protocol (MCP) that establishes.<n>emphbidirectional integration between LLM agents and the game engine.<n>a director agent orchestrates specialist subagents for animation, cinematography, and sound design, augmented by a visual reasoning feedback loop for perception-driven refinement.
• Score: 13.671638376402377
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Cutscenes are carefully choreographed cinematic sequences embedded in video games and interactive media, serving as the primary vehicle for narrative delivery, character development, and emotional engagement. Producing cutscenes is inherently complex: it demands seamless coordination across screenwriting, cinematography, character animation, voice acting, and technical direction, often requiring days to weeks of collaborative effort from multidisciplinary teams to produce minutes of polished content. In this work, we present Cutscene Agent, an LLM agent framework for automated end-to-end cutscene generation. The framework makes three contributions: (1)~a Cutscene Toolkit built on the Model Context Protocol (MCP) that establishes \emph{bidirectional} integration between LLM agents and the game engine -- agents not only invoke engine operations but continuously observe real-time scene state, enabling closed-loop generation of editable engine-native cinematic assets; (2)~a multi-agent system where a director agent orchestrates specialist subagents for animation, cinematography, and sound design, augmented by a visual reasoning feedback loop for perception-driven refinement; and (3)~CutsceneBench, a hierarchical evaluation benchmark for cutscene generation. Unlike typical tool-use benchmarks that evaluate short, isolated function calls, cutscene generation requires long-horizon, multi-step orchestration of dozens of interdependent tool invocations with strict ordering constraints -- a capability dimension that existing benchmarks do not cover. We evaluate a range of LLMs on CutsceneBench and analyze their performance across this challenging task.

Related papers

• Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation [53.27387848819395]
  Long-form narrative-to-film generation requires shot-level controllability and cross-clip consistency.<n>We introduce a structured orchestration layer for film-oriented script-to-video generation.
  arXiv  Detail & Related papers  (2026-09-07T16:33:14Z)
• ViMax: Agentic Video Generation [55.546794487716646]
  Long-form video generation requires systematic narrative planning and visual consistency.<n>Our framework employs a hierarchical narrative engine with retrieval-augmented generation for global story coherence.<n>VLM-guided agents continuously monitor and refine both narrative coherence and visual fidelity.
  arXiv  Detail & Related papers  (2026-06-02T12:55:41Z)
• One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems [17.754369892506542]
  One Sentence, One Drama is a hierarchical multi-agent framework that transforms a user's single-sentence idea into a fully produced short drama.<n>Our approach is built upon three key components: (1) a multi-agent debate-based story generation module that enforces short-drama pacing and narrative coherence; (2) a 3D-grounded first-frame generation mechanism that establishes a shared spatial reference for consistent character positioning and scene layout across clips; and (3) multi-stage reviewer loops that perform comprehensive error detection and targeted revision across script, visual, and video generation stages.
  arXiv  Detail & Related papers  (2026-05-21T08:15:46Z)
• Agentic Video Generation: From Text to Executable Event Graphs via Tool-Constrained LLM Planning [4.964902130083661]
  Existing multi-agent video generation systems use LLM agents to orchestrate neural video generators.<n>We present an agentic system that inverts this paradigm, constructing a formal Graph of Events in Space and Time.<n>A programmatic state backend enforces all simulator constraints through validated tool calls, guaranteeing that every generated specification is executable.
  arXiv  Detail & Related papers  (2026-04-11T23:51:13Z)
• Mind-of-Director: Multi-modal Agent-Driven Film Previsualization via Collaborative Decision-Making [35.41772376528704]
  We present Mind-of-Director, a multi-modal agent-driven framework for film previz.<n>Given a creative idea, Mind-of-Director orchestrates multiple specialized agents to produce previz sequences within the game engine.<n>A real-time visual editing system built in the game engine further enables interactive inspection and synchronized timeline adjustment.
  arXiv  Detail & Related papers  (2026-03-16T03:40:22Z)
• The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation [95.18045807704284]
  We introduce an end-to-end agentic framework for dialogue-to-cinematic-video generation.<n> ScripterAgent is trained to translate coarse dialogue into a fine-grained, executable cinematic script.<n>Our framework significantly improves script faithfulness and temporal fidelity across all tested video models.
  arXiv  Detail & Related papers  (2026-01-25T08:10:28Z)
• AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generation [50.63646953706144]
  We introduce AniMaker, a framework enabling efficient multi-candidate clip generation and storytelling-aware clip selection.<n>AniMaker achieves superior quality as measured by popular metrics including VBench and our proposed AniEval framework.
  arXiv  Detail & Related papers  (2025-06-12T10:06:21Z)
• ReelWave: Multi-Agentic Movie Sound Generation through Multimodal LLM Conversation [72.22243595269389]
  This paper proposes a multi-agentic framework for audio generation supervised by an autonomous Sound Director agent.<n>The Foley Artist works cooperatively with the Composer and Voice Actor agents, and together they autonomously generate off-screen sound to complement the overall production.<n>Our framework can generate rich and relevant audio content conditioned on video clips extracted from movies.
  arXiv  Detail & Related papers  (2025-03-10T11:57:55Z)
• StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration [88.94832383850533]
  We propose a multi-agent framework designed for Customized Storytelling Video Generation (CSVG) StoryAgent decomposes CSVG into distinct subtasks assigned to specialized agents, mirroring the professional production process. Specifically, we introduce a customized Image-to-Video (I2V) method, LoRA-BE, to enhance intra-shot temporal consistency. Our contributions include the introduction of StoryAgent, a versatile framework for video generation tasks, and novel techniques for preserving protagonist consistency.
  arXiv  Detail & Related papers  (2024-11-07T18:00:33Z)
• Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation [36.46957675498949]
  Anim-Director is an autonomous animation-making agent. It harnesses the advanced understanding and reasoning capabilities of LMMs and generative AI tools. The whole process is notably autonomous without manual intervention.
  arXiv  Detail & Related papers  (2024-08-19T08:27:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.