A Benchmark and Multi-Agent System for Instruction-driven Cinematic Video Compilation

• URL: http://arxiv.org/abs/2604.10456v1
• Date: Sun, 12 Apr 2026 04:39:09 GMT
• Title: A Benchmark and Multi-Agent System for Instruction-driven Cinematic Video Compilation
• Abstract summary: We introduce CineBench, the first benchmark for instruction-driven cinematic video compilation.<n>We present CineAgents, a multi-agent system that reformulates cinematic video compilation into design-and-compose'' paradigm.
• Score: 75.66313073019326
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The surging demand for adapting long-form cinematic content into short videos has motivated the need for versatile automatic video compilation systems. However, existing compilation methods are limited to predefined tasks, and the community lacks a comprehensive benchmark to evaluate the cinematic compilation. To address this, we introduce CineBench, the first benchmark for instruction-driven cinematic video compilation, featuring diverse user instructions and high-quality ground-truth compilations annotated by professional editors. To overcome contextual collapse and temporal fragmentation, we present CineAgents, a multi-agent system that reformulates cinematic video compilation into ``design-and-compose'' paradigm. CineAgents performs script reverse-engineering to construct a hierarchical narrative memory to provide multi-level context and employs an iterative narrative planning process that refines a creative blueprint into a final compiled script. Extensive experiments demonstrate that CineAgents significantly outperforms existing methods, generating compilations with superior narrative coherence and logical coherence.

Related papers

• Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation [53.27387848819395]
  Long-form narrative-to-film generation requires shot-level controllability and cross-clip consistency.<n>We introduce a structured orchestration layer for film-oriented script-to-video generation.
  arXiv  Detail & Related papers  (2026-09-07T16:33:14Z)
• SmartDirector: Keyframe-Conditioned Cinematic Video Generation with Narrative Pacing Control [14.692728579474169]
  We propose SmartDirector, a framework that enhances the narrative capacity of video generation models.<n>SmartDirector supports flexible generation scenarios including single-shot generation, multi-shot narrative synthesis, and video extension.
  arXiv  Detail & Related papers  (2026-05-27T03:16:09Z)
• Camera Artist: A Multi-Agent Framework for Cinematic Language Storytelling Video Generation [4.910318162000904]
  We propose Camera Artist, a multi-agent framework that models a real-world filmmaking workflow to generate narrative videos with explicit cinematic language.<n>Camera Artist builds upon established agentic pipelines and introduces a dedicated Cinematography Shot Agent, which integrates storyboard generation to strengthen shot-to-shot narrative continuity and cinematic language injection to produce more expressive, film-oriented shot designs.
  arXiv  Detail & Related papers  (2026-04-10T10:27:52Z)
• CutClaw: Agentic Hours-Long Video Editing via Music Synchronization [96.62825277039117]
  CutClaw is an autonomous multi-agent framework designed to edit hours-long raw footage into meaningful short videos.<n>It produces videos with synchronized music, followed by instructions, and a visually appealing appearance.<n>We conduct detailed experiments to demonstrate that CutClaw significantly outperforms state-of-the-art baselines in generating high-quality, rhythm-aligned videos.
  arXiv  Detail & Related papers  (2026-03-31T12:25:53Z)
• Beyond End-to-End Video Models: An LLM-Based Multi-Agent System for Educational Video Generation [15.004606775581356]
  LAVES is a hierarchical multi-agent system for generating high-quality instructional videos from educational problems.<n>In large-scale deployments, LAVES achieves a throughput exceeding one million videos per day, delivering over a 95% reduction in cost.
  arXiv  Detail & Related papers  (2026-02-12T10:14:36Z)
• The Script is All You Need: An Agentic Framework for Long-Horizon Dialogue-to-Cinematic Video Generation [95.18045807704284]
  We introduce an end-to-end agentic framework for dialogue-to-cinematic-video generation.<n> ScripterAgent is trained to translate coarse dialogue into a fine-grained, executable cinematic script.<n>Our framework significantly improves script faithfulness and temporal fidelity across all tested video models.
  arXiv  Detail & Related papers  (2026-01-25T08:10:28Z)
• From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding [16.83482677439144]
  We propose a human-inspired automatic video editing framework (HIVE)<n>Our approach incorporates character extraction, dialogue analysis, and narrative summarization through multimodal large language models.<n>Our framework consistently outperforms existing baselines across both general and advertisement-oriented editing tasks.
  arXiv  Detail & Related papers  (2025-07-03T16:54:32Z)
• VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention [76.3175166538482]
  VideoGen-of-Thought (VGoT) is a step-by-step framework that automates multi-shot video synthesis from a single sentence.<n>VGoT addresses three core challenges: Narrative fragmentation, visual inconsistency, and transition artifacts.<n>Combined in a training-free pipeline, VGoT surpasses strong baselines by 20.4% in within-shot face consistency and 17.4% in style consistency.
  arXiv  Detail & Related papers  (2024-12-03T08:33:50Z)
• TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation [97.96178992465511]
  We argue that generated videos should incorporate the emergence of new concepts and their relation transitions like in real-world videos as time progresses. To assess the Temporal Compositionality of video generation models, we propose TC-Bench, a benchmark of meticulously crafted text prompts, corresponding ground truth videos, and robust evaluation metrics.
  arXiv  Detail & Related papers  (2024-06-12T21:41:32Z)
• Transcript to Video: Efficient Clip Sequencing from Texts [65.87890762420922]
  We present Transcript-to-Video -- a weakly-supervised framework that uses texts as input to automatically create video sequences from an extensive collection of shots. Specifically, we propose a Content Retrieval Module and a Temporal Coherent Module to learn visual-language representations and model shot sequencing styles. For fast inference, we introduce an efficient search strategy for real-time video clip sequencing.
  arXiv  Detail & Related papers  (2021-07-25T17:24:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.