EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation
- URL: http://arxiv.org/abs/2605.15199v1
- Date: Thu, 14 May 2026 17:59:55 GMT
- Title: EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation
- Abstract summary: We introduce EntityBench, a benchmark of 140 episodes (2,491 shots) derived from real narrative media.<n>It is paired with a three-pillar evaluation suite that disentangles intra-shot quality, prompt-following alignment, and cross-shot consistency.<n> Experiments show that cross-shot entity consistency degrades sharply with recurrence distance in existing methods.
- Score: 16.322441569982647
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Multi-shot video generation extends single-shot generation to coherent visual narratives, yet maintaining consistent characters, objects, and locations across shots remains a challenge over long sequences. Existing evaluations typically use independently generated prompt sets with limited entity coverage and simple consistency metrics, making standardized comparison difficult. We introduce EntityBench, a benchmark of 140 episodes (2,491 shots) derived from real narrative media, with explicit per-shot entity schedules tracking characters, objects, and locations simultaneously across easy / medium / hard tiers of up to 50 shots, 13 cross-shot characters, 8 cross-shot locations, 22 cross-shot objects, and recurrence gaps spanning up to 48 shots. It is paired with a three-pillar evaluation suite that disentangles intra-shot quality, prompt-following alignment, and cross-shot consistency, with a fidelity gate that admits only accurate entity appearances into cross-shot scoring. As a baseline, we propose EntityMem, a memory-augmented generation system that stores verified per-entity visual references in a persistent memory bank before generation begins. Experiments show that cross-shot entity consistency degrades sharply with recurrence distance in existing methods, and that explicit per-entity memory yields the highest character fidelity (Cohen's d = +2.33) and presence among methods evaluated. Code and data are available at https://github.com/Catherine-R-He/EntityBench/.
Related papers
- LogiShot: Logically Coherent Cross-Shot Video Generation [68.674867923812]
We argue that achieving cross-shot logical coherence in video generation requires establishing logical connections across shots and maintaining visual consistency.<n>We propose LogiShot, which incorporates information through two complementary paths.<n>Experiments demonstrate that LogiShot consistently outperforms existing baselines in terms of logical coherence across multiple shots.
arXiv Detail & Related papers (2026-08-09T17:11:57Z) - GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Scheduling [48.381235555561965]
We present textbfGroundShot, a training-free, model-agnostic agentic framework for entity-grounded multi-shot generation.<n>GroundShot builds an entity-level visual memory online from accepted generated shots.<n>Experiments show that GroundShot improves multi-shot consistency over existing methods while requiring no additional training or model modification.
arXiv Detail & Related papers (2026-06-18T18:00:03Z) - Closed-Loop Triplet Synergistic Generation for Long-Form Video [61.88597038104749]
CoSyTriGen is an agentic framework that formulates multi-shot long video generation as a closed-loop visual-text-memory synergy process.<n>A vision-language-model-based analyzer reasons over this triplet and produces updates to both prompts and memory along two pathways.<n> Experiments on our StoryBench benchmark demonstrate substantial improvements in cross-shot consistency, prompt adherence, and cinematic continuity over representative methods.
arXiv Detail & Related papers (2026-06-15T03:56:43Z) - Advancing Narrative Long Video Generation via Training-Free Identity-Aware Memory [79.01059178883817]
IAMFlow is a training-free identity-aware memory framework that explicitly models and tracks persistent entity identities.<n>A VLM asynchronously verifies and refines attributes from rendered frames, enabling explicit entity tracking in place of implicit similarity-based matching.<n>NarraStream-Bench is a benchmark for narrative streaming video generation that features 324 multi-prompt scripts spanning six dimensions.
arXiv Detail & Related papers (2026-05-18T17:54:34Z) - CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narratives [117.85963914353904]
CausalCine is an interactive autoregressive framework that transforms multi-shot video generation into an online directing process.<n>CausalCine generates causally across shot changes, accepts dynamic prompts on the fly, and reuses context without regenerating previous shots.
arXiv Detail & Related papers (2026-05-12T17:59:51Z) - ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytelling [31.758254551463406]
ShotStream is a novel causal multi-shot architecture that enables interactive storytelling.<n>It generates coherent multi-shot videos with sub-second latency, achieving 16 FPS on a single GPU.
arXiv Detail & Related papers (2026-03-26T17:59:59Z) - GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection [54.879037588415656]
GenHOI is a lightweight augmentation to pretrained video generation models.<n>It injects reference-object information in a temporally balanced and spatially selective manner.<n>GenHOI significantly outperforms state-of-the-art HOI reenactment and all-in-one video editing methods.
arXiv Detail & Related papers (2026-03-06T09:01:09Z) - VideoMemory: Toward Consistent Video Generation via Memory Integration [28.605816634949814]
VideoMemory integrates narrative planning with visual generation through a Dynamic Memory Bank.<n>The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds.<n>This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation.
arXiv Detail & Related papers (2026-01-07T07:10:32Z) - VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention [70.61101071902596]
Current video generation models excel at short clips but fail to produce cohesive multi-shot narratives due to disjointed visual dynamics and fractured storylines.<n>We introduce VideoGen-of-Thought (VGoT), a step-by-step framework that automates multi-shot video synthesis from a single sentence.<n>VGoT generates multi-shot videos that outperform state-of-the-art baselines by 20.4% in within-shot face consistency and 17.4% in style consistency.
arXiv Detail & Related papers (2025-03-19T11:59:14Z) - VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention [76.3175166538482]
VideoGen-of-Thought (VGoT) is a step-by-step framework that automates multi-shot video synthesis from a single sentence.<n>VGoT addresses three core challenges: Narrative fragmentation, visual inconsistency, and transition artifacts.<n>Combined in a training-free pipeline, VGoT surpasses strong baselines by 20.4% in within-shot face consistency and 17.4% in style consistency.
arXiv Detail & Related papers (2024-12-03T08:33:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.