Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration

• URL: http://arxiv.org/abs/2605.17423v1
• Date: Sun, 17 May 2026 12:38:21 GMT
• Title: Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration
• Abstract summary: Soap2Soap is a multi-agent framework that enforces long-term visual consistency through a DualBridge mechanism.<n>A closed-loop verification agent audits identity, stability, and alignment to trigger selective regeneration.
• Score: 61.98029663481308
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We study series-level cinematic remaking, a long-horizon video-to-video generation problem that localizes full episodes or films via stylization or actor replacement while strictly preserving narrative structure, motion choreography, and character identity across hundreds of shots. Existing video generation and editing pipelines often break down in this regime due to compounding identity drift, background mutation, and semantic erosion under large camera motions and viewpoint changes. We propose Soap2Soap, a multi-agent framework that enforces long-term language-visual consistency through a Dual-Bridge Consistency mechanism: a scene-aware JSON screenplay serving as a persistent semantic backbone, and dynamically allocated visual reference anchors at both scene and shot levels. To suppress drift before video synthesis, we introduce batch keyframe consistency, jointly generating multiple keyframes in a shared latent context via a grid-based formulation. A closed-loop verification agent further audits identity, stability, and alignment to trigger selective regeneration. Experiments on SoapBench demonstrate strong improvements over commercial video generation APIs in long-term consistency and narrative fidelity.

Related papers

• CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling [111.28808966759613]
  We propose a unified framework named CineWeaver to achieve reference-controllable multi-shot long-video generation without retraining.<n> Experimental results demonstrate that CineWeaver produces high-quality cinematic videos of long durations with consistent identities, stable global appearance, and clear shot transitions.
  arXiv  Detail & Related papers  (2026-07-29T06:48:11Z)
• Closed-Loop Triplet Synergistic Generation for Long-Form Video [61.88597038104749]
  CoSyTriGen is an agentic framework that formulates multi-shot long video generation as a closed-loop visual-text-memory synergy process.<n>A vision-language-model-based analyzer reasons over this triplet and produces updates to both prompts and memory along two pathways.<n> Experiments on our StoryBench benchmark demonstrate substantial improvements in cross-shot consistency, prompt adherence, and cinematic continuity over representative methods.
  arXiv  Detail & Related papers  (2026-06-15T03:56:43Z)
• ViMax: Agentic Video Generation [55.546794487716646]
  Long-form video generation requires systematic narrative planning and visual consistency.<n>Our framework employs a hierarchical narrative engine with retrieval-augmented generation for global story coherence.<n>VLM-guided agents continuously monitor and refine both narrative coherence and visual fidelity.
  arXiv  Detail & Related papers  (2026-06-02T12:55:41Z)
• VideoMemory: Toward Consistent Video Generation via Memory Integration [28.605816634949814]
  VideoMemory integrates narrative planning with visual generation through a Dynamic Memory Bank.<n>The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds.<n>This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation.
  arXiv  Detail & Related papers  (2026-01-07T07:10:32Z)
• CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation [9.91271343855315]
  CoAgent is a framework for coherent video generation that formulates the process as a plan-synthesize-verify pipeline.<n>A Storyboard Planner decomposes the input into structured shot-level plans with explicit entities, spatial relations, and temporal cues.<n>A Global Context Manager maintains entity-level memory to preserve appearance and identity consistency across shots.<n>A pacing-aware editor refines temporal rhythm and transitions to match the desired narrative flow.
  arXiv  Detail & Related papers  (2025-12-27T09:38:34Z)
• FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusion [46.67733869872552]
  textbfFilmWeaver is a framework designed to generate consistent, multi-shot videos of arbitrary length.<n>Our key insight is to decouple the problem into inter-shot consistency and intra-shot coherence.<n>Our method surpasses existing approaches on metrics for both consistency and aesthetic quality.
  arXiv  Detail & Related papers  (2025-12-12T04:34:53Z)
• VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention [70.61101071902596]
  Current video generation models excel at short clips but fail to produce cohesive multi-shot narratives due to disjointed visual dynamics and fractured storylines.<n>We introduce VideoGen-of-Thought (VGoT), a step-by-step framework that automates multi-shot video synthesis from a single sentence.<n>VGoT generates multi-shot videos that outperform state-of-the-art baselines by 20.4% in within-shot face consistency and 17.4% in style consistency.
  arXiv  Detail & Related papers  (2025-03-19T11:59:14Z)
• VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention [76.3175166538482]
  VideoGen-of-Thought (VGoT) is a step-by-step framework that automates multi-shot video synthesis from a single sentence.<n>VGoT addresses three core challenges: Narrative fragmentation, visual inconsistency, and transition artifacts.<n>Combined in a training-free pipeline, VGoT surpasses strong baselines by 20.4% in within-shot face consistency and 17.4% in style consistency.
  arXiv  Detail & Related papers  (2024-12-03T08:33:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.