Memento: Reconstruct to Remember for Consistent Long Video Generation
- URL: http://arxiv.org/abs/2606.14667v1
- Date: Fri, 12 Jun 2026 17:37:13 GMT
- Title: Memento: Reconstruct to Remember for Consistent Long Video Generation
- Abstract summary: Long-form video generation requires recurring subjects to remain consistent across various shots, viewpoints, motions, and scene transitions.<n>Meton is a subject-reconstruction-guided framework that treats subject preservation as an explicit identity grounding problem.<n>Meton achieves state-of-the-art performance in long-term subject consistency, cross-shot coherence, and visual quality.
- Score: 33.84564823908538
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Long-form video generation requires recurring subjects to remain consistent across various shots, viewpoints, motions, and scene transitions. Existing temporal decomposition methods improve scalability by generating videos shot by shot. However, they mainly focus on optimizing plausible next-shot continuations without verifying whether the historical memory preserves identity-critical subject evidence. Consequently, as generation proceeds, recurring subjects may be diluted, overwritten, or forgotten. In this paper, we propose Memento, a subject-reconstruction-guided framework that treats subject preservation as an explicit identity grounding problem, based on the premise that a memory bank faithfully preserving a subject should support reconstructing that subject from memory alone. Specifically, Memento jointly trains autoregressive next-shot generation with memory-based subject reconstruction, recovering target appearances using historical memory and global story captions. To disentangle long-range subject evidence from short-range cues, Memento introduces a dual-query memory mechanism, where one query retrieves identity-relevant memory and the other selects short-context keyframes for coherent continuation. Additionally, a subject-aware cinematic data pipeline provides precise reconstruction supervision via consistent, pronoun-free subject descriptions. Experiments demonstrate that Memento achieves state-of-the-art performance in long-term subject consistency, cross-shot coherence, and visual quality.
Related papers
- Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding [64.34948094316685]
We introduce LatentStream, a progressive latent working memory framework that shifts streaming memory from store-and-retrieve to retrieve-and-internalize.<n>LatentStream achieves new state-of-the-art results on existing online and offline video benchmarks.
arXiv Detail & Related papers (2026-09-03T17:28:14Z) - Tether the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation [52.12619606640385]
We introduce StreamingMem, a query-aware memory router for frozen video generators.<n>TetherMem separates subject and scene queries and modulates historical access with region- and age-conditioned priors.<n>On complete 30-second videos, it sustains changes in background, viewpoint, and scene state while preserving subject recognizability and temporal continuity.
arXiv Detail & Related papers (2026-08-27T10:05:17Z) - RECAP-Forcing: Retaining Content Appearances for Long Video Generation [37.756464872090596]
We propose RECAP-Forcing, organizing memory by appearance novelty.<n>A long video is not merely a sequence of frames, but an evolving cast of subjects, objects, and scenes.<n>As the video evolves, an optical-flow-based novelty bank extends the same principle by selectively retaining newly revealed content.
arXiv Detail & Related papers (2026-08-27T06:24:59Z) - PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory [80.58558679163197]
PermaVid is a novel framework built upon a multi-modal context memory that disentangles spatial context into semantic appearance and geometric structure.<n>Our method maintains strong long-term semantic and structural consistency after edits, significantly outperforming state-of-the-art methods.
arXiv Detail & Related papers (2026-06-15T09:20:32Z) - Closed-Loop Triplet Synergistic Generation for Long-Form Video [61.88597038104749]
CoSyTriGen is an agentic framework that formulates multi-shot long video generation as a closed-loop visual-text-memory synergy process.<n>A vision-language-model-based analyzer reasons over this triplet and produces updates to both prompts and memory along two pathways.<n> Experiments on our StoryBench benchmark demonstrate substantial improvements in cross-shot consistency, prompt adherence, and cinematic continuity over representative methods.
arXiv Detail & Related papers (2026-06-15T03:56:43Z) - FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion [59.207505503284715]
FadeMem organizes historical KV blocks into a temporal hierarchy under a fixed cache budget.<n>New history is inserted as fine-grained entries, while older adjacent entries are progressively merged.<n>Experiments show improved subject consistency, background stability, and temporal coherence over existing bounded-cache strategies.
arXiv Detail & Related papers (2026-06-09T10:22:18Z) - MemGuard: Preventing Memory Contamination in Long-Term Memory-Augmented Large Language Models [56.31411457917676]
We introduce MemGuard, a type-aware memory framework that preserves functional memory boundaries during memory construction and retrieval.<n>Across hallucination and long-horizon conversation benchmarks, MemGuard improves memory reliability by up to 28.27% while retrieving up to 5.8x fewer memory tokens than prior methods.
arXiv Detail & Related papers (2026-05-27T06:04:19Z) - Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning [53.96129188781529]
We propose a question-guided geometric memory framework for video spatial reasoning.<n>ours injects camera-conditioned geometry into visual tokens and maintains two complementary memories.<n>ours achieves state-of-the-art performance among evaluated spatial reasoning models.
arXiv Detail & Related papers (2026-05-26T17:26:29Z) - EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation [18.052867824594347]
Multi-shot video generation requires maintaining a consistent appearance of recurring entities across shots.<n>Recent autoregressive methods reuse previously generated frames as memory.<n>We propose an entity-centric memory in the form of an entity-indexed bank of latent patches.
arXiv Detail & Related papers (2026-05-22T13:20:29Z) - EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understanding [89.26501160264199]
EgoMemReason systematically evaluates week-long egocentric video understanding through memory-driven reasoning.<n>EgoMemReason comprises 500 questions across three memory types and six core challenges.<n>We evaluate EgoMemReason on 17 methods across MLLMs and agentic frameworks.
arXiv Detail & Related papers (2026-05-11T01:59:59Z) - Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generation [22.26820693283945]
We propose a decoupled framework that separates memory conditioning from generation.<n>We employ a lightweight, independent memory branch to learn precise spatial consistency from historical observation.<n>Our approach achieves state-of-the-art performance in terms of both visual quality and spatial consistency.
arXiv Detail & Related papers (2026-04-20T13:00:17Z) - VideoMemory: Toward Consistent Video Generation via Memory Integration [28.605816634949814]
VideoMemory integrates narrative planning with visual generation through a Dynamic Memory Bank.<n>The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds.<n>This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation.
arXiv Detail & Related papers (2026-01-07T07:10:32Z) - StoryMem: Multi-shot Long Video Storytelling with Memory [32.97816766878247]
We propose StoryMem, a paradigm that reformulates long-form video storytelling as iterative shot synthesis conditioned on explicit visual memory.<n>The proposed framework naturally accommodates smooth shot transitions and customized story generation applications.
arXiv Detail & Related papers (2025-12-22T16:23:24Z) - Memory in the Age of AI Agents [217.9368190980982]
This work aims to provide an up-to-date landscape of current agent memory research.<n>We identify three dominant realizations of agent memory, namely token-level, parametric, and latent memory.<n>To support practical development, we compile a comprehensive summary of memory benchmarks and open-source frameworks.
arXiv Detail & Related papers (2025-12-15T17:22:34Z) - WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoning [66.24870234484668]
We introduce WorldMM, a novel multimodal memory agent that constructs and retrieves from multiple complementary memories.<n>WorldMM significantly outperforms existing baselines across five long video question-answering benchmarks.
arXiv Detail & Related papers (2025-12-02T05:14:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.