PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

• URL: http://arxiv.org/abs/2606.16449v2
• Date: Tue, 16 Jun 2026 02:33:07 GMT
• Title: PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory
• Abstract summary: PermaVid is a novel framework built upon a multi-modal context memory that disentangles spatial context into semantic appearance and geometric structure.<n>Our method maintains strong long-term semantic and structural consistency after edits, significantly outperforming state-of-the-art methods.
• Score: 80.58558679163197
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Consistent video generation under editing operations requires persistence: when edits modify scene appearance or layout, subsequent generations should remain coherent across time and viewpoints. However, existing memory designs struggle to maintain long-term consistency after such modifications, as stored contexts may become outdated or invalid. To address this, we propose PermaVid, a novel framework built upon a multi-modal context memory that disentangles spatial context into semantic appearance and geometric structure, together with an edit-aware memory update and retrieval strategy that keeps memory evolution aligned with subsequent observations. Specifically, we develop two complementary memory banks: an RGB context memory that captures appearance-aware observations while implicitly encoding geometry, and a depth context memory that preserves geometry-only structure disentangled from semantics. Building on this design, we introduce a memory-guided video generation model that performs multi-modal feature fusion under reference conditions drawn from mixed-modality memory contexts. Experiments demonstrate that our method maintains strong long-term semantic and structural consistency after edits, significantly outperforming state-of-the-art methods.

Related papers

• Beyond Retrieval: Progressive Latent Memory Evolution for Streaming Video Understanding [64.34948094316685]
  We introduce LatentStream, a progressive latent working memory framework that shifts streaming memory from store-and-retrieve to retrieve-and-internalize.<n>LatentStream achieves new state-of-the-art results on existing online and offline video benchmarks.
  arXiv  Detail & Related papers  (2026-09-03T17:28:14Z)
• RECAP-Forcing: Retaining Content Appearances for Long Video Generation [37.756464872090596]
  We propose RECAP-Forcing, organizing memory by appearance novelty.<n>A long video is not merely a sequence of frames, but an evolving cast of subjects, objects, and scenes.<n>As the video evolves, an optical-flow-based novelty bank extends the same principle by selectively retaining newly revealed content.
  arXiv  Detail & Related papers  (2026-08-27T06:24:59Z)
• Closed-Loop Triplet Synergistic Generation for Long-Form Video [61.88597038104749]
  CoSyTriGen is an agentic framework that formulates multi-shot long video generation as a closed-loop visual-text-memory synergy process.<n>A vision-language-model-based analyzer reasons over this triplet and produces updates to both prompts and memory along two pathways.<n> Experiments on our StoryBench benchmark demonstrate substantial improvements in cross-shot consistency, prompt adherence, and cinematic continuity over representative methods.
  arXiv  Detail & Related papers  (2026-06-15T03:56:43Z)
• Geometry-Aware Implicit Memory for Video World Models [29.522291951915577]
  GIM-World is a geometry-aware implicit memory framework for video world models.<n>A camera-queryable geometry head distills 3D scene structure from a frozen foundation model into the memory during training.<n>Experiments on MIND show that GIM-World better preserves long-horizon geometric and visual consistency than both explicit- and implicit-memory baselines.
  arXiv  Detail & Related papers  (2026-06-01T16:08:43Z)
• Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning [53.96129188781529]
  We propose a question-guided geometric memory framework for video spatial reasoning.<n>ours injects camera-conditioned geometry into visual tokens and maintains two complementary memories.<n>ours achieves state-of-the-art performance among evaluated spatial reasoning models.
  arXiv  Detail & Related papers  (2026-05-26T17:26:29Z)
• EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation [18.052867824594347]
  Multi-shot video generation requires maintaining a consistent appearance of recurring entities across shots.<n>Recent autoregressive methods reuse previously generated frames as memory.<n>We propose an entity-centric memory in the form of an entity-indexed bank of latent patches.
  arXiv  Detail & Related papers  (2026-05-22T13:20:29Z)
• Ray-Aware Pointer Memory with Adaptive Updates for Streaming 3D Reconstruction [19.132257919770947]
  3D reconstruction from continuous image streams requires both accurate geometric aggregation and stable memory management.<n>We propose a ray-aware pointer memory for streaming 3D reconstruction that explicitly models both spatial location and viewing direction.<n>Our approach provides a principled framework for scalable and drift-resistant online 3D reconstruction from image streams.
  arXiv  Detail & Related papers  (2026-05-07T06:42:11Z)
• VideoMemory: Toward Consistent Video Generation via Memory Integration [28.605816634949814]
  VideoMemory integrates narrative planning with visual generation through a Dynamic Memory Bank.<n>The Dynamic Memory Bank stores explicit visual and semantic descriptors for characters, props, and backgrounds.<n>This retrieval-update mechanism enables consistent portrayal of entities across distant shots and supports coherent long-form generation.
  arXiv  Detail & Related papers  (2026-01-07T07:10:32Z)
• Spatia: Video Generation with Updatable Spatial Memory [60.21619361473996]
  Spatia is a spatial memory-aware video generation framework that preserves a 3D scene point cloud as persistent spatial memory.<n>Spatia iteratively generates video clips conditioned on this spatial memory and continuously updates it through visual SLAM.<n>Spatia enables applications such as explicit camera control and 3D-aware interactive editing, providing a geometrically grounded framework for scalable, memory-driven video generation.
  arXiv  Detail & Related papers  (2025-12-17T18:59:59Z)
• VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory [55.73900731190389]
  We introduce Surfel-Indexed View Memory (VMem), a memory module that remembers past views by indexing them geometrically based on the 3D surface elements (surfels) they have observed.<n>VMem enables efficient retrieval of the most relevant past views when generating new ones.
  arXiv  Detail & Related papers  (2025-06-23T17:59:56Z)
• Video World Models with Long-term Spatial Memory [110.530715838396]
  We introduce a novel framework to enhance long-term consistency of video world models.<n>Our framework includes mechanisms to store and retrieve information from the long-term spatial memory.<n>Our evaluations show improved quality, consistency, and context length compared to relevant baselines.
  arXiv  Detail & Related papers  (2025-06-05T17:42:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.