Tether the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation

• URL: http://arxiv.org/abs/2608.26902v1
• Date: Thu, 27 Aug 2026 10:05:17 GMT
• Title: Tether the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation
• Abstract summary: We introduce StreamingMem, a query-aware memory router for frozen video generators.<n>TetherMem separates subject and scene queries and modulates historical access with region- and age-conditioned priors.<n>On complete 30-second videos, it sustains changes in background, viewpoint, and scene state while preserving subject recognizability and temporal continuity.
• Score: 52.12619606640385
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Streaming autoregressive video models generate long videos chunk by chunk, using historical memory to maintain consistency. Existing methods typically expose subject and scene queries to history through similar policies. This stabilizes the subject, but can also lock backgrounds, viewpoints, and scene structure to previously generated states even when local motion continues. We call this failure memory-anchored scene under-progression; consistency and motion metrics alone can miss it. We introduce TetherMem, a training-free, query-aware spatiotemporal memory router for frozen video generators. TetherMem separates subject and scene queries and modulates historical access with region- and age-conditioned priors: subject queries retain identity-bearing history, while scene queries reduce reliance on subject history and stale backgrounds. Across 2,400 blinded pairwise judgments from 10 annotators, TetherMem achieves the highest estimated expected preference among eight streaming long-video baselines for overall quality (0.780) and scene progression (0.769). On complete 30-second videos, it sustains changes in background, viewpoint, and scene state while preserving subject recognizability and temporal continuity.

Related papers

• LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation [22.878882105342182]
  Autoregressive video diffusion produces chunks from a bounded recent context.<n>Recency-based caching evicts historical cues needed when subjects, objects, scenes, or attributes reappear.<n>LayerRecall retrieves relevant historical K/V states and injects them only into backbone-specific memory-sensitive layers.
  arXiv  Detail & Related papers  (2026-08-28T15:49:13Z)
• Memento: Reconstruct to Remember for Consistent Long Video Generation [33.84564823908538]
  Long-form video generation requires recurring subjects to remain consistent across various shots, viewpoints, motions, and scene transitions.<n>Meton is a subject-reconstruction-guided framework that treats subject preservation as an explicit identity grounding problem.<n>Meton achieves state-of-the-art performance in long-term subject consistency, cross-shot coherence, and visual quality.
  arXiv  Detail & Related papers  (2026-06-12T17:37:13Z)
• TetherCache: Stabilizing Autoregressive Long-Form Video Generation with Gated Recall and Trusted Alignment [51.33418612284208]
  We propose TetherCache, a training-free and plug-and-play cache management strategy for drift-resistant long video generation.<n>Gated Recall with Attention-Diversity Balancing selects long-range memory frames using a gated score.<n>TAME lightly edits newly recalled memory tokens by aligning their statistics to a trusted context distribution.
  arXiv  Detail & Related papers  (2026-06-11T08:16:08Z)
• FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion [59.207505503284715]
  FadeMem organizes historical KV blocks into a temporal hierarchy under a fixed cache budget.<n>New history is inserted as fine-grained entries, while older adjacent entries are progressively merged.<n>Experiments show improved subject consistency, background stability, and temporal coherence over existing bounded-cache strategies.
  arXiv  Detail & Related papers  (2026-06-09T10:22:18Z)
• Echo-Forcing: A Scene Memory Framework for Interactive Long Video Generation [48.476317015122625]
  Echo-Forcing is a training-free scene memory framework for interactive long video generation.<n>It supports smooth transitions, hard cuts, and long-range scene recall under a bounded cache budget.
  arXiv  Detail & Related papers  (2026-05-15T14:33:09Z)
• Seeing the Scene Matters: Revealing Forgetting in Video Understanding Models with a Scene-Aware Long-Video Benchmark [13.365117498062565]
  This work defines a scene as a coherent segment of a video in which both visual and semantic contexts remain consistent.<n>We introduce a new benchmark, SceneBench, designed to provide scene-level challenges.<n>Scene-RAG improves VLM performance by +2.50%, confirming that current models still struggle with long-context retention.
  arXiv  Detail & Related papers  (2026-03-28T12:44:19Z)
• Mixture of Contexts for Long Video Generation [72.96361488755986]
  We recast long-context video generation as an internal information retrieval task.<n>We propose a simple, learnable sparse attention routing module, Mixture of Contexts (MoC), as an effective long-term memory retrieval engine.<n>As we scale the data and gradually sparsify the routing, the model allocates compute to salient history, preserving identities, actions, and scenes over minutes of content.
  arXiv  Detail & Related papers  (2025-08-28T17:57:55Z)
• SceneRAG: Scene-level Retrieval-Augmented Generation for Video Understanding [6.980340270823506]
  We present SceneRAG, a framework to segment videos into narrative-consistent scenes.<n>For each scene, the framework fuses information from both visual and textual modalities to extract entity relations.<n>Experiments on the LongerVideos benchmark, featuring over 134 hours of diverse content, confirm that SceneRAG substantially outperforms prior baselines.
  arXiv  Detail & Related papers  (2025-06-09T10:00:54Z)
• Generating Long Videos of Dynamic Scenes [66.56925105992472]
  We present a video generation model that reproduces object motion, changes in camera viewpoint, and new content that arises over time. A common failure case is for content to never change due to over-reliance on inductive biases to provide temporal consistency.
  arXiv  Detail & Related papers  (2022-06-07T16:29:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.