Prompt Relay: Inference-Time Temporal Control for Multi-Event Video Generation

• URL: http://arxiv.org/abs/2604.10030v1
• Date: Sat, 11 Apr 2026 04:59:06 GMT
• Title: Prompt Relay: Inference-Time Temporal Control for Multi-Event Video Generation
• Abstract summary: We propose Prompt Relay, an inference-time, plug-and-play method to enable fine-grained temporal control in video generation.<n> Prompt Relay introduces a penalty into the cross-attention mechanism, so that each temporal segment attends only to its assigned prompt.
• Score: 40.694968116482315
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Video diffusion models have achieved remarkable progress in generating high-quality videos. However, these models struggle to represent the temporal succession of multiple events in real-world videos and lack explicit mechanisms to control when semantic concepts appear, how long they persist, and the order in which multiple events occur. Such control is especially important for movie-grade video synthesis, where coherent storytelling depends on precise timing, duration, and transitions between events. When using a single paragraph-style prompt to describe a sequence of complex events, models often exhibit semantic entanglement, where concepts intended for different moments in the video bleed into one another, resulting in poor text-video alignment. To address these limitations, we propose Prompt Relay, an inference-time, plug-and-play method to enable fine-grained temporal control in multi-event video generation, requiring no architectural modifications and no additional computational overhead. Prompt Relay introduces a penalty into the cross-attention mechanism, so that each temporal segment attends only to its assigned prompt, allowing the model to represent one semantic concept at a time and thereby improving temporal prompt alignment, reducing semantic interference, and enhancing visual quality.

Related papers

• CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling [111.28808966759613]
  We propose a unified framework named CineWeaver to achieve reference-controllable multi-shot long-video generation without retraining.<n> Experimental results demonstrate that CineWeaver produces high-quality cinematic videos of long durations with consistent identities, stable global appearance, and clear shot transitions.
  arXiv  Detail & Related papers  (2026-07-29T06:48:11Z)
• TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation [61.27832169507143]
  We propose a novel, training-free attention mechanism, Temporal-wise Separable Attention (TS-Attn)<n>TS-Attn rearranges attention distribution to ensure temporal awareness and global coherence in multi-event scenarios.<n>It boosts StoryEval-Bench scores by 33.5% and 16.4% on Wan2.1-T2V-14B and Wan2.2-T2V-A14B with only a 2% increase in inference time.
  arXiv  Detail & Related papers  (2026-04-21T13:56:36Z)
• SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls [21.71988638522276]
  We present SwitchCraft, a training-free framework for multi-event video generation.<n>SwitchCraft steers frame-level attention to align with relevant event prompts.<n>Experiments demonstrate that SwitchCraft substantially improves prompt alignment, event clarity, and scene consistency.
  arXiv  Detail & Related papers  (2026-02-27T11:59:06Z)
• AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation [58.844504598618094]
  We propose AlcheMinT, a unified framework that introduces explicit timestamps conditioning for subject-driven video generation.<n>Our approach introduces a novel positional encoding mechanism that unlocks the encoding of temporal intervals, associated in our case with subject identities.<n>We incorporate subject-descriptive text tokens to strengthen binding between visual identity and video captions, mitigating ambiguity during generation.
  arXiv  Detail & Related papers  (2025-12-11T18:59:34Z)
• TempoControl: Temporal Attention Guidance for Text-to-Video Models [18.49685485536669]
  We introduce TempoControl, a method that allows for temporal alignment of visual concepts during inference.<n>Our method steers attention using three complementary principles: aligning its temporal shape with a control signal, amplifying it where visibility is needed, and maintaining spatial focus.<n>We demonstrate its effectiveness across various video generation applications, including temporal reordering for single and multiple objects, as well as action and audio-aligned generation.
  arXiv  Detail & Related papers  (2025-10-02T17:13:35Z)
• STOP: Integrated Spatial-Temporal Dynamic Prompting for Video Understanding [48.12128042470839]
  We propose an integrated Spatial-TempOral dynamic Prompting (STOP) model.<n>It consists of two complementary modules, the intra-frame spatial prompting and inter-frame temporal prompting.<n>STOP consistently achieves superior performance against state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-20T09:16:20Z)
• Text2Story: Advancing Video Storytelling with Text Guidance [19.901781116843942]
  We introduce a novel storytelling framework that achieves this by integrating scene and action prompts through dynamics-inspired prompt mixing.<n>We propose a dynamics-informed prompt weighting mechanism that adaptively balances the influence of scene and action prompts at each diffusion timestep.<n>To further enhance motion continuity, we incorporate a semantic action representation to encode high-level action semantics into the blending process.
  arXiv  Detail & Related papers  (2025-03-08T19:04:36Z)
• Mind the Time: Temporally-Controlled Multi-Event Video Generation [65.05423863685866]
  We present MinT, a multi-event video generator with temporal control.<n>Our key insight is to bind each event to a specific period in the generated video, which allows the model to focus on one event at a time.<n>For the first time in the literature, our model offers control over the timing of events in generated videos.
  arXiv  Detail & Related papers  (2024-12-06T18:52:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.