TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation

• URL: http://arxiv.org/abs/2605.31590v1
• Date: Fri, 29 May 2026 17:56:09 GMT
• Title: TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generation
• Abstract summary: We present TunerDiT, a progressive steering method that requires no additional training for multi-event generation.<n>TunerDiT achieves state-of-the-art performance across 8 metrics and offers a tunable trade-off between video consistency and event separation.
• Score: 61.04423890085284
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Text-to-video (T2V) generation faces challenging questions when generating videos with long horizons containing multiple events. Inspired by the intrinsics of the diffusion process, we probe video diffusion transformers (DiTs) and uncover intrinsic turning points in the DiT denoising trajectory where conditioning text affects generation from global layout to fine-grained details. Building on this finding, we present TunerDiT, a simple yet effective progressive steering method that requires no additional training for multi-event generation. TunerDiT comprises two steering handles: (1) Event-Partitioned Masking that enforces event boundaries while allowing cross-event transition bands; (2) Cross-Event Prompt Fusion that injects neighboring event semantics for late-stage refinement. We contribute a self-curated prompt suite for benchmarking multi-event generation, i.e., Meve. TunerDiT achieves state-of-the-art performance across 8 metrics and offers a tunable trade-off between video consistency and event separation, compared with other training-free methods. The improvement in text alignment increases with the event count, indicating a scaling possibility with increasing event count.

Related papers

• TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation [61.27832169507143]
  We propose a novel, training-free attention mechanism, Temporal-wise Separable Attention (TS-Attn)<n>TS-Attn rearranges attention distribution to ensure temporal awareness and global coherence in multi-event scenarios.<n>It boosts StoryEval-Bench scores by 33.5% and 16.4% on Wan2.1-T2V-14B and Wan2.2-T2V-A14B with only a 2% increase in inference time.
  arXiv  Detail & Related papers  (2026-04-21T13:56:36Z)
• When and Where do Events Switch in Multi-Event Video Generation? [59.9025263656304]
  Existing methods that extend to multi-event generation omit an inspection of the intrinsic factor in event shifting.<n>This work introduces MEve, a self-curated prompt suite for evaluating multi-event text-to-video (T2V) generation.
  arXiv  Detail & Related papers  (2025-10-03T14:31:56Z)
• Event2Vec: Processing Neuromorphic Events directly by Representations in Vector Space [11.383354549570436]
  Neuromorphic event cameras possess superior temporal resolution, power efficiency, and dynamic range compared to traditional cameras.<n> Existing solutions to this incompatibility often sacrifice temporal resolution, require extensive pre-processing, and do not fully leverage GPU acceleration.<n>We introduce event2vec, a novel representation that allows neural networks to process events directly.
  arXiv  Detail & Related papers  (2025-04-21T18:21:18Z)
• DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation [54.30327187663316]
  DiTCtrl is a training-free multi-prompt video generation method under MM-DiT architectures for the first time.<n>We analyze MM-DiT's attention mechanism, finding that the 3D full attention behaves similarly to that of the cross/self-attention blocks in the UNet-like diffusion models.<n>Based on our careful design, the video generated by DiTCtrl achieves smooth transitions and consistent object motion given multiple sequential prompts.
  arXiv  Detail & Related papers  (2024-12-24T18:51:19Z)
• Mind the Time: Temporally-Controlled Multi-Event Video Generation [65.05423863685866]
  We present MinT, a multi-event video generator with temporal control.<n>Our key insight is to bind each event to a specific period in the generated video, which allows the model to focus on one event at a time.<n>For the first time in the literature, our model offers control over the timing of events in generated videos.
  arXiv  Detail & Related papers  (2024-12-06T18:52:20Z)
• Event Transformer [43.193463048148374]
  Event camera's low power consumption and ability to capture microsecond brightness make it attractive for various computer vision tasks. Existing event representation methods typically convert events into frames, voxel grids, or spikes for deep neural networks (DNNs) This work introduces a novel token-based event representation, where each event is considered a fundamental processing unit termed an event-token.
  arXiv  Detail & Related papers  (2022-04-11T15:05:06Z)
• Team RUC_AIM3 Technical Report at Activitynet 2020 Task 2: Exploring Sequential Events Detection for Dense Video Captioning [63.91369308085091]
  We propose a novel and simple model for event sequence generation and explore temporal relationships of the event sequence in the video. The proposed model omits inefficient two-stage proposal generation and directly generates event boundaries conditioned on bi-directional temporal dependency in one pass. The overall system achieves state-of-the-art performance on the dense-captioning events in video task with 9.894 METEOR score on the challenge testing set.
  arXiv  Detail & Related papers  (2020-06-14T13:21:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.