AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation
- URL: http://arxiv.org/abs/2606.03972v2
- Date: Wed, 03 Jun 2026 17:26:01 GMT
- Title: AAD-1: Asymmetric Adversarial Distillation for One-Step Autoregressive Video Generation
- Abstract summary: AAD-1 is an Asymmetric Adversarial Distillation framework for one-step autoregressive image-to-video generation.<n>AAD-1 achieves state-of-the-art performance in one-step autoregressive video generation.
- Score: 66.55343616132005
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present AAD-1, an Asymmetric Adversarial Distillation framework for One-step autoregressive image-to-video generation. State-of-the-art methods adopt adversarial distillation but suffer from motion collapse and training instability, resulting in static videos. AAD-1 addresses these challenges through two key designs in architecture and training strategy. Our key architectural insight is to break the symmetry between generator and discriminator. While the generator remains causal to preserve autoregressive sampling capability, the discriminator attends bidirectionally over the full spatiotemporal context and produces a single holistic realism score for the entire video sequence. This asymmetric design enables the discriminator to effectively detect global temporal failures and long-range drift that cause motion collapse in autoregressive generation. To stabilize training, we introduce a phased strategy that first uses distribution matching to bootstrap a stable one-step generator, providing a warm-up phase that brings the student distribution closer to the teacher before adversarial distillation begins. Extensive experiments on VBench demonstrate that AAD-1 achieves state-of-the-art performance in one-step autoregressive video generation.
Related papers
- Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation [52.34982929108336]
Few-step distillation improves the efficiency of autoregressive (AR) video generation, but often causes diversity collapse.<n>We analyze this degradation in Distribution Matching Distillation (DMD)-distilled AR video generators and find that, in the autoregressive setting, it takes the form of a structured uncertainty collapse.
arXiv Detail & Related papers (2026-09-10T08:59:47Z) - Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models [49.369312232769154]
We introduce Causal-rCM, a leading, unified, and scalable algorithm-infrastructure open recipe for diffusion distillation and causal training.<n>We achieve state-of-the-art streaming video generation performance in both frame-wise and chunk-wise settings, using only synthetic data for training.
arXiv Detail & Related papers (2026-06-24T06:58:02Z) - Drift-AR: Single-Step Visual Autoregressive Generation via Anti-Symmetric Drifting [25.589468409950484]
Autoregressive (AR)-Diffusion hybrid paradigms combine AR's structured semantic modeling with diffusion's high-fidelity synthesis, yet suffer from a dual speed bottleneck.<n>We propose textbfDrift-AR, which leverages entropy signal to accelerate both stages.<n> Experiments on MAR, TransDiff, and NextStep-1 demonstrate 3.8-5.5$times$ speedup with genuine 1-NFE decoding, matching or surpassing original quality.
arXiv Detail & Related papers (2026-03-30T05:29:00Z) - Adaptive Video Distillation: Mitigating Oversaturation and Temporal Collapse in Few-Step Generation [43.89162138967428]
We propose a novel distillation framework tailored specifically for video diffusion models.<n>Its core innovations include: (1) an adaptive regression loss that dynamically adjusts spatial supervision weights to prevent artifacts arising from excessive distribution shifts; (2) a temporal regularization loss that promotes smooth and physically plausible sampling trajectories; and (3) an inference-time frame strategy that reduces sampling overhead while preserving perceptual quality.<n>Experiments and ablation studies on the VBench and VBench2 benchmarks demonstrate that our method achieves stable few-step video synthesis, significantly enhancing perceptual fidelity and motion realism.
arXiv Detail & Related papers (2026-03-23T11:54:33Z) - OmniForcing: Unleashing Real-time Joint Audio-Visual Generation [51.031726911410594]
Recent joint audio-visual diffusion models achieve remarkable generation quality but suffer from high latency.<n>We propose OmniForcing, the first framework to distill an offline, dual-stream bidirectional diffusion model into a high-fidelity streaming autore generator.
arXiv Detail & Related papers (2026-03-12T08:17:36Z) - Towards One-step Causal Video Generation via Adversarial Self-Distillation [71.30373662465648]
Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising.<n>Our framework produces a single distilled model that flexibly supports multiple inference-step settings.
arXiv Detail & Related papers (2025-11-03T10:12:47Z) - Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusion [67.94300151774085]
We introduce Self Forcing, a novel training paradigm for autoregressive video diffusion models.<n>It addresses the longstanding issue of exposure bias, where models trained on ground-truth context must generate sequences conditioned on their own imperfect outputs.
arXiv Detail & Related papers (2025-06-09T17:59:55Z) - Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis [20.2271205957037]
Hyper-SD is a novel framework that amalgamates the advantages of ODE Trajectory Preservation and Reformulation.
We introduce Trajectory Segmented Consistency Distillation to progressively perform consistent distillation within pre-defined time-step segments.
We incorporate human feedback learning to boost the performance of the model in a low-step regime and mitigate the performance loss incurred by the distillation process.
arXiv Detail & Related papers (2024-04-21T15:16:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.