ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors

• URL: http://arxiv.org/abs/2606.22371v2
• Date: Tue, 23 Jun 2026 05:42:33 GMT
• Title: ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors
• Abstract summary: We propose ZeroGVC, a zero-shot generative video compression framework.<n>ZeroGVC encodes the first frame of each group of pictures (GOP) with an image and represents subsequent P-frames through Codebook-Guided Autoregressive Latent Compression.<n>Experiments on standard video compression benchmarks demonstrate that ZeroGVC achieves superior perceptual reconstruction quality at ultra-lows without any additional training.
• Score: 52.50325804778549
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent generative video compression methods leverage powerful generative priors to achieve perceptually pleasing reconstructions. However, most existing approaches require additional training to adapt generative models to produce realistic reconstructions from compact representations. In this paper, we propose ZeroGVC, a zero-shot generative video compression framework that leverages pretrained autoregressive diffusion priors for low-delay video reconstruction. ZeroGVC encodes the first frame of each group of pictures (GOP) with an image codec and represents subsequent P-frames through Codebook-Guided Autoregressive Latent Compression. This design is motivated by our observation that the compression scheme of denoising diffusion codebook models is effective in few-step consistency sampling. By selecting compact combinations of reproducible codebook noise vectors, ZeroGVC steers the latent denoising trajectory toward the target P-frame while allowing the decoder to reproduce the same trajectory in only a few denoising steps. In addition, we design an optional bidirectional reference mode that mitigates error propagation by leveraging the next I-frame context without introducing any additional bitrate overhead. Extensive experiments on standard video compression benchmarks demonstrate that ZeroGVC achieves superior perceptual reconstruction quality at ultra-low bitrates without any additional training.

Related papers

• Video Compression with Graph-inspired Neural Representation [22.393981515406537]
  Implicit Neural Representations (INR) provide a compact and content-adaptive paradigm for video compression.<n>We propose G-NeRV, a graph-inspired INR that explicitly improves temporal redundancy exploitation in the implicit latent space.<n>G-NeRV outperforms the state-of-the-art INR-based, NVRC, and the latest standard video, VVC VTM, by 8.86% and 14.68% (in BD-rate), respectively.
  arXiv  Detail & Related papers  (2026-09-02T12:43:03Z)
• Generation Is Compression: Zero-Shot Video Coding via Stochastic Rectified Flow [1.8898767128464697]
  emphGenerative Video Codebook Codec (GVCC) is a zero-shot framework that turns a pretrained video generative model into the itself.<n>Building on this unified backbone, we instantiate three conditioning strategies -- emphImage-to-Video (I2V), emphText-to-Video (T2V) and emphFirst-Last-Frame-to-Video (FLF2V)
  arXiv  Detail & Related papers  (2026-03-27T16:33:20Z)
• ProGVC: Progressive-based Generative Video Compression via Auto-Regressive Context Modeling [10.843021248963305]
  We propose a Progressive-based Generative Video Compression framework that unifies progressive transmission, efficient entropy coding, and detail synthesis within a single synthesis.<n>ProGVC encodes videos into hierarchical multi-scale residual token maps, enabling flexible rate adaptation by transmitting a coarse-to-fine subset of scales in a progressive manner.
  arXiv  Detail & Related papers  (2026-03-18T09:51:39Z)
• Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherence [30.812937732503457]
  Free-GVC is a training-free generative video compression framework.<n>Our method operates at the group-of-pictures level, encoding video segments into a compact latent space.<n>Experiments show that Free-GVC achieves an average of 93.29% BD-Rate reduction in DISTS over the latest neural DCVC-RT.
  arXiv  Detail & Related papers  (2026-02-10T15:12:51Z)
• Generative Neural Video Compression via Video Diffusion Prior [33.164111717707414]
  DiT-based generative neural video compression framework built upon advanced video generation foundation model.<n>First DiT-based generative neural video compression framework built upon advanced video generation foundation model.
  arXiv  Detail & Related papers  (2025-12-04T17:27:32Z)
• REGEN: Learning Compact Video Embedding with (Re-)Generative Decoder [52.698595889988766]
  We present a novel perspective on learning video embedders for generative modeling.<n>Rather than requiring an exact reproduction of an input video, an effective embedder should focus on visually plausible reconstructions.<n>We propose replacing the conventional encoder-decoder video embedder with an encoder-generator framework.
  arXiv  Detail & Related papers  (2025-03-11T17:51:07Z)
• Epsilon-VAE: Denoising as Visual Decoding [61.29255979767292]
  We propose denoising as decoding, shifting from single-step reconstruction to iterative refinement.<n>Specifically, we replace the decoder with a diffusion process that iteratively refines noise to recover the original image.<n>By adopting iterative reconstruction through diffusion, our autoencoder, namely Epsilon-VAE, achieves high reconstruction quality.
  arXiv  Detail & Related papers  (2024-10-05T08:27:53Z)
• Compression-Realized Deep Structural Network for Video Quality Enhancement [78.13020206633524]
  This paper focuses on the task of quality enhancement for compressed videos. Most of the existing methods lack a structured design to optimally leverage the priors within compression codecs. A new paradigm is urgently needed for a more conscious'' process of quality enhancement.
  arXiv  Detail & Related papers  (2024-05-10T09:18:17Z)
• HybridFlow: Infusing Continuity into Masked Codebook for Extreme Low-Bitrate Image Compression [51.04820313355164]
  HyrbidFlow combines the continuous-feature-based and codebook-based streams to achieve both high perceptual quality and high fidelity under extreme lows. Experimental results demonstrate superior performance across several datasets under extremely lows.
  arXiv  Detail & Related papers  (2024-04-20T13:19:08Z)
• Learned Video Compression via Heterogeneous Deformable Compensation Network [78.72508633457392]
  We propose a learned video compression framework via heterogeneous deformable compensation strategy (HDCVC) to tackle the problems of unstable compression performance. More specifically, the proposed algorithm extracts features from the two adjacent frames to estimate content-Neighborhood heterogeneous deformable (HetDeform) kernel offsets. Experimental results indicate that HDCVC achieves superior performance than the recent state-of-the-art learned video compression approaches.
  arXiv  Detail & Related papers  (2022-07-11T02:31:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.