Generation Is Compression: Zero-Shot Video Coding via Stochastic Rectified Flow

• URL: http://arxiv.org/abs/2603.26571v2
• Date: Thu, 02 Apr 2026 07:16:33 GMT
• Title: Generation Is Compression: Zero-Shot Video Coding via Stochastic Rectified Flow
• Abstract summary: emphGenerative Video Codebook Codec (GVCC) is a zero-shot framework that turns a pretrained video generative model into the itself.<n>Building on this unified backbone, we instantiate three conditioning strategies -- emphImage-to-Video (I2V), emphText-to-Video (T2V) and emphFirst-Last-Frame-to-Video (FLF2V)
• Score: 1.8898767128464697
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advances in generative modeling have enabled perceptual video compression at ultra-low bitrates, yet existing methods predominantly treat the generative model as a refinement or reconstruction module attached to a separately designed codec backbone. We propose \emph{Generative Video Codebook Codec} (GVCC), a zero-shot framework that turns a pretrained video generative model into the codec itself: the transmitted bitstream directly specifies the generative decoding trajectory, with no retraining required. To enable this, we convert the deterministic rectified-flow ODE of modern video foundation models into an equivalent SDE at inference time, unlocking per-step stochastic injection points for codebook-driven compression. Building on this unified backbone, we instantiate three complementary conditioning strategies -- \emph{Image-to-Video} (I2V) with autoregressive GOP chaining, tail latent residual correction, and adaptive atom allocation, \emph{Text-to-Video} (T2V) operating at near-zero side information as a pure generative prior, and \emph{First-Last-Frame-to-Video} (FLF2V) with boundary-sharing GOP chaining for dual-anchor temporal control. Together, these variants span a principled trade-off space between spatial fidelity, temporal coherence, and compression efficiency. Experiments on standard benchmarks show that GVCC achieves high-quality reconstruction below 0.002\,bpp while supporting flexible bitrate control through a single hyperparameter.

Related papers

• Video Compression with Graph-inspired Neural Representation [22.393981515406537]
  Implicit Neural Representations (INR) provide a compact and content-adaptive paradigm for video compression.<n>We propose G-NeRV, a graph-inspired INR that explicitly improves temporal redundancy exploitation in the implicit latent space.<n>G-NeRV outperforms the state-of-the-art INR-based, NVRC, and the latest standard video, VVC VTM, by 8.86% and 14.68% (in BD-rate), respectively.
  arXiv  Detail & Related papers  (2026-09-02T12:43:03Z)
• ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors [52.50325804778549]
  We propose ZeroGVC, a zero-shot generative video compression framework.<n>ZeroGVC encodes the first frame of each group of pictures (GOP) with an image and represents subsequent P-frames through Codebook-Guided Autoregressive Latent Compression.<n>Experiments on standard video compression benchmarks demonstrate that ZeroGVC achieves superior perceptual reconstruction quality at ultra-lows without any additional training.
  arXiv  Detail & Related papers  (2026-06-21T07:46:14Z)
• ProGVC: Progressive-based Generative Video Compression via Auto-Regressive Context Modeling [10.843021248963305]
  We propose a Progressive-based Generative Video Compression framework that unifies progressive transmission, efficient entropy coding, and detail synthesis within a single synthesis.<n>ProGVC encodes videos into hierarchical multi-scale residual token maps, enabling flexible rate adaptation by transmitting a coarse-to-fine subset of scales in a progressive manner.
  arXiv  Detail & Related papers  (2026-03-18T09:51:39Z)
• Next-Frame Decoding for Ultra-Low-Bitrate Image Compression with Video Diffusion Priors [30.653078447499894]
  We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC)<n>We define an explicit intermediate state during decoding: a compact anchor frame.<n>We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image.
  arXiv  Detail & Related papers  (2026-03-16T11:24:26Z)
• Geometric Transformation-Embedded Mamba for Learned Video Compression [5.89272315125701]
  We introduce a video compression framework founded on a direct transform strategy, i.e., nonlinear transform, quantization, and entropy coding.<n>Our method outperforms state-of-the-art video compression approaches in terms of perceptual quality and temporal consistency under low-bitrate constraints.
  arXiv  Detail & Related papers  (2026-03-09T03:14:07Z)
• Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherence [30.812937732503457]
  Free-GVC is a training-free generative video compression framework.<n>Our method operates at the group-of-pictures level, encoding video segments into a compact latent space.<n>Experiments show that Free-GVC achieves an average of 93.29% BD-Rate reduction in DISTS over the latest neural DCVC-RT.
  arXiv  Detail & Related papers  (2026-02-10T15:12:51Z)
• Towards Holistic Modeling for Video Frame Interpolation with Auto-regressive Diffusion Transformers [95.68243351895107]
  We propose a holistic, video-centric paradigm named textbfLocal textbfDiffusion textbfForcing for textbfVideo textbfFrame textbfInterpolation (LDF-VFI)<n>Our framework is built upon an auto-regressive diffusion transformer that models the entire video sequence to ensure long-range temporal coherence.<n>LDF-VFI achieves state-of-the-art performance on challenging long-sequence benchmarks, demonstrating superior per
  arXiv  Detail & Related papers  (2026-01-21T12:58:52Z)
• GIViC: Generative Implicit Video Compression [11.908506692749743]
  Implicit Video Compression ( GIViC) is inspired by the characteristics that INRs share with large language diffusion models in exploiting long-term dependencies.<n>A novel Gene Gated Linear Attention-based transformer (HGLA) is also integrated into the framework, which dual-factorizes global dependency modeling.<n>As far as we are aware GIViC is the first INR-based video that outperforms VTM coding configuration.
  arXiv  Detail & Related papers  (2025-03-25T12:39:45Z)
• REGEN: Learning Compact Video Embedding with (Re-)Generative Decoder [52.698595889988766]
  We present a novel perspective on learning video embedders for generative modeling.<n>Rather than requiring an exact reproduction of an input video, an effective embedder should focus on visually plausible reconstructions.<n>We propose replacing the conventional encoder-decoder video embedder with an encoder-generator framework.
  arXiv  Detail & Related papers  (2025-03-11T17:51:07Z)
• Rethinking Video Tokenization: A Conditioned Diffusion-based Approach [58.164354605550194]
  New tokenizer, Diffusion Conditioned-based Gene Tokenizer, replaces GAN-based decoder with conditional diffusion model.<n>We trained using only a basic MSE diffusion loss for reconstruction, along with KL term and LPIPS perceptual loss from scratch.<n>Even a scaled-down version of CDT (3$times inference speedup) still performs comparably with top baselines.
  arXiv  Detail & Related papers  (2025-03-05T17:59:19Z)
• Improved Video VAE for Latent Video Diffusion Model [55.818110540710215]
  Video Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora. Most of existing VAEs inflate a pretrained image VAE into the 3D causal structure for temporal-spatial compression. We propose a new KTC architecture and a group causal convolution (GCConv) module to further improve video VAE (IV-VAE)
  arXiv  Detail & Related papers  (2024-11-10T12:43:38Z)
• High-Efficiency Neural Video Compression via Hierarchical Predictive Learning [27.41398149573729]
  Enhanced Deep Hierarchical Video Compression-DHVC 2.0- introduces superior compression performance and impressive complexity efficiency. Uses hierarchical predictive coding to transform each video frame into multiscale representations. Supports transmission-friendly progressive decoding, making it particularly advantageous for networked video applications in the presence of packet loss.
  arXiv  Detail & Related papers  (2024-10-03T15:40:58Z)
• Compression-Realized Deep Structural Network for Video Quality Enhancement [78.13020206633524]
  This paper focuses on the task of quality enhancement for compressed videos. Most of the existing methods lack a structured design to optimally leverage the priors within compression codecs. A new paradigm is urgently needed for a more conscious'' process of quality enhancement.
  arXiv  Detail & Related papers  (2024-05-10T09:18:17Z)
• Learned Video Compression via Heterogeneous Deformable Compensation Network [78.72508633457392]
  We propose a learned video compression framework via heterogeneous deformable compensation strategy (HDCVC) to tackle the problems of unstable compression performance. More specifically, the proposed algorithm extracts features from the two adjacent frames to estimate content-Neighborhood heterogeneous deformable (HetDeform) kernel offsets. Experimental results indicate that HDCVC achieves superior performance than the recent state-of-the-art learned video compression approaches.
  arXiv  Detail & Related papers  (2022-07-11T02:31:31Z)
• Conditional Entropy Coding for Efficient Video Compression [82.35389813794372]
  We propose a very simple and efficient video compression framework that only focuses on modeling the conditional entropy between frames. We first show that a simple architecture modeling the entropy between the image latent codes is as competitive as other neural video compression works and video codecs. We then propose a novel internal learning extension on top of this architecture that brings an additional 10% savings without trading off decoding speed.
  arXiv  Detail & Related papers  (2020-08-20T20:01:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.