Generative Video Compression with One-Dimensional Latent Representation

• URL: http://arxiv.org/abs/2603.15302v1
• Date: Mon, 16 Mar 2026 14:02:17 GMT
• Title: Generative Video Compression with One-Dimensional Latent Representation
• Abstract summary: We introduce Generative Video Compression with One-Dimensional (1D) Latent Representation (GVC1D)<n>GVC1D encodes the video data into extreme compact 1D latent tokens conditioned on both short- and long-term contexts.<n> Experimental results indicate that GVC1D attains superior compression efficiency, surpassing previous video compression methods.
• Score: 59.29493435530304
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent advancements in generative video codec (GVC) typically encode video into a 2D latent grid and employ high-capacity generative decoders for reconstruction. However, this paradigm still leaves two key challenges in fully exploiting spatial-temporal redundancy: Spatially, the 2D latent grid inevitably preserves intra-frame redundancy due to its rigid structure, where adjacent patches remain highly similar, thereby necessitating a higher bitrate. Temporally, the 2D latent grid is less effective for modeling long-term correlations in a compact and semantically coherent manner, as it hinders the aggregation of common contents across frames. To address these limitations, we introduce Generative Video Compression with One-Dimensional (1D) Latent Representation (GVC1D). GVC1D encodes the video data into extreme compact 1D latent tokens conditioned on both short- and long-term contexts. Without the rigid 2D spatial correspondence, these 1D latent tokens can adaptively attend to semantic regions and naturally facilitate token reduction, thereby reducing spatial redundancy. Furthermore, the proposed 1D memory provides semantically rich long-term context while maintaining low computational cost, thereby further reducing temporal redundancy. Experimental results indicate that GVC1D attains superior compression efficiency, where it achieves bitrate reductions of 60.4\% under LPIPS and 68.8\% under DISTS on the HEVC Class B dataset, surpassing the previous video compression methods.Project: https://gvc1d.github.io/

Related papers

• STAC: Selective Spatiotemporal Aggregation and Compression for Video Reasoning Segmentation [60.597357847359255]
  Video segmentation demands pixel-accurate object tracking across hundreds of frames under complex natural language queries.<n>Existing methods address this through token compression, yet typically operate on features lacking temporal context.<n>State-space models resolve this constraint, as their linear recurrence selectively conditions each token on temporal context at $mathcalO(T)$ cost compression to reduce.
  arXiv  Detail & Related papers  (2026-07-03T03:28:25Z)
• Scaling Parallel Sequence Models to Foundation-Scale Vision Encoders [123.58723804218151]
  Vision foundation models are bottlenecked by the quadratic cost of self-attention.<n>We present C-GSPN based on 2D spatial propagation propagation.
  arXiv  Detail & Related papers  (2026-05-30T14:29:43Z)
• PackForcing: Short Video Training Suffices for Long Video Sampling and Long Context Inference [46.18482046594169]
  PackForcing generates coherent 2-minute, 832x480 videos at 16 FPS on a single H200 GPU.<n>It achieves a bounded KV cache of just 4 GB and enables a remarkable 24x temporal (5s to 120s) operating effectively either zero-shot or trained on merely 5-second clips.
  arXiv  Detail & Related papers  (2026-03-26T17:59:05Z)
• TeCoNeRV: Leveraging Temporal Coherence for Compressible Neural Representations for Videos [51.99176811574457]
  Implicit Neural Representations (INRs) have recently demonstrated impressive performance for video compression.<n>However, scaling to high-resolution videos while maintaining encoding efficiency remains a significant challenge.<n>We address these fundamental limitations through three key contributions.<n>We are the first hypernetwork approach to demonstrate results at 480p, 720p and 1080p on UVG, HEVC and MCL-JCV.
  arXiv  Detail & Related papers  (2026-02-18T18:59:55Z)
• Adaptive 1D Video Diffusion Autoencoder [44.70149252636057]
  We propose One-Dimensional Diffusion Video Autoencoder (One-DVA), a transformer-based framework for adaptive 1D encoding and diffusion-based decoding.<n>One-DVA achieves performance comparable to 3D-CNN VAEs on reconstruction metrics at identical compression ratios.<n>We further regularize the One-DVA latent distribution for generative modeling and fine-tune its decoder to mitigate artifacts caused by the generation process.
  arXiv  Detail & Related papers  (2026-02-04T05:11:12Z)
• SemanticGen: Video Generation in Semantic Space [60.49729308406981]
  State-of-the-art video generative models typically learn the distribution of video latents in the VAE space and map them to pixels using a VAE decoder.<n>We introduce SemanticGen, a novel solution to generate videos in the semantic space.<n>Our method is also effective and computationally efficient when extended to long video generation.
  arXiv  Detail & Related papers  (2025-12-23T18:59:56Z)
• Generative Latent Coding for Ultra-Low Bitrate Image Compression [61.71793017252801]
  We introduce a Generative Latent Coding architecture, which performs transform coding in the latent space of a generative vector-quantized variational auto-encoder (VQ-VAE), instead of in the pixel space.<n>The generative latent space is characterized by greater sparsity, richer semantic and better alignment with human perception, rendering it advantageous for achieving high-realism and high-fidelity compression.
  arXiv  Detail & Related papers  (2025-12-23T09:35:40Z)
• High-Efficiency Neural Video Compression via Hierarchical Predictive Learning [27.41398149573729]
  Enhanced Deep Hierarchical Video Compression-DHVC 2.0- introduces superior compression performance and impressive complexity efficiency. Uses hierarchical predictive coding to transform each video frame into multiscale representations. Supports transmission-friendly progressive decoding, making it particularly advantageous for networked video applications in the presence of packet loss.
  arXiv  Detail & Related papers  (2024-10-03T15:40:58Z)
• EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging [6.8372546605486555]
  We show that an UHD color video with high compression ratio can be reconstructed from a snapshot 2D measurement using a single end-to-end deep learning model with PSNR above 32 dB. Our method significantly outperforms all previous SOTA algorithms with better real-time performance.
  arXiv  Detail & Related papers  (2023-05-17T07:28:46Z)
• Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis [40.249030338644225]
  Video-to-Video synthesis (Vid2Vid) has achieved remarkable results in generating a photo-realistic video from a sequence of semantic maps. Fast-Vid2Vid achieves around real-time performance as 20 FPS and saves around 8x computational cost on a single V100 GPU.
  arXiv  Detail & Related papers  (2022-07-11T17:57:57Z)
• Dynamic Point Cloud Compression with Cross-Sectional Approach [10.850101961203748]
  MPEG finalized a Video-based Point Cloud Compression standard known as V-PCC. The proposed method addresses these limitations by using a novel cross-sectional approach. The experimental results using standard video sequences show that the proposed technique can achieve better compression in both geometric and texture data.
  arXiv  Detail & Related papers  (2022-04-25T02:58:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.