Towards Generative Video Compression
- URL: http://arxiv.org/abs/2107.12038v1
- Date: Mon, 26 Jul 2021 08:53:48 GMT
- Title: Towards Generative Video Compression
- Authors: Fabian Mentzer, Eirikur Agustsson, Johannes Ball\'e, David Minnen,
Nick Johnston, George Toderici
- Abstract summary: We present a neural video compression method based on generative adversarial networks (GANs) that outperforms previous neural video compression methods and is comparable to HEVC in a user study.
- Score: 37.759436128930346
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a neural video compression method based on generative adversarial
networks (GANs) that outperforms previous neural video compression methods and
is comparable to HEVC in a user study. We propose a technique to mitigate
temporal error accumulation caused by recursive frame compression that uses
randomized shifting and un-shifting, motivated by a spectral analysis. We
present in detail the network design choices, their relative importance, and
elaborate on the challenges of evaluating video compression methods in user
studies.
Related papers
- Releasing the Parameter Latency of Neural Representation for High-Efficiency Video Compression [18.769136361963472]
implicit neural representation (INR) technique models entire videos as basic units, automatically capturing intra-frame and inter-frame correlations.
In this paper, we show that our method significantly enhances the rate-distortion performance of INR video compression.
arXiv Detail & Related papers (2024-10-02T15:19:31Z) - Scene Matters: Model-based Deep Video Compression [13.329074811293292]
We propose a model-based video compression (MVC) framework that regards scenes as the fundamental units for video sequences.
Our proposed MVC directly models novel intensity variation of the entire video sequence in one scene, seeking non-redundant representations instead of reducing redundancy.
Our method achieves up to a 20% reduction compared to the latest video standard H.266 and is more efficient in decoding than existing video coding strategies.
arXiv Detail & Related papers (2023-03-08T13:15:19Z) - Learned Video Compression via Heterogeneous Deformable Compensation
Network [78.72508633457392]
We propose a learned video compression framework via heterogeneous deformable compensation strategy (HDCVC) to tackle the problems of unstable compression performance.
More specifically, the proposed algorithm extracts features from the two adjacent frames to estimate content-Neighborhood heterogeneous deformable (HetDeform) kernel offsets.
Experimental results indicate that HDCVC achieves superior performance than the recent state-of-the-art learned video compression approaches.
arXiv Detail & Related papers (2022-07-11T02:31:31Z) - Estimating the Resize Parameter in End-to-end Learned Image Compression [50.20567320015102]
We describe a search-free resizing framework that can further improve the rate-distortion tradeoff of recent learned image compression models.
Our results show that our new resizing parameter estimation framework can provide Bjontegaard-Delta rate (BD-rate) improvement of about 10% against leading perceptual quality engines.
arXiv Detail & Related papers (2022-04-26T01:35:02Z) - Implicit Neural Representations for Image Compression [103.78615661013623]
Implicit Neural Representations (INRs) have gained attention as a novel and effective representation for various data types.
We propose the first comprehensive compression pipeline based on INRs including quantization, quantization-aware retraining and entropy coding.
We find that our approach to source compression with INRs vastly outperforms similar prior work.
arXiv Detail & Related papers (2021-12-08T13:02:53Z) - Neural Weight Step Video Compression [0.5772546394254112]
In this work, we suggest a set of experiments for testing the feasibility of compressing video using two architectural paradigms.
We propose a novel technique of encoding frames of a video as low-entropy parameter updates.
To assess the feasibility of the considered approaches, we will test the video compression performance on several high-resolution video datasets.
arXiv Detail & Related papers (2021-12-02T18:53:05Z) - Perceptual Learned Video Compression with Recurrent Conditional GAN [158.0726042755]
We propose a Perceptual Learned Video Compression (PLVC) approach with recurrent conditional generative adversarial network.
PLVC learns to compress video towards good perceptual quality at low bit-rate.
The user study further validates the outstanding perceptual performance of PLVC in comparison with the latest learned video compression approaches.
arXiv Detail & Related papers (2021-09-07T13:36:57Z) - Feedback Recurrent Autoencoder for Video Compression [14.072596106425072]
We propose a new network architecture for learned video compression operating in low latency mode.
Our method yields state of the art MS-SSIM/rate performance on the high-resolution UVG dataset.
arXiv Detail & Related papers (2020-04-09T02:58:07Z) - Content Adaptive and Error Propagation Aware Deep Video Compression [110.31693187153084]
We propose a content adaptive and error propagation aware video compression system.
Our method employs a joint training strategy by considering the compression performance of multiple consecutive frames instead of a single frame.
Instead of using the hand-crafted coding modes in the traditional compression systems, we design an online encoder updating scheme in our system.
arXiv Detail & Related papers (2020-03-25T09:04:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.